Add a prompt cache that can hold multiple prompts#625

angeloskath merged 5 commits into

mainml-explore/mlx-lm:mainfrom

lru-trie-cacheml-explore/mlx-lm:lru-trie-cacheCopy head branch name to clipboard