Fix slow batch generation in server by setting wired_limit#652

angeloskath merged 2 commits into

ml-explore:mainml-explore/mlx-lm:mainfrom

otarkhan:fix-batch-generation-wired-limitotarkhan/mlx-lm:fix-batch-generation-wired-limitCopy head branch name to clipboard