New Ollama update adds Llama 3, ability to ask multiple questions at once and more
Geeky Gadgets - 2024-05-06T08:12:28.000Z

Ollama 0.133 introduces an experimental approach to parallel processing, empowering developers and researchers to optimize their AI applications, especially on single-machine environments such as Apple silicon laptops. By leveraging the newly introduced `OLLAMA_NUM_PARALLEL` and `OLLAMA_MAX_LOADED_MODELS` environment variables, users can now effortlessly manage multiple AI models and process several requests concurrently. This enhancement unlocks new levels of […] Read this story