But i dont understand why everyone just keep bashing ollama. Does no one run multiple models?
Because for the longest time they were just a wrapper around llama.cpp and not until pushed they acknowledged the devs behind llama.cpp. They also took a lot of the spot and funding for what actually was llama.cpp features.
Until now, ollama model router implementation is still better. There is still no model queue system in llama-server.
llama-server is also released around last year only.
Maybe after https://github.com/ggml-org/llama.cpp/issues/21678#issuecomment-4592982609 then there is not much reason to use ollama.
Anyway i stopped using ollama and just deal with the issue now. Because most huggingface models work better with llama.cpp.
But i dont understand why everyone just keep bashing ollama. Does no one run multiple models?
https://sleepingrobots.com/dreams/stop-using-ollama/
Because for the longest time they were just a wrapper around llama.cpp and not until pushed they acknowledged the devs behind llama.cpp. They also took a lot of the spot and funding for what actually was llama.cpp features.