Alternatives to Ollama

Alternatives, ranked

1. 1
   LL

   llama.cpp

   C/C++ inference engine for LLMs on CPUs and GPUs, using the GGUF format and quantization.

   • Released more recently
   • No shared features
   Updated 3 days ago

   11 92.6 = Compare
2. 2
   VL

   vLLM

   High-throughput LLM serving engine with paged attention and an OpenAI-compatible server.

   • No shared features
   Updated 4 days ago

   28 91.3 = Compare
3. 3
   LO

   LocalAI

   Self-hosted, OpenAI-compatible API that runs text, image and audio models on local hardware.

   • No shared features
   Updated 4 days ago

   63 89.1 = Compare