MySoftRank
Publish software Sign in

Alternatives to Ollama

Ordered by how much they overlap with Ollama, then by score.

4 alternatives

Alternatives, ranked

  1. llama.cpp

    C/C++ inference engine for LLMs on CPUs and GPUs, using the GGUF format and quantization.

    • Released more recently
    • No shared features
    Updated 48 days ago
    6 94.4 = Compare

  2. LocalAI

    Self-hosted, OpenAI-compatible API that runs text, image and audio models on local hardware.

    • No shared features
    Updated 49 days ago
    61 86.6 = Compare

  3. vLLM

    High-throughput LLM serving engine with paged attention and an OpenAI-compatible server.

    • No shared features
    Updated 49 days ago
    92 81.7 = Compare

  4. LM Studio

    Discover, download and run local LLMs offline on Mac, Windows and Linux with an intuitive desktop interface and local OpenAI-like server.

    • Runs on more platforms
    • No shared features
    Stale: 633 days without a release
    367 40.0 = Compare