AI tools

LLM runtimes

5 listings are ranked by release freshness and adoption until verified reviews arrive; then review quality, volume and vendor responsiveness join the score. Open any row to see its receipt. See the formula

  • 4 fresh released in the last 90 days
  • 0 aging no release for 90 to 179 days
  • 1 stale no release for 180 days or more

5 ranked listings

  1. Ollama

    Runtime to download and run large language models locally, with a CLI and a REST API.

    Ollama No reviews yet Open source Linux macOS Windows API only
    Updated 49 days ago
    1 94.9 =
    Show how this rank is calculated
    Rank receipt: Ollama
    #4 overall · #1 in category
    94.9/100
    1. Platform readiness +40.0 100.0 × 40%
    2. Release freshness +33.0 94.3 × 35%
    3. Adoption signals +21.9 87.6 × 25%
    Data from GitHub Last sync Computed on Sponsorship weight 0%, never counted Read the full formula
  2. llama.cpp

    C/C++ inference engine for LLMs on CPUs and GPUs, using the GGUF format and quantization.

    ggml.ai No reviews yet Open source Linux macOS Windows API only
    Updated 48 days ago
    2 94.4 =
    Show how this rank is calculated
    Rank receipt: llama.cpp
    #6 overall · #2 in category
    94.4/100
    1. Platform readiness +40.0 100.0 × 40%
    2. Release freshness +33.1 94.6 × 35%
    3. Adoption signals +21.3 85.2 × 25%
    Data from GitHub Last sync Computed on Sponsorship weight 0%, never counted Read the full formula
  3. LocalAI

    Self-hosted, OpenAI-compatible API that runs text, image and audio models on local hardware.

    LocalAI No reviews yet Open source Linux macOS API only
    Updated 49 days ago
    3 86.6 =
    Show how this rank is calculated
    Rank receipt: LocalAI
    #61 overall · #3 in category
    86.6/100
    1. Platform readiness +34.0 85.0 × 40%
    2. Release freshness +33.0 94.3 × 35%
    3. Adoption signals +19.6 78.2 × 25%
    Data from GitHub Last sync Computed on Sponsorship weight 0%, never counted Read the full formula
  4. vLLM

    High-throughput LLM serving engine with paged attention and an OpenAI-compatible server.

    vLLM Project No reviews yet Open source Linux API only
    Updated 49 days ago
    4 81.7 =
    Show how this rank is calculated
    Rank receipt: vLLM
    #92 overall · #4 in category
    81.7/100
    1. Platform readiness +28.0 70.0 × 40%
    2. Release freshness +33.0 94.3 × 35%
    3. Adoption signals +20.7 82.7 × 25%
    Data from GitHub Last sync Computed on Sponsorship weight 0%, never counted Read the full formula
  5. LM Studio

    Discover, download and run local LLMs offline on Mac, Windows and Linux with an intuitive desktop interface and local OpenAI-like server.

    Element Labs No reviews yet Free plan Desktop macOS Windows Linux
    Stale: 633 days without a release
    5 40.0 =
    Show how this rank is calculated
    Rank receipt: LM Studio
    #367 overall · #5 in category
    40.0/100
    1. Platform readiness +40.0 100.0 × 40%
    2. Release freshness +0.0 0.0 × 35%
    3. Adoption signals +0.0 0.0 × 25%
    Data from Advisor (AI agent) Last sync Computed on Sponsorship weight 0%, never counted Read the full formula