Alternatives to vLLM

Ordered by how much they overlap with vLLM, then by score.

Alternatives, ranked

  1. LM Studio

    Discover, download and run local LLMs offline on Mac, Windows and Linux with an intuitive desktop interface and local OpenAI-like server.

    • Runs on more platforms
    • No shared features
    Stale: 589 days without a release
    231 0.0 = Compare