Alternatives to Ollama

Ordered by how much they overlap with Ollama, then by score.

Alternatives, ranked

  1. llama.cpp

    C/C++ inference engine for LLMs on CPUs and GPUs, using the GGUF format and quantization.

    • Released more recently
    • No shared features
    Updated 61 days ago
    6 93.0 = Compare
  2. LocalAI

    Self-hosted, OpenAI-compatible API that runs text, image and audio models on local hardware.

    • No shared features
    Updated 62 days ago
    64 85.2 = Compare
  3. vLLM

    High-throughput LLM serving engine with paged attention and an OpenAI-compatible server.

    • No shared features
    Updated 62 days ago
    92 80.3 = Compare
  4. LM Studio

    Discover, download and run local LLMs offline on Mac, Windows and Linux with an intuitive desktop interface and local OpenAI-like server.

    • Runs on more platforms
    • No shared features
    Stale: 646 days without a release
    367 40.0 = Compare