Alternatives to llama.cpp

Ordered by how much they overlap with llama.cpp, then by score.

Alternatives, ranked

  1. LM Studio

    Discover, download and run local LLMs offline on Mac, Windows and Linux with an intuitive desktop interface and local OpenAI-like server.

    • Runs on more platforms
    • No shared features
    Stale: 646 days without a release
    367 40.0 = Compare