Alternatives to LocalAI
Ordered by how much they overlap with LocalAI, then by score.
Alternatives, ranked
-
Ollama
Runtime to download and run large language models locally, with a CLI and a REST API.
Updated 62 days ago5 93.5 = Compare -
llama.cpp
C/C++ inference engine for LLMs on CPUs and GPUs, using the GGUF format and quantization.
Updated 61 days ago6 93.0 = Compare -
vLLM
High-throughput LLM serving engine with paged attention and an OpenAI-compatible server.
Updated 62 days ago92 80.3 = Compare -
LM Studio
Discover, download and run local LLMs offline on Mac, Windows and Linux with an intuitive desktop interface and local OpenAI-like server.
Stale: 646 days without a release367 40.0 = Compare