LocalAI
Self-hosted, OpenAI-compatible API that runs text, image and audio models on local hardware.
Overview
Self-hosted, OpenAI-compatible API that runs text, image and audio models on local hardware.
- Category
- LLM runtimes · AI tools
- Platforms
- Linux, macOS, API only
- Pricing
- Free
- License
- MIT
- Source code
- mudler/LocalAI
- Repository stars
- 49,161
- API
- No public API description
Release history
Updated 2 days ago10 releases in the last 12 months.
-
v4.10.0
-
v4.9.0
-
v4.8.2
-
v4.8.1
-
v4.8.0
-
v4.7.0
What users say
No reviews yet
Ratings appear once verified reviews arrive. Until then the rank uses public signals only: release freshness and repository adoption.
Alternatives to LocalAI
See all alternatives Ollama
3
93.8
=
Runtime to download and run large language models locally, with a CLI and a REST API.
Updated 2 days ago
llama.cpp
9
92.6
=
C/C++ inference engine for LLMs on CPUs and GPUs, using the GGUF format and quantization.
Updated 1 day ago
vLLM
22
91.3
=
High-throughput LLM serving engine with paged attention and an OpenAI-compatible server.
Updated 2 days ago