Ollama
Runtime to download and run large language models locally, with a CLI and a REST API.
Overview
Runtime to download and run large language models locally, with a CLI and a REST API.
- Category
- LLM runtimes · AI tools
- Platforms
- Linux, macOS, Windows, API only
- Pricing
- Free
- License
- MIT
- Source code
- ollama/ollama
- Repository stars
- 181,226
- API
- No public API description
Release history
Updated 2 days ago3 releases in the last 12 months.
-
v0.34.2
-
v0.34.1
-
v0.34.0
What users say
No reviews yet
Ratings appear once verified reviews arrive. Until then the rank uses public signals only: release freshness and repository adoption.
Alternatives to Ollama
See all alternatives llama.cpp
9
92.6
=
C/C++ inference engine for LLMs on CPUs and GPUs, using the GGUF format and quantization.
Updated 1 day ago
vLLM
22
91.3
=
High-throughput LLM serving engine with paged attention and an OpenAI-compatible server.
Updated 2 days ago
LocalAI
54
89.1
=
Self-hosted, OpenAI-compatible API that runs text, image and audio models on local hardware.
Updated 2 days ago