Ollama
One-command local chat and app integration
Primary sourceInstallation depends on your OS. These commands are examples or templates: replace placeholders and verify quantization, file format, drivers and runtime support. Memory fit does not guarantee deployment.
- 1Install
curl -fsSL https://ollama.com/install.sh | sh - 2Start a model
ollama run gemma3:1b - 3Connect your app
OpenAI-compatible + native API · :11434. Keep the service bound to localhost unless you add authentication and network controls.
GPU and driver support varies by operating system. Confirm the current hardware matrix before buying hardware. Since v0.34.2 (2026-09-15) Ollama's first-run setup offered account sign-in, and the release notes said you could continue locally; since v0.40.1 (2026-10-07) the CLI Welcome screen completes onboarding on Enter and the intermediate account step is gone, while cloud models keep the sign-in flow. Since v0.40.0 (2026-09-25) Ollama runs MLX-supported model architectures on Apple silicon through MLX by default rather than its own runner; NVIDIA and CPU paths are unchanged.
Representative open-weight models
Qwen3.6 35B-A3B
- Estimated memory
- ~25 GB
- Context
- 262K native
Gemma 3 1B
- Estimated memory
- ~1.4 GB
- Context
- 32K
Llama 3.2 3B
- Estimated memory
- ~2.8 GB
- Context
- 128K
Qwen3 4B
- Estimated memory
- ~3.6 GB
- Context
- 32K+
Gemma 3 4B
- Estimated memory
- ~4.2 GB
- Context
- 128K
Qwen3 8B
- Estimated memory
- ~6.8 GB
- Context
- 32K+