गाइड पर वापस
RUNTIME / EASY

Ollama

One-command local chat and app integration

प्राथमिक स्रोत
DifficultyEasySetup profile
Platforms5cpu · apple · nvidia · amd · intel
APIOpenAI-compatible + native API:11434
01 / INSTALL & RUN

Installation depends on your OS. These commands are examples or templates: replace placeholders and verify quantization, file format, drivers and runtime support. Memory fit does not guarantee deployment.

  1. 1
    Installcurl -fsSL https://ollama.com/install.sh | sh
  2. 2
    Start a modelollama run gemma3:1b
  3. 3
    Connect your app

    OpenAI-compatible + native API · :11434. Keep the service bound to localhost unless you add authentication and network controls.

सावधानी

GPU and driver support varies by operating system. Confirm the current hardware matrix before buying hardware. Since v0.34.2 (2026-09-15) Ollama's first-run setup offered account sign-in, and the release notes said you could continue locally; since v0.40.1 (2026-10-07) the CLI Welcome screen completes onboarding on Enter and the intermediate account step is gone, while cloud models keep the sign-in flow. Since v0.40.0 (2026-09-25) Ollama runs MLX-supported model architectures on Apple silicon through MLX by default rather than its own runner; NVIDIA and CPU paths are unchanged.

02 / COMPATIBLE MODELS

प्रतिनिधि ओपन-वेट मॉडल

Alibaba Qwen

Qwen3.6 35B-A3B

35B3B active · Q4 / NVFP4 MoE
अनुमानित मेमोरी
~25 GB
कॉन्टेक्स्ट
262K native
Google

Gemma 3 1B

1BINT4 / GGUF Q4
अनुमानित मेमोरी
~1.4 GB
कॉन्टेक्स्ट
32K
Meta

Llama 3.2 3B

3BGGUF Q4
अनुमानित मेमोरी
~2.8 GB
कॉन्टेक्स्ट
128K
Alibaba Qwen

Qwen3 4B

4BGGUF Q4
अनुमानित मेमोरी
~3.6 GB
कॉन्टेक्स्ट
32K+
Google

Gemma 3 4B

4BINT4 / GGUF Q4
अनुमानित मेमोरी
~4.2 GB
कॉन्टेक्स्ट
128K
Alibaba Qwen

Qwen3 8B

8BGGUF Q4
अनुमानित मेमोरी
~6.8 GB
कॉन्टेक्स्ट
32K+