返回指南
推論服務 / 簡單

Ollama

One-command local chat and app integration

一手來源
難度簡單安裝難度
平台5cpu · apple · nvidia · amd · intel
APIOpenAI-compatible + native API:11434
01 / 安裝與執行

安裝方式取決於作業系統。以下指令是範例或範本,請先替換佔位符並核對量化版本、檔案格式、驅動與執行環境支援;記憶體適配不保證部署成功。

  1. 1
    安裝curl -fsSL https://ollama.com/install.sh | sh
  2. 2
    啟動模型ollama run gemma3:1b
  3. 3
    連接你的應用

    OpenAI-compatible + native API · :11434. 除非加入驗證與網路存取控制,否則請將服務綁定到 localhost。

注意

GPU and driver support varies by operating system. Confirm the current hardware matrix before buying hardware. Since v0.34.2 (2026-09-15) Ollama's first-run setup offered account sign-in, and the release notes said you could continue locally; since v0.40.1 (2026-10-07) the CLI Welcome screen completes onboarding on Enter and the intermediate account step is gone, while cloud models keep the sign-in flow. Since v0.40.0 (2026-09-25) Ollama runs MLX-supported model architectures on Apple silicon through MLX by default rather than its own runner; NVIDIA and CPU paths are unchanged.

02 / 相容模型

代表性開放權重模型

Alibaba Qwen

Qwen3.6 35B-A3B

35B3B active · Q4 / NVFP4 MoE
估算記憶體
~25 GB
上下文
262K native
Google

Gemma 3 1B

1BINT4 / GGUF Q4
估算記憶體
~1.4 GB
上下文
32K
Meta

Llama 3.2 3B

3BGGUF Q4
估算記憶體
~2.8 GB
上下文
128K
Alibaba Qwen

Qwen3 4B

4BGGUF Q4
估算記憶體
~3.6 GB
上下文
32K+
Google

Gemma 3 4B

4BINT4 / GGUF Q4
估算記憶體
~4.2 GB
上下文
128K
Alibaba Qwen

Qwen3 8B

8BGGUF Q4
估算記憶體
~6.8 GB
上下文
32K+