返回指南
推理服务 / 简单

Ollama

One-command local chat and app integration

一手来源
难度简单安装难度
平台5cpu · apple · nvidia · amd · intel
APIOpenAI-compatible + native API:11434
01 / 安装与运行

安装方式取决于操作系统。以下命令是示例或模板,请先替换占位符并核对量化版本、文件格式、驱动和运行时支持;内存适配不保证部署成功。

  1. 1
    安装curl -fsSL https://ollama.com/install.sh | sh
  2. 2
    启动模型ollama run gemma3:1b
  3. 3
    接入你的应用

    OpenAI-compatible + native API · :11434. 除非添加认证与网络访问控制,否则请将服务绑定到 localhost。

注意

GPU and driver support varies by operating system. Confirm the current hardware matrix before buying hardware. Since v0.34.2 (2026-09-15) Ollama's first-run setup offered account sign-in, and the release notes said you could continue locally; since v0.40.1 (2026-10-07) the CLI Welcome screen completes onboarding on Enter and the intermediate account step is gone, while cloud models keep the sign-in flow. Since v0.40.0 (2026-09-25) Ollama runs MLX-supported model architectures on Apple silicon through MLX by default rather than its own runner; NVIDIA and CPU paths are unchanged.

02 / 兼容模型

代表性开放权重模型

Alibaba Qwen

Qwen3.6 35B-A3B

35B3B active · Q4 / NVFP4 MoE
估算内存
~25 GB
上下文
262K native
Google

Gemma 3 1B

1BINT4 / GGUF Q4
估算内存
~1.4 GB
上下文
32K
Meta

Llama 3.2 3B

3BGGUF Q4
估算内存
~2.8 GB
上下文
128K
Alibaba Qwen

Qwen3 4B

4BGGUF Q4
估算内存
~3.6 GB
上下文
32K+
Google

Gemma 3 4B

4BINT4 / GGUF Q4
估算内存
~4.2 GB
上下文
128K
Alibaba Qwen

Qwen3 8B

8BGGUF Q4
估算内存
~6.8 GB
上下文
32K+