硬件 / SYSTEM RAM

8 GB CPU laptop

Small text models with short context. Expect patient, private inference rather than speed.

Everyday laptop8 GB

01 / 实际上限

Qwen3 4B

列表中排在最前的模型可能是勉强适配或需要卸载的。日常使用建议选第一个标为 余量充足 的结果，并保持上下文适中。

02 / 默认推理服务

llama.cpp

GGUF models, CPU/GPU offload, embedded and unusual hardware. New architectures may require a recent build. Backend availability does not imply equal performance. Since v0.7.0 (2026-10-15) llama-server listens on port 9931 by default instead of 8080; the example commands pin that port explicitly. Older builds accept the same --port flag but default to 8080.

打开指南

03 / 模型范围