硬體 / SYSTEM RAM

8 GB CPU laptop

Small text models with short context. Expect patient, private inference rather than speed.

Everyday laptop8 GB

01 / 實際上限

Qwen3 4B

清單中排最前的模型可能是勉強適配或需要卸載的。日常使用建議選第一個標為 餘量充足 的結果，並保持上下文適中。

02 / 預設推論服務

llama.cpp

GGUF models, CPU/GPU offload, embedded and unusual hardware. New architectures may require a recent build. Backend availability does not imply equal performance. Since v0.7.0 (2026-10-15) llama-server listens on port 9931 by default instead of 8080; the example commands pin that port explicitly. Older builds accept the same --port flag but default to 8080.

開啟指南

03 / 模型範圍