Mac mini M6 · 24 GB
A compact current-generation Mac with 24 GB unified memory. Keep macOS, runtime, and KV-cache headroom separate from model weights.
PrimärquelleQwen3.6 27B
The highest listed result may be a tight or offloaded fit. For daily use, prefer the first result marked Bequem and keep context modest.
MLX LM
Native Apple silicon inference, experimentation and fine-tuning. Only for Apple silicon. Use an MLX-converted model and tune KV cache size for long contexts. The bundled mlx_lm.server is an OpenAI-compatible HTTP endpoint (default 127.0.0.1:8080), but upstream warns it implements only basic security checks and is not recommended for production.
Leitfaden öffnenRepräsentative Open-Weight-Modelle
Qwen3.6 27B
- Geschätzter Speicher
- ~18.5 GB
- Kontext
- 262K native
Devstral Small 2 24B
- Geschätzter Speicher
- ~18.5 GB
- Kontext
- 256K
gpt-oss-20b
- Geschätzter Speicher
- ~16 GB
- Kontext
- 128K
Qwen3 14B
- Geschätzter Speicher
- ~11.2 GB
- Kontext
- 32K+
Gemma 3 12B
- Geschätzter Speicher
- ~9.4 GB
- Kontext
- 128K
Qwen3 8B
- Geschätzter Speicher
- ~6.8 GB
- Kontext
- 32K+
Fit is based on estimated total model memory. Driver support, KV cache, multimodal projectors, concurrency, and desktop applications can all reduce available headroom. Current fit: Qwen3.6 27B (Knapp), Devstral Small 2 24B (Knapp), gpt-oss-20b (Knapp), Qwen3 14B (Bequem), Gemma 3 12B (Bequem), Qwen3 8B (Bequem).