Mac mini M6 · 24 GB
A compact current-generation Mac with 24 GB unified memory. Keep macOS, runtime, and KV-cache headroom separate from model weights.
Birincil kaynakQwen3.6 27B
The highest listed result may be a tight or offloaded fit. For daily use, prefer the first result marked Rahat and keep context modest.
MLX LM
Native Apple silicon inference, experimentation and fine-tuning. Only for Apple silicon. Use an MLX-converted model and tune KV cache size for long contexts. The bundled mlx_lm.server is an OpenAI-compatible HTTP endpoint (default 127.0.0.1:8080), but upstream warns it implements only basic security checks and is not recommended for production.
Rehberi açTemsilî açık ağırlıklı modeller
Qwen3.6 27B
- Tahmini bellek
- ~18.5 GB
- Bağlam
- 262K native
Devstral Small 2 24B
- Tahmini bellek
- ~18.5 GB
- Bağlam
- 256K
gpt-oss-20b
- Tahmini bellek
- ~16 GB
- Bağlam
- 128K
Qwen3 14B
- Tahmini bellek
- ~11.2 GB
- Bağlam
- 32K+
Gemma 3 12B
- Tahmini bellek
- ~9.4 GB
- Bağlam
- 128K
Qwen3 8B
- Tahmini bellek
- ~6.8 GB
- Bağlam
- 32K+
Fit is based on estimated total model memory. Driver support, KV cache, multimodal projectors, concurrency, and desktop applications can all reduce available headroom. Current fit: Qwen3.6 27B (Sınırda), Devstral Small 2 24B (Sınırda), gpt-oss-20b (Sınırda), Qwen3 14B (Rahat), Gemma 3 12B (Rahat), Qwen3 8B (Rahat).