Apple silicon · 32 GB
24B–32B Q4 models become practical for one local user.
Qwen3.6 35B-A3B
The highest listed result may be a tight or offloaded fit. For daily use, prefer the first result marked Ruim and keep context modest.
MLX LM
Native Apple silicon inference, experimentation and fine-tuning. Only for Apple silicon. Use an MLX-converted model and tune KV cache size for long contexts. The bundled mlx_lm.server is an OpenAI-compatible HTTP endpoint (default 127.0.0.1:8080), but upstream warns it implements only basic security checks and is not recommended for production.
Open gidsRepresentatieve open-weightmodellen
Qwen3.6 35B-A3B
- Geschat geheugen
- ~25 GB
- Context
- 262K native
Qwen3 32B
- Geschat geheugen
- ~24.5 GB
- Context
- 32K+
Qwen3 30B-A3B
- Geschat geheugen
- ~22.5 GB
- Context
- 32K+
Qwen3.6 27B
- Geschat geheugen
- ~18.5 GB
- Context
- 262K native
Qwen3.8 27B
- Geschat geheugen
- ~19.5 GB
- Context
- 262K native
Gemma 3 27B
- Geschat geheugen
- ~20.5 GB
- Context
- 128K
Fit is based on estimated total model memory. Driver support, KV cache, multimodal projectors, concurrency, and desktop applications can all reduce available headroom. Current fit: Qwen3.6 35B-A3B (Krap), Qwen3 32B (Krap), Qwen3 30B-A3B (Krap), Qwen3.6 27B (Krap), Qwen3.8 27B (Krap), Gemma 3 27B (Krap).