Apple silicon · 16 GB
A polished 4B–8B local experience when the OS and apps have enough headroom.
Qwen3 14B
The highest listed result may be a tight or offloaded fit. For daily use, prefer the first result marked आराम से and keep context modest.
MLX LM
Native Apple silicon inference, experimentation and fine-tuning. Only for Apple silicon. Use an MLX-converted model and tune KV cache size for long contexts. The bundled mlx_lm.server is an OpenAI-compatible HTTP endpoint (default 127.0.0.1:8080), but upstream warns it implements only basic security checks and is not recommended for production.
गाइड खोलेंप्रतिनिधि ओपन-वेट मॉडल
Qwen3 14B
- अनुमानित मेमोरी
- ~11.2 GB
- कॉन्टेक्स्ट
- 32K+
Gemma 3 12B
- अनुमानित मेमोरी
- ~9.4 GB
- कॉन्टेक्स्ट
- 128K
Qwen3 8B
- अनुमानित मेमोरी
- ~6.8 GB
- कॉन्टेक्स्ट
- 32K+
Qwen3 4B
- अनुमानित मेमोरी
- ~3.6 GB
- कॉन्टेक्स्ट
- 32K+
Gemma 3 4B
- अनुमानित मेमोरी
- ~4.2 GB
- कॉन्टेक्स्ट
- 128K
Llama 3.2 3B
- अनुमानित मेमोरी
- ~2.8 GB
- कॉन्टेक्स्ट
- 128K
Fit is based on estimated total model memory. Driver support, KV cache, multimodal projectors, concurrency, and desktop applications can all reduce available headroom. Current fit: Qwen3 14B (सीमित), Gemma 3 12B (सीमित), Qwen3 8B (आराम से), Qwen3 4B (आराम से), Gemma 3 4B (आराम से), Llama 3.2 3B (आराम से).