Voltar ao guia
HARDWARE / UNIFIED MEMORY

Apple silicon · 64 GB

32B models with long context or 70B Q4 with conservative headroom.

M-series Max / Ultra64 GB
01 / PRACTICAL CEILING

Llama 3.1 70B

The highest listed result may be a tight or offloaded fit. For daily use, prefer the first result marked Comfortable and keep context modest.

02 / DEFAULT RUNTIME

MLX LM

Native Apple silicon inference, experimentation and fine-tuning. Only for Apple silicon. Use an MLX-converted model and tune KV cache size for long contexts.

Abrir guia
03 / MODEL ENVELOPE

Modelos open-weight representativos

Meta

Llama 3.1 70B

70BGGUF Q4
Memória estimada
~46 GB
Contexto
128K
Alibaba Qwen

Qwen3 32B

32BGGUF Q4
Memória estimada
~24.5 GB
Contexto
32K+
Alibaba Qwen

Qwen3 30B-A3B

30B3B active · GGUF Q4 MoE
Memória estimada
~22.5 GB
Contexto
32K+
Google

Gemma 3 27B

27BINT4
Memória estimada
~20.5 GB
Contexto
128K
Mistral AI

Devstral Small 2 24B

24BGGUF Q4 / BF16
Memória estimada
~18.5 GB
Contexto
256K
OpenAI

gpt-oss-20b

21B3.6B active · MXFP4
Memória estimada
~16 GB
Contexto
128K
Atenção

Fit is based on estimated total model memory. Driver support, KV cache, multimodal projectors, concurrency, and desktop applications can all reduce available headroom. Current fit: Llama 3.1 70B (Tight), Qwen3 32B (Comfortable), Qwen3 30B-A3B (Comfortable), Gemma 3 27B (Comfortable), Devstral Small 2 24B (Comfortable), gpt-oss-20b (Comfortable).