Back to guide
MODEL / GOOGLE

Gemma 3 27B

Google's 24 GB fit example is for the INT4 variant and excludes some runtime overhead.

Primary source
Total parameters27B
Estimated memory~20.5 GBINT4
Context128KText + Image
LicenseGemma140+ languages
01 / BEST FOR
  • vision
  • knowledge work
  • quality chat
02 / ESTIMATED FIT
03 / DEPLOY WITH

These are runtime examples, not validated installation recipes. Fit estimates assume quantized files; official repositories may hold full-precision weights. MLX, GGUF and TensorRT require matching conversions or engines.

OllamaEasyollama run gemma3:27b
llama.cppMediumllama-server -m /path/to/verified-model.gguf --port 9931
LM StudioEasySearch “google/gemma-3-27b-it” → Load a Q4/INT4 build → Start Server
MLX LMMediummlx_lm.server --model google/gemma-3-27b-it
Watch out

Google's 24 GB fit example is for the INT4 variant and excludes some runtime overhead.