RTX 4090
Used-card condition, power supply and case clearance need separate checks.
Model card checked 2026-09-26 · Memory fit estimated; speed unknown unless a separately linked measurement matches your configuration.
Also searched as: qwen image 2.1 / qwen-image-2.1 / qwen image 2.1 gguf
A text-to-image and image-editing pipeline, not an LLM: read the fit label as 'does not fit resident' rather than 'impossible', because the same pipeline is documented running on a 24 GB card with the text encoder offloaded. Qwen publishes no VRAM table and no quantization-tier mapping. The model card, the ModelScope card, the GitHub README and the release blog only offer enable_model_cpu_offload(); the official organization ships no quantized checkpoint, so every GGUF, INT8 and FP4 build is third-party. The 33.1 GB figure is the vLLM-Omni recipe's on-disk component total (Qwen3-VL 8B text encoder 17.5 GB + 7.1B DiT 14.2 GB + VAE 1.4 GB), not a measured peak. The two runtime projects that publish measured peaks disagree by design: SGLang's 2026-09-20 table reports 38.4 GiB resident on an H200 and a 22.7 GiB peak on a 24 GB RTX 4090 whose encoder is offloaded layer by layer, while vLLM-Omni reports 34.0 GB BF16 and 27.5-28.1 GB with text-encoder FP8 on a GB300 (NVIDIA only, and not yet in a tagged release). Community reports for the same 1024x1024 regime span 2 GB to 38.4 GiB with no shared protocol, so no single figure is 'the' requirement. GGUF also needs a loader that recognizes qwen_image 2.1 and a Qwen3-VL mmproj vision tower. See the memory and quantization decision page for every source and its conditions.
Primary sourceThese are runtime examples, not validated installation recipes. Fit estimates assume quantized files; official repositories may hold full-precision weights. MLX, GGUF and TensorRT require matching conversions or engines.
python3 -m sglang.launch_server --model-path Qwen/Qwen-Image-2.1 --port 30000vllm serve Qwen/Qwen-Image-2.1 --dtype autoA text-to-image and image-editing pipeline, not an LLM: read the fit label as 'does not fit resident' rather than 'impossible', because the same pipeline is documented running on a 24 GB card with the text encoder offloaded. Qwen publishes no VRAM table and no quantization-tier mapping. The model card, the ModelScope card, the GitHub README and the release blog only offer enable_model_cpu_offload(); the official organization ships no quantized checkpoint, so every GGUF, INT8 and FP4 build is third-party. The 33.1 GB figure is the vLLM-Omni recipe's on-disk component total (Qwen3-VL 8B text encoder 17.5 GB + 7.1B DiT 14.2 GB + VAE 1.4 GB), not a measured peak. The two runtime projects that publish measured peaks disagree by design: SGLang's 2026-09-20 table reports 38.4 GiB resident on an H200 and a 22.7 GiB peak on a 24 GB RTX 4090 whose encoder is offloaded layer by layer, while vLLM-Omni reports 34.0 GB BF16 and 27.5-28.1 GB with text-encoder FP8 on a GB300 (NVIDIA only, and not yet in a tagged release). Community reports for the same 1024x1024 regime span 2 GB to 38.4 GiB with no shared protocol, so no single figure is 'the' requirement. GGUF also needs a loader that recognizes qwen_image 2.1 and a Qwen3-VL mmproj vision tower. See the memory and quantization decision page for every source and its conditions.
Filter by a runtime path and an installed-capacity floor you already established for your workload. This does not calculate required VRAM. Inputs stay in this browser.
Used-card condition, power supply and case clearance need separate checks.
Check Blackwell kernels for the exact quantization; more VRAM does not certify faster decode.
Verify OS, driver and ROCm/Vulkan support. Experimental forks are not stock-runtime support.
BIOS GPU allocation and system use reduce available memory; 128 GB RAM is not 128 GB dedicated VRAM.
m5 ultra 96g and m5 ultra 96gb refer to this capacity. Memory is shared with macOS; verify shipping date and MLX conversion.
ARM64 packages and GB10 kernels must support the chosen model. Capacity is not a latency result.
| Issuer / checkpoint | Values | Source / verified |
|---|---|---|
| Alibaba Qwen / Qwen/Qwen-Image-2.1 | 15.4B total; Not a token context: one prompt plus up to 10 reference images; Qwen Research | Publisher model card / 2026-09-26 |
Inference experiments only. The Q4 memory budget is estimated, not a tested maximum context. Unsupported kernels, missing vision projectors, incorrect tool parsers and longer-context KV allocation can fail even when weights fit. No successful deployment, quality or speed is guaranteed.
Compare hardware purchase paths