Workstation · 48 GB
70B Q4 serving begins here, with limited room for cache and concurrency.
Qwen3 32B
The highest listed result may be a tight or offloaded fit. For daily use, prefer the first result marked Comfortable and keep context modest.
vLLM
Linux GPU servers, concurrency and OpenAI-compatible production APIs. CUDA, ROCm and XPU feature coverage differs. Driver, shared-memory and quantization compatibility are version-specific.
गाइड खोलेंप्रतिनिधि ओपन-वेट मॉडल
Qwen3 32B
- अनुमानित मेमोरी
- ~24.5 GB
- कॉन्टेक्स्ट
- 32K+
Qwen3 30B-A3B
- अनुमानित मेमोरी
- ~22.5 GB
- कॉन्टेक्स्ट
- 32K+
Gemma 3 27B
- अनुमानित मेमोरी
- ~20.5 GB
- कॉन्टेक्स्ट
- 128K
Devstral Small 2 24B
- अनुमानित मेमोरी
- ~18.5 GB
- कॉन्टेक्स्ट
- 256K
gpt-oss-20b
- अनुमानित मेमोरी
- ~16 GB
- कॉन्टेक्स्ट
- 128K
Qwen3 14B
- अनुमानित मेमोरी
- ~11.2 GB
- कॉन्टेक्स्ट
- 32K+
Fit is based on estimated total model memory. Driver support, KV cache, multimodal projectors, concurrency, and desktop applications can all reduce available headroom. Current fit: Qwen3 32B (Comfortable), Qwen3 30B-A3B (Comfortable), Gemma 3 27B (Comfortable), Devstral Small 2 24B (Comfortable), gpt-oss-20b (Comfortable), Qwen3 14B (Comfortable).