가이드로
HARDWARE / UNIFIED MEMORY

NVIDIA DGX Spark · 128 GB

A compact local AI system with 128 GB coherent memory. It can hold large low-bit models, but decode speed and software support remain model-specific.

1차 출처
GB10 Grace Blackwell128 GB
01 / PRACTICAL CEILING

Qwen3.8 Flash Next

The highest listed result may be a tight or offloaded fit. For daily use, prefer the first result marked 여유 있음 and keep context modest.

02 / DEFAULT RUNTIME

vLLM

Linux GPU servers, concurrency and OpenAI-compatible production APIs. CUDA, ROCm and XPU feature coverage differs. Driver, shared-memory and quantization compatibility are version-specific.

가이드 열기
03 / MODEL ENVELOPE

대표 오픈 웨이트 모델

Alibaba Qwen

Qwen3.8 Flash Next

English
180BQ4 estimated budget
추정 메모리
~108 GB
컨텍스트
262,144 native; 1M extended
inclusionAI

Ling-3.0-flash

English
124BQ4 estimated budget
추정 메모리
~74.4 GB
컨텍스트
Check selected runtime and checkpoint
OpenAI

gpt-oss-120b

117B5.1B active · MXFP4
추정 메모리
~80 GB
컨텍스트
128K
Meta

Llama 4 Scout

109B17B active · INT4 MoE
추정 메모리
~78 GB
컨텍스트
10M advertised
Meta

Llama 3.1 70B

70BGGUF Q4
추정 메모리
~46 GB
컨텍스트
128K
Nex AGI

Nex-N2.5-mini

English
35BQ4 estimated budget
추정 메모리
~21 GB
컨텍스트
262,144 (config max_position_embeddings)
주의

Fit is based on estimated total model memory. Driver support, KV cache, multimodal projectors, concurrency, and desktop applications can all reduce available headroom. Current fit: Qwen3.8 Flash Next (빠듯함), Ling-3.0-flash (여유 있음), gpt-oss-120b (여유 있음), Llama 4 Scout (여유 있음), Llama 3.1 70B (여유 있음), Nex-N2.5-mini (여유 있음).