HARDWARE / UNIFIED MEMORY

NVIDIA DGX Spark · 128 GB

A compact local AI system with 128 GB coherent memory. It can hold large low-bit models, but decode speed and software support remain model-specific.

一次情報

GB10 Grace Blackwell128 GB

01 / PRACTICAL CEILING

Qwen3.8 Flash Next

The highest listed result may be a tight or offloaded fit. For daily use, prefer the first result marked 余裕あり and keep context modest.

02 / DEFAULT RUNTIME

vLLM

Linux GPU servers, concurrency and OpenAI-compatible production APIs. CUDA, ROCm and XPU feature coverage differs. Driver, shared-memory and quantization compatibility are version-specific.

ガイドを開く

03 / MODEL ENVELOPE

代表的なオープンウェイトモデル

Alibaba Qwen

Qwen3.8 Flash Next

English

180BQ4 estimated budget

推定メモリ: ~108 GB
コンテキスト: 262,144 native; 1M extended

inclusionAI

Ling-3.0-flash

English

124BQ4 estimated budget

推定メモリ: ~74.4 GB
コンテキスト: Check selected runtime and checkpoint

OpenAI

gpt-oss-120b

117B5.1B active · MXFP4

推定メモリ: ~80 GB
コンテキスト: 128K

Llama 4 Scout

109B17B active · INT4 MoE

推定メモリ: ~78 GB
コンテキスト: 10M advertised

Llama 3.1 70B

70BGGUF Q4

推定メモリ: ~46 GB
コンテキスト: 128K

Nex AGI

Nex-N2.5-mini

English

35BQ4 estimated budget

推定メモリ: ~21 GB
コンテキスト: 262,144 (config max_position_embeddings)

注意

Fit is based on estimated total model memory. Driver support, KV cache, multimodal projectors, concurrency, and desktop applications can all reduce available headroom. Current fit: Qwen3.8 Flash Next (ぎりぎり), Ling-3.0-flash (余裕あり), gpt-oss-120b (余裕あり), Llama 4 Scout (余裕あり), Llama 3.1 70B (余裕あり), Nex-N2.5-mini (余裕あり).