CanRun

Solar Open 2 250B hardware requirements

What is Solar Open 2 250B?

Solar Open 2 is Upstage's mixture-of-experts model from July 2026: 250B parameters, 15B active per token. It is built for agentic work such as office tasks, documents and coding, with tool calling and adjustable reasoning. It reads up to 1M tokens. Only 12 of its 48 layers keep a KV cache, so the cache is about a quarter of what it would be if every layer used full attention.

Model card

About the model

Parameters
250.29B total · 15B active (MoE)
Attention
Hybrid attention (only some layers use full attention)
Max context
1,048,576 tokens
Released
2026-07-22

GGUF files

Tracked quantizations of Solar Open 2 250B, smallest first
QuantFile sizeQualityPublished by
Q2_K95.43 GBHeavy lossCommunity GGUF · prometheusAIR
IQ4_XSbaseline136.24 GBGood balanceCommunity GGUF · prometheusAIR
Q6_K205.55 GBNear-losslessCommunity GGUF · prometheusAIR

Memory needed by quant and context

Graphics card memory in GB: weights loaded on the GPU + f16 KV cache + compute buffer. Add about 0.6 GB if the GPU also drives your display on Windows. Part of the file stays off the graphics card: llama.cpp keeps the input embedding table in system RAM. A Mac counts the whole file, so it needs a little more.
Quant4k8k16k32k64k128k256k
Q2_K95.595.796.297.299.1102.9110.5
IQ4_XS136.3136.5137.0138.0139.9143.7151.3
Q6_K205.6205.9206.3207.3209.2213.0220.7

Which GPUs can run Solar Open 2 250B?

How to read the verdicts

Runs great
Fully on the GPU at 20 tok/s or more
Runs well
Fully on the GPU at 8–20 tok/s; MoE experts in system RAM at 20 tok/s or more; or at least 90% on the GPU at 8 tok/s or more
Runs slowly
2–8 tok/s; CPU-only; less than 90% on the GPU; or MoE experts in system RAM below 20 tok/s
Won't run
Does not fit, or under 2 tok/s

Filter this list by budget, type and context in the calculator

Scroll sideways to see every column.

58 GPUs, Macs and CPU setups at IQ4_XS with 8k context, sorted by verdict and speed
HardwareVerdictSpeedQuantMemoryRuns asContextNotesPrice
Apple M5 Ultra · 256 GB
Runs great
est. 50.3 tok/s40.3–60.4calibrated estimate ±20%
IQ4_XS137.2 / 179.2 GBUnified memoryup to 128k——
Apple M3 Ultra · 256 GB
Runs great
est. 37.0 tok/s29.6–44.4calibrated estimate ±20%
IQ4_XS137.2 / 179.2 GBUnified memoryup to 64k——
Apple M2 Ultra · 192 GB
Runs slowly
est. 36.3 tok/s25.4–47.2theoretical estimate ±30%
IQ4_XS136.6 GB RAMCPU onlyup to 256k
  • CPU inference — capped at Runs slowly
  • Q2_K (heavy quality loss): Runs great
—
NVIDIA RTX PRO 6000 Blackwell
Won't runTry Q2_K (heavy quality loss): Runs well
est. 83.0 tok/s58.1–107.9theoretical estimate ±30%
Q2_K92.7 / 96.0 GB + 4.4 GB RAMMoE experts in RAMup to 256k
  • Not fully on the GPU — Runs great needs the whole model in GPU memory
  • With 64 GB RAM: Runs slowly
—
NVIDIA RTX PRO 6000 Blackwell Max-Q
Won't runTry Q2_K (heavy quality loss): Runs well
est. 83.0 tok/s58.1–107.9theoretical estimate ±30%
Q2_K92.7 / 96.0 GB + 4.4 GB RAMMoE experts in RAMup to 256k
  • Not fully on the GPU — Runs great needs the whole model in GPU memory
  • With 64 GB RAM: Runs slowly
—
Apple M5 Max (40-core GPU) · 128 GB
Won't runTry Q2_K (heavy quality loss): Runs slowly
est. 43.1 tok/s30.2–56.1theoretical estimate ±30%
Q2_K95.8 GB RAMCPU onlyup to 256k
  • CPU inference — capped at Runs slowly
—
Apple M4 Max (40-core GPU) · 128 GB
Won't runTry Q2_K (heavy quality loss): Runs slowly
est. 38.4 tok/s26.8–49.9theoretical estimate ±30%
Q2_K95.8 GB RAMCPU onlyup to 256k
  • CPU inference — capped at Runs slowly
—
NVIDIA DGX Spark · 128 GB
Won't runTry Q2_K (heavy quality loss): Runs well
est. 22.0 tok/s17.6–26.3calibrated estimate ±20%
Q2_K96.4 / 116.9 GBUnified memoryup to 128k—$3,999 launch MSRP (128 GB)
Ryzen AI Max+ 395 (Strix Halo) · 128 GB
Won't runTry Q2_K (heavy quality loss): Runs slowly
est. 18.0 tok/s12.6–23.4theoretical estimate ±30%
Q2_K95.8 GB RAMCPU onlyup to 256k
  • CPU inference — capped at Runs slowly
$1,999 launch MSRP (128 GB)
Apple M4 · 32 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 28.0 GB of memory is free (22.4 GB usable by the GPU)
—
Apple M4 Max (32-core GPU) · 36 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 32.0 GB of memory is free (25.2 GB usable by the GPU)
—
Apple M4 Pro · 64 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 60.0 GB of memory is free (44.8 GB usable by the GPU)
—
Apple M5 · 32 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 28.0 GB of memory is free (22.4 GB usable by the GPU)
—
Apple M5 Max (32-core GPU) · 36 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 32.0 GB of memory is free (25.2 GB usable by the GPU)
—
Apple M5 Pro · 64 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 60.0 GB of memory is free (44.8 GB usable by the GPU)
—
Apple M6 · 32 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 28.0 GB of memory is free (22.4 GB usable by the GPU)
—
Intel Arc B580
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$290 street (as of 2026-08-09)
DDR4-3200 dual-channel CPU · 64 GB
Won't run
—IQ4_XSneeds 136.6 GB——
  • Needs about 136.6 GB; 60.0 GB of RAM is free
—
DDR5-5600 dual-channel CPU · 96 GB
Won't run
—IQ4_XSneeds 136.6 GB——
  • Needs about 136.6 GB; 92.0 GB of RAM is free
—
DDR5-6000 dual-channel CPU · 96 GB
Won't run
—IQ4_XSneeds 136.6 GB——
  • Needs about 136.6 GB; 92.0 GB of RAM is free
—
GeForce GTX 1080 Ti
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 10.4 GB of VRAM and 28.0 GB of RAM are free
$699 launch MSRP
GeForce RTX 2080 Ti
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 10.4 GB of VRAM and 28.0 GB of RAM are free
$999 launch MSRP
GeForce RTX 3050 8GB
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$249 launch MSRP
GeForce RTX 3060 12GB
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$250 street (as of 2026-08-09)
GeForce RTX 3070
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$499 launch MSRP
GeForce RTX 3080 10GB
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 9.4 GB of VRAM and 28.0 GB of RAM are free
$699 launch MSRP
GeForce RTX 3080 12GB
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$799 launch MSRP
GeForce RTX 3090
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$1,050 street (as of 2026-08-09)
GeForce RTX 3090 Ti
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$1,999 launch MSRP
GeForce RTX 4060
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$299 launch MSRP
GeForce RTX 4060 Laptop
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 4060 Ti 16GB
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$499 launch MSRP
GeForce RTX 4060 Ti 8GB
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$399 launch MSRP
GeForce RTX 4070
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$599 launch MSRP
GeForce RTX 4070 Laptop
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 4070 Super
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$599 launch MSRP
GeForce RTX 4070 Ti Super
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$799 launch MSRP
GeForce RTX 4080
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$1,199 launch MSRP
GeForce RTX 4080 Laptop
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 4080 Super
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$999 launch MSRP
GeForce RTX 4090
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$2,755 street (as of 2026-08-09)
GeForce RTX 4090 Laptop
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 5060
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$339 street (as of 2026-08-09)
GeForce RTX 5060 Ti 16GB
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$569 street (as of 2026-08-09)
GeForce RTX 5060 Ti 8GB
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$429 street (as of 2026-08-09)
GeForce RTX 5070
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$629 street (as of 2026-08-09)
GeForce RTX 5070 Ti
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$949 street (as of 2026-08-09)
GeForce RTX 5070 Ti Laptop
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 5080
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$1,256 street (as of 2026-08-09)
GeForce RTX 5080 Laptop
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 5090
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 31.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$4,200 street (as of 2026-08-09)
GeForce RTX 5090 Laptop
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
—
Radeon RX 7800 XT
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$499 launch MSRP
Radeon RX 7900 XT
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 19.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$899 launch MSRP
Radeon RX 7900 XTX
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$999 launch MSRP
Radeon RX 9060 XT 16GB
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$449 street (as of 2026-08-09)
Radeon RX 9070
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$639 street (as of 2026-08-09)
Radeon RX 9070 XT
Won't run
—IQ4_XSneeds 136.5 GB——
  • Needs about 136.5 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
$689 street (as of 2026-08-09)

Models with a thinking mode spend extra tokens thinking, so their speed thresholds are 1.5× stricter (30 / 12 / 3 tok/s). With thinking turned off, a model may do one grade better.

Cheapest GPUs that run it

No GPU with a current street price reaches Runs great or Runs well at IQ4_XS. The table above lists Macs, unified-memory PCs and CPU setups.

Measured results for Solar Open 2 250B

No public measurements for this model yet.

Frequently asked questions

How much VRAM does Solar Open 2 250B need?

At IQ4_XS the file is 136.24 GB; with 8k context a graphics card needs about 136.5 GB (weights 135.56 GB, KV cache 0.4 GB, compute buffer 0.6 GB). The smallest tracked file (Q2_K (heavy quality loss)) needs about 95.7 GB. Part of the file stays off the graphics card: llama.cpp keeps the input embedding table in system RAM. A Mac counts the whole file, so it needs a little more.

What is the cheapest GPU that runs Solar Open 2 250B well?

Nothing with a street or launch price can run it at IQ4_XS. The best tracked option, which has no listed price, is Apple M5 Ultra · 256 GB: Runs great.

Can Solar Open 2 250B run on an 8 GB, 16 GB or 24 GB GPU?

At IQ4_XS with 8k context: GeForce RTX 4060 — Won't run; GeForce RTX 5060 Ti 16GB — Won't run; GeForce RTX 3090 — Won't run.

Speeds are estimates from memory bandwidth, calibrated against public benchmarks, and each one comes with an error band and a confidence label. Real results vary with drivers, backend, context length and thermals.