Solar Open 2 250B hardware requirements

About the model

Parameters
250.29B total · 15B active (MoE)
Attention
Hybrid linear attention
Max context
1,048,576 tokens
Released
2026-07-22

GGUF files

Tracked quantizations of Solar Open 2 250B, smallest first
QuantFile sizeQualityPublished by
Q2_K95.43 GBHeavy lossCommunity GGUF · prometheusAIR
IQ4_XSbaseline136.24 GBGood balanceCommunity GGUF · prometheusAIR
Q6_K205.55 GBNear-losslessCommunity GGUF · prometheusAIR

Memory needed by quant and context

Weights + f16 KV cache + compute buffer, in GB. Add about 0.6 GB if the GPU also drives your display on Windows.
Quant4k8k16k32k64k128k256k
Q2_K96.296.496.997.899.8103.6111.2
IQ4_XS137.0137.2137.7138.7140.6144.4152.0
Q6_K206.3206.5207.0208.0209.9213.7221.3

Which GPUs can run Solar Open 2 250B?

How to read the verdicts

Runs great
Fully on the GPU at 20 tok/s or more
Runs well
Fully on the GPU at 8–20 tok/s; MoE experts in system RAM at 20 tok/s or more; or at least 90% on the GPU at 8 tok/s or more
Runs slowly
2–8 tok/s; CPU-only; less than 90% on the GPU; or MoE experts in system RAM below 20 tok/s
Won't run
Does not fit, or under 2 tok/s

Scroll sideways to see every column.

54 GPUs, Macs and CPU setups at IQ4_XS with 8k context, sorted by verdict and speed
HardwareVerdictSpeedQuantMemoryRuns asContextNotesPrice
Apple M3 Ultra · 256 GB
Runs great
est. 27.7 tok/s22.2–33.3calibrated estimate ±20%
IQ4_XS137.2 / 179.2 GBUnified memoryup to 64k——
Apple M2 Ultra · 192 GB
Runs slowly
est. 27.1 tok/s19.0–35.2theoretical estimate ±30%
IQ4_XS136.6 GB RAMCPU onlyup to 256k
  • CPU inference — capped at Runs slowly
  • Q2_K (heavy quality loss): Runs great
—
Apple M5 Max (40-core GPU) · 128 GB
Won't runTry Q2_K (heavy quality loss): Runs slowly
est. 30.1 tok/s21.1–39.1theoretical estimate ±30%
Q2_K95.8 GB RAMCPU onlyup to 256k
  • CPU inference — capped at Runs slowly
—
Apple M4 Max (40-core GPU) · 128 GB
Won't runTry Q2_K (heavy quality loss): Runs slowly
est. 26.8 tok/s18.7–34.8theoretical estimate ±30%
Q2_K95.8 GB RAMCPU onlyup to 256k
  • CPU inference — capped at Runs slowly
—
Ryzen AI Max+ 395 (Strix Halo) · 128 GB
Won't runTry Q2_K (heavy quality loss): Runs slowly
est. 18.0 tok/s12.6–23.4theoretical estimate ±30%
Q2_K95.8 GB RAMCPU onlyup to 256k
  • CPU inference — capped at Runs slowly
$1,999 launch MSRP
NVIDIA DGX Spark · 128 GB
Won't runTry Q2_K (heavy quality loss): Runs slowly
est. 15.3 tok/s10.7–19.9theoretical estimate ±30%
Q2_K95.8 GB RAMCPU onlyup to 256k
  • CPU inference — capped at Runs slowly
$3,999 launch MSRP
Apple M4 · 32 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 28.0 GB of memory is free (22.4 GB usable by the GPU)
—
Apple M4 Max (32-core GPU) · 48 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 44.0 GB of memory is free (33.6 GB usable by the GPU)
—
Apple M4 Pro · 64 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 60.0 GB of memory is free (44.8 GB usable by the GPU)
—
Apple M5 · 32 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 28.0 GB of memory is free (22.4 GB usable by the GPU)
—
Apple M5 Max (32-core GPU) · 48 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 44.0 GB of memory is free (33.6 GB usable by the GPU)
—
Apple M5 Pro · 64 GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 60.0 GB of memory is free (44.8 GB usable by the GPU)
—
Intel Arc B580
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$290 street (as of 2026-08-09)
DDR4-3200 dual-channel CPU · 64 GB
Won't run
—IQ4_XSneeds 136.6 GB——
  • Needs about 136.6 GB; 60.0 GB of RAM is free
—
DDR5-5600 dual-channel CPU · 96 GB
Won't run
—IQ4_XSneeds 136.6 GB——
  • Needs about 136.6 GB; 92.0 GB of RAM is free
—
DDR5-6000 dual-channel CPU · 96 GB
Won't run
—IQ4_XSneeds 136.6 GB——
  • Needs about 136.6 GB; 92.0 GB of RAM is free
—
GeForce GTX 1080 Ti
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 10.4 GB of VRAM and 28.0 GB of RAM are free
$699 launch MSRP
GeForce RTX 2080 Ti
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 10.4 GB of VRAM and 28.0 GB of RAM are free
$999 launch MSRP
GeForce RTX 3050 8GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$249 launch MSRP
GeForce RTX 3060 12GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$250 street (as of 2026-08-09)
GeForce RTX 3070
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$499 launch MSRP
GeForce RTX 3080 10GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 9.4 GB of VRAM and 28.0 GB of RAM are free
$699 launch MSRP
GeForce RTX 3080 12GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$799 launch MSRP
GeForce RTX 3090
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$1,050 street (as of 2026-08-09)
GeForce RTX 3090 Ti
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$1,999 launch MSRP
GeForce RTX 4060
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$299 launch MSRP
GeForce RTX 4060 Laptop
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 4060 Ti 16GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$499 launch MSRP
GeForce RTX 4060 Ti 8GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$399 launch MSRP
GeForce RTX 4070
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$599 launch MSRP
GeForce RTX 4070 Laptop
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 4070 Super
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$599 launch MSRP
GeForce RTX 4070 Ti Super
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$799 launch MSRP
GeForce RTX 4080
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$1,199 launch MSRP
GeForce RTX 4080 Laptop
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 4080 Super
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$999 launch MSRP
GeForce RTX 4090
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$2,755 street (as of 2026-08-09)
GeForce RTX 4090 Laptop
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
—
GeForce RTX 5060
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$339 street (as of 2026-08-09)
GeForce RTX 5060 Ti 16GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$569 street (as of 2026-08-09)
GeForce RTX 5060 Ti 8GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 7.4 GB of VRAM and 28.0 GB of RAM are free
$429 street (as of 2026-08-09)
GeForce RTX 5070
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
$629 street (as of 2026-08-09)
GeForce RTX 5070 Ti
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$949 street (as of 2026-08-09)
GeForce RTX 5070 Ti Laptop
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 11.4 GB of VRAM and 28.0 GB of RAM are free
—
GeForce RTX 5080
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$1,256 street (as of 2026-08-09)
GeForce RTX 5080 Laptop
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
—
GeForce RTX 5090
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 31.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$4,200 street (as of 2026-08-09)
GeForce RTX 5090 Laptop
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
—
Radeon RX 7800 XT
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$499 launch MSRP
Radeon RX 7900 XT
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 19.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$899 launch MSRP
Radeon RX 7900 XTX
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 23.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$999 launch MSRP
Radeon RX 9060 XT 16GB
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$449 street (as of 2026-08-09)
Radeon RX 9070
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$639 street (as of 2026-08-09)
Radeon RX 9070 XT
Won't run
—IQ4_XSneeds 137.2 GB——
  • Needs about 137.2 GB; 15.4 GB of VRAM and 28.0 GB of RAM are free
  • With 128 GB RAM: Runs slowly
$689 street (as of 2026-08-09)

Cheapest GPUs that run it

No GPU with a current street price reaches Runs great or Runs well at IQ4_XS. The table above lists Macs, unified-memory PCs and CPU setups.

Measured results for Solar Open 2 250B

No public measurements for this model yet.

Frequently asked questions

How much VRAM does Solar Open 2 250B need?

At IQ4_XS the weights are 136.24 GB; with 8k context the total is about 137.2 GB (KV cache 0.4 GB, compute buffer 0.6 GB). The smallest tracked file (Q2_K (heavy quality loss)) needs about 96.4 GB.

What is the cheapest GPU that runs Solar Open 2 250B well?

No GPU with a current street price reaches Runs great or Runs well at IQ4_XS. The best tracked option is Apple M3 Ultra · 256 GB: Runs great.

Can Solar Open 2 250B run on an 8 GB, 16 GB or 24 GB GPU?

At IQ4_XS with 8k context: GeForce RTX 4060 — Won't run; GeForce RTX 5060 Ti 16GB — Won't run; GeForce RTX 3090 — Won't run.

Speeds are estimates from memory bandwidth, calibrated against public benchmarks, and each one comes with an error band and a confidence label. Real results vary with drivers, backend, context length and thermals.