Solar Open 100B hardware requirements
About the model
- Parameters
- 102.65B total · 12B active (MoE)
- Attention
- Full attention
- Max context
- 131,072 tokens
- Released
- 2025-12-10
- Model card
- Solar Open 100B on Hugging Face
GGUF files
| Quant | File size | Quality | Published by |
|---|---|---|---|
| Q2_K | 37.69 GB | Heavy loss | Community GGUF · mradermacher |
| IQ4_XS | 55.53 GB | Good balance | Community GGUF · mradermacher |
| Q4_K_Mbaseline | 62.26 GB | Good balance | Community GGUF · mradermacher |
| Q8_0 | 109.15 GB | Near-lossless | Community GGUF · mradermacher |
Memory needed by quant and context
| Quant | 4k | 8k | 16k | 32k | 64k | 128k |
|---|---|---|---|---|---|---|
| Q2_K | 39.0 | 39.9 | 41.6 | 44.9 | 51.7 | 65.2 |
| IQ4_XS | 56.9 | 57.7 | 59.4 | 62.8 | 69.5 | 83.0 |
| Q4_K_M | 63.6 | 64.4 | 66.1 | 69.5 | 76.2 | 89.7 |
| Q8_0 | 110.5 | 111.3 | 113.0 | 116.4 | 123.1 | 136.6 |
Which GPUs can run Solar Open 100B?
How to read the verdicts
- Runs great
- Fully on the GPU at 20 tok/s or more
- Runs well
- Fully on the GPU at 8–20 tok/s; MoE experts in system RAM at 20 tok/s or more; or at least 90% on the GPU at 8 tok/s or more
- Runs slowly
- 2–8 tok/s; CPU-only; less than 90% on the GPU; or MoE experts in system RAM below 20 tok/s
- Won't run
- Does not fit, or under 2 tok/s
Scroll sideways to see every column.
| Hardware | Verdict | Speed | Quant | Memory | Runs as | Context | Notes | Price |
|---|---|---|---|---|---|---|---|---|
| Apple M3 Ultra · 96 GB | Runs great | est. 26.7 tok/s21.4–32.1calibrated estimate ±20% | Q4_K_M | 64.4 / 67.2 GB | Unified memory | up to 16k | — | — |
| Apple M2 Ultra · 128 GB | Runs great | est. 26.1 tok/s20.9–31.3calibrated estimate ±20% | Q4_K_M | 64.4 / 89.6 GB | Unified memory | up to 16k | — | — |
| Apple M5 Max (40-core GPU) · 128 GB | Runs great | est. 20.7 tok/s16.6–24.9calibrated estimate ±20% | Q4_K_M | 64.4 / 89.6 GB | Unified memory | up to 8k | — | — |
| Apple M4 Max (40-core GPU) · 128 GB | Runs well | est. 18.4 tok/s14.7–22.1calibrated estimate ±20% | Q4_K_M | 64.4 / 89.6 GB | Unified memory | up to 64k |
| — |
| Ryzen AI Max+ 395 (Strix Halo) · 128 GB | Runs well | est. 15.3 tok/s12.2–18.3calibrated estimate ±20% | Q4_K_M | 64.4 / 89.6 GB | Unified memory | up to 32k |
| $1,999 launch MSRP |
| NVIDIA DGX Spark · 128 GB | Runs well | est. 12.3 tok/s9.8–14.7calibrated estimate ±20% | Q4_K_M | 64.4 / 89.6 GB | Unified memory | up to 16k | — | $3,999 launch MSRP |
| DDR5-6000 dual-channel CPU · 96 GB | Runs slowly | est. 4.6 tok/s3.7–5.6calibrated estimate ±20% | Q4_K_M | 63.9 GB RAM | CPU only | up to 64k | — | — |
| DDR5-5600 dual-channel CPU · 96 GB | Runs slowly | est. 4.3 tok/s3.5–5.2calibrated estimate ±20% | Q4_K_M | 63.9 GB RAM | CPU only | up to 32k | — | — |
| Apple M5 Max (32-core GPU) · 48 GB | Won't runTry Q2_K (heavy quality loss): Runs slowly | est. 22.9 tok/s16.1–29.8theoretical estimate ±30% | Q2_K | 39.3 GB RAM | CPU only | up to 16k |
| — |
| Apple M4 Max (32-core GPU) · 48 GB | Won't runTry Q2_K (heavy quality loss): Runs slowly | est. 20.4 tok/s14.3–26.6theoretical estimate ±30% | Q2_K | 39.3 GB RAM | CPU only | up to 16k |
| — |
| Apple M5 Pro · 64 GB | Won't runTry IQ4_XS: Runs slowly | est. 11.4 tok/s8.0–14.8theoretical estimate ±30% | IQ4_XS | 57.1 GB RAM | CPU only | up to 16k |
| — |
| Apple M4 Pro · 64 GB | Won't runTry IQ4_XS: Runs slowly | est. 10.1 tok/s7.1–13.1theoretical estimate ±30% | IQ4_XS | 57.1 GB RAM | CPU only | up to 16k |
| — |
| DDR4-3200 dual-channel CPU · 64 GB | Won't runTry IQ4_XS: Runs slowly | est. 2.7 tok/s2.2–3.3calibrated estimate ±20% | IQ4_XS | 57.1 GB RAM | CPU only | up to 16k | — | — |
| Apple M4 · 32 GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| — |
| Apple M5 · 32 GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| — |
| Intel Arc B580 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $290 street (as of 2026-08-09) |
| GeForce GTX 1080 Ti | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $699 launch MSRP |
| GeForce RTX 2080 Ti | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $999 launch MSRP |
| GeForce RTX 3050 8GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $249 launch MSRP |
| GeForce RTX 3060 12GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $250 street (as of 2026-08-09) |
| GeForce RTX 3070 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $499 launch MSRP |
| GeForce RTX 3080 10GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $699 launch MSRP |
| GeForce RTX 3080 12GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $799 launch MSRP |
| GeForce RTX 3090 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $1,050 street (as of 2026-08-09) |
| GeForce RTX 3090 Ti | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $1,999 launch MSRP |
| GeForce RTX 4060 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $299 launch MSRP |
| GeForce RTX 4060 Laptop | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| — |
| GeForce RTX 4060 Ti 16GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $499 launch MSRP |
| GeForce RTX 4060 Ti 8GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $399 launch MSRP |
| GeForce RTX 4070 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $599 launch MSRP |
| GeForce RTX 4070 Laptop | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| — |
| GeForce RTX 4070 Super | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $599 launch MSRP |
| GeForce RTX 4070 Ti Super | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $799 launch MSRP |
| GeForce RTX 4080 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $1,199 launch MSRP |
| GeForce RTX 4080 Laptop | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| — |
| GeForce RTX 4080 Super | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $999 launch MSRP |
| GeForce RTX 4090 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $2,755 street (as of 2026-08-09) |
| GeForce RTX 4090 Laptop | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| — |
| GeForce RTX 5060 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $339 street (as of 2026-08-09) |
| GeForce RTX 5060 Ti 16GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $569 street (as of 2026-08-09) |
| GeForce RTX 5060 Ti 8GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $429 street (as of 2026-08-09) |
| GeForce RTX 5070 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $629 street (as of 2026-08-09) |
| GeForce RTX 5070 Ti | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $949 street (as of 2026-08-09) |
| GeForce RTX 5070 Ti Laptop | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| — |
| GeForce RTX 5080 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $1,256 street (as of 2026-08-09) |
| GeForce RTX 5080 Laptop | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| — |
| GeForce RTX 5090 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $4,200 street (as of 2026-08-09) |
| GeForce RTX 5090 Laptop | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| — |
| Radeon RX 7800 XT | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $499 launch MSRP |
| Radeon RX 7900 XT | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $899 launch MSRP |
| Radeon RX 7900 XTX | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $999 launch MSRP |
| Radeon RX 9060 XT 16GB | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $449 street (as of 2026-08-09) |
| Radeon RX 9070 | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $639 street (as of 2026-08-09) |
| Radeon RX 9070 XT | Won't run | — | Q4_K_M | needs 64.4 GB | — | — |
| $689 street (as of 2026-08-09) |
Cheapest GPUs that run it
No GPU with a current street price reaches Runs great or Runs well at Q4_K_M. The table above lists Macs, unified-memory PCs and CPU setups.
Measured results for Solar Open 100B
No public measurements for this model yet.
Frequently asked questions
How much VRAM does Solar Open 100B need?
At Q4_K_M the weights are 62.26 GB; with 8k context the total is about 64.4 GB (KV cache 1.6 GB, compute buffer 0.6 GB). The smallest tracked file (Q2_K (heavy quality loss)) needs about 39.9 GB.
What is the cheapest GPU that runs Solar Open 100B well?
No GPU with a current street price reaches Runs great or Runs well at Q4_K_M. The best tracked option is Apple M3 Ultra · 96 GB: Runs great.
Can Solar Open 100B run on an 8 GB, 16 GB or 24 GB GPU?
At Q4_K_M with 8k context: GeForce RTX 4060 — Won't run; GeForce RTX 5060 Ti 16GB — Won't run; GeForce RTX 3090 — Won't run.
Speeds are estimates from memory bandwidth, calibrated against public benchmarks, and each one comes with an error band and a confidence label. Real results vary with drivers, backend, context length and thermals.