EXAONE 4.0 1.2B hardware requirements
About the model
- Parameters
- 1.28B
- Attention
- Full attention
- Max context
- 65,536 tokens
- Released
- 2025-07-11
- Model card
- EXAONE 4.0 1.2B on Hugging Face
GGUF files
| Quant | File size | Quality | Published by |
|---|---|---|---|
| IQ4_XS | 0.75 GB | Good balance | Official GGUF · LGAI-EXAONE |
| Q4_K_Mbaseline | 0.81 GB | Good balance | Official GGUF · LGAI-EXAONE |
| Q6_K | 1.05 GB | Near-lossless | Official GGUF · LGAI-EXAONE |
| Q8_0 | 1.36 GB | Near-lossless | Official GGUF · LGAI-EXAONE |
Memory needed by quant and context
| Quant | 4k | 8k | 16k | 32k | 64k |
|---|---|---|---|---|---|
| IQ4_XS | 1.5 | 1.8 | 2.4 | 3.6 | 5.9 |
| Q4_K_M | 1.6 | 1.9 | 2.5 | 3.6 | 5.9 |
| Q6_K | 1.8 | 2.1 | 2.7 | 3.9 | 6.2 |
| Q8_0 | 2.1 | 2.4 | 3.0 | 4.2 | 6.5 |
Which GPUs can run EXAONE 4.0 1.2B?
How to read the verdicts
- Runs great
- Fully on the GPU at 20 tok/s or more
- Runs well
- Fully on the GPU at 8–20 tok/s; MoE experts in system RAM at 20 tok/s or more; or at least 90% on the GPU at 8 tok/s or more
- Runs slowly
- 2–8 tok/s; CPU-only; less than 90% on the GPU; or MoE experts in system RAM below 20 tok/s
- Won't run
- Does not fit, or under 2 tok/s
Scroll sideways to see every column.
| Hardware | Verdict | Speed | Quant | Memory | Runs as | Context | Notes | Price |
|---|---|---|---|---|---|---|---|---|
| GeForce RTX 5090 | Runs great | est. 955.1 tok/s840.5–1,069.8calibrated estimate ±12% | Q4_K_M | 2.5 / 32.0 GB | Full GPU | up to 64k | — | $4,200 street (as of 2026-08-09) |
| Radeon RX 7900 XTX | Runs great | est. 570.2 tok/s501.7–638.6calibrated estimate ±12% | Q4_K_M | 2.5 / 24.0 GB | Full GPU | up to 64k | — | $999 launch MSRP |
| GeForce RTX 3090 Ti | Runs great | est. 537.3 tok/s472.8–601.7calibrated estimate ±12% | Q4_K_M | 2.5 / 24.0 GB | Full GPU | up to 64k | — | $1,999 launch MSRP |
| GeForce RTX 4090 | Runs great | est. 537.3 tok/s472.8–601.7calibrated estimate ±12% | Q4_K_M | 2.5 / 24.0 GB | Full GPU | up to 64k | — | $2,755 street (as of 2026-08-09) |
| GeForce RTX 5080 | Runs great | est. 511.7 tok/s450.3–573.1calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $1,256 street (as of 2026-08-09) |
| GeForce RTX 3090 | Runs great | est. 498.9 tok/s439.0–558.8calibrated estimate ±12% | Q4_K_M | 2.5 / 24.0 GB | Full GPU | up to 64k | — | $1,050 street (as of 2026-08-09) |
| GeForce RTX 3080 12GB | Runs great | est. 486.1 tok/s427.8–544.4calibrated estimate ±12% | Q4_K_M | 2.5 / 12.0 GB | Full GPU | up to 64k | — | $799 launch MSRP |
| GeForce RTX 5070 Ti | Runs great | est. 477.6 tok/s420.3–534.9calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $949 street (as of 2026-08-09) |
| GeForce RTX 5080 Laptop | Runs great | est. 477.6 tok/s420.3–534.9calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | — |
| GeForce RTX 5090 Laptop | Runs great | est. 477.6 tok/s420.3–534.9calibrated estimate ±12% | Q4_K_M | 2.5 / 24.0 GB | Full GPU | up to 64k | — | — |
| Radeon RX 7900 XT | Runs great | est. 475.1 tok/s418.1–532.1calibrated estimate ±12% | Q4_K_M | 2.5 / 20.0 GB | Full GPU | up to 64k | — | $899 launch MSRP |
| GeForce RTX 3080 10GB | Runs great | est. 405.1 tok/s356.5–453.7calibrated estimate ±12% | Q4_K_M | 2.5 / 10.0 GB | Full GPU | up to 64k | — | $699 launch MSRP |
| GeForce RTX 4080 Super | Runs great | est. 392.3 tok/s345.2–439.4calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $999 launch MSRP |
| Radeon RX 9070 | Runs great | est. 383.1 tok/s337.1–429.0calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $639 street (as of 2026-08-09) |
| Radeon RX 9070 XT | Runs great | est. 383.1 tok/s337.1–429.0calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $689 street (as of 2026-08-09) |
| GeForce RTX 4080 | Runs great | est. 382.2 tok/s336.3–428.0calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $1,199 launch MSRP |
| Radeon RX 7800 XT | Runs great | est. 370.6 tok/s326.1–415.1calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $499 launch MSRP |
| GeForce RTX 4070 Ti Super | Runs great | est. 358.2 tok/s315.2–401.2calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $799 launch MSRP |
| GeForce RTX 5070 | Runs great | est. 358.2 tok/s315.2–401.2calibrated estimate ±12% | Q4_K_M | 2.5 / 12.0 GB | Full GPU | up to 64k | — | $629 street (as of 2026-08-09) |
| GeForce RTX 5070 Ti Laptop | Runs great | est. 358.2 tok/s315.2–401.2calibrated estimate ±12% | Q4_K_M | 2.5 / 12.0 GB | Full GPU | up to 64k | — | — |
| GeForce RTX 2080 Ti | Runs great | est. 328.3 tok/s288.9–367.7calibrated estimate ±12% | Q4_K_M | 2.5 / 11.0 GB | Full GPU | up to 64k | — | $999 launch MSRP |
| GeForce RTX 4090 Laptop | Runs great | est. 307.0 tok/s270.2–343.9calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | — |
| Apple M5 Max (40-core GPU) · 48 GB | Runs great | est. 280.5 tok/s224.4–336.6calibrated estimate ±20% | Q4_K_M | 1.9 / 33.6 GB | Unified memory | up to 64k | — | — |
| Apple M3 Ultra · 96 GB | Runs great | est. 274.4 tok/s219.5–329.3calibrated estimate ±20% | Q4_K_M | 1.9 / 67.2 GB | Unified memory | up to 64k | — | — |
| GeForce RTX 4070 | Runs great | est. 268.6 tok/s236.4–300.9calibrated estimate ±12% | Q4_K_M | 2.5 / 12.0 GB | Full GPU | up to 64k | — | $599 launch MSRP |
| GeForce RTX 4070 Super | Runs great | est. 268.6 tok/s236.4–300.9calibrated estimate ±12% | Q4_K_M | 2.5 / 12.0 GB | Full GPU | up to 64k | — | $599 launch MSRP |
| Apple M2 Ultra · 64 GB | Runs great | est. 268.0 tok/s214.4–321.6calibrated estimate ±20% | Q4_K_M | 1.9 / 44.8 GB | Unified memory | up to 64k | — | — |
| GeForce GTX 1080 Ti | Runs great | est. 258.0 tok/s180.6–335.4theoretical estimate ±30% | Q4_K_M | 2.5 / 11.0 GB | Full GPU | up to 64k | — | $699 launch MSRP |
| Apple M4 Max (40-core GPU) · 48 GB | Runs great | est. 249.4 tok/s199.6–299.3calibrated estimate ±20% | Q4_K_M | 1.9 / 33.6 GB | Unified memory | up to 64k | — | — |
| GeForce RTX 3070 | Runs great | est. 238.8 tok/s210.1–267.4calibrated estimate ±12% | Q4_K_M | 2.5 / 8.0 GB | Full GPU | up to 64k | — | $499 launch MSRP |
| GeForce RTX 5060 | Runs great | est. 238.8 tok/s210.1–267.4calibrated estimate ±12% | Q4_K_M | 2.5 / 8.0 GB | Full GPU | up to 64k | — | $339 street (as of 2026-08-09) |
| GeForce RTX 5060 Ti 16GB | Runs great | est. 238.8 tok/s210.1–267.4calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $569 street (as of 2026-08-09) |
| GeForce RTX 5060 Ti 8GB | Runs great | est. 238.8 tok/s210.1–267.4calibrated estimate ±12% | Q4_K_M | 2.5 / 8.0 GB | Full GPU | up to 64k | — | $429 street (as of 2026-08-09) |
| GeForce RTX 4080 Laptop | Runs great | est. 230.3 tok/s202.6–257.9calibrated estimate ±12% | Q4_K_M | 2.5 / 12.0 GB | Full GPU | up to 64k | — | — |
| Apple M5 Max (32-core GPU) · 36 GB | Runs great | est. 210.2 tok/s168.1–252.2calibrated estimate ±20% | Q4_K_M | 1.9 / 25.2 GB | Unified memory | up to 64k | — | — |
| Intel Arc B580 | Runs great | est. 204.9 tok/s163.9–245.8calibrated estimate ±20% | Q4_K_M | 2.5 / 12.0 GB | Full GPU | up to 64k | — | $290 street (as of 2026-08-09) |
| GeForce RTX 3060 12GB | Runs great | est. 191.9 tok/s168.9–214.9calibrated estimate ±12% | Q4_K_M | 2.5 / 12.0 GB | Full GPU | up to 64k | — | $250 street (as of 2026-08-09) |
| Radeon RX 9060 XT 16GB | Runs great | est. 191.2 tok/s168.3–214.2calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $449 street (as of 2026-08-09) |
| Apple M4 Max (32-core GPU) · 36 GB | Runs great | est. 187.3 tok/s149.8–224.8calibrated estimate ±20% | Q4_K_M | 1.9 / 25.2 GB | Unified memory | up to 64k | — | — |
| GeForce RTX 4060 Ti 16GB | Runs great | est. 153.5 tok/s135.1–171.9calibrated estimate ±12% | Q4_K_M | 2.5 / 16.0 GB | Full GPU | up to 64k | — | $499 launch MSRP |
| GeForce RTX 4060 Ti 8GB | Runs great | est. 153.5 tok/s135.1–171.9calibrated estimate ±12% | Q4_K_M | 2.5 / 8.0 GB | Full GPU | up to 64k | — | $399 launch MSRP |
| GeForce RTX 4060 | Runs great | est. 145.0 tok/s127.6–162.4calibrated estimate ±12% | Q4_K_M | 2.5 / 8.0 GB | Full GPU | up to 64k | — | $299 launch MSRP |
| Apple M5 Pro · 24 GB | Runs great | est. 140.3 tok/s112.2–168.3calibrated estimate ±20% | Q4_K_M | 1.9 / 16.8 GB | Unified memory | up to 64k | — | — |
| GeForce RTX 4060 Laptop | Runs great | est. 136.4 tok/s120.1–152.8calibrated estimate ±12% | Q4_K_M | 2.5 / 8.0 GB | Full GPU | up to 64k | — | — |
| GeForce RTX 4070 Laptop | Runs great | est. 136.4 tok/s120.1–152.8calibrated estimate ±12% | Q4_K_M | 2.5 / 8.0 GB | Full GPU | up to 64k | — | — |
| Ryzen AI Max+ 395 (Strix Halo) · 32 GB | Runs great | est. 126.7 tok/s101.4–152.0calibrated estimate ±20% | Q4_K_M | 1.9 / 22.4 GB | Unified memory | up to 64k | — | $1,999 launch MSRP |
| Apple M4 Pro · 24 GB | Runs great | est. 124.7 tok/s99.8–149.7calibrated estimate ±20% | Q4_K_M | 1.9 / 16.8 GB | Unified memory | up to 64k | — | — |
| GeForce RTX 3050 8GB | Runs great | est. 119.4 tok/s105.1–133.7calibrated estimate ±12% | Q4_K_M | 2.5 / 8.0 GB | Full GPU | up to 64k | — | $249 launch MSRP |
| NVIDIA DGX Spark · 128 GB | Runs great | est. 83.1 tok/s66.5–99.8calibrated estimate ±20% | Q4_K_M | 1.9 / 89.6 GB | Unified memory | up to 64k | — | $3,999 launch MSRP |
| Apple M5 · 16 GB | Runs great | est. 70.2 tok/s56.1–84.2calibrated estimate ±20% | Q4_K_M | 1.9 / 11.2 GB | Unified memory | up to 32k | — | — |
| Apple M4 · 16 GB | Runs great | est. 54.8 tok/s43.9–65.8calibrated estimate ±20% | Q4_K_M | 1.9 / 11.2 GB | Unified memory | up to 32k | — | — |
| DDR5-6000 dual-channel CPU · 16 GB | Runs slowly | est. 36.5 tok/s29.2–43.9calibrated estimate ±20% | Q4_K_M | 1.3 GB RAM | CPU only | up to 64k |
| — |
| DDR5-5600 dual-channel CPU · 16 GB | Runs slowly | est. 34.1 tok/s27.3–40.9calibrated estimate ±20% | Q4_K_M | 1.3 GB RAM | CPU only | up to 64k |
| — |
| DDR4-3200 dual-channel CPU · 16 GB | Runs slowly | est. 19.5 tok/s15.6–23.4calibrated estimate ±20% | Q4_K_M | 1.3 GB RAM | CPU only | up to 64k |
| — |
Cheapest GPUs that run it
- Runs greatGeForce RTX 3060 12GB$250 street (as of 2026-08-09), est. 191.9 tok/s (168.9–214.9, calibrated estimate ±12%).
Measured results for EXAONE 4.0 1.2B
No public measurements for this model yet.
Frequently asked questions
How much VRAM does EXAONE 4.0 1.2B need?
At Q4_K_M the weights are 0.81 GB; with 8k context the total is about 1.9 GB (KV cache 0.5 GB, compute buffer 0.6 GB). The smallest tracked file (IQ4_XS) needs about 1.8 GB.
What is the cheapest GPU that runs EXAONE 4.0 1.2B well?
Cheapest that runs it great: GeForce RTX 3060 12GB at $250 (street price as of 2026-08-09), est. 191.9 tok/s (168.9–214.9, calibrated estimate ±12%).
Can EXAONE 4.0 1.2B run on an 8 GB, 16 GB or 24 GB GPU?
At Q4_K_M with 8k context: GeForce RTX 4060 — Runs great, est. 145.0 tok/s (127.6–162.4, calibrated estimate ±12%); GeForce RTX 5060 Ti 16GB — Runs great, est. 238.8 tok/s (210.1–267.4, calibrated estimate ±12%); GeForce RTX 3090 — Runs great, est. 498.9 tok/s (439.0–558.8, calibrated estimate ±12%).
Speeds are estimates from memory bandwidth, calibrated against public benchmarks, and each one comes with an error band and a confidence label. Real results vary with drivers, backend, context length and thermals.