Which local LLMs can the DDR5-5600 dual-channel CPU run?

No GPU — the whole model runs from system RAM

CPU-only inference with 4 GB of RAM kept for the OS, 8k context and an f16 KV cache. Verdicts are shown for each RAM size.

Specs

Memory options: 16 GB · 32 GB · 64 GB · 96 GB
Memory bandwidth: 89.6 GB/s
Launch year: 2021

Verdicts at a glance

At Q4_K_M (or the closest available quant) with 8k context.

16 GBRuns great0 modelsRuns well0 modelsRuns slowly28 modelsWon't run31 models5 more models run at a lower quant.
32 GBRuns great0 modelsRuns well0 modelsRuns slowly38 modelsWon't run21 models8 more models run at a lower quant.
64 GBRuns great0 modelsRuns well0 modelsRuns slowly39 modelsWon't run20 models10 more models run at a lower quant.
96 GBRuns great0 modelsRuns well0 modelsRuns slowly44 modelsWon't run15 models8 more models run at a lower quant.

How to read the verdicts

Runs great: Fully on the GPU at 20 tok/s or more
Runs well: Fully on the GPU at 8–20 tok/s; MoE experts in system RAM at 20 tok/s or more; or at least 90% on the GPU at 8 tok/s or more
Runs slowly: 2–8 tok/s; CPU-only; less than 90% on the GPU; or MoE experts in system RAM below 20 tok/s
Won't run: Does not fit, or under 2 tok/s

Every model on the DDR5-5600 dual-channel CPU

Scroll sideways to see every column.

59 models sorted by verdict and speed, with 96 GB of memory
Model	Verdict	Speed	Quant	Memory	Runs as	Context	Notes
MiniCPM5 1B	Runs slowly	est. 50.3 tok/s40.2–60.3calibrated estimate ±20%	Q4_K_M	0.9 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly thinking mode
Ling-3.0 Tiny	Runs slowly	est. 45.3 tok/s31.7–58.9theoretical estimate ±30%	Q4_K_M	4.9 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly thinking mode
Llama 3.2 1B	Runs slowly	est. 41.5 tok/s33.2–49.8calibrated estimate ±20%	Q4_K_M	1.1 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly
EXAONE 4.0 1.2B	Runs slowly	est. 34.1 tok/s27.3–40.9calibrated estimate ±20%	Q4_K_M	1.3 GB RAM	CPU only	up to 64k	CPU inference — capped at Runs slowly thinking mode
Gemma 4 E2B	Runs slowly	est. 28.9 tok/s20.2–37.6theoretical estimate ±30%	Q4_K_M	3.2 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly thinking mode
LFM2.5 2.6B	Runs slowly	est. 24.8 tok/s17.4–32.3theoretical estimate ±30%	Q4_K_M	1.8 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly thinking mode
HyperCLOVA X SEED 1.5B	Runs slowly	est. 24.7 tok/s19.7–29.6calibrated estimate ±20%	Q4_K_M	1.8 GB RAM	CPU only	up to 16k	CPU inference — capped at Runs slowly
MiniCPM5 2B	Runs slowly	est. 23.4 tok/s18.7–28.1calibrated estimate ±20%	Q4_K_M	1.9 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly thinking mode
Mellum2.1 12B-A2.5B Thinking	Runs slowly	est. 21.7 tok/s17.3–26.0calibrated estimate ±20%	Q4_K_M	8.2 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly thinking mode
MiniCPM-V 4.7 35B-A3B	Runs slowly	est. 19.5 tok/s15.6–23.5calibrated estimate ±20%	Q4_K_M	21.3 GB RAM	CPU only	up to 256k	CPU inference — capped at Runs slowly thinking mode
Qwen3.6 35B-A3B	Runs slowly	est. 19.0 tok/s15.2–22.8calibrated estimate ±20%	Q4_K_M	22.5 GB RAM	CPU only	up to 256k	CPU inference — capped at Runs slowly thinking mode
Qwen3.5 35B-A3B	Runs slowly	est. 18.7 tok/s15.0–22.5calibrated estimate ±20%	Q4_K_M	22.8 GB RAM	CPU only	up to 256k	CPU inference — capped at Runs slowly thinking mode
gpt-oss-20b	Runs slowly	est. 16.8 tok/s13.5–20.2calibrated estimate ±20%	MXFP4	12.3 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly thinking mode
Kolibri 1	Runs slowly	est. 16.2 tok/s13.0–19.5calibrated estimate ±20%	Q4_K_M	49.9 GB RAM	CPU only	up to 256k	CPU inference — capped at Runs slowly thinking mode
Nemotron 3.5 Lightning 30B-A3B	Runs slowly	est. 15.6 tok/s10.9–20.3theoretical estimate ±30%	Q4_K_M	25.5 GB RAM	CPU only	up to 256k	CPU inference — capped at Runs slowly thinking mode
Spark-X2.5 4B	Runs slowly	est. 15.4 tok/s12.4–18.5calibrated estimate ±20%	Q4_K_M	2.9 GB RAM	CPU only	up to 256k	CPU inference — capped at Runs slowly thinking mode
Llama 3.2 3B	Runs slowly	est. 15.1 tok/s12.1–18.2calibrated estimate ±20%	Q4_K_M	3.0 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly
Qwen3.5 4B	Runs slowly	est. 14.5 tok/s11.6–17.4calibrated estimate ±20%	Q4_K_M	3.1 GB RAM	CPU only	up to 256k	CPU inference — capped at Runs slowly thinking mode
Gemma 4 26B-A4B	Runs slowly	est. 14.2 tok/s11.3–17.0calibrated estimate ±20%	Q4_K_M	17.1 GB RAM	CPU only	up to 256k	CPU inference — capped at Runs slowly thinking mode
Gemma 4 E4B	Runs slowly	est. 14.1 tok/s9.9–18.3theoretical estimate ±30%	Q4_K_M	5.1 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly thinking mode
Qwen3 30B-A3B (2507)	Runs slowly	est. 13.7 tok/s11.0–16.4calibrated estimate ±20%	Q4_K_M	19.4 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly
Kanana 1.5 15.7B-A3B	Runs slowly	est. 12.6 tok/s10.0–15.1calibrated estimate ±20%	Q4_K_M	11.5 GB RAM	CPU only	up to 32k	CPU inference — capped at Runs slowly
gpt-oss-120b	Runs slowly	est. 12.6 tok/s10.0–15.1calibrated estimate ±20%	MXFP4	63.7 GB RAM	CPU only	up to 128k	CPU inference — capped at Runs slowly thinking mode
Ling-3.0 Flash	Runs slowly	est. 12.2 tok/s8.5–15.9theoretical estimate ±30%	Q4_K_M	77.1 GB RAM	CPU only	up to 256k	CPU inference — capped at Runs slowly thinking mode
K2-Horizon MoVA 36B-A4B	Runs slowly	est. 9.6 tok/s6.7–12.5theoretical estimate ±30%	Q4_K_M	24.0 GB RAM	CPU only	up to 32k	thinking mode
Laguna S 2.1	Runs slowly	est. 7.7 tok/s6.2–9.2calibrated estimate ±20%	Q4_K_M	68.1 GB RAM	CPU only	up to 128k	thinking mode
DeepSeek R1 Distill Llama 8B	Runs slowly	est. 7.5 tok/s6.0–9.0calibrated estimate ±20%	Q4_K_M	6.0 GB RAM	CPU only	up to 64k	thinking mode
Kanana 1.5 8B	Runs slowly	est. 7.5 tok/s6.0–9.0calibrated estimate ±20%	Q4_K_M	6.0 GB RAM	CPU only	up to 32k	—
Llama 3.1 8B	Runs slowly	est. 7.5 tok/s6.0–9.0calibrated estimate ±20%	Q4_K_M	6.0 GB RAM	CPU only	up to 128k	—
Nanbeige4.2 3B	Runs slowly	est. 7.3 tok/s5.1–9.5theoretical estimate ±30%	Q4_K_M	4.2 GB RAM	CPU only	up to 32k	thinking mode
Qwen3.5 9B	Runs slowly	est. 7.3 tok/s5.8–8.8calibrated estimate ±20%	Q4_K_M	6.1 GB RAM	CPU only	up to 256k	thinking mode
DeepSeek R1 0528 Qwen3 8B	Runs slowly	est. 7.2 tok/s5.7–8.6calibrated estimate ±20%	Q4_K_M	6.2 GB RAM	CPU only	up to 64k	thinking mode
Qwen3 8B	Runs slowly	est. 7.2 tok/s5.7–8.6calibrated estimate ±20%	Q4_K_M	6.2 GB RAM	CPU only	up to 32k	thinking mode
K2-Horizon 7B	Runs slowly	est. 6.6 tok/s5.3–7.9calibrated estimate ±20%	Q4_K_M	6.8 GB RAM	CPU only	up to 32k	thinking mode
Gemma 4 12B	Runs slowly	est. 6.2 tok/s4.9–7.4calibrated estimate ±20%	Q4_K_M	7.3 GB RAM	CPU only	up to 256k	thinking mode
Qwen3.5 122B-A10B	Runs slowly	est. 6.0 tok/s4.8–7.2calibrated estimate ±20%	Q4_K_M	78.5 GB RAM	CPU only	up to 256k	thinking mode
Gemma 3 12B	Runs slowly	est. 5.7 tok/s4.6–6.9calibrated estimate ±20%	Q4_K_M	7.8 GB RAM	CPU only	up to 128k	—
HyperCLOVA X SEED Think 14B	Runs slowly	est. 4.4 tok/s3.1–5.7theoretical estimate ±30%	Q4_K_M	10.2 GB RAM	CPU only	up to 32k	thinking mode
Solar Open 100B	Runs slowly	est. 4.3 tok/s3.5–5.2calibrated estimate ±20%	Q4_K_M	63.9 GB RAM	CPU only	up to 16k	thinking mode
Qwen3 14B	Runs slowly	est. 4.3 tok/s3.5–5.2calibrated estimate ±20%	Q4_K_M	10.3 GB RAM	CPU only	up to 32k	thinking mode
DeepSeek R1 Distill Qwen 14B	Runs slowly	est. 4.2 tok/s3.4–5.1calibrated estimate ±20%	Q4_K_M	10.6 GB RAM	CPU only	up to 16k	thinking mode
Phi-4	Runs slowly	est. 4.2 tok/s3.3–5.0calibrated estimate ±20%	Q4_K_M	10.7 GB RAM	CPU only	up to 16k	—
Mistral Small 3.2 24B	Runs slowly	est. 2.9 tok/s2.3–3.4calibrated estimate ±20%	Q4_K_M	15.7 GB RAM	CPU only	up to 32k	—
Gemma 3 27B	Runs slowly	est. 2.6 tok/s2.1–3.1calibrated estimate ±20%	Q4_K_M	17.2 GB RAM	CPU only	up to 64k	—
Muse Glimmer 30B	Won't runTry Q2_K (heavy quality loss): Runs slowly	est. 4.0 tok/s3.2–4.8calibrated estimate ±20%	Q2_K	11.1 GB RAM	CPU only	up to 128k	thinking mode
Qwen3.8 27B	Won't runTry Q2_K (heavy quality loss): Runs slowly	est. 3.9 tok/s3.2–4.7calibrated estimate ±20%	Q2_K	11.4 GB RAM	CPU only	up to 32k	thinking mode
Qwen3.6 27B	Won't runTry UD-Q2_K_XL (heavy quality loss): Runs slowly	est. 3.6 tok/s2.9–4.3calibrated estimate ±20%	UD-Q2_K_XL	12.4 GB RAM	CPU only	up to 32k	thinking mode
Gemma 4 31B	Won't runTry UD-Q2_K_XL (heavy quality loss): Runs slowly	est. 3.6 tok/s2.9–4.3calibrated estimate ±20%	UD-Q2_K_XL	12.4 GB RAM	CPU only	up to 32k	thinking mode
Qwen3.5 27B	Won't runTry UD-Q2_K_XL (heavy quality loss): Runs slowly	est. 3.6 tok/s2.8–4.3calibrated estimate ±20%	UD-Q2_K_XL	12.6 GB RAM	CPU only	up to 32k	thinking mode
Granite 4.2 30B	Won't runTry Q2_K (heavy quality loss): Runs slowly	est. 3.4 tok/s2.8–4.1calibrated estimate ±20%	Q2_K	13.0 GB RAM	CPU only	up to 8k	thinking mode
DeepSeek R1 Distill Qwen 32B	Won't runTry Q2_K (heavy quality loss): Runs slowly	est. 3.1 tok/s2.5–3.7calibrated estimate ±20%	Q2_K	14.5 GB RAM	CPU only	up to 8k	thinking mode
Qwen3 32B	Won't runTry Q2_K (heavy quality loss): Runs slowly	est. 3.1 tok/s2.5–3.7calibrated estimate ±20%	Q2_K	14.5 GB RAM	CPU only	up to 8k	thinking mode
EXAONE 4.0 32B	Won't run	est. 2.3 tok/s1.8–2.7calibrated estimate ±20%	Q4_K_M	19.9 GB RAM	CPU only	—	Fits, but too slow to use thinking mode
EXAONE 4.5 33B	Won't run	est. 2.2 tok/s1.7–2.6calibrated estimate ±20%	Q4_K_M	20.6 GB RAM	CPU only	—	Fits, but too slow to use thinking mode
Nanbeige4.3 33B	Won't run	est. 2.0 tok/s1.6–2.4calibrated estimate ±20%	Q4_K_M	22.5 GB RAM	CPU only	—	Fits, but too slow to use thinking mode
Llama 3.3 70B	Won't run	est. 1.0 tok/s0.8–1.2calibrated estimate ±20%	Q4_K_M	45.2 GB RAM	CPU only	—	Fits, but too slow to use
DeepSeek V4 Flash 0731	Won't run	—	MXFP4	needs 155.0 GB	—	—	Needs about 155.0 GB; 92.0 GB of RAM is free thinking mode
GLM-5.3 Flash	Won't run	—	Q4_K_M	needs 181.5 GB	—	—	Needs about 181.5 GB; 92.0 GB of RAM is free thinking mode
Solar Open 2 250B	Won't run	—	IQ4_XS	needs 136.6 GB	—	—	Needs about 136.6 GB; 92.0 GB of RAM is free thinking mode

Models with a thinking mode spend extra tokens thinking, so their speed thresholds are 1.5× stricter (30 / 12 / 3 tok/s). With thinking turned off, a model may do one grade better.

Verdict by memory size

Q4_K_M verdict for each memory configuration — open the model page for speeds
Model	16 GB	32 GB	64 GB	96 GB
MiniCPM5 1B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Ling-3.0 Tiny	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Llama 3.2 1B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
EXAONE 4.0 1.2B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Gemma 4 E2B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
LFM2.5 2.6B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
HyperCLOVA X SEED 1.5B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
MiniCPM5 2B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Mellum2.1 12B-A2.5B Thinking	Runs slowly	Runs slowly	Runs slowly	Runs slowly
MiniCPM-V 4.7 35B-A3B	Won't run	Runs slowly	Runs slowly	Runs slowly
Qwen3.6 35B-A3B	Won't run	Runs slowly	Runs slowly	Runs slowly
Qwen3.5 35B-A3B	Won't run	Runs slowly	Runs slowly	Runs slowly
gpt-oss-20b	Won't run	Runs slowly	Runs slowly	Runs slowly
Kolibri 1	Won't run	Won't run	Runs slowly	Runs slowly
Nemotron 3.5 Lightning 30B-A3B	Won't run	Runs slowly	Runs slowly	Runs slowly
Spark-X2.5 4B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Llama 3.2 3B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Qwen3.5 4B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Gemma 4 26B-A4B	Won't run	Runs slowly	Runs slowly	Runs slowly
Gemma 4 E4B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Qwen3 30B-A3B (2507)	Won't run	Runs slowly	Runs slowly	Runs slowly
Kanana 1.5 15.7B-A3B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
gpt-oss-120b	Won't run	Won't run	Won't run	Runs slowly
Ling-3.0 Flash	Won't run	Won't run	Won't run	Runs slowly
K2-Horizon MoVA 36B-A4B	Won't run	Runs slowly	Runs slowly	Runs slowly
Laguna S 2.1	Won't run	Won't run	Won't run	Runs slowly
DeepSeek R1 Distill Llama 8B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Kanana 1.5 8B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Llama 3.1 8B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Nanbeige4.2 3B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Qwen3.5 9B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
DeepSeek R1 0528 Qwen3 8B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Qwen3 8B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
K2-Horizon 7B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Gemma 4 12B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Qwen3.5 122B-A10B	Won't run	Won't run	Won't run	Runs slowly
Gemma 3 12B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
HyperCLOVA X SEED Think 14B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Solar Open 100B	Won't run	Won't run	Won't run	Runs slowly
Qwen3 14B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
DeepSeek R1 Distill Qwen 14B	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Phi-4	Runs slowly	Runs slowly	Runs slowly	Runs slowly
Mistral Small 3.2 24B	Won't run	Runs slowly	Runs slowly	Runs slowly
Gemma 3 27B	Won't run	Runs slowly	Runs slowly	Runs slowly
Muse Glimmer 30B	Won't run	Won't run	Won't run	Won't run
Qwen3.8 27B	Won't run	Won't run	Won't run	Won't run
Qwen3.6 27B	Won't run	Won't run	Won't run	Won't run
Gemma 4 31B	Won't run	Won't run	Won't run	Won't run
Qwen3.5 27B	Won't run	Won't run	Won't run	Won't run
Granite 4.2 30B	Won't run	Won't run	Won't run	Won't run
DeepSeek R1 Distill Qwen 32B	Won't run	Won't run	Won't run	Won't run
Qwen3 32B	Won't run	Won't run	Won't run	Won't run
EXAONE 4.0 32B	Won't run	Won't run	Won't run	Won't run
EXAONE 4.5 33B	Won't run	Won't run	Won't run	Won't run
Nanbeige4.3 33B	Won't run	Won't run	Won't run	Won't run
Llama 3.3 70B	Won't run	Won't run	Won't run	Won't run
DeepSeek V4 Flash 0731	Won't run	Won't run	Won't run	Won't run
GLM-5.3 Flash	Won't run	Won't run	Won't run	Won't run
Solar Open 2 250B	Won't run	Won't run	Won't run	Won't run

Measured results on the DDR5-5600 dual-channel CPU

Public benchmarks we calibrate against. Their conditions (context, backend, flags) can differ from the estimates above.

Measured results on the DDR5-5600 dual-channel CPU
Model	Quant	Backend	Context	Prompt (tok/s)	Generation (tok/s)	Flags	Source	Measured
mistral-7b	Q4_K_M	llamafile	512	—	11.2	—	github.com	2024-06-15

Frequently asked questions

What is the largest model this CPU setup can run?

Ling-3.0 Flash at Q4_K_M (a 77.01 GB file) runs from 96 GB of RAM at est. 12.2 tok/s (8.5–15.9, theoretical estimate ±30%).

How many local LLMs run well on the DDR5-5600 dual-channel CPU?

At Q4_K_M with 8k context, with 96 GB of memory, out of 59 tracked models: 0 run great, 0 run well, 44 run slowly and 15 won't run.

Can the DDR5-5600 dual-channel CPU run a 70B model like Llama 3.3 70B?

It fits in memory but is too slow to use: est. 1.0 tok/s (0.8–1.2, calibrated estimate ±20%).

Speeds are estimates from memory bandwidth, calibrated against public benchmarks, and each one comes with an error band and a confidence label. Real results vary with drivers, backend, context length and thermals.