CanRun

Every local LLM on CanRun

58 open-weight models with GGUF files, from 1.08B to 320B parameters. Pick one to see how much memory it needs at each quant and context length, and how it runs on 56 GPUs, Macs and PCs.

All models

The memory column is for loading the whole model on one graphics card. To see what runs on your own PC, Mac or laptop, use the calculator. Check my PC in the calculator · Browse GPUs, Macs and PCs

Popular first follows a five-level score CanRun gives each model, so it can differ from the downloads column. Pick “Most downloaded” to sort by downloads alone.

Show only

Scroll sideways to see every column.

58 models with their size, memory needed, license and context length
ModelHugging Face orgParametersMemory needed (Q4_K_M, 8k)ReleasedThinking modeLicenseMax contextDownloads (30 days)
Gemma 4 26B-A4BGoogle26.54B (MoE, 4B active)17.7 GB2026-03-11Off by defaultOpenApache-2.0256k9.79M
Qwen3 14BQwen14.8B10.5 GB2025-04-29On by defaultOpenApache-2.032k9.03M
Gemma 4 31BGoogle31.27B19.5 GB2026-03-11Off by defaultOpenApache-2.0256k8.83M
Qwen3 8BQwen8.2B6.5 GB2025-04-29On by defaultOpenApache-2.032k8.58M
Qwen3.5 4BQwen4.66B3.6 GB2026-02-27On by defaultOpenApache-2.0256k7.79M
Qwen3.8 27BQwen27.78B17.6 GB2026-08-05On by defaultOpenApache-2.0256k7.73M
Qwen3.5 9BQwen9.65B6.0 GB2026-02-27On by defaultOpenApache-2.0256k7.05M
GLM-5.3 FlashZ.ai320B (MoE, 18B active)181.4 GB2026-08-25Always onOpenMIT1M6.53M
gpt-oss-20bOpenAI20.9B (MoE, 3.6B active)12.3 GB (MXFP4)2025-08-05Always onOpenApache-2.0128k5.89M
Llama 3.1 8BMeta Llama8.03B6.3 GB2024-07-23—Custom termsLlama 3.1128k5.26M
Gemma 4 E4BGoogle8B3.7 GB2026-03-02Off by defaultOpenApache-2.0128k4.08M
Qwen3.6 35B-A3BQwen35.95B (MoE, 3B active)21.8 GB2026-04-15On by defaultOpenApache-2.0256k3.68M
gpt-oss-120bOpenAI116.8B (MoE, 5.1B active)63.6 GB (MXFP4)2025-08-05Always onOpenApache-2.0128k3.07M
Gemma 4 E2BGoogle5.12B2.1 GB2026-03-02Off by defaultOpenApache-2.0128k2.85M
Qwen3.5 35B-A3BQwen35.95B (MoE, 3B active)22.3 GB2026-02-24On by defaultOpenApache-2.0256k1.42M
Qwen3 30B-A3B (2507)Qwen30.5B (MoE, 3.3B active)19.8 GB2025-07-31—OpenApache-2.0256k1.09M
DeepSeek V4 Flash 0731DeepSeek284.33B (MoE, 13.8B active)155.1 GB (MXFP4)2026-07-31On by defaultOpenMIT1M4.24M
Qwen3 32BQwen32.8B22.0 GB2025-04-29On by defaultOpenApache-2.032k2.84M
Qwen3.6 27BQwen27.78B17.2 GB2026-04-21On by defaultOpenApache-2.0256k2.35M
Qwen3.5 27BQwen27.78B17.2 GB2026-02-24On by defaultOpenApache-2.0256k1.72M
Gemma 4 12BGoogle11.96B7.8 GB2026-05-23Off by defaultOpenApache-2.0256k1.71M
Llama 3.2 3BMeta Llama3.21B3.5 GB2024-09-25—Custom termsLlama 3.2128k1.11M
DeepSeek R1 0528 Qwen3 8BDeepSeek8.19B6.5 GB2025-05-29Always onOpenMIT128k405K
Gemma 3 27BGoogle27.4B17.8 GB2025-03-12—Custom termsGemma128k371K
Phi-4Microsoft14.7B11.0 GB2024-12-12—OpenMIT16k370K
DeepSeek R1 Distill Qwen 32BDeepSeek32.8B22.1 GB2025-01-20Always onOpenMIT128k360K
Gemma 3 12BGoogle12.2B8.4 GB2025-03-12—Custom termsGemma128k352K
Llama 3.3 70BMeta Llama70.6B45.2 GB2024-12-06—Custom termsLlama 3.3128k227K
Muse Glimmer 30BMeta Inc.29.78B17.2 GB2026-08-09Always onOpenApache-2.0128k216K
Mistral Small 3.2 24BMistral AI23.6B15.9 GB2025-06-20—OpenApache-2.0128k200K
EXAONE 4.5 33BKorean modelLG AI Research34.35B20.4 GB2026-04-04On by defaultNon-commercialEXAONE AI Model License 1.2 NC256k41K
Llama 3.2 1BMeta Llama1.24B1.6 GB2024-09-25—Custom termsLlama 3.2128k4.63M
MiniCPM5 2BOpenBMB2.52B2.3 GB2026-09-06Model decidesOpenApache-2.0128k1.32M
Qwen3.5 122B-A10BQwen125.09B (MoE, 10B active)76.6 GB2026-02-24On by defaultOpenApache-2.0256k722K
Nemotron 3.5 Lightning 30B-A3BNVIDIA31.58B (MoE, 3B active)25.1 GB2026-08-01On by defaultOpenOpenMDW-1.1256k719K
DeepSeek R1 Distill Qwen 14BDeepSeek14.77B10.7 GB2025-01-20Always onOpenMIT128k320K
DeepSeek R1 Distill Llama 8BDeepSeek8.03B6.3 GB2025-01-20Always onOpenMIT128k125K
EXAONE 4.0 32BKorean modelLG AI Research32B20.2 GB2025-07-11Off by defaultNon-commercialEXAONE AI Model License 1.2 NC128k23.6K
HyperCLOVA X SEED Think 14BKorean modelHyperCLOVA X14.75B10.4 GB2025-07-21Model decidesCustom termsHyperCLOVA X SEED128k22.4K
Solar Open 100BKorean modelUpstage102.65B (MoE, 12B active)64.0 GB2025-12-10On by defaultCustom termsUpstage Solar License128k9,372
Solar Open 2 250BKorean modelUpstage250.29B (MoE, 15B active)136.5 GB (IQ4_XS)2026-07-22On by defaultCustom termsUpstage Solar License1M7,855
Kanana 1.5 8BKorean modelKakao Corp.8.03B6.3 GB2025-05-21—OpenApache-2.032k6,909
HyperCLOVA X SEED 1.5BKorean modelHyperCLOVA X1.59B2.4 GB2025-04-22—Custom termsHyperCLOVA X SEED16k1,176
Laguna S 2.1Poolside117.56B (MoE, 8B active)68.5 GB2026-07-13On by defaultOpenOpenMDW-1.11M386K
MiniCPM5 1BOpenBMB1.08B1.3 GB2026-05-21Model decidesOpenApache-2.0128k353K
MiniCPM-V 4.7 35B-A3BOpenBMB35.21B (MoE, 3B active)21.6 GB2026-10-07On by defaultOpenApache-2.0256k120K
Nanbeige4.2 3BNanbeige LLM Lab4.17B4.4 GB2026-07-21On by defaultOpenApache-2.0256k120K
LFM2.5 2.6BLiquid AI2.7B2.4 GB2026-07-28Always onCustom termsLFM Open License 1.0128k102K
K2-Horizon 7BInstitute of Foundation Models9B6.8 GB2026-09-01Always onOpenApache-2.0512k86.8K
Granite 4.2 30BIBM Granite29.28B20.2 GB2026-08-07On by defaultOpenApache-2.0128k39.5K
Spark-X2.5 4BSparkLLM4.11B3.5 GB2026-08-24On by defaultOpenApache-2.01M36.9K
Kolibri 1Aleph Alpha78.1B (MoE, 3.46B active)50.2 GB2026-10-02On by defaultOpenApache-2.0256k21.3K
EXAONE 4.0 1.2BKorean modelLG AI Research1.28B1.9 GB2025-07-11Off by defaultNon-commercialEXAONE AI Model License 1.2 NC64k15.3K
Mellum2.1 12B-A2.5B ThinkingJetBrains12.15B (MoE, 2.5B active)8.6 GB2026-09-20On by defaultOpenApache-2.0128k4,901
Kanana 1.5 15.7B-A3BKorean modelKakao Corp.15.7B (MoE, 3B active)11.9 GB2025-07-23—Custom termsKanana License32k518
K2-Horizon MoVA 36B-A4BInstitute of Foundation Models37.44B (MoE, 4B active)24.2 GB2026-09-01Always onOpenApache-2.0512k11.2K
Ling-3.0 TinyinclusionAI7.89B (MoE, 1.3B active)5.3 GB2026-08-10On by defaultOpenMIT128k11.1K
Ling-3.0 FlashinclusionAI127.49B (MoE, 5.1B active)75.4 GB2026-08-02On by defaultOpenMIT256k10.4K

How to read this list

  • Hugging Face org: the organization that publishes the original weights, under the name it uses on Hugging Face. Some of these are brand names rather than company names.
  • Parameters: the total count. Mixture-of-experts (MoE) models also show their active count. The whole model has to fit in memory, but each token reads only the active part, so an MoE model usually generates faster than a dense model of the same total size. The size filter groups MoE models by their total.
  • Memory needed: graphics card memory for the Q4_K_M file with 8k context. Models without a Q4_K_M file use the closest quant, named in brackets. It adds up the weights, the KV cache and the compute buffer, the same calculation as the memory table on each model page. Add about 0.6 GB if the GPU also drives your display on Windows.
  • Released: the date the original repository was created on Hugging Face. A repository prepared privately can predate the public release.
  • Thinking mode: the model writes out its reasoning before it answers. That costs extra tokens, so its verdicts use speed thresholds 1.5× stricter. “Always on” models always think, “On by default” and “Off by default” models can be switched, and “Model decides” models choose for themselves.
  • License: Open means a permissive license such as Apache-2.0 or MIT. Custom terms means the maker’s own license, so read it before commercial use. Non-commercial licenses do not allow commercial use.
  • Downloads: Hugging Face downloads of the original repository over the last 30 days, as of October 21, 2026. Downloads of GGUF copies are not counted, so the number can understate how widely a model is used.
  • Popular first follows a five-level score CanRun gives each model, weighing downloads together with how widely it is used in Korea. Models with the same score are ordered by downloads.