Every local LLM on CanRun
58 open-weight models with GGUF files, from 1.08B to 320B parameters. Pick one to see how much memory it needs at each quant and context length, and how it runs on 56 GPUs, Macs and PCs.
All models
The memory column is for loading the whole model on one graphics card. To see what runs on your own PC, Mac or laptop, use the calculator. Check my PC in the calculator · Browse GPUs, Macs and PCs
Popular first follows a five-level score CanRun gives each model, so it can differ from the downloads column. Pick “Most downloaded” to sort by downloads alone.
Scroll sideways to see every column.
| Model | Hugging Face org | Parameters | Memory needed (Q4_K_M, 8k) | Released | Thinking mode | License | Max context | Downloads (30 days) |
|---|---|---|---|---|---|---|---|---|
| Gemma 4 26B-A4B | 26.54B (MoE, 4B active) | 17.7 GB | 2026-03-11 | Off by default | OpenApache-2.0 | 256k | 9.79M | |
| Qwen3 14B | Qwen | 14.8B | 10.5 GB | 2025-04-29 | On by default | OpenApache-2.0 | 32k | 9.03M |
| Gemma 4 31B | 31.27B | 19.5 GB | 2026-03-11 | Off by default | OpenApache-2.0 | 256k | 8.83M | |
| Qwen3 8B | Qwen | 8.2B | 6.5 GB | 2025-04-29 | On by default | OpenApache-2.0 | 32k | 8.58M |
| Qwen3.5 4B | Qwen | 4.66B | 3.6 GB | 2026-02-27 | On by default | OpenApache-2.0 | 256k | 7.79M |
| Qwen3.8 27B | Qwen | 27.78B | 17.6 GB | 2026-08-05 | On by default | OpenApache-2.0 | 256k | 7.73M |
| Qwen3.5 9B | Qwen | 9.65B | 6.0 GB | 2026-02-27 | On by default | OpenApache-2.0 | 256k | 7.05M |
| GLM-5.3 Flash | Z.ai | 320B (MoE, 18B active) | 181.4 GB | 2026-08-25 | Always on | OpenMIT | 1M | 6.53M |
| gpt-oss-20b | OpenAI | 20.9B (MoE, 3.6B active) | 12.3 GB (MXFP4) | 2025-08-05 | Always on | OpenApache-2.0 | 128k | 5.89M |
| Llama 3.1 8B | Meta Llama | 8.03B | 6.3 GB | 2024-07-23 | — | Custom termsLlama 3.1 | 128k | 5.26M |
| Gemma 4 E4B | 8B | 3.7 GB | 2026-03-02 | Off by default | OpenApache-2.0 | 128k | 4.08M | |
| Qwen3.6 35B-A3B | Qwen | 35.95B (MoE, 3B active) | 21.8 GB | 2026-04-15 | On by default | OpenApache-2.0 | 256k | 3.68M |
| gpt-oss-120b | OpenAI | 116.8B (MoE, 5.1B active) | 63.6 GB (MXFP4) | 2025-08-05 | Always on | OpenApache-2.0 | 128k | 3.07M |
| Gemma 4 E2B | 5.12B | 2.1 GB | 2026-03-02 | Off by default | OpenApache-2.0 | 128k | 2.85M | |
| Qwen3.5 35B-A3B | Qwen | 35.95B (MoE, 3B active) | 22.3 GB | 2026-02-24 | On by default | OpenApache-2.0 | 256k | 1.42M |
| Qwen3 30B-A3B (2507) | Qwen | 30.5B (MoE, 3.3B active) | 19.8 GB | 2025-07-31 | — | OpenApache-2.0 | 256k | 1.09M |
| DeepSeek V4 Flash 0731 | DeepSeek | 284.33B (MoE, 13.8B active) | 155.1 GB (MXFP4) | 2026-07-31 | On by default | OpenMIT | 1M | 4.24M |
| Qwen3 32B | Qwen | 32.8B | 22.0 GB | 2025-04-29 | On by default | OpenApache-2.0 | 32k | 2.84M |
| Qwen3.6 27B | Qwen | 27.78B | 17.2 GB | 2026-04-21 | On by default | OpenApache-2.0 | 256k | 2.35M |
| Qwen3.5 27B | Qwen | 27.78B | 17.2 GB | 2026-02-24 | On by default | OpenApache-2.0 | 256k | 1.72M |
| Gemma 4 12B | 11.96B | 7.8 GB | 2026-05-23 | Off by default | OpenApache-2.0 | 256k | 1.71M | |
| Llama 3.2 3B | Meta Llama | 3.21B | 3.5 GB | 2024-09-25 | — | Custom termsLlama 3.2 | 128k | 1.11M |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | 8.19B | 6.5 GB | 2025-05-29 | Always on | OpenMIT | 128k | 405K |
| Gemma 3 27B | 27.4B | 17.8 GB | 2025-03-12 | — | Custom termsGemma | 128k | 371K | |
| Phi-4 | Microsoft | 14.7B | 11.0 GB | 2024-12-12 | — | OpenMIT | 16k | 370K |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | 32.8B | 22.1 GB | 2025-01-20 | Always on | OpenMIT | 128k | 360K |
| Gemma 3 12B | 12.2B | 8.4 GB | 2025-03-12 | — | Custom termsGemma | 128k | 352K | |
| Llama 3.3 70B | Meta Llama | 70.6B | 45.2 GB | 2024-12-06 | — | Custom termsLlama 3.3 | 128k | 227K |
| Muse Glimmer 30B | Meta Inc. | 29.78B | 17.2 GB | 2026-08-09 | Always on | OpenApache-2.0 | 128k | 216K |
| Mistral Small 3.2 24B | Mistral AI | 23.6B | 15.9 GB | 2025-06-20 | — | OpenApache-2.0 | 128k | 200K |
| EXAONE 4.5 33BKorean model | LG AI Research | 34.35B | 20.4 GB | 2026-04-04 | On by default | Non-commercialEXAONE AI Model License 1.2 NC | 256k | 41K |
| Llama 3.2 1B | Meta Llama | 1.24B | 1.6 GB | 2024-09-25 | — | Custom termsLlama 3.2 | 128k | 4.63M |
| MiniCPM5 2B | OpenBMB | 2.52B | 2.3 GB | 2026-09-06 | Model decides | OpenApache-2.0 | 128k | 1.32M |
| Qwen3.5 122B-A10B | Qwen | 125.09B (MoE, 10B active) | 76.6 GB | 2026-02-24 | On by default | OpenApache-2.0 | 256k | 722K |
| Nemotron 3.5 Lightning 30B-A3B | NVIDIA | 31.58B (MoE, 3B active) | 25.1 GB | 2026-08-01 | On by default | OpenOpenMDW-1.1 | 256k | 719K |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | 14.77B | 10.7 GB | 2025-01-20 | Always on | OpenMIT | 128k | 320K |
| DeepSeek R1 Distill Llama 8B | DeepSeek | 8.03B | 6.3 GB | 2025-01-20 | Always on | OpenMIT | 128k | 125K |
| EXAONE 4.0 32BKorean model | LG AI Research | 32B | 20.2 GB | 2025-07-11 | Off by default | Non-commercialEXAONE AI Model License 1.2 NC | 128k | 23.6K |
| HyperCLOVA X SEED Think 14BKorean model | HyperCLOVA X | 14.75B | 10.4 GB | 2025-07-21 | Model decides | Custom termsHyperCLOVA X SEED | 128k | 22.4K |
| Solar Open 100BKorean model | Upstage | 102.65B (MoE, 12B active) | 64.0 GB | 2025-12-10 | On by default | Custom termsUpstage Solar License | 128k | 9,372 |
| Solar Open 2 250BKorean model | Upstage | 250.29B (MoE, 15B active) | 136.5 GB (IQ4_XS) | 2026-07-22 | On by default | Custom termsUpstage Solar License | 1M | 7,855 |
| Kanana 1.5 8BKorean model | Kakao Corp. | 8.03B | 6.3 GB | 2025-05-21 | — | OpenApache-2.0 | 32k | 6,909 |
| HyperCLOVA X SEED 1.5BKorean model | HyperCLOVA X | 1.59B | 2.4 GB | 2025-04-22 | — | Custom termsHyperCLOVA X SEED | 16k | 1,176 |
| Laguna S 2.1 | Poolside | 117.56B (MoE, 8B active) | 68.5 GB | 2026-07-13 | On by default | OpenOpenMDW-1.1 | 1M | 386K |
| MiniCPM5 1B | OpenBMB | 1.08B | 1.3 GB | 2026-05-21 | Model decides | OpenApache-2.0 | 128k | 353K |
| MiniCPM-V 4.7 35B-A3B | OpenBMB | 35.21B (MoE, 3B active) | 21.6 GB | 2026-10-07 | On by default | OpenApache-2.0 | 256k | 120K |
| Nanbeige4.2 3B | Nanbeige LLM Lab | 4.17B | 4.4 GB | 2026-07-21 | On by default | OpenApache-2.0 | 256k | 120K |
| LFM2.5 2.6B | Liquid AI | 2.7B | 2.4 GB | 2026-07-28 | Always on | Custom termsLFM Open License 1.0 | 128k | 102K |
| K2-Horizon 7B | Institute of Foundation Models | 9B | 6.8 GB | 2026-09-01 | Always on | OpenApache-2.0 | 512k | 86.8K |
| Granite 4.2 30B | IBM Granite | 29.28B | 20.2 GB | 2026-08-07 | On by default | OpenApache-2.0 | 128k | 39.5K |
| Spark-X2.5 4B | SparkLLM | 4.11B | 3.5 GB | 2026-08-24 | On by default | OpenApache-2.0 | 1M | 36.9K |
| Kolibri 1 | Aleph Alpha | 78.1B (MoE, 3.46B active) | 50.2 GB | 2026-10-02 | On by default | OpenApache-2.0 | 256k | 21.3K |
| EXAONE 4.0 1.2BKorean model | LG AI Research | 1.28B | 1.9 GB | 2025-07-11 | Off by default | Non-commercialEXAONE AI Model License 1.2 NC | 64k | 15.3K |
| Mellum2.1 12B-A2.5B Thinking | JetBrains | 12.15B (MoE, 2.5B active) | 8.6 GB | 2026-09-20 | On by default | OpenApache-2.0 | 128k | 4,901 |
| Kanana 1.5 15.7B-A3BKorean model | Kakao Corp. | 15.7B (MoE, 3B active) | 11.9 GB | 2025-07-23 | — | Custom termsKanana License | 32k | 518 |
| K2-Horizon MoVA 36B-A4B | Institute of Foundation Models | 37.44B (MoE, 4B active) | 24.2 GB | 2026-09-01 | Always on | OpenApache-2.0 | 512k | 11.2K |
| Ling-3.0 Tiny | inclusionAI | 7.89B (MoE, 1.3B active) | 5.3 GB | 2026-08-10 | On by default | OpenMIT | 128k | 11.1K |
| Ling-3.0 Flash | inclusionAI | 127.49B (MoE, 5.1B active) | 75.4 GB | 2026-08-02 | On by default | OpenMIT | 256k | 10.4K |
How to read this list
- Hugging Face org: the organization that publishes the original weights, under the name it uses on Hugging Face. Some of these are brand names rather than company names.
- Parameters: the total count. Mixture-of-experts (MoE) models also show their active count. The whole model has to fit in memory, but each token reads only the active part, so an MoE model usually generates faster than a dense model of the same total size. The size filter groups MoE models by their total.
- Memory needed: graphics card memory for the Q4_K_M file with 8k context. Models without a Q4_K_M file use the closest quant, named in brackets. It adds up the weights, the KV cache and the compute buffer, the same calculation as the memory table on each model page. Add about 0.6 GB if the GPU also drives your display on Windows.
- Released: the date the original repository was created on Hugging Face. A repository prepared privately can predate the public release.
- Thinking mode: the model writes out its reasoning before it answers. That costs extra tokens, so its verdicts use speed thresholds 1.5× stricter. “Always on” models always think, “On by default” and “Off by default” models can be switched, and “Model decides” models choose for themselves.
- License: Open means a permissive license such as Apache-2.0 or MIT. Custom terms means the maker’s own license, so read it before commercial use. Non-commercial licenses do not allow commercial use.
- Downloads: Hugging Face downloads of the original repository over the last 30 days, as of October 21, 2026. Downloads of GGUF copies are not counted, so the number can understate how widely a model is used.
- Popular first follows a five-level score CanRun gives each model, weighing downloads together with how widely it is used in Korea. Models with the same score are ordered by downloads.