Ling-3.0 Tiny hardware requirements
What is Ling-3.0 Tiny?
Ling-3.0 Tiny is a small mixture-of-experts model that inclusionAI, Ant Group's AGI initiative, released in August 2026. It has 7.9B parameters in total, activates 1.3B per token and is built for local use, covering agent tasks, coding, math and science reasoning. Thinking is on by default and can be turned off per request, and the license is MIT.
About the model
- Parameters
- 7.89B total · 1.3B active (MoE)
- Attention
- Hybrid attention (only some layers use full attention)
- Max context
- 131,072 tokens
- Released
- 2026-08-10
- Model card
- Ling-3.0 Tiny on Hugging Face
Other sizes in this series
| Model | Parameters | Baseline quant | Memory needed (8k) | GeForce RTX 4060 | GeForce RTX 5060 Ti 16GB | GeForce RTX 3090 |
|---|---|---|---|---|---|---|
| Ling-3.0 Tinythis model | 7.89B total · 1.3B active (MoE) | Q4_K_M | 5.3 GB | Runs great | Runs great | Runs great |
| Ling-3.0 Flash | 127.49B total · 5.1B active (MoE) | Q4_K_M | 75.4 GB | Won't run | Won't run | Won't run |
GGUF files
| Quant | File size | Quality | Published by |
|---|---|---|---|
| Q4_K_Mbaseline | 4.82 GB | Good balance | Official GGUF · inclusionAI |
| Q8_0 | 8.41 GB | Near-lossless | Official GGUF · inclusionAI |
Memory needed by quant and context
| Quant | 4k | 8k | 16k | 32k | 64k | 128k |
|---|---|---|---|---|---|---|
| Q4_K_M | 5.2 | 5.3 | 5.4 | 5.7 | 6.2 | 7.3 |
| Q8_0 | 8.7 | 8.8 | 8.9 | 9.2 | 9.7 | 10.8 |
Which GPUs can run Ling-3.0 Tiny?
How to read the verdicts
- Runs great
- Fully on the GPU at 20 tok/s or more
- Runs well
- Fully on the GPU at 8–20 tok/s; MoE experts in system RAM at 20 tok/s or more; or at least 90% on the GPU at 8 tok/s or more
- Runs slowly
- 2–8 tok/s; CPU-only; less than 90% on the GPU; or MoE experts in system RAM below 20 tok/s
- Won't run
- Does not fit, or under 2 tok/s
Filter this list by budget, type and context in the calculator
Scroll sideways to see every column.
| Hardware | Verdict | Speed | Quant | Memory | Runs as | Context | Notes | Price |
|---|---|---|---|---|---|---|---|---|
| GeForce RTX 5090 | Runs great | est. 485.1 tok/s339.6–630.7theoretical estimate ±30% | Q4_K_M | 5.9 / 32.0 GB | Full GPU | up to 128k | — | $4,200 street (as of 2026-08-09) |
| GeForce RTX 3090 Ti | Runs great | est. 390.2 tok/s273.2–507.3theoretical estimate ±30% | Q4_K_M | 5.9 / 24.0 GB | Full GPU | up to 128k | — | $1,999 launch MSRP |
| GeForce RTX 4090 | Runs great | est. 390.2 tok/s273.2–507.3theoretical estimate ±30% | Q4_K_M | 5.9 / 24.0 GB | Full GPU | up to 128k | — | $2,755 street (as of 2026-08-09) |
| GeForce RTX 5080 | Runs great | est. 381.7 tok/s267.2–496.2theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $1,256 street (as of 2026-08-09) |
| GeForce RTX 3090 | Runs great | est. 377.2 tok/s264.1–490.4theoretical estimate ±30% | Q4_K_M | 5.9 / 24.0 GB | Full GPU | up to 128k | — | $1,050 street (as of 2026-08-09) |
| GeForce RTX 3080 12GB | Runs great | est. 372.7 tok/s260.9–484.5theoretical estimate ±30% | Q4_K_M | 5.9 / 12.0 GB | Full GPU | up to 128k | — | $799 launch MSRP |
| GeForce RTX 5070 Ti | Runs great | est. 369.6 tok/s258.7–480.4theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $949 street (as of 2026-08-09) |
| GeForce RTX 5080 Laptop | Runs great | est. 369.6 tok/s258.7–480.4theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | — |
| GeForce RTX 5090 Laptop | Runs great | est. 369.6 tok/s258.7–480.4theoretical estimate ±30% | Q4_K_M | 5.9 / 24.0 GB | Full GPU | up to 128k | — | — |
| GeForce RTX 3080 10GB | Runs great | est. 340.5 tok/s238.4–442.7theoretical estimate ±30% | Q4_K_M | 5.9 / 10.0 GB | Full GPU | up to 128k | — | $699 launch MSRP |
| GeForce RTX 4080 Super | Runs great | est. 334.9 tok/s234.4–435.4theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $999 launch MSRP |
| GeForce RTX 4080 | Runs great | est. 330.3 tok/s231.2–429.4theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $1,199 launch MSRP |
| GeForce RTX 4070 Ti Super | Runs great | est. 318.9 tok/s223.2–414.6theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $799 launch MSRP |
| GeForce RTX 5070 | Runs great | est. 318.9 tok/s223.2–414.6theoretical estimate ±30% | Q4_K_M | 5.9 / 12.0 GB | Full GPU | up to 128k | — | $629 street (as of 2026-08-09) |
| GeForce RTX 5070 Ti Laptop | Runs great | est. 318.9 tok/s223.2–414.6theoretical estimate ±30% | Q4_K_M | 5.9 / 12.0 GB | Full GPU | up to 128k | — | — |
| GeForce RTX 2080 Ti | Runs great | est. 303.8 tok/s212.6–394.9theoretical estimate ±30% | Q4_K_M | 5.9 / 11.0 GB | Full GPU | up to 128k | — | $999 launch MSRP |
| GeForce RTX 4090 Laptop | Runs great | est. 292.2 tok/s204.6–379.9theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | — |
| Apple M5 Max (40-core GPU) · 48 GB | Runs great | est. 282.8 tok/s198.0–367.7theoretical estimate ±30% | Q4_K_M | 5.5 / 33.6 GB | Unified memory | up to 128k | — | — |
| GeForce RTX 4070 | Runs great | est. 269.7 tok/s188.8–350.5theoretical estimate ±30% | Q4_K_M | 5.9 / 12.0 GB | Full GPU | up to 128k | — | $599 launch MSRP |
| GeForce RTX 4070 Super | Runs great | est. 269.7 tok/s188.8–350.5theoretical estimate ±30% | Q4_K_M | 5.9 / 12.0 GB | Full GPU | up to 128k | — | $599 launch MSRP |
| Apple M4 Max (40-core GPU) · 48 GB | Runs great | est. 266.6 tok/s186.6–346.5theoretical estimate ±30% | Q4_K_M | 5.5 / 33.6 GB | Unified memory | up to 128k | — | — |
| Apple M5 Ultra · 96 GB | Runs great | est. 264.1 tok/s184.9–343.3theoretical estimate ±30% | Q4_K_M | 5.5 / 67.2 GB | Unified memory | up to 128k | — | — |
| GeForce GTX 1080 Ti | Runs great | est. 262.9 tok/s184.1–341.8theoretical estimate ±30% | Q4_K_M | 5.9 / 11.0 GB | Full GPU | up to 128k | — | $699 launch MSRP |
| Radeon RX 7900 XTX | Runs great | est. 252.5 tok/s176.8–328.3theoretical estimate ±30% | Q4_K_M | 5.9 / 24.0 GB | Full GPU | up to 128k | — | $999 launch MSRP |
| GeForce RTX 3070 | Runs great | est. 250.3 tok/s175.2–325.4theoretical estimate ±30% | Q4_K_M | 5.9 / 8.0 GB | Full GPU | up to 128k | — | $499 launch MSRP |
| GeForce RTX 5060 | Runs great | est. 250.3 tok/s175.2–325.4theoretical estimate ±30% | Q4_K_M | 5.9 / 8.0 GB | Full GPU | up to 128k | — | $339 street (as of 2026-08-09) |
| GeForce RTX 5060 Ti 16GB | Runs great | est. 250.3 tok/s175.2–325.4theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $569 street (as of 2026-08-09) |
| GeForce RTX 5060 Ti 8GB | Runs great | est. 250.3 tok/s175.2–325.4theoretical estimate ±30% | Q4_K_M | 5.9 / 8.0 GB | Full GPU | up to 128k | — | $429 street (as of 2026-08-09) |
| GeForce RTX 4080 Laptop | Runs great | est. 244.5 tok/s171.1–317.8theoretical estimate ±30% | Q4_K_M | 5.9 / 12.0 GB | Full GPU | up to 128k | — | — |
| Apple M5 Max (32-core GPU) · 36 GB | Runs great | est. 243.0 tok/s170.1–315.9theoretical estimate ±30% | Q4_K_M | 5.5 / 25.2 GB | Unified memory | up to 128k | — | — |
| Radeon RX 7900 XT | Runs great | est. 239.1 tok/s167.4–310.9theoretical estimate ±30% | Q4_K_M | 5.9 / 20.0 GB | Full GPU | up to 128k | — | $899 launch MSRP |
| Apple M3 Ultra · 96 GB | Runs great | est. 229.2 tok/s160.4–298.0theoretical estimate ±30% | Q4_K_M | 5.5 / 67.2 GB | Unified memory | up to 128k | — | — |
| Apple M4 Max (32-core GPU) · 36 GB | Runs great | est. 227.4 tok/s159.2–295.6theoretical estimate ±30% | Q4_K_M | 5.5 / 25.2 GB | Unified memory | up to 128k | — | — |
| Apple M2 Ultra · 64 GB | Runs great | est. 227.1 tok/s158.9–295.2theoretical estimate ±30% | Q4_K_M | 5.5 / 44.8 GB | Unified memory | up to 128k | — | — |
| Radeon RX 9070 | Runs great | est. 222.2 tok/s155.5–288.8theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $639 street (as of 2026-08-09) |
| Radeon RX 9070 XT | Runs great | est. 222.2 tok/s155.5–288.8theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $689 street (as of 2026-08-09) |
| Radeon RX 7800 XT | Runs great | est. 219.5 tok/s153.6–285.3theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $499 launch MSRP |
| GeForce RTX 3060 12GB | Runs great | est. 216.2 tok/s151.3–281.1theoretical estimate ±30% | Q4_K_M | 5.9 / 12.0 GB | Full GPU | up to 128k | — | $250 street (as of 2026-08-09) |
| Apple M5 Pro · 24 GB | Runs great | est. 189.8 tok/s132.9–246.8theoretical estimate ±30% | Q4_K_M | 5.5 / 16.8 GB | Unified memory | up to 128k | — | — |
| GeForce RTX 4060 Ti 16GB | Runs great | est. 184.3 tok/s129.0–239.5theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $499 launch MSRP |
| GeForce RTX 4060 Ti 8GB | Runs great | est. 184.3 tok/s129.0–239.5theoretical estimate ±30% | Q4_K_M | 5.9 / 8.0 GB | Full GPU | up to 128k | — | $399 launch MSRP |
| NVIDIA DGX Spark · 64 GB | Runs great | est. 179.8 tok/s125.8–233.7theoretical estimate ±30% | Q4_K_M | 5.5 / 48.2 GB | Unified memory | up to 128k | — | $3,999 launch MSRP (128 GB) |
| GeForce RTX 4060 | Runs great | est. 176.6 tok/s123.6–229.6theoretical estimate ±30% | Q4_K_M | 5.9 / 8.0 GB | Full GPU | up to 128k | — | $299 launch MSRP |
| Apple M4 Pro · 24 GB | Runs great | est. 175.4 tok/s122.8–228.1theoretical estimate ±30% | Q4_K_M | 5.5 / 16.8 GB | Unified memory | up to 128k | — | — |
| Intel Arc B580 | Runs great | est. 170.7 tok/s119.5–222.0theoretical estimate ±30% | Q4_K_M | 5.9 / 12.0 GB | Full GPU | up to 128k | — | $290 street (as of 2026-08-09) |
| GeForce RTX 4060 Laptop | Runs great | est. 168.7 tok/s118.1–219.3theoretical estimate ±30% | Q4_K_M | 5.9 / 8.0 GB | Full GPU | up to 128k | — | — |
| GeForce RTX 4070 Laptop | Runs great | est. 168.7 tok/s118.1–219.3theoretical estimate ±30% | Q4_K_M | 5.9 / 8.0 GB | Full GPU | up to 128k | — | — |
| Radeon RX 9060 XT 16GB | Runs great | est. 162.4 tok/s113.7–211.2theoretical estimate ±30% | Q4_K_M | 5.9 / 16.0 GB | Full GPU | up to 128k | — | $449 street (as of 2026-08-09) |
| Ryzen AI Max+ 395 (Strix Halo) · 32 GB | Runs great | est. 154.3 tok/s108.0–200.5theoretical estimate ±30% | Q4_K_M | 5.5 / 22.4 GB | Unified memory | up to 128k | — | $1,999 launch MSRP (128 GB) |
| GeForce RTX 3050 8GB | Runs great | est. 152.1 tok/s106.5–197.8theoretical estimate ±30% | Q4_K_M | 5.9 / 8.0 GB | Full GPU | up to 128k | — | $249 launch MSRP |
| Apple M5 · 16 GB | Runs great | est. 114.6 tok/s80.2–148.9theoretical estimate ±30% | Q4_K_M | 5.5 / 11.2 GB | Unified memory | up to 128k | — | — |
| Apple M6 · 16 GB | Runs great | est. 114.6 tok/s80.2–148.9theoretical estimate ±30% | Q4_K_M | 5.5 / 11.2 GB | Unified memory | up to 128k | — | — |
| Apple M4 · 16 GB | Runs great | est. 93.7 tok/s65.6–121.9theoretical estimate ±30% | Q4_K_M | 5.5 / 11.2 GB | Unified memory | up to 128k | — | — |
| DDR5-6000 dual-channel CPU · 16 GB | Runs slowly | est. 48.5 tok/s34.0–63.1theoretical estimate ±30% | Q4_K_M | 4.9 GB RAM | CPU only | up to 128k |
| — |
| DDR5-5600 dual-channel CPU · 16 GB | Runs slowly | est. 45.3 tok/s31.7–58.9theoretical estimate ±30% | Q4_K_M | 4.9 GB RAM | CPU only | up to 128k |
| — |
| DDR4-3200 dual-channel CPU · 16 GB | Runs slowly | est. 25.9 tok/s18.1–33.6theoretical estimate ±30% | Q4_K_M | 4.9 GB RAM | CPU only | up to 128k |
| — |
Models with a thinking mode spend extra tokens thinking, so their speed thresholds are 1.5× stricter (30 / 12 / 3 tok/s). With thinking turned off, a model may do one grade better.
Cheapest GPUs that run it
- Runs greatGeForce RTX 3060 12GB$250 street (as of 2026-08-09), est. 216.2 tok/s (151.3–281.1, theoretical estimate ±30%).
Measured results for Ling-3.0 Tiny
No public measurements for this model yet.
Frequently asked questions
How much VRAM does Ling-3.0 Tiny need?
At Q4_K_M the file is 4.82 GB; with 8k context a graphics card needs about 5.3 GB (weights 4.68 GB, KV cache 0.1 GB, compute buffer 0.6 GB). Part of the file stays off the graphics card: llama.cpp keeps the input embedding table in system RAM. A Mac counts the whole file, so it needs a little more.
What is the cheapest GPU that runs Ling-3.0 Tiny well?
Cheapest that runs it great: GeForce RTX 3060 12GB at $250 (street price as of 2026-08-09), est. 216.2 tok/s (151.3–281.1, theoretical estimate ±30%).
Can Ling-3.0 Tiny run on an 8 GB, 16 GB or 24 GB GPU?
At Q4_K_M with 8k context: GeForce RTX 4060 — Runs great, est. 176.6 tok/s (123.6–229.6, theoretical estimate ±30%); GeForce RTX 5060 Ti 16GB — Runs great, est. 250.3 tok/s (175.2–325.4, theoretical estimate ±30%); GeForce RTX 3090 — Runs great, est. 377.2 tok/s (264.1–490.4, theoretical estimate ±30%).
Speeds are estimates from memory bandwidth, calibrated against public benchmarks, and each one comes with an error band and a confidence label. Real results vary with drivers, backend, context length and thermals.