https://canrunllm.com/guides Guides to running local LLMs on your own PC or Mac. en Wed, 30 Sep 2026 00:00:00 GMT https://canrunllm.com/guides/vram-requirementshttps://canrunllm.com/guides/vram-requirementsWhat fits on 8, 12, 16, 24 and 32 GB graphics cards: the memory formula, model-by-model verdicts, and how context length and quantization change the answer.Wed, 30 Sep 2026 00:00:00 GMT https://canrunllm.com/guides/ollama-context-lengthhttps://canrunllm.com/guides/ollama-context-lengthWhy Ollama trims long conversations or slows down: its default context length by VRAM tier, how to raise it, and what a longer context costs in memory.Wed, 30 Sep 2026 00:00:00 GMT https://canrunllm.com/guides/gguf-quantizationhttps://canrunllm.com/guides/gguf-quantizationWhat each GGUF quant level costs in gigabytes, how we group them by quality, and when dropping one level turns a model that does not fit into one that runs.Wed, 30 Sep 2026 00:00:00 GMT https://canrunllm.com/guides/korean-open-llmshttps://canrunllm.com/guides/korean-open-llmsSpecs, licenses and what it takes to run LG EXAONE, Kakao Kanana, NAVER HyperCLOVA X SEED and Upstage Solar locally, with verdicts on common GPUs and Macs.Wed, 30 Sep 2026 00:00:00 GMT https://canrunllm.com/guides/mac-local-llmhttps://canrunllm.com/guides/mac-local-llmHow much of a Mac’s unified memory a local model can use, which M4 and M5 configurations fit which models, and why memory bandwidth sets the speed.Wed, 30 Sep 2026 00:00:00 GMT https://canrunllm.com/guides/kv-cache-contexthttps://canrunllm.com/guides/kv-cache-contextWhy a longer context needs more memory, how much each model’s KV cache costs per token, and what q8_0 and q4_0 KV cache quantization buy you.Wed, 30 Sep 2026 00:00:00 GMT