Topic
vllm
3 articles
vllmgpuAug 18, 2026
Running a big LLM across multiple GPUs with vLLM
A plain-English guide to serving a model too big for one GPU, in two tracks: a runbook from download to serving with every flag and error explained, and a deep dive into how tensor, pipeline, and expert parallelism split the model, with measured numbers from a 235B model on four RTX PRO 6000 cards.
local-aillmAug 18, 2026
The Local LLM Glossary: Every Term, Flag, and Number in Plain English
Plain-English definitions for every term you hit in local LLM posts: prefill and decode, tokens per second, FP8 and NVFP4, Q4_K_M, KV cache, YaRN, Gated DeltaNet, speculative decoding, and every vLLM, llama.cpp, and Ollama flag worth knowing.
qwendgxsparkAug 17, 2026
Running Qwen3.8-27B on DGX Spark
Qwen3.8-27B on DGX Spark with llama.cpp, Ollama, vLLM, and SGLang: the recipes, the tokens per second I measured, MTP speculative decoding, and the sharp edges I hit along the way.