LLM Inference Engineering Quiz

Test your understanding of prefill versus decode bottlenecks, the KV cache size formula, the effect of grouped-query attention, PagedAttention, continuous batching, chunked prefill, speculative-decoding acceptance math, prefill/decode disaggregation, goodput, autoscaling signals, tensor and pipeline parallelism for serving, and prefix caching.

Start quiz