Transformers for AI Engineers Quiz

Test your understanding of transformer internals from an AI Engineer's perspective: scaled dot-product and multi-head attention, self- vs cross-attention, decoder-only vs encoder-decoder architectures, why the KV cache exists and how it scales, what parameter count does and doesn't predict, and positional encoding including RoPE.

Start quiz