Sequence Models: From RNNs to Attention Quiz

Test your understanding of backpropagation through time, vanishing gradients, LSTM gates and parameter counts, the seq2seq bottleneck, query/key/value attention, why Transformers won and what they cost, padding and masking, exposure bias and decoding strategies.

Start quiz