Training Deep Networks: Optimizers, Schedules & Regularization Quiz

Test your understanding of momentum, Adam and AdamW, learning-rate warmup and scaling, BatchNorm and pre-norm, dropout, gradient clipping, regularization and loss-curve diagnosis.

Start quiz