Week 7 Part II · Training Infrastructure
Overfitting; dropout, weight decay, early stopping; basic data augmentation.
Curated, free, canonical references for this week: a course or lecture, a book chapter, a video, and an authoritative blog post or official tutorial. Each opens in a new tab.
Dedicated sections on L2/L1 regularization and dropout, plus train/val/test discipline.
Covers overfitting, weight decay, dropout, early stopping, and augmentation as one toolkit (free PDF).
Intuitive introduction to L2/weight-decay regularization and the bias-variance trade-off.
A runnable tutorial explaining dropout, with both a from-scratch and an nn.Dropout version.