Week 10 Part III · Architectures & Representation Learning
Sequence data and recurrence; the RNN cell; backpropagation through time; vanishing and exploding gradients.
Curated, free, canonical references for this week: a course or lecture, a book chapter, a video, and an authoritative blog post or official tutorial. Each opens in a new tab.
Its Language Models and RNNs lecture covers recurrence and the vanishing-gradient problem.
Derives BPTT by unrolling the RNN graph and shows how vanishing/exploding gradients arise.
Accessible lecture introducing sequence data, the RNN cell, recurrence, and BPTT.
Classic post building intuition for what RNNs learn via character-level language models.