Join free to take this lesson
Anyone can look around, but taking a lesson needs a free account. With one, your answers are checked step by step and your progress is saved, so you can stop and pick up where you left off on any device.
10 steps ยท about 18 min
By the end you can
- Carry out a gradient-descent step $\theta \leftarrow \theta - \eta L'(\theta)$
- Find how large the step size can be before gradient descent diverges
- Compute a small network's output and count its parameters
Who it is for: You know derivatives and the chain rule (lessons 2.2-2.4) and partial derivatives (lesson 4.2).
The steps
- Too big a step
- Gradient descent
- One step
- Fitting a weight
- The largest safe step
- A neural network
- Run a tiny network
- Count the parameters
- Reading a loss curve
- Why the chain rule matters
Discussion 0 comments
Log in to join the discussion.