Quiz: The Importance of Good Gradients

Most neural networks are trained using gradient descent. As such, the gradients of a neural network being good is extremely important. This quiz walks you through reasoning about the goodness of gradients, and the different ways things can go wrong.

The quiz questions should take less than a minute each. There is a time limit of 10 minutes per question just to make things more fun. Enjoy!