External Resources

Overview:

• Grant Sanderson (3Blue1Brown)’s “But What is a Neural Network?” - Beatiful animations/visuals for picturing what a basic Neural Network does/looks like. Also gives some intuition of the importance of explainability/building up NNs from explainable features

Gradients and Gradient Descent

• “Gradient Descent” - Good introductory page for learning rate, and a brief look at batch/stochastic GD
• Grant Sanderson (3Blue1Brown)’s “Gradient Descent, how Neural Networks Learn”
• Differentiation with respect to a vector - Calculating gradients
• Tensorflow Playground - play with neural networks with varying numbers of layers and with different activation functions