Math

All of these subjects are incredibly interesting on their own merits and the topics I recommend learning for each subject barely scratch their respect surfaces. What is here feels sufficient to me in terms of getting a solid intuitive grasp of neural networks, but you'll definitely want to go deeper using more comprehensive resources if you end up falling in love with deep learning.