Plans for week 40

Plans for week 40

• Work on project 1 and discussions on how to structure your report
• No weekly exercises for week 40, project work only
• Video on how to write scientific reports recorded during one of the lab sessions
• A general guideline can be found at https://github.com/CompPhysics/MachineLearning/blob/master/doc/Projects/EvaluationGrading/EvaluationForm.md.
• Lecture October 5

• Stochastic Gradient descent with examples and automatic differentiation
• Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.
• Readings and Videos:
  • These lecture notes
  • For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well.
  • Aurelien Geron's chapter 4 on stochastic gradient descent
  • For neural networks we recommend Goodfellow et al chapter 6.
  • Video on gradient descent
  • Video on stochastic gradient descent
  • Neural Networks demystified
  • Building Neural Networks from scratch