Topics

• Fundamentals of Artificial Neural Networks

• PyTorch for Deep Learning

• Large Language Models

PDF Notes

Session4_Slides.pdf

Jupyter Notebooks

session4_deeplearning.ipynb

References

• PyTorch.
• Dive into Deep Learning, Interactive deep learning book with code, math, and discussions, Aston Zhang and Zachary C. Lipton and Mu Li and Alexander J. Smola, 2020,
• Deep learning, Yoshua Bengio, Ian Goodfellow, and Aaron Courville, MIT press, 2017,
• nanoGPT. Small scale implementation to train GPT-like language models.