Lec 20. Scaling Laws

MIT 6.7960 Deep Learning, Fall 2024 Instructor: Phillip Isola View the complete course: https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/ YouTube Playlist: https://www.youtube.com/playlist?list=PLUl4u3cNGP63URZnh5iqBzDTDYPUTQT-8 This video covers scaling laws in neural architectures, including power laws, their limitations, theoretical foundations, and the concept of critical batch size. License: Creative Commons BY-NC-SA More information at https://ocw.mit.edu/terms More courses at https://ocw.mit.edu Support OCW at http://ow.ly/a1If50zVRlQ We encourage constructive comments and discussion on OCW’s YouTube and other social media channels. Personal attacks, hate speech, trolling, and inappropriate comments are not allowed and may be removed. More details at https://ocw.mit.edu/comments.