These are some of the very recent and fairly advanced works in some of the leading research areas in theoretical deep learning.  For some of the more introductory and application oriented resources check out our Computer Vision summer school

Resources on Theoretical Deep Learning

Deep Learning Theory, Talks, Tutorials, Blogs and Courses