Ilya 30u30 Notes
Link to full paper list
Supposedly the papers ilya gave carmack to help him understand the industry, although who knows...
Papers Remaining
note: I have stopped this series and am implementing models from scratch in jax instead
- The Annotated Transformer
- Recurrent Neural Network Regularization
- Keeping Neural Networks Simple by Minimizing the Description Length of the Weights
- Multi-Scale Context Aggregation by Dilated Convolutions
- A Simple NN Module for Relational Reasoning
- Variational Lossy Autoencoder
- Relational RNNs
- Quantifying the Rise and Fall of Complexity in Closed Systems: The Coffee Automaton
- Neural Turing Machines
- Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
- A Tutorial Introduction to the Minimum Description Length Principle
- Machine Super Intelligence Dissertation
- PAGE 434 onwards: Komogrov Complexity
- CS231n Convolutional Neural Networks for Visual Recognition
Remaining papers: 17/30