| 01/10 |
Deep Neural Networks and Automatic Differentiation |
1-autodiff.pdf |
|
Assignment 1 Release |
| 01/15 |
Deep Learning Framework 1 |
2-tensorflow.pdf |
Link
|
|
| 01/17 |
Deep Learning Framework 2 |
3-pytorch.pdf |
Link
|
|
| 01/22 |
Deep Learning Compiler 1 |
|
Link
|
|
| 01/24 |
Deep Learning Compiler 2 |
|
Link
|
|
| 01/29 |
Graph Optimization |
|
Link
|
Assignment 1 Due; Assignment 2 Release |
| 01/31 |
Deep Learning Inference 1 |
|
Link
|
|
| 02/05 |
Deep Learning Inference 2 |
|
Link
|
Project Proposal Due |
| 02/07 |
Transformers |
|
Link
|
|
| 02/12 |
Parallel Training 1 |
|
Link
|
Assignment 2 Due; Assignment 3 Release |
| 02/14 |
Parallel Training 2 |
|
Link
|
|
| 02/19 |
Parallel Training 3 |
|
Link
|
|
| 02/21 |
Parallel Training 4 |
|
Link
|
|
| 02/26 |
Checkpointing, Fault Tolerance |
|
|
Assignment 3 Due |
| 02/28 |
Sparse Mixture of Experts |
|
Link
|
|
| 03/05 |
Efficient Attention Mechanisms |
|
Link
|
Project Checkpoint 1 Report Due |
| 03/07 |
Continuous Batching |
|
Link
|
|
| 03/12 |
NO CLASS (Spring Break) |
|
|
|
| 03/14 |
NO CLASS (Spring Break) |
|
|
|
| 03/19 |
Memory Management |
|
Link
|
|
| 03/21 |
Efficient Decoding |
|
Link
|
|
| 03/26 |
Human Feedback |
|
Link
|
Project Checkpoint 2 Report Due |
| 03/28 |
Parameter-Efficient Fine-Tuning |
|
Link
|
|
| 04/02 |
Prompt Engineering |
|
Link
|
|
| 04/04 |
Structured Language Model Programs |
|
Link
|
|
| 04/09 |
Vector Databases |
|
Link
|
|
| 04/11 |
Reasoning with LLMs |
|
|
|
| 04/16 |
Project Presentation |
|
|
|
| 04/18 |
Project Presentation |
|
|
|
| 04/23 |
NO CLASS (Finish Project Report) |
|
|
Project Final Report Due |