Week 6: Distillation and final model decision
May 13, 2026 · Block 1: Lecture · Block 2: Lab
Slides: View in browser · Download PDF
Lab notebook: week6_lab.ipynb
Homework notebook: week6_homework.ipynb
Memo rubric: week6_memo_rubric.md
Readings: Pick 2–3 that connect to your memo.
- Abdin 2024 — Phi4
- Busbridge 2025 — Scaling Laws
- Guo 2021 — Uncertainty Calibration
- Hebbalaguppe 2024 — Calibration Transfer
- Hinton 2015 — Distilling
- Hsieh 2023 — Step By Step
- Kandpal 2023 — Long Tail Knowledge
- Kim 2026 — Calibrated Uncertainty
- Mohammadshahi 2025 — What Is Left
- Sanh 2019 — Distilbert
- Stanton 2021 — Does Kd Work
- Yu 2024 — Sample Wise Long Tail
- Zhou 2024 — Baldistill