Week 5: Quantization and decoder economics

May 6, 2026 · Block 1: Lecture · Block 2: Lab

Slides: View in browser · Download PDF

Lab notebook: week5_lab.ipynb

Homework notebook: week5_homework.ipynb

Memo rubric: week5_memo_rubric.md

Readings: Pick 2–3 that connect to your memo.

• Dettmers 2022 — Llm Int8
• Dettmers 2023 — Qlora
• Frantar 2023 — Gptq
• Kurtic 2024 — Bf16 Or Death
• Lee 2025 — Quantization Trade Offs
• Lin 2024 — Awq
• Lin 2025 — Radio
• Paglieri 2024 — Diminishing Outliers
• Xiao 2023 — Smoothquant