Week 3: Parameter-efficient adaptation (LoRA/PEFT)

Apr 22, 2026 · Block 1: Lecture · Block 2: Lab

Slides: View in browser · Download PDF

Lab notebook: week3_lab.ipynb

Homework notebook: week3_homework.ipynb

Memo rubric: week3_memo_rubric.md

Readings: Pick 2–3 that connect to your memo.

• Behnamghader 2024 — Llm2vec
• Dettmers 2023 — Qlora
• He 2022 — Unified Peft
• Houlsby 2019 — Adapters
• Hu 2021 — Lora
• Kandpal 2023 — Long Tail Knowledge
• Valdes 2026 — Cost Aware Selection
• Weller 2025 — Ettin Seq Vs Seq
• Yousefiramandi 2025 — Decoder Cls