Schedule
| When | What |
|---|---|
| Week 1 | Fundamentals of LLM generation and basic prompting techniques |
| Fri, Sep 6 | Topics: Generation hyperparameters; zero-shot and few-shot prompting; prompting for code. In-class Notebook |
| Week 2 | More prompting techniques; chat models |
| Tue, Sep 10 | Topics: Chain of thought prompting; program-aided language models. In-class Notebook Out: Math Word Problems. |
| Fri, Sep 13 | Topics: Introduction to chat models; adapting prompting to chat models |
| Week 3 | LLMs and tools |
| Tue, Sep 17 | Topics: LLMs and tools use |
| Fri, Sep 20 | Topics: Multi-turn conversations |
| Week 4 | Memory |
| Tue, Sep 24 | Topics: Programming with LLMs. Due: Math Word Problems. Out: Thomas the Travel Agent. |
| Fri, Sep 27 | Topics: Embeddings |
| Week 5 | Retrieval |
| Tue, Oct 1 | |
| Fri, Oct 4 | Topics: TBD. Guest speaker: Yann Debray (MathWorks) |
| Week 6 | Attacks |
| Tue, Oct 8 | No class: Arjun at COLM. Due: Thomas the Travel Agent. Out: [Homework 2] |
| Fri, Oct 11 | |
| Week 7 | Systems reliability |
| Tue, Oct 15 | |
| Fri, Oct 18 | |
| Week 8 | |
| Tue, Oct 22 | No class: Arjun at OOPSLA. Due: [Homework 2]. Out: [Homework 3] |
| Fri, Oct 25 | No class: Arjun at OOPSLA. |
| Week 9 | Advanced prompting techniques |
| Tue, Oct 29 | |
| Fri, Nov 1 | |
| Week 10 | Agents |
| Tue, Nov 5 | Due: [Homework 3]. Out: [Homework 4] |
| Fri, Nov 8 | |
| Week 11 | New Topics from Fall 2024 |
| Tue, Nov 12 | |
| Fri, Nov 15 | |
| Week 12 | Fine-tuning |
| Tue, Nov 19 | Due: [Homework 4]. Out: [Project]. Tentative: SC24 |
| Fri, Nov 22 | |
| Week 13 | |
| Tue, Nov 26 | |
| Fri, Nov 29 | No class: Thanksgiving |
| Week 14 | |
| Tue, Dec 3 | Last class: Presentations |