Course notes I have taken.

Notes from four university courses on LLMs, agents, and computer vision.

All Build notes Course notes Essays Letters Book notes Field notes

Newest first

202417 notes

№ 17

Sep 23, 2024

15 min · 130 readsCourse Notes

Preference Optimization Is Proxy Design

№ 16

Sep 18, 2024

10 min · 150 readsCourse Notes

Post-Training Teaches the System What to Reward

№ 15

Sep 11, 2024

11 min · 62 readsCourse Notes

Data Quality Beats Token Count

№ 14

Sep 06, 2024

12 min · 116 readsCourse Notes

Data Is the Model Diet

№ 13

Aug 26, 2024

10 min · 137 readsCourse Notes

Evaluation Is a Contract

№ 12

Aug 21, 2024

7 min · 203 readsCourse Notes

Scaling Laws Are Planning Tools

№ 11

Aug 15, 2024

9 min · 95 readsCourse Notes

Inference Is Cache, Latency, and Scheduling

№ 10

Aug 10, 2024

8 min · 222 readsCourse Notes

Scaling Laws Make Expensive Choices Less Blind

№ 09

Aug 03, 2024

9 min · 140 readsCourse Notes

Distributed Training Is a Scheduling Problem

№ 08

Jul 29, 2024

9 min · 109 readsCourse Notes

Parallelism Starts With the Bottleneck

№ 07

Jul 18, 2024

7 min · 173 readsCourse Notes

Kernels Save Time by Moving Less Data

№ 06

Jul 13, 2024

11 min · 240 readsCourse Notes

GPUs Reward Memory Discipline

№ 05

Jul 06, 2024

11 min · 130 readsCourse Notes

Mixture of Experts Routes Capacity

№ 04

Jul 01, 2024

7 min · 115 readsCourse Notes

Transformers Are Controlled Editing Machines

№ 03

Jun 25, 2024

9 min · 96 readsCourse Notes

Training Is Math Plus Bookkeeping

№ 02

Jun 20, 2024

10 min · 265 readsCourse Notes

Tokenization Is Where Text Becomes Compute

№ 01

Jun 12, 2024

3 min · 578 readsCourse Notes

The Pipeline Is the Model