Blog

Pytorch

Filter

All Posts self-improvement18 machine-learning18 stanford-cs33618 letters15 deep-learning15 motivation8 discipline7 mindset6 books5 focus4 productivity4 action4 +74 more

Tutorials·January 10, 2026·8 min read

CS336 Notes: Lecture 8 - Parallelism 2

Hands-on distributed training: implementing collectives with PyTorch and NCCL, data/tensor/pipeline parallelism in practice, and understanding the compute-memory-communication tradeoff.

machine-learning distributed-training stanford-cs336 deep-learning

Read

Tutorials·January 4, 2026·10 min read

CS336 Notes: Lecture 2 - PyTorch and Resource Accounting

Resource accounting for LLM training: compute estimates, memory budgets, dtypes, tensors, and mixed precision.

machine-learning pytorch stanford-cs336 gpu

Read