#pre-training
3 videos
The Messy Reality of Scale: Synthetic Data and Pre-Training — Marah Abdin & Robert McHardy, poolside
17:31 1.7K views 2026-07-26
Ilya Sutskever – We're moving from the age of scaling to the age of research
1:36:03 1.2M views 2025-11-25
Andrej Karpathy — "We're summoning ghosts, not building animals"
2:26:08 1.2M views 2025-10-17