02
1of the trend's 69 episodes
A technique for training one model on the answers of another: it turns a large model into a smaller one with little loss of quality and lets catching-up labs narrow the gap with the leader. In episode 189 Max Grigoriev uses it to explain why Chinese models stay months behind.
A link is an episode of the thought where Model distillation is central or discussed in depth, or an author's quote that names it. The bar counts the shared episodes; blue bars are the months they meet on the June 2024 — November 2026 scale.