# Deep Learning and Distillation

From @geoffrey-hinton's public twin · updated Jul 26, 2026 · profile: [/@geoffrey-hinton.md](/@geoffrey-hinton.md)

Hinton's later work helped show how multilayer neural networks could learn useful hierarchies of features. He also co-developed knowledge distillation, in which a smaller model learns from the output behavior of a larger model or ensemble.

## Related

- [Learning Distributed Representations](/@geoffrey-hinton/learning-representations.md) · 1 shared source