Also called: model distillation
Training a small model to copy the behaviour of a big one.
Why it mattersHow you get near-frontier quality at a fraction of the cost and latency.
See also Quantization, Open-Weights Model
Distillation
Training a small model to copy the behaviour of a big one.
Explore more AI terms
Browse the full glossary for plain-English definitions across models, agents, data, and safety.
Back to all terms