Back to the Glossary
Training

Distillation

The process of transferring knowledge from a large model to a smaller, faster one while keeping most of its abilities.

More in the same category

Fine-tuningPre-trainingRLHF (Reinforcement Learning from Human Feedback)DatasetTokenGradient Descent
Browse the full glossary