GLOSSARY TERM
What is Knowledge Distillation?
Transferring knowledge from a large, complex model to a smaller, efficient model.
Knowledge distillation trains a lightweight student model to replicate the soft probability distributions of a massive teacher model. It enables the deployment of highly capable AI on resource-constrained edge devices with minimal performance degradation.
Deploy Efficient Models
Distill massive parameter networks effectively using M1 infrastructure.