What Mechanisms Does Knowledge Distillation Distill?

Cindy Wu, Ekdeep Singh Lubana, Bruno Kacper Mlodozeniec, Robert Kirk, David Krueger
January 2023
Cite OpenReview PMLR
Type
1
Publication
UniReps: the First Workshop on Unifying Representations in Neural Models