Method

Vanilla

KD

FitNet

AT

M-FitNet

SRKD

Teacher

Top-1

44.89

46.05

45.97

46.33

45.91

46.54

48.98

Top-5

71.33

72.55

72.38

72.64

72.41

72.78

75.36