Method | Vanilla | KD | FitNet | AT | M-FitNet | SRKD | Teacher |
Top-1 | 44.89 | 46.05 | 45.97 | 46.33 | 45.91 | 46.54 | 48.98 |
Top-5 | 71.33 | 72.55 | 72.38 | 72.64 | 72.41 | 72.78 | 75.36 |