模型

Acc

F1 score

BERT

(教师一)

94.09%

0.9128

BERT

(教师二)

87.62%

0.8447

TextCNN

87.26%

0.8149

KD1 [17]

89.68%

0.8969

KD2 [17]

88.48%

0.8849

Avg Weight [1]

89.56%

0.8955

CA-MKD [4]

89.26%

0.8928

AEKD [23]

89.30%

0.8930

EBKD [24]

89.72%

0.8975

Our

90.56%

0.9057