Model

互联网虚假新闻社会生活领域

事实核查新闻社会生活领域

Macro F1 Score

Accuracy

F1 score

Macro F1 Score

Accuracy

F1 score

Fake

Real

Fake

Real

Transformer

84.84

85.12

82.81

86.88

82.45

83.97

77.29

87.62

+Emoration

84.66

84.80

83.21

86.11

81.43

83.13

75.81

87.05

+EmoCred

84.54

84.66

83.19

85.89

81.07

82.81

75.34

86.81

+6Sentiment*

85.52

85.66

84.08

86.95

82.92

84.38

77.94

87.90

Transformer*

85.94

85.99

85.09

86.78

82.75

84.25

77.66

87.84

Transformer* + CNN

86.14

86.26

84.85

87.42

83.19

84.44

78.61

87.78

+Emoration

85.15

85.27

83.81

86.49

84.56

85.57

80.60

88.51

+EmoCred

86.38

86.45

85.39

87.37

83.64

84.69

79.50

87.78

SMCT

87.28

87.38

86.15

88.40

85.23

86.35

81.15

89.31