Accuracy (%)

Sigmoid

ReLU

Leaky ReLU

Absolute value

MNIST

97.02

97.6

97.73

97.58

Fashion-MNIST

84.72

87.25

86.92

86.24