Non-linearities

ANNs are normally non-linear models that use different types of non-linearities. The most commonly used are as follows:

• sigmoid
• Tanh
• ReLU