Table 2
Transform functions commonly used (Maca et al. 2014)
| Function | Formula | Derivative | Suggested normalization equation | |
|---|---|---|---|---|
| TF1 | Logistic(soft step、sigmoid) |  |  | Equation (2) |
| TF2 | Tanh |  |  | Equation (3) |
| TF3 | Arctan |  |  | Equation (3) |
| TF4 | Identity |  | f^′ (x) =  | Equation (3) |
| TF5 | Rectified linear unit (ReLU) |  |  | Equation (2) |
| TF6 | Parameteric rectified linear unit (PReLU、leaky ReLU) |  |  | Equation (3) |
| TF7 | Exponential linear unit(ELU) |  |  | Equation (3) |
| TF8 | Inverse abs (IA) |  |  | Equation (3) |
| TF9 | Rootsig (RS) |  |  | Equation (3) |
| TF10 | Sech function (SF) |  |  | Equation (3) |
| Function | Formula | Derivative | Suggested normalization equation | |
|---|---|---|---|---|
| TF1 | Logistic(soft step、sigmoid) | | | Equation (2) |
| TF2 | Tanh | | | Equation (3) |
| TF3 | Arctan | | | Equation (3) |
| TF4 | Identity | | f^′ (x) = | Equation (3) |
| TF5 | Rectified linear unit (ReLU) | | | Equation (2) |
| TF6 | Parameteric rectified linear unit (PReLU、leaky ReLU) | | | Equation (3) |
| TF7 | Exponential linear unit(ELU) | | | Equation (3) |
| TF8 | Inverse abs (IA) | | | Equation (3) |
| TF9 | Rootsig (RS) | | | Equation (3) |
| TF10 | Sech function (SF) | | | Equation (3) |