As shown in Table 1, two time series of variables *x*_{1} and *x*_{2} are considered. Firstly, records of variables are transformed into a discrete space (Alfonso 2010):Equation (5) rounds the original variable *x* into its nearest lowest integer multiple of *a*, called *X*. In this paper, the recorded discharges are rounded to their integer value (by *a* = 1) in order to apply the grouping property of mutual information. This choice makes the information retained by stations more precisely quantified, and provides good estimations for the entropy of original variables (Samuel *et al.* 2013). Therefore, the time series in Table 1 are transformed to the discrete values through rounding the digits (columns 3 and 4). Table 1 shows the mechanism of calculating the entropy of variables *X*_{1} and *X*_{2}, using Equation (1). To calculate the joint entropy *H*(*X*_{1}, *X*_{2}), two approaches can be followed. The first one is using Equation (2), illustrated in columns 1 to 3 of Table 2. This approach, however, is not straightforward for more than two variables. The second approach is agglomerating the variables. Agglomeration for two variables *X*_{1} and *X*_{2} is done by *A**=* 10*X*_{1}*+**X*_{2}. This creates a unique value for new variable *A* corresponding to unique pairs of (*X*_{1}, *X*_{2}). Then, the probability of samples of new variable *A* can be calculated as shown in column 5 of Table 2. Subsequently, the entropy of *A* (i.e. *H*(*A*)) is calculated using Equation (1) which is exactly the same as *H*(*X*_{1}, *X*_{2}) obtained from Equation (2) by the first approach.

5

Table 1

x_{1}
. | x_{2}
. | X_{1}
. | X_{2}
. | p(X_{1})
. | p(X_{2})
. | log[p(X_{1})]
. | −p(X_{1})*log[p(X_{1})]
. | log[p(X_{2})]
. | −p(X_{2})*log[p(X_{2})]
. |
---|---|---|---|---|---|---|---|---|---|

3.24 | 2.2 | 3 | 2 | 0.1 | 0.3 | −1 | 0.1 | −0.52288 | 0.157 |

4.25 | 2.08 | 4 | 2 | 0.1 | – | −1 | 0.1 | – | 0 |

5.3 | 1.15 | 5 | 1 | 0.7 | 0.1 | −0.155 | 0.108 | −1 | 0.1 |

5.33 | 4.81 | 5 | 4 | – | 0.3 | – | 0 | −0.523 | 0.157 |

5.45 | 5.4 | 5 | 5 | – | 0.2 | – | 0 | −0.699 | 0.140 |

5.7 | 4.36 | 5 | 4 | – | – | – | 0 | – | 0 |

6.55 | 4.6 | 6 | 4 | 0.1 | – | −1 | 0.1 | – | 0 |

5.42 | 5.21 | 5 | 5 | – | – | – | 0 | – | 0 |

5.4 | 3.13 | 5 | 3 | – | 0.1 | – | 0 | −1 | 0.1 |

5.25 | 2.91 | 5 | 2 | – | – | – | 0 | – | 0 |

H(X_{1}) = 0.408 | H(X_{2}) = 0.654 |

x_{1}
. | x_{2}
. | X_{1}
. | X_{2}
. | p(X_{1})
. | p(X_{2})
. | log[p(X_{1})]
. | −p(X_{1})*log[p(X_{1})]
. | log[p(X_{2})]
. | −p(X_{2})*log[p(X_{2})]
. |
---|---|---|---|---|---|---|---|---|---|

3.24 | 2.2 | 3 | 2 | 0.1 | 0.3 | −1 | 0.1 | −0.52288 | 0.157 |

4.25 | 2.08 | 4 | 2 | 0.1 | – | −1 | 0.1 | – | 0 |

5.3 | 1.15 | 5 | 1 | 0.7 | 0.1 | −0.155 | 0.108 | −1 | 0.1 |

5.33 | 4.81 | 5 | 4 | – | 0.3 | – | 0 | −0.523 | 0.157 |

5.45 | 5.4 | 5 | 5 | – | 0.2 | – | 0 | −0.699 | 0.140 |

5.7 | 4.36 | 5 | 4 | – | – | – | 0 | – | 0 |

6.55 | 4.6 | 6 | 4 | 0.1 | – | −1 | 0.1 | – | 0 |

5.42 | 5.21 | 5 | 5 | – | – | – | 0 | – | 0 |

5.4 | 3.13 | 5 | 3 | – | 0.1 | – | 0 | −1 | 0.1 |

5.25 | 2.91 | 5 | 2 | – | – | – | 0 | – | 0 |

H(X_{1}) = 0.408 | H(X_{2}) = 0.654 |

Table 2

p(X_{1}, X_{2})
. | log[p(X_{1}, X_{2})]
. | −p(X_{1}, X_{2})*log[p(X_{1}, X_{2})]
. | A
. | P(A)
. | log[P(A)]
. | −p(A)*log[p(A)]
. |
---|---|---|---|---|---|---|

0.1 | −1 | 0.1 | 32 | 0.1 | −1 | 0.1 |

0.1 | −1 | 0.1 | 42 | 0.1 | −1 | 0.1 |

0.1 | −1 | 0.1 | 51 | 0.1 | −1 | 0.1 |

0.2 | −0.699 | 0.14 | 54 | 0.2 | −0.699 | 0.14 |

0.2 | −0.699 | 0.14 | 55 | 0.2 | −0.699 | 0.14 |

– | – | 0 | 54 | – | – | 0 |

0.1 | −1 | 0.1 | 64 | 0.1 | −1 | 0.1 |

– | – | 0 | 55 | – | – | 0 |

0.1 | −1 | 0.1 | 53 | 0.1 | −1 | 0.1 |

0.1 | −1 | 0.1 | 52 | 0.1 | −1 | 0.1 |

H(X_{1}, X_{2}) = 0.88 | H(A) = 0.88 |

p(X_{1}, X_{2})
. | log[p(X_{1}, X_{2})]
. | −p(X_{1}, X_{2})*log[p(X_{1}, X_{2})]
. | A
. | P(A)
. | log[P(A)]
. | −p(A)*log[p(A)]
. |
---|---|---|---|---|---|---|

0.1 | −1 | 0.1 | 32 | 0.1 | −1 | 0.1 |

0.1 | −1 | 0.1 | 42 | 0.1 | −1 | 0.1 |

0.1 | −1 | 0.1 | 51 | 0.1 | −1 | 0.1 |

0.2 | −0.699 | 0.14 | 54 | 0.2 | −0.699 | 0.14 |

0.2 | −0.699 | 0.14 | 55 | 0.2 | −0.699 | 0.14 |

– | – | 0 | 54 | – | – | 0 |

0.1 | −1 | 0.1 | 64 | 0.1 | −1 | 0.1 |

– | – | 0 | 55 | – | – | 0 |

0.1 | −1 | 0.1 | 53 | 0.1 | −1 | 0.1 |

0.1 | −1 | 0.1 | 52 | 0.1 | −1 | 0.1 |

H(X_{1}, X_{2}) = 0.88 | H(A) = 0.88 |

This site uses cookies. By continuing to use our website, you are agreeing to our privacy policy.