Physically based, spatially distributed hydrological models have mostly been calibrated manually; a few were calibrated automatically but without full consideration of conflicting multi-objectives. Here, we successfully applied the non-dominated sorting genetic algorithm II (NSGA-II) and its two variants, namely the reference point-based R-NSGA-II and the extension ER-NSGA-II, to multi-objective, automatic calibration of the SHETRAN hydrological model. Moreover, we demonstrated the possibility of speeding up the calibration process by adjusting the recombination and mutation parameters of the optimization algorithms. The simulated binary crossover and polynomial mutation were used with respective probabilities of 0.9 and 0.1, and crossover and mutation distribution indices (ηc, ηm) with values of (0.5, 0.5), (2.0, 0.5) and (20., 20.). The results indicate that the use of smaller (ηc, ηm) speeded up the optimization process of SHETRAN calibration, especially during the initial stage, for all three algorithms; however, the use of the R-NSGA-II and ER-NSGA-II did not provide a more efficient optimization compared to the NSGA-II. The broad search of the algorithms, enabled by the generation of diversified solutions due to the use of small (ηc, ηm), contributed to the improved efficiency. Finally, we successfully validated the optimal solutions for both the basin outlet and the internal gauging stations.
INTRODUCTION
Physically based, spatially distributed hydrological models have been widely used for evaluating the impacts of hypothetic changes resulting from climate (Bathurst et al. 1996; Kilsby et al. 2007; Gül et al. 2010; Bathurst 2011; Goderniaux et al. 2011; Thompson 2012; Mourato et al. 2014, 2015), land-use (McMichael & Hope 2007; Im et al. 2009; Birkinshaw et al. 2011; Kalantari et al. 2014), environment (Birkinshaw & Ewen 2000; Lutz et al. 2013; Hansen et al. 2014; Refsgaard et al. 2014) and management (Adams & Parkin 2002; Mottes et al. 2014). In practice, these models require calibration due to various reasons, namely approximations in model design, unavailability of parameters due to unaffordable cost, experiment constraints, as well as scaling problem (Beven 2012). The calibrations are complicated and expensive due to the sophisticated model structure, heavy computation requirements and a large number of calibration parameters (Refsgaard 1997; Madsen 2003; Blasone et al. 2007; Santos et al. 2012; Zhang et al. 2013). Consequently, calibrations were carried out manually, with consideration of a single objective and few parameters. The efficacy and efficiency of global optimization methods in automatic calibration have been demonstrated by Madsen (2003), Santos et al. (2003, 2012) and Zhang et al. (2013) for the MIKE-SHE, WESP and SHETRAN models. However, such applications are still sparse and few considered the full tradeoff characteristics of conflicted multi-objectives. The models configured with finer spatial resolution represent better the integrated hydrological process of a catchment (Vázquez et al. 2002; Wildemeersch et al. 2014), which implies an increase of the simulation time for an individual model run. Consequently, automatic calibration of these models with requirements of tens of thousands of simulations to be performed would become unaffordable due to the demands of heavy computations. Therefore, a balance must be found between the desired model performance and manageable computing resources; as well, the calibration objectives should be achieved by a limited number of model simulations.
Multi-objective evolutionary algorithms (MOEAs) are effective and efficient in the calibration of distributed models. Successful examples can be found in Bekele & Nicklow (2007), Shafii & Smedt (2009) and Zhang et al. (2010), by using the non-dominated sorting genetic algorithm II (NSGA-II) (Deb et al. 2002), for the SWAT and WetSpa models. Since modellers are mostly interested in choosing one of a set of solutions instead of the entire non-dominated solutions, their preferred information can also be included to speed up the optimization process of calibration, as Deb et al. (2006) suggested in the reference point-based R-NSGA-II. Furthermore, the extension ER-NSGA-II proposed by Siegmund et al. (2012) directs the optimization straight towards the preference points by using the constrained Pareto-fitness approach and a self-adaptive ɛ-clearing strategy. These methods suggest great potential in finding a preferred diverse set of non-dominated solutions for automatic calibration of physically based, spatially distributed models in a limited number of model simulations.
The NSGA-II and its variants use the simulated binary crossover (SBX) (Deb & Agrawal 1995) and polynomial mutation (PM) operators (Deb 2001) to generate offspring solutions from the selected parent individuals. The operators involve parameters, called crossover (ηc) and mutation (ηm) distribution indices, which determine the spread of offspring solutions relative to the parent solutions. On the one hand, the use of large values for both ηc and ηm results in offspring solutions close to the parent solutions; on the other hand, the use of small values leads to solutions apart from the parents (Deb 2001). Therefore, the selection of appropriate values of ηc and ηm is highly crucial, considering the importance of diversity control of offspring solutions in the optimization processes. However, the proper values may vary with different problems and also during the optimization processes. For example, Deb et al. (2007) developed a self-adaptive procedure for updating the value of ηc and found improvements in solving both single and multiple objective optimization problems; Zeng et al. (2010) proposed a self-adaptive mechanism to adjust the proper value of ηc and got better performances on benchmark problems; Deb & Deb (2014) identified different ranges of ηm for different problems. However, the importance of finding appropriate pairs (ηc, ηm) for different problems or even for different stages of the same problem-solving process, has not been paid enough attention to for the hydrological model calibration problems; as one can notice, the use of (ηc, ηm) is simply with fixed values in the ranges of ([15, 20], [15, 20]) (Bekele & Nicklow 2007; Tang 2007; Tang et al. 2007; Zhang et al. 2010; Kollat et al. 2012), which may have prevented the algorithms from obtaining better performances.
In the context of anti-desertification strategies, this study presents the application of the NSGA-II and its two variants R-NSGA-II and ER-NSGA-II to the multi-objective, automatic calibration of the physically based, spatially distributed SHETRAN hydrological model for a semi-arid middle-sized basin in southern Portugal with high concerns about both water scarcity and flash floods problems. To complete the above-mentioned limitations, we investigate the effects of the recombination and mutation parameters of the three algorithms on the optimization processes. Since the use of small ηc and ηm may lead to a quicker and more thorough search of the calibration parameters in the physically possible ranges, this study proposes the use of (ηc, ηm) with values of (0.5, 0.5) and (2.0, 0.5), in comparison to (20., 20.), which is a typical pair of values used in previous hydrological applications with the three algorithms, namely NSGA-II, R-NSGA-II and ER-NSGA-II, for the automatic calibration of the SHETRAN hydrological model. It is intended to find out whether the NSGA-II and its two variants, R-NSGA-II and ER-NSGA-II, can automatically calibrate the SHETRAN model and whether the use of smaller (ηc, ηm) can accelerate the optimization processes. The results will be used for evaluating the climate and land-use change impacts on basin hydrology and sediment transport, in areas undergoing desertification.
DATA AND METHODS
Cobres basin
Data used for simulating the Cobres basin include a 10 m resolution digital elevation model, taken from the website of the Portuguese Geographic Information System (http://www.igeoe.pt/), a soil map with a scale of 1:25,000 provided by the Institute of Hydraulics, Rural Engineering and Environment, IHERA, a land-use map with a scale of 1:100,000 from CORINE Land Cover 2006 for Continental Portugal (Caetano et al. 2009), hourly weather and streamflow data provided by the Portuguese Water Resources Information System (SNIRH) for the stations indicated in Figure 1. Hourly PET was calculated by FAO Penman–Monteith method (Allen et al. 1998). Details concerning data can be found in Zhang et al. (2013). In this study, the multi-objective calibration is carried out for the basin outlet from October 1st, 2004 to September 30th, 2006 with the first 10 months as a warm-up period; the calibrated parameters are validated for the basin outlet and the internal gauging stations from October 1st, 2006 to September 30th, 2008. Due to missing data, the period from November 4th, 2006 to November 7th, 2006 is not considered for the basin outlet and for the two internal gauging stations.
SHETRAN modelling system
SHETRAN (http://research.ncl.ac.uk/shetran/) is a physically based, spatially distributed modelling system for water flow and sediment and contaminant transports in river catchments (Ewen et al. 2000; Birkinshaw et al. 2010). The model has a modular design and mainly consists of three components, namely, those concerning water flow, sediment transport and solute transport. These components model the physical processes by finite difference representations of the partial differential equations of mass and energy conservation and by empirical equations derived from independent experimental research. In SHETRAN, a basin is discretized by an orthogonal grid network in the horizontal view and by a column of horizontal layers at each grid square in the vertical view; as well, the river network is simplified by the links running along the edges of the grid squares (Figure 1).
In this paper, the automatic calibration is considered only for the water flow component of SHETRAN (v4.4.0). In the present application, the model represents the physical processes of the hydrological cycle through: (1) the interception calculated from the modified Rutter model; (2) the actual evapotranspiration (AET) calculated from a prescribed ratio of AET/PET as a function of soil water potential; (3) the overland (2D) and channel (1D) flow processes based on the diffusive wave approximation of the Saint–Venant equations; (4) the subsurface flow processes calculated from 3D variably saturated flow equation; (5) the river aquifer interaction calculated from the Darcy equation.
The objective functions of SHETRAN calibration
The MOEAs
Similarities and differences between NSGA-II, R-NSGA-II and ER-NSGA-II
The R-NSGA-II (Deb et al. 2006) and ER-NSGA-II (Siegmund et al. 2012) are two variants of the NSGA-II algorithm (Deb et al. 2002). The three algorithms follow the same procedure: (a) generation of an initial population P; (b) selection of parent solutions by tournament; (c) generation of offspring solutions by crossover and mutation; (d) evaluation of new offspring solutions Q; (e) selection of a new population, out of ; (f) check of convergence criteria; steps (b)–(f) are repeated until the convergence criteria are satisfied. In this study, 30 sets of the initial population are generated by Latin hypercube sampling to consider the random seed effects. For all three algorithms, the non-dominated sorting method is used to rank the solutions from high to low non-dominated levels, in terms of all objective functions, so that the solutions from higher levels are absolutely better than those from lower levels but those from the same level are not comparable unless a second fitness measure is specified; SBX and PM are used to generate offspring solutions with respective probabilities of 0.9 and 0.1; convergence is considered being satisfied when the number of SHETRAN simulations reaches 1,500 or all the changes of performance metrics of the algorithm, during the recent five generations, are lower than the limits described in the section ‘The performance metrics of MOEAs’.
SBX and PM
Configurations of the optimizations for SHETRAN calibration
The Cobres basin is discretized into 175 grid squares of 2 × 2 km2 (Figure 1), to each of which are assigned parameters with unique values. The SHETRAN calibration parameters are the Strickler overland flow resistance coefficient and AET/PET ratio for the grid squares with two main types of land-use and the top soil depth, saturated hydraulic conductivity, saturated water content, residual water content and van Genuchten n and α parameters for those with three main types of soil. As shown in Table 1, the parameter values are constrained within physically realistic ranges according to field measurements of Cardoso (1965) and literature data (Bathurst et al. 1996, 2002; Saxton & Rawls 2006). Details of the SHETRAN model set-up and parameter ranges can be found in Zhang et al. (2013). As for the configuration of MOEAs, the population size is set to 50, the maximum number of generations is 30, and the (ηc, ηm) parameters are given three alternative sets (0.5, 0.5), (2.0, 0.5) and (20., 20.), based on the recommended value of (20., 20.) by Deb et al. (2002) and the values previously applied to hydrological applications (Bekele & Nicklow 2007; Tang 2007; Zeng et al. 2010), for all three algorithms NSGA-II, R-NSGA-II and ER-NSGA-II; three reference points with (RMSE, LOGE) of (1.50, 2.50), (1.25, 2.65) and (1.00, 2.80) are set for the R-NSGA-II and ER-NSGA-II, based on the possible ranges of results obtained from a trial run by NSGA-II and as explained in Zhang et al. (2013). For R-NSGA-II, the ɛ is set to 0.001, according to Deb et al. (2006) and Siegmund et al. (2012). For ER-NSGA-II, the a, and are set as 0.5, 0.001 and 0.5 to allow for a variation of ɛ in the range of [0.001, 0.026]; the constraint of the Pareto-fitness approach recommended by Siegmund et al. (2012) is used, and, for step (e) in the section ‘Similarities and differences between NSGA-II, R-NSGA-II and ER-NSGA-II’, the best five non-dominated levels of are supposed to provide 28, 12, 6, 3 and 1 solutions as new populations. A Matlab code was developed for the above-mentioned optimizations based on Seshadri (2009) and Lin (2011).
Parameters (unit) . | Description . | Range . | Automatic calibration resultsa,b . | |||||
---|---|---|---|---|---|---|---|---|
Sim1a . | Sim1b . | Sim1 . | Sim2 . | Sim3 . | Sim4 . | |||
K1 (m1/3s–1) | Strickler overland flow resistance coefficient for crops | 2.5–10.0 | 9.6 | 9.7 | 10.0 | 10.0 | 9.1 | 3.2 |
K2 (m1/3s–1) | Strickler overland flow resistance coefficient for agroforestry | 0.5–5.0 | 5.0 | 5.0 | 5.0 | 0.5 | 0.5 | 0.5 |
Ks1 (m/day) | Saturated hydraulic conductivity of Vx soil | 0.110–0.192 | 0.174 | 0.190 | 0.184 | 0.192 | 0.192 | 0.188 |
θs1 (m3/m3) | Saturated water content of Vx soil | 0.506–0.517 | 0.517 | 0.517 | 0.511 | 0.517 | 0.506 | 0.513 |
θr1 (m3/m3) | Residual water content of Vx soil | 0.065–0.073 | 0.067 | 0.066 | 0.068 | 0.073 | 0.071 | 0.069 |
n1 (-) | van Genuchten n of Vx soil | 1.221–1.403 | 1.221 | 1.221 | 1.221 | 1.221 | 1.224 | 1.226 |
α1 (cm−1) | van Genuchten α of Vx soil | 0.0055–0.0250 | 0.0056 | 0.0055 | 0.0057 | 0.0055 | 0.0055 | 0.0055 |
h1 (m) | Top soil depth of Vx soil | 0.30–0.65 | 0.30 | 0.30 | 0.33 | 0.65 | 0.65 | 0.65 |
Ks2 (m/day) | Saturated hydraulic conductivity of Px soil | 0.191–0.425 | 0.424 | 0.423 | 0.425 | 0.423 | 0.423 | 0.425 |
θs2 (m3/m3) | Saturated water content of Px soil | 0.418–0.519 | 0.418 | 0.418 | 0.418 | 0.418 | 0.493 | 0.418 |
θr2 (m3/m3) | Residual water content of Px soil | 0.041–0.053 | 0.053 | 0.053 | 0.053 | 0.042 | 0.051 | 0.048 |
n2 (-) | van Genuchten n of Px soil | 1.345–1.422 | 1.347 | 1.347 | 1.347 | 1.345 | 1.345 | 1.358 |
α2 (cm−1) | van Genuchten α of Px soil | 0.0075–0.0225 | 0.0075 | 0.0075 | 0.0075 | 0.0075 | 0.0076 | 0.0088 |
h2 (m) | Top soil depth of Px soil | 0.30–0.40 | 0.33 | 0.33 | 0.33 | 0.30 | 0.35 | 0.4 |
Ks3 (m/day) | Saturated hydraulic conductivity of Ex soil | 0.233–2.221 | 2.019 | 1.786 | 1.987 | 1.987 | 2.043 | 2.221 |
θs3 (m3/m3) | Saturated water content of Ex soil | 0.446–0.457 | 0.446 | 0.446 | 0.446 | 0.446 | 0.452 | 0.446 |
θr3 (m3/m3) | Residual water content of Ex soil | 0.051–0.120 | 0.082 | 0.065 | 0.073 | 0.120 | 0.083 | 0.051 |
n3 (-) | van Genuchten n of Ex soil | 1.311–1.557 | 1.488 | 1.381 | 1.557 | 1.544 | 1.321 | 1.311 |
α3 (cm−1) | van Genuchten α of Ex soil | 0.0250–0.0690 | 0.0252 | 0.0250 | 0.0275 | 0.0670 | 0.028 | 0.025 |
h3 (m) | Top soil depth of Ex soil | 0.05–0.10 | 0.05 | 0.05 | 0.05 | 0.10 | 0.06 | 0.05 |
AETPETFC1 (-) | The AET/PET ratio at field capacity for crop | 0.50–0.90 | 0.500 | 0.500 | 0.500 | 0.500 | 0.502 | 0.501 |
AETPETFC2 (-) | The AET/PET ratio at field capacity for agroforestry | 0.60–0.80 | 0.612 | 0.617 | 0.622 | 0.600 | 0.600 | 0.607 |
Parameters (unit) . | Description . | Range . | Automatic calibration resultsa,b . | |||||
---|---|---|---|---|---|---|---|---|
Sim1a . | Sim1b . | Sim1 . | Sim2 . | Sim3 . | Sim4 . | |||
K1 (m1/3s–1) | Strickler overland flow resistance coefficient for crops | 2.5–10.0 | 9.6 | 9.7 | 10.0 | 10.0 | 9.1 | 3.2 |
K2 (m1/3s–1) | Strickler overland flow resistance coefficient for agroforestry | 0.5–5.0 | 5.0 | 5.0 | 5.0 | 0.5 | 0.5 | 0.5 |
Ks1 (m/day) | Saturated hydraulic conductivity of Vx soil | 0.110–0.192 | 0.174 | 0.190 | 0.184 | 0.192 | 0.192 | 0.188 |
θs1 (m3/m3) | Saturated water content of Vx soil | 0.506–0.517 | 0.517 | 0.517 | 0.511 | 0.517 | 0.506 | 0.513 |
θr1 (m3/m3) | Residual water content of Vx soil | 0.065–0.073 | 0.067 | 0.066 | 0.068 | 0.073 | 0.071 | 0.069 |
n1 (-) | van Genuchten n of Vx soil | 1.221–1.403 | 1.221 | 1.221 | 1.221 | 1.221 | 1.224 | 1.226 |
α1 (cm−1) | van Genuchten α of Vx soil | 0.0055–0.0250 | 0.0056 | 0.0055 | 0.0057 | 0.0055 | 0.0055 | 0.0055 |
h1 (m) | Top soil depth of Vx soil | 0.30–0.65 | 0.30 | 0.30 | 0.33 | 0.65 | 0.65 | 0.65 |
Ks2 (m/day) | Saturated hydraulic conductivity of Px soil | 0.191–0.425 | 0.424 | 0.423 | 0.425 | 0.423 | 0.423 | 0.425 |
θs2 (m3/m3) | Saturated water content of Px soil | 0.418–0.519 | 0.418 | 0.418 | 0.418 | 0.418 | 0.493 | 0.418 |
θr2 (m3/m3) | Residual water content of Px soil | 0.041–0.053 | 0.053 | 0.053 | 0.053 | 0.042 | 0.051 | 0.048 |
n2 (-) | van Genuchten n of Px soil | 1.345–1.422 | 1.347 | 1.347 | 1.347 | 1.345 | 1.345 | 1.358 |
α2 (cm−1) | van Genuchten α of Px soil | 0.0075–0.0225 | 0.0075 | 0.0075 | 0.0075 | 0.0075 | 0.0076 | 0.0088 |
h2 (m) | Top soil depth of Px soil | 0.30–0.40 | 0.33 | 0.33 | 0.33 | 0.30 | 0.35 | 0.4 |
Ks3 (m/day) | Saturated hydraulic conductivity of Ex soil | 0.233–2.221 | 2.019 | 1.786 | 1.987 | 1.987 | 2.043 | 2.221 |
θs3 (m3/m3) | Saturated water content of Ex soil | 0.446–0.457 | 0.446 | 0.446 | 0.446 | 0.446 | 0.452 | 0.446 |
θr3 (m3/m3) | Residual water content of Ex soil | 0.051–0.120 | 0.082 | 0.065 | 0.073 | 0.120 | 0.083 | 0.051 |
n3 (-) | van Genuchten n of Ex soil | 1.311–1.557 | 1.488 | 1.381 | 1.557 | 1.544 | 1.321 | 1.311 |
α3 (cm−1) | van Genuchten α of Ex soil | 0.0250–0.0690 | 0.0252 | 0.0250 | 0.0275 | 0.0670 | 0.028 | 0.025 |
h3 (m) | Top soil depth of Ex soil | 0.05–0.10 | 0.05 | 0.05 | 0.05 | 0.10 | 0.06 | 0.05 |
AETPETFC1 (-) | The AET/PET ratio at field capacity for crop | 0.50–0.90 | 0.500 | 0.500 | 0.500 | 0.500 | 0.502 | 0.501 |
AETPETFC2 (-) | The AET/PET ratio at field capacity for agroforestry | 0.60–0.80 | 0.612 | 0.617 | 0.622 | 0.600 | 0.600 | 0.607 |
a’sim1a’, ‘sim1b’, ‘sim1’, ‘sim2’, ‘sim3’ and ‘sim4’ are SHETRAN simulations with (RMSE, LOGE, NSE) of respectively (2.82, 2.73, 0.87), (2.83, 2.73, 0.87), (2.81, 2.74, 0.87), (3.81, 2.53, 0.77), (4.85, 2.49, 0.63) and (5.85, 2.46, 0.46) at basin outlet, for the calibration period (2004–2006).
b’sim1a’, ‘sim1b’ and ‘sim1'are equivalently good; the hydrograph comparisons are shown in Figure 8 for the simulations ‘sim1’, ‘sim2’, ‘sim3’ and ‘sim4’.
The performance metrics of MOEAs
Convergence and diversity are two orthogonal goals of a successful MOEA (Deb 2001). This paper evaluates the two aspects of optimization processes of SHETRAN calibration by using the performance metrics hypervolume, ɛ-indicator, generational distance (Reed et al. 2013) and opt-indicator. The normalized objective function values are used for the evaluation, and a trial run optimization is carried out to determine the possible maximum and minimum SHETRAN objective values. By specifying a vector of worst objective values, the hypervolume assesses the ratio of volume dominated by the local Pareto approximate set PF to the volume dominated by the reference Pareto approximate set PF′. The ε-indicator estimates the largest distance required to translate a PF solution to dominate its nearest neighbour in the PF′. The generational distance measures the average Euclidean distance of points in PF to their nearest corresponding objective vectors in the PF′. Details of the definitions are referred to in Nicklow et al. (2010) and Reed et al. (2013). The opt-indicator, defined in this study, indicates the smallest distance required for translating a PF solution to dominate its nearest neighbour in the PF′. As it measures the least effort for getting one more PF solution dominating the nearest neighbour in the PF′, the opt-indicator is the easiest metric to be improved comparing to the others.
The metrics evaluation is performed with two purposes: first, determination of convergence for each optimization process; second, comparison of performance among different optimization processes. The assessment of convergence by performance metrics is done every five generations evolution. The convergence is considered satisfied if the changes of hypervolume, ɛ-indicator, generational distance and opt-indicator are all less than 0.01%. The comparisons among the nine optimizations are implemented only after their completion.
RESULTS AND DISCUSSION
Comparisons of the use of (ηc, ηm) with different values
It is shown that, for NSGA-II, R-NSGA-II and ER-NSGA-II, the use of (ηc, ηm) with value of (0.5, 0.5) gets the best solutions and is most efficient; the use of (2.0, 0.5) gets better solutions and is more efficient than that of (20., 20.). As shown in Figures 2(a)–2(c) and 3(a)–3(b), the use of smaller (ηc, ηm) makes the three algorithms produce better solutions. Figure 2(a)–2(c) demonstrates the evidence by comparison of ensembles of non-dominated solutions obtained from the 30 trial runs of each optimization after 1,500 SHETRAN simulations; this is displayed in Figure 3(a) through comparisons of the non-dominated solutions of the ensembles, shown in Figure 2(a)–2(c), for all optimizations. On the other hand, it is shown that the use of smaller (ηc, ηm) may reduce the random seed effects of the three algorithms. As one may notice, this is shown in Figure 2(a)–2(c) from the smaller objective spaces of the ensembles, associated with optimizations with the smaller (ηc, ηm). As well, one can also see it clearly in Figure 3(b), where it is shown that, by using the same initial condition, the use of NSGA-II algorithm with (ηc, ηm) of (0.5, 0.5) gets non-dominated solutions mostly close to the Pareto approximate set, and the use of (ηc, ηm) of (2.0, 0.5) also gets solutions closer to it than those of (20., 20.). The Pareto approximate set, shown in empty circles in Figure 3(b), is derived from the final results of all nine optimizations.
The effects of smaller (ηc, ηm) in accelerating the optimization are most pronounced in the first, but not in the second, 15 generations of evolutionary processes (or 750 SHETRAN simulations), and the discrepancies vary with different performance metrics. If we define the efficiency of optimization process as the rate of improvement in performance metrics with the number of model runs, the effects of the use of smaller (ηc, ηm) are clearly noticed by comparisons displayed in Figure 4(a)–4(l). All nine optimizations mostly start with their best efficiencies, the smaller the value of (ηc, ηm) the higher the efficiency; and then, all efficiencies decrease and stabilize in similar values for the second set of evolutionary processes (or 750 SHETRAN simulations). Figures 5(a)–5(d) and 6(a)–6(d) also show the same story, by displaying, respectively, the 50th and 95th percentiles of the dynamic performances. The SBX operator is mainly responsible for this phenomenon, since the probability was set as 0.9 for crossover and 0.1 for mutation operators; and the explanation is probably related to the self-adaptive nature of the SBX operator (Deb et al. 2007). Nevertheless, the use of 0.5 as ηm has also promoted the differences of performance metrics between optimizations with (ηc, ηm) of (0.5, 0.5), (2.0, 0.5) and that of (20., 20.).
The spread of offspring is proportional to that of parent solutions and related to ηc as well, as clearly shown in Equations (11), (12) and (13). At the beginning of optimizations, the spread of parent solutions is very large, due to the random selection of initial solutions, which therefore create offspring solutions far away from the parents and the use of smaller value of ηc even further enlarges the spread of offspring. From Figure 4(a)–4(l), it is evident that the broad search of the algorithms in their early generations enables the efficient improvement of the optimizations. However, when the solutions tend to converge due to the action of genetic operators, the spread of parent solutions becomes smaller which diminishes the effect of ηc on the spread of offspring solutions; consequently, distance solutions are not likely to be generated and the optimization search focuses on a narrower region. This explains the gradually decreasing efficiency of the nine optimizations during the first 15 generations of evolutionary processes (or 750 SHETRAN simulations). As for ηm, Equations (14) and (15) demonstrate that the use of smaller ηm also favours the creation of distant offspring solutions, which thus facilitates a broader search for the optimizations with (ηc, ηm) of (0.5, 0.5) and (2.0, 0.5) rather than that of (20., 20.). Furthermore, as shown in Equation (15), the mutation operator introduces diversified solutions with the same efficiency during all the optimization processes. This may explain the nearly constant performance of the nine optimizations during the second 15 generations of evolutionary processes (or 750 SHETRAN simulations). All in all, it is shown in Figure 4(a)–4(l) that a broad search is highly important for all three algorithms.
Comparisons among the NSGA-II, R-NSGA-II and ER-NSGA-II
It is shown that, by considering the preference points and maintaining solutions with distances larger than 0.001, the R-NSGA-II does not improve, compared to the NSGA-II; and in the case of the use of (ηc, ηm) with value of (20., 20.), the R-NSGA-II demonstrates a worse performance than the NSGA-II. This is evident in Figures 2(d)–2(f) and 3(a) by comparing the final results from the 30 trial runs of each optimization, after 1,500 SHETRAN simulations. From Figure 2(d) and 2(e), the ensembles of non-dominated solutions obtained from the R-NSGA-II, by using (ηc, ηm) of (0.5, 0.5) or (2.0, 0.5), are neither better nor worse than those from the NSGA-II; however, from Figure 2(f), by using (ηc, ηm) of (20., 20.), R-NSGA-II performs worse than NSGA-II. As well, these conclusions are also true when one compares the performance metrics of the algorithms during the optimization processes. In Figure 4(a)–4(l), the first two columns show that, by using (ηc, ηm) with values of (0.5, 0.5) and (2.0, 0.5), the average performances of the NSGA-II are always equivalent or slightly better than those from the R-NSGA-II; by using (ηc, ηm) with values of (20., 20.), the NSGA-II demonstrates much better performances than the R-NSGA-II. Figures 5(a)–5(d) and 6(a)–6(d) also support the same conclusions by comparing the 50th and 95th percentiles of results obtained from the 30 trial runs.
It is also shown that, by considering the preference points, the constrained Pareto-fitness approach and the self-adaptive ε approach, the ER-NSGA-II does not improve, compared to NSGA-II and R-NSGA-II; and in the case of the use of (ηc, ηm) with a value of (20., 20.), the ER-NSGA-II displays a performance similar to that of R-NSGA-II, which is worse than that obtained by the NSGA-II. This is evident in Figures 2(d)–2(f) and 3(a) by comparison of final results; and, as shown in Figures 4(a)–4(l), 5(a)–5(d) and 6(a)–6(d), it is also apparent when it compares the performance metrics of the algorithms during the optimization processes.
From Figures 5(a)–5(d) and 6(a)–6(d), it is clear that using smaller (ηc, ηm) enables all three algorithms to get much better performances; however, by using the same (ηc, ηm), the R-NSGA-II and ER-NSGA-II cannot get improvements compared to NSGA-II. As explained in the section ‘Comparisons of the use of (ηc, ηm) with different values’, the use of smaller (ηc, ηm) encourages the generations of offsprings further distant from their parent solutions, especially in the early stage of the optimization, which largely increases the diversity of the searched population. For the three algorithms, the diversity of the searched population is determined primarily by the use of (ηc, ηm) and secondarily by the particular diversity maintenance in the second measure of population selection. Therefore, by the use of smaller (ηc, ηm), the NSGA-II, R-NSGA-II and ER-NSGA-II show nearly equivalently good performances; and the effect of different diversity maintenance in the second measure of population selection can be seen from the comparison of the three algorithms with the use of larger (ηc, ηm). Compared to NSGA-II, the R-NSGA-II and ER-NSGA-II abandon the crowding distance as the second measure for population selection, but adopt the preference distance instead, by considering the decision-maker's preferences and by using the ɛ-clearing strategy to maintain diversity of solutions. However, our application has shown no improvements brought about by the R-NSGA-II and ER-NSGA-II compared to NSGA-II. The direct inclusion of preference points is not necessarily more efficient than the use of crowding distance; this is probably due to their differences in the effects of stimulating the generation of diversified solutions. As well, for the ER-NSGA-II, the constrained Pareto-fitness approach may have also contributed to the bad performances by increasing the probability of introducing solutions from worse non-dominated levels into the new population.
Comparisons of the SHETRAN validation results
The validation results are satisfactory, which is also in agreement with those obtained from the SHETRAN calibration. As shown in Figure 7(a)–7(f), the non-dominated solutions from the optimization of NSGA-II, R-NSGA-II and ER-NSGA-II with (ηc, ηm) of (0.5, 0.5) are the best; and those obtained from optimizations with (ηc, ηm) of (2.0, 0.5) are better than those of (20., 20.). The validation results, shown in Figure 7(d)–7(f), correspond well with the calibration results, shown in Figure 7(a)–7(c). In this study, the SHETRAN model was calibrated and validated at basin outlet, as displayed in Figures 7(a) and 7(d), but the model performances have also been evaluated at two internal gauging stations, as shown in Figure 7(b)–7(c) and 7(e)–7(f). The results show that both the calibration and validation results are satisfactory not only at basin outlet but also at basin internal gauging stations. Figure 7 shows that, in terms of NSE, the best solutions have values of 0.87 and 0.81 at basin outlet, 0.70 and 0.72 at internal gauging station Abernoa and 0.82 and 0.66 at internal gauging station Entradas, respectively, for calibration and validation. Moreover, the equifinality problem (Beven & Freer 2001) was identified; the three optimal solutions ‘sim1a’, ‘sim1b’ and ‘sim1’, shown in Table 1, have different parameter settings but equivalently good model performances for both the calibration and validation simulations.
Visual comparisons between the observed and simulated hydrographs are made in Figure 8(a)–8(d), for one of the best solutions, for the largest storm events during the respective calibration and validation periods. The best solution ‘sim1’ was calibrated with (RMSE, LOGE, NSE) values of (2.81, 2.74, 0.87); the NSE is 0.89 and 0.75, respectively, for storms No. 1 and No. 4 at basin outlet (Figure 8(a)–8(b)) and it is 0.74 and 0.66 for storm No. 4 respectively at internal gauging stations Albernoa and Entradas (Figure 8(c) and 8(d)). The ‘sim1a’ and ‘sim1b’ are not shown because they are indistinguishable from ‘sim1’. To illustrate the differences in SHETRAN objective values, Figure 8(a)–8(d) also display the other three solutions, namely ‘sim2’, ‘sim3’ and ‘sim4’, with calibrated (RMSE, LOGE, NSE) values of (3.81, 2.53, 0.77), (4.85, 2.49, 0.63) and (5.85, 2.46, 0.46). From Table 1, the main differences of the calibrated parameters, between the best solutions and the others are: Strickler overland flow resistance coefficients for both crops and agroforestry and top soil depth of Vx soil. In ‘sim1a’, ‘sim1b’ and ‘sim1’, the small top soil depth makes more water appear as surface runoff, and the large Strickler overland flow resistance makes surface runoff increase. This explains the larger surface runoff and storm discharges of the best solutions compared to the other ones.
The best solutions have better performances than the previous SHETRAN simulations carried out for the Cobres basin and the optimized parameters are well consistent with the literature data. By using the 12-minute resolution rainfall data, daily PET data and 2 km spatial resolution, Bathurst et al. (1996) obtained NSE of 0.83, 0.81 and 0.61 at basin outlet for the SHETRAN simulations of the Cobres basin, respectively, during the calibration period from 1977 to 1979 and the two validation periods from 1980 to 1982 and from 1983 to 1985. By using the hourly rainfall and PET data, 2 km spatial resolution and the modified shuffled complex evolution (MSCE) optimization algorithm and the same model configuration, Zhang et al. (2013) calibrated and validated the SHETRAN model at Cobres basin for the same periods selected in this study, namely from 2004 to 2006 and from 2006 to 2008, and they got the optimized solution with NSE at basin outlet of 0.86 and 0.74, respectively. The best solutions have similar or close calibration parameters, such as top soil depth, AET/PET ratio and Strickler overland flow resistance coefficients, to the optimized solution obtained by Zhang et al. (2013). The soil depth of Vx is 0.30 or 0.33 m, which is equal or close to 0.30 m obtained by Zhang et al. (2013) and well inside the range of [0.13, 0.33] m measured by Bathurst et al. (1996). The AET/PET ratio at field capacity is 0.500 and around 0.617, respectively, for crops and agroforestry, which is near their respective lower limits and similar to the values of 0.500 and 0.600 obtained by Zhang et al. (2013). The smaller calibrated AET/PET ratios show the attempts of optimization algorithms in reducing AET to increase the total runoff for a better SHETRAN performance. However, for all these optimized solutions, the surface runoffs are largely underestimated, which may be explained by the reduced soil infiltration resulting from the surface sealing and crust formation (Zhang et al. 2013), physical processes that are not embodied in SHETRAN model and cannot be dealt with by an arbitrarily reduction of the saturated hydraulic conductivity. The Strickler overland flow resistance coefficient is around 10.0 m1/3s–1 and 5.0 m1/3s–1, respectively, for crops and agroforestry, which are at their respective large limit and approximate the values of 10.0 and 4.9 m1/3s–1 obtained by Zhang et al. (2013). By setting a larger Strickler overland flow resistance coefficient, the optimization algorithms try to increase the discharge capacity of river links to compensate for the loss of drainage density resulting from the use of a coarse spatial resolution (Zhang et al. 2013, Zhang 2015). Further studies are required to clarify this point.
CONCLUSIONS
This paper successfully applied the NSGA-II optimization algorithm (Deb et al. 2002) and its two variants, namely R-NSGA-II (Deb et al. 2006) and ER-NSGA-II (Siegmund et al. 2012), to the multi-objective calibration of the physically based, spatially distributed hydrological model SHETRAN. SBX and PM were used to generate offspring solutions with respective probabilities of 0.9 and 0.1. The crossover and mutation distribution indices (ηc, ηm) were configured as (0.5, 0.5), (2.0, 0.5) and (20., 20.) for all the three algorithms. The nine optimizations were repeated 30 times to consider random seed effects, and all of them terminated due to a limit of 1,500 SHETRAN simulations before the convergence criteria of performance metrics were satisfied. The comparisons among the nine optimizations have shown the distinct effect of using smaller values of (ηc, ηm) on getting better efficiency of the three algorithms; however, this effect is clear in the first, but not in the second, half of the optimization processes, due to the self-adaptive property of the SBX operator. On the other hand, the comparisons have also demonstrated that, by using the same values of (ηc, ηm), the R-NSGA-II and ER-NSGA-II do not provide more efficient optimization than the NSGA-II. The better efficiency brought about by the use of smaller (ηc, ηm) can be explained by the enhanced diversity of the offspring solutions. The lack of improvement in the optimization of the R-NSGA-II and ER-NSGA-II, compared to the NSGA-II, might be explained by the lack of diversified solutions, which was probably caused by the use of preference distance, rather than crowding distance, as the second measure for population selection.
The validation results of the non-dominated solutions from the nine optimizations are in agreement with those of their calibration. The optimizations with (ηc, ηm) of (0.5, 0.5) produce the best solutions and those with (ηc, ηm) of (2.0, 0.5) give better solutions than those with (20., 20.). The equifinality problem (Beven & Freer 2001) was identified; the calibration and validation results of the best solutions are satisfactory not only at basin outlet but also at internal gauging stations. In terms of NSE, the best solutions, respectively, for calibration and validation have values of 0.87 and 0.81 at basin outlet, 0.70 and 0.72 at internal gauging station Abernoa and 0.82 and 0.66 at internal gauging station Entradas; as for storm events, the solution has NSE of 0.89 and 0.75, respectively, for storms No. 1 (during the calibration period) and No. 4 (during the validation period) at basin outlet, and 0.74 and 0.66 for storm No. 4 at Albernoa and Entradas, respectively.
Finally, the study has demonstrated the importance of generating diversified offspring solutions for performance improvements of the global optimization methods (Laumanns et al. 2002; Reed et al. 2013) when it comes to automatic calibration of physically based, spatially distributed hydrological models. Although the study has only considered several settings of (ηc, ηm) due to the limited computational resources, the conclusions were made based on the mechanism of the optimization processes. Further applications should take into account more parameters of the global optimization methods and the relatively large ranges, as indicated in Reed et al. (2013), for getting better performances.
ACKNOWLEDGEMENTS
This study was made possible by a PhD grant of the Portuguese Foundation for Science and Technology (SFRH/BD/48820/2008). The authors are grateful for the support from the ERLAND (PTDC/AAC-AMB/100520/2008) project. The authors thank SNIRH and SAGRA/COTR for providing the necessary data, the research center CEFAGE (http://www.cefage.uevora.pt/en/) of the University of Évora for offering the required computational resources, and the following researchers for fruitful discussions and for providing access to the SHETRAN model: Prof. Chris Kilsby, Prof. James Bathurst, Dr Steve Birkinshaw, Dr Greg O'Donnell and Dr Isabella Bovolo from the University of Newcastle, UK. Also the authors are indebted to Prof. Francisco Santos, Prof. Elsa Sampaio, Prof. Ricardo Serralheiro, Prof. Shakib Shahidian, Dr Júlio Lima and Dr Célia Toureiro from the University of Évora and Dr João Pedro Nunes from the University of Aveiro, Portugal. Finally, we very much appreciate the comments and suggestions from the four anonymous reviewers, which considerably improved the manuscript.