Abstract
The Soil Conservation Service Curve Number (SCS-CN) method is one of the popular methods for calculating storm depth from a rainfall event. The previous research identified antecedent rainfall as a key element that controls the non-linear behaviour of the model. The original version indirectly uses five days antecedent rainfall to identify the land condition as dry, normal or wet. This leads to a sudden jump once the land condition changes. To obviate this, the present work intends to improve the performance of antecedent rainfall-based SCS-CN models. Two forms of SCS-CN model (M1 and M2), two recently developed P-P5 based models (M3 and M4), and an alternate approach of considering P5 in the SCS-CN model (M5 and M6), as proposed here, were investigated. Based on the evaluation of several error metrics, the new proposed model M6 has performed better than other models. The performance of this model is evaluated using rainfall-runoff events of 114 watersheds located in the USA. The median value of Nash-Sutcliffe Efficiency was found as 0.78 for the M6 model followed by M5 (0.75), M3 (0.73), M4 (0.72), M2 (0.63) and M1 (0.61) model.
HIGHLIGHTS
The study has been done on significant runoff producing events for which runoff coefficient is greater than 0.12.
Research supports the superior performance of the proposed model in US watersheds.
It acknowledges the applicability of five days antecedent rainfall (P5) on runoff prediction and shows improvement in model performance under all statistical indices.
Graphical Abstract
ABBREVIATIONS
- SCS-CN
Soil Conservation Service Curve Number
- AMC
antecedent moisture condition
- ARC
antecedent runoff condition
- CN
curve number
- S
potential maximum retention
- NEH-4
National Engineering Handbook-Section 4
- Ia
initial abstraction
- λ
initial abstraction coefficient
- USDA-ARS
United States Department of Agriculture-Agricultural Research Service
- RMSE
root mean square error
- NSE
Nash-Sutcliffe Efficiency
- PBIAS
percentage bias
- RGS
rank and grading system
INTRODUCTION
In surface water hydrology, the correct estimation of runoff is arguably the most important assignment for hydrologists and water scientists. This is useful in water supply, water allocation, hydrological analysis, watershed management, flood forecasting, flood protection work, integrated water management, control of non-point source pollution, etc. The runoff amount depends on rainfall intensity and its amount, wetness condition of the soil, watershed slope, various abstractions, land use, land cover, and many more factors. Hewlett et al. (1977) developed a rainfall-runoff relationship for a forest catchment and found negligible effects of rainfall intensity on peak discharge and runoff volume. Several studies have been conducted at event scale on various catchments of Europe to understand surface runoff generation process (Jordan 1994; Meyles et al. 2003; Latron et al. 2008). In case of events having both low-intensity rainfall and low-rainfall magnitude, the antecedent wetness state plays a major role in controlling runoff amount than rainfall intensity or its magnitude and a more precise and correct estimate can be achieved by using antecedent rainfall characteristics. If the joint dependence between rainfall event and antecedent precipitation is not taken into account properly, the runoff amount is consistently underestimated and when only one or two days' antecedent rainfall is considered, the magnitude of design flood can be as much as 30% less than actual (Pathiraja et al. 2012). The impact of prior rainfall of 48 hrs to 120 hrs of a rainfall event is more significant in determining the resulting runoff compared to other factors such as average and maximum rainfall intensity, event magnitude, and rainfall duration.
The relationship of intensity of storm event with antecedent moisture condition has become an increasing research subject in the context of anthropogenic climate change. To understand the role of antecedent moisture in rainfall runoff modelling, a tank experiment has been conducted based on high resolution observation in Hohai University, China, and a non-linear relationship was observed between soil moisture index and total runoff (Song & Wang 2019). If a model is calibrated without considering the impact of prior rainfall on the land surface, there will be a high likelihood that calibrated parameters will not produce the correct runoff yield. The water content in the upper soil surface may be an important factor in the rainfall-runoff relationship. A relatively lower sensitivity of antecedent rainfall on surface runoff has been found, maybe, due to the relatively dry upper surface in semiarid small watersheds located in Southeastern Arizona in the USA, contrary to other reported results (Zhang et al. 2011). The surface runoff is a threshold process and is governed by the runoff coefficient, which increases abruptly when a certain moisture threshold is exceeded. Similar results were found with changing values of moisture threshold by Radatz et al. (2013) and Zhao et al. (2015). A soil moisture accounting procedure was proposed by Michel et al. (2005) but criticized by Sahu et al. (2007) for not circumventing an undesirable sudden jump. Verma et al. (2020) conceptualized a theory of activation soil moisture (ASM) by coupling the infiltration component with the Soil Moisture Accounting (SMA) concept. The rainfall intensity, state of antecedent moisture and process of surface runoff are the three main reasons which evolve spatial and temporal non-linearity and complicate the watershed response. Most of the research shows that the rainfall-to-runoff transformation process is non-linear and the prime factor of nonlinearity is the antecedent moisture condition (Radatz et al. 2013; Zhao et al. 2015). This antecedent moisture, along with soil characteristics, regulates the runoff process and affects the capability to store new water due to the occurrence of rainfall as well as the infiltration capacity of the soil (Merz & Blöschl 2009). It is a challenging task to evaluate the impact of antecedent rainfall on runoff at a watershed scale and it is required in the planning and management of a watershed.
There are distinct mathematical models available in hydrology with various merits, demerits and complications. The SCS-CN method is the simplest and universally accepted model for event-based rainfall-runoff modeling and integrated with various hydrological, water quality, or erosion estimation models. After a long experimental work, this method was developed for conditions prevailing in the USA. The model requires only maximum potential storage (S, mm) of the watershed in the form of a curve number (CN) to calculate runoff depth. Generally, soil type, land use and adopted practices are not much changed, but antecedent moisture condition status is changed frequently with the antecedent rainfall amount, which affects the runoff flow pattern. Antecedent moisture condition (AMC) classes were re-labelled as antecedent runoff condition (ARC) classes (NRCS 2004). The observation and monitoring of soil moisture are difficult; that is why antecedent precipitation, which can address initial soil moisture status by using five days of rainfall (Brocca et al. 2008), is in common use. This term is used as a predictor to decide the antecedent runoff condition, which is categorized in three levels i.e. ARC I (dry), ARC II (normal), and ARC III (wet). These levels form a discrete relation between antecedent rainfall and curve number and are responsible for an undesirable sudden jump in runoff estimation (Mishra et al. 2008). Generally, the CN value obtained from NEH-4 table or calculated from the P-Q dataset is CNII (normal) and can be converted into CNI (dry) or CNIII (wet) as per the antecedent rainfall amount. The CN model uses the antecedent five-day rainfall to categorize it into either dry, normal, or wet conditions to account for watershed initial losses (Sahu et al. 2007).
To obviate the error in predicting runoff calculations due to the sudden jump in curve number value, consideration of pre-storm rainfall is required in event-based runoff modelling, which minimizes the error and tries to correct the runoff value. This study has been done to evaluate the relative significance of antecedent precipitation (P5) on the calculated runoff amount. Very few studies have been done to investigate the effect of antecedent rainfall on runoff behaviour. This is assessed using six variants of models, which are introduced here.
SCS-CN MODEL (M1 AND M2)
The conversion of SII to SI or SIII depends on the previous 5 days' rainfall. The value of P5 < 35.6 mm, 35.6 mm ≤ P5 ≤ 53.3 mm, and P5 > 53.3 mm assumes dry, normal, or wet conditions, respectively, for any storm event.
AJMAL & KIM MODEL (M3 AND M4)
It is to be noted that in both the above equations, Equations (8) and (9), S is the only unknown parameter. These equations are unique in nature and also exclude λ. Their performance were found to be significantly better than the SCS-CN model for the studied catchments. Equations (8) and (9) directly used P5 value instead to decide antecedent conditions as dry, normal, or wet before rainfall and to some extent were able to overcome the sudden jump in runoff computation. To check its applicability in other watersheds, similar equations are to be used in this study by utilizing the P-P5 dataset of 114 US watersheds.
PROPOSED MODEL (M5 AND M6)
The previous research suggested antecedent rainfall as a key component. The original model considers antecedent rainfall only to classify the land condition as dry, normal, or wet and ignored the exact amount of 5 days' prior rainfall (P5) which creates an undesirable sudden jump in runoff computation. This can be explained by an example. If we assume a rainfall amount of 100 mm (which occurs in the growing season) over different land conditions with CN values as 60, 70, 80, and 90; and the antecedent five days rainfall variation from 1 to 100 mm. These CN values have been assumed, since for most of the watersheds its value falls in between 55 to 95 (Hawkins et al. 1985).
From Figure 1 (assuming λ = 0.2 and using Equation (3), it can be seen that the calculated values of runoff are 1.29 mm for ARC I (P5 < 35.6 mm, CN = 60 or S = 385.30 mm), 18.57 mm for ARC II (P5 = 35.6 mm to 53.3 mm, CN = 60 or S = 169.33 mm), and 46.13 mm for ARC III (P5 > 53.3 mm, CN = 60 or S = 72.81 mm). It means if five days' prior rainfall value changes the antecedent rainfall condition from ARC I to ARC II, the runoff value suddenly jumps from 1.29 mm to 18.57 mm for 100 mm rainfall. Similarly, shifting the antecedent state from ARC II to ARC III, runoff jumps from 18.57 mm to 46.13 mm. Similar jumps are illustrated in Figure 1 at CN = 70, 80, and 90 for ARC I, ARC II and ARC III. This undesirable jump is due to the indirect use of P5 and it reduces the model efficiency.
Computed runoff generated from 100 mm of rainfall with different curve number (CN = 60, 70, 80, 90) and varying 5-days antecedent rainfall (P5 = 0 to 100 mm). Here CN0 is curve number when P5 is equal to zero.
Computed runoff generated from 100 mm of rainfall with different curve number (CN = 60, 70, 80, 90) and varying 5-days antecedent rainfall (P5 = 0 to 100 mm). Here CN0 is curve number when P5 is equal to zero.

This equation is a version of the SCS-CN equation with incorporating P5 and represents a simplified form of model M6. The different models using P5 value either directly or indirectly and related equations are also summarized in Table 1.
Parameter description of different models
S.No. . | Model . | Equation to be used and description of model . | Remarks . |
---|---|---|---|
1. | M1 | According to the P-Q dataset, determine S for individual storms using Equation (5). The median value of S for the whole dataset was calculated, which represented watershed S at normal condition. The runoff depth was calculated using Equation (3) at λ = 0.2. S can be converted using Equation (6) or Equation (7) based on antecedent condition as normal, dry or wet. | SCS-CN model (USDA 1985) |
2. | M2 | S value was optimized using Equation (3) at λ = 0.2, according to antecedent normal, dry, or wet condition which is decided based on P5 value and using Equation (5), Equation (6), or Equation (7) respectively. | SCS-CN model (NRCS 2004) |
3. | M3 | Equation (8) was used which directly consider P5 and optimized S value | Ajmal model (Ajmal & Kim 2015) |
4. | M4 | Equation (9) was used which directly consider P5 and optimized S value | Ajmal model (Ajmal & Kim 2015) |
5. | M5 | Optimized S value with λ = 0.2 using Equation (12) | Proposed model |
6. | M6 | Optimized S value with varying λ using Equation (11) | Proposed model |
S.No. . | Model . | Equation to be used and description of model . | Remarks . |
---|---|---|---|
1. | M1 | According to the P-Q dataset, determine S for individual storms using Equation (5). The median value of S for the whole dataset was calculated, which represented watershed S at normal condition. The runoff depth was calculated using Equation (3) at λ = 0.2. S can be converted using Equation (6) or Equation (7) based on antecedent condition as normal, dry or wet. | SCS-CN model (USDA 1985) |
2. | M2 | S value was optimized using Equation (3) at λ = 0.2, according to antecedent normal, dry, or wet condition which is decided based on P5 value and using Equation (5), Equation (6), or Equation (7) respectively. | SCS-CN model (NRCS 2004) |
3. | M3 | Equation (8) was used which directly consider P5 and optimized S value | Ajmal model (Ajmal & Kim 2015) |
4. | M4 | Equation (9) was used which directly consider P5 and optimized S value | Ajmal model (Ajmal & Kim 2015) |
5. | M5 | Optimized S value with λ = 0.2 using Equation (12) | Proposed model |
6. | M6 | Optimized S value with varying λ using Equation (11) | Proposed model |
MATERIAL AND METHODS
Study area and data selection criteria
This study has been done over 114 US watersheds having areas varying from 0.17 ha to 30,351.45 ha. Data is taken from the United States Department of Agriculture-Agricultural Research Service (USDA-ARS) database which is a collection of storm depth (P mm), runoff depth (Q mm), and antecedent five days rainfall (P5 mm) and generated from the breakpoint rainfall-runoff dataset. The information of watershed ID with its serial number, situated location, and states have been provided in Table 2. The average storm depth (P), average runoff depth (Q) and average antecedent rainfall value (P5) in mm unit for different watersheds are illustrated in Figure 2(a). In addition, the drainage area of different watersheds (ha) in log scale and number of available and selected events for this study are presented in Figure 2(b).
Different watersheds ID's with S.No., location, state and goodness of fit of different models based on NSE (Nash-Sutcliffe Efficiency) and RGS (Rank and grading system)
S. No. . | WS ID . | Location . | State . | Model rank based on NSE . | Obtained score based on rank . | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | ||||
1 | 9004 | Americus | Georgia | Neg | 0.26 | 0.69 | 0.67 | 0.76 | 0.88 | 1 | 2 | 4 | 3 | 5 | 6 |
2 | 13007 | Blacksburg | Virginia | Neg | Neg | 0.08 | 0.08 | Neg | Neg | 1 | 2 | 6 | 5 | 3 | 4 |
3 | 13008 | Blacksburg | Virginia | Neg | 0.62 | 0.89 | 0.89 | 0.79 | 0.92 | 1 | 2 | 5 | 4 | 3 | 6 |
4 | 13009 | Blacksburg | Virginia | 0.42 | 0.44 | 0.67 | 0.67 | 0.53 | 0.65 | 1 | 2 | 6 | 5 | 3 | 4 |
5 | 13010 | Blacksburg | Virginia | Neg | Neg | 0.57 | 0.56 | 0.21 | 0.59 | 1 | 2 | 5 | 4 | 3 | 6 |
6 | 13012 | Blacksburg | Virginia | 0.13 | 0.13 | 0.58 | 0.57 | 0.41 | 0.61 | 1 | 2 | 5 | 4 | 3 | 6 |
7 | 13014 | Blacksburg | Virginia | 0.83 | 0.87 | 0.95 | 0.95 | 0.92 | 0.94 | 1 | 2 | 6 | 5 | 3 | 4 |
8 | 13015 | Blacksburg | Virginia | Neg | Neg | 0.89 | 0.89 | 0.66 | 0.90 | 1 | 2 | 5 | 4 | 3 | 6 |
9 | 17001 | Edwardsville | Illinois | 0.75 | 0.75 | 0.79 | 0.78 | 0.80 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
10 | 17002 | Edwardsville | Illinois | 0.72 | 0.72 | 0.77 | 0.76 | 0.79 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
11 | 17003 | Edwardsville | Illinois | 0.72 | 0.72 | 0.72 | 0.71 | 0.78 | 0.80 | 2 | 4 | 3 | 1 | 5 | 6 |
12 | 17004 | Edwardsville | Illinois | 0.70 | 0.70 | 0.81 | 0.80 | 0.80 | 0.84 | 1 | 2 | 5 | 3 | 4 | 6 |
13 | 19001 | Lafayette | Indiana | Neg | Neg | 0.07 | Neg | 0.15 | 0.39 | 1 | 2 | 4 | 3 | 5 | 6 |
14 | 19004 | Lafayette | Indiana | 0.55 | 0.57 | 0.58 | 0.56 | 0.63 | 0.68 | 1 | 3 | 4 | 2 | 5 | 6 |
15 | 19005 | Lafayette | Indiana | 0.81 | 0.84 | 0.84 | 0.83 | 0.86 | 0.87 | 1 | 4 | 3 | 2 | 5 | 6 |
16 | 19006 | Lafayette | Indiana | 0.29 | 0.29 | 0.51 | 0.45 | 0.43 | 0.58 | 1 | 2 | 5 | 4 | 3 | 6 |
17 | 19007 | Lafayette | Indiana | 0.50 | 0.57 | 0.65 | 0.64 | 0.65 | 0.73 | 1 | 2 | 5 | 3 | 4 | 6 |
18 | 19008 | Lafayette | Indiana | 0.78 | 0.79 | 0.81 | 0.78 | 0.84 | 0.84 | 2 | 3 | 4 | 1 | 5 | 6 |
19 | 19009 | Lafayette | Indiana | 0.77 | 0.83 | 0.78 | 0.76 | 0.87 | 0.88 | 2 | 4 | 3 | 1 | 5 | 6 |
20 | 19010 | Lafayette | Indiana | 0.85 | 0.85 | 0.83 | 0.80 | 0.90 | 0.90 | 3 | 4 | 2 | 1 | 5 | 6 |
21 | 19011 | Lafayette | Indiana | 0.81 | 0.85 | 0.89 | 0.87 | 0.91 | 0.91 | 1 | 2 | 4 | 3 | 5 | 6 |
22 | 22003 | Fourmile CK | Iowa | 0.40 | 0.46 | 0.70 | 0.68 | 0.68 | 0.70 | 1 | 2 | 5 | 4 | 3 | 6 |
23 | 22004 | Fourmile CK | Iowa | 0.43 | 0.47 | 0.69 | 0.68 | 0.68 | 0.69 | 1 | 2 | 5 | 4 | 3 | 6 |
24 | 25001 | Kingdom City | Missouri | 0.78 | 0.78 | 0.81 | 0.80 | 0.81 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
25 | 26001 | Coshocton | Ohio | 0.19 | 0.34 | 0.70 | 0.69 | 0.66 | 0.71 | 1 | 2 | 5 | 4 | 3 | 6 |
26 | 26010 | Coshocton | Ohio | 0.45 | 0.46 | 0.68 | 0.66 | 0.62 | 0.70 | 1 | 2 | 5 | 4 | 3 | 6 |
27 | 26013 | Coshocton | Ohio | Neg | Neg | 0.27 | 0.26 | 0.01 | 0.27 | 1 | 2 | 6 | 4 | 3 | 5 |
28 | 26014 | Coshocton | Ohio | 0.64 | 0.65 | 0.70 | 0.69 | 0.70 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
29 | 26016 | Coshocton | Ohio | 0.19 | 0.35 | 0.65 | 0.64 | 0.53 | 0.63 | 1 | 2 | 6 | 5 | 3 | 4 |
30 | 26018 | Coshocton | Ohio | 0.59 | 0.69 | 0.74 | 0.72 | 0.75 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
31 | 26030 | Coshocton | Ohio | 0.55 | 0.57 | 0.70 | 0.69 | 0.64 | 0.71 | 1 | 2 | 5 | 4 | 3 | 6 |
32 | 26031 | Coshocton | Ohio | Neg | Neg | 0.52 | 0.49 | 0.24 | 0.48 | 1 | 2 | 6 | 5 | 3 | 4 |
33 | 26035 | Coshocton | Ohio | 0.35 | 0.35 | 0.72 | 0.72 | 0.55 | 0.74 | 1 | 2 | 5 | 4 | 3 | 6 |
34 | 26036 | Coshocton | Ohio | 0.56 | 0.61 | 0.71 | 0.71 | 0.66 | 0.68 | 1 | 2 | 6 | 5 | 3 | 4 |
35 | 26863 | Coshocton | Ohio | 0.84 | 0.84 | 0.88 | 0.87 | 0.87 | 0.89 | 1 | 2 | 5 | 3 | 4 | 6 |
36 | 33002 | Bentonville | Arkansas | Neg | Neg | 0.36 | 0.33 | Neg | 0.32 | 1 | 2 | 6 | 5 | 3 | 4 |
37 | 33005 | Bentonville | Arkansas | 0.92 | 0.93 | 0.96 | 0.96 | 0.95 | 0.97 | 1 | 2 | 5 | 4 | 3 | 6 |
38 | 33006 | Bentonville | Arkansas | 0.76 | 0.80 | 0.82 | 0.82 | 0.82 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
39 | 34002 | Cherokee | Oklahoma | 0.68 | 0.68 | 0.70 | 0.68 | 0.73 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
40 | 34006 | Cherokee | Oklahoma | 0.48 | 0.48 | 0.59 | 0.57 | 0.60 | 0.64 | 1 | 2 | 4 | 3 | 5 | 6 |
41 | 34007 | Cherokee | Oklahoma | 0.55 | 0.57 | 0.61 | 0.59 | 0.66 | 0.69 | 1 | 2 | 4 | 3 | 5 | 6 |
42 | 34008 | Cherokee | Oklahoma | 0.50 | 0.50 | 0.58 | 0.56 | 0.61 | 0.65 | 1 | 2 | 4 | 3 | 5 | 6 |
43 | 35001 | Guthrie | Oklahoma | 0.66 | 0.66 | 0.78 | 0.77 | 0.78 | 0.79 | 1 | 2 | 5 | 3 | 4 | 6 |
44 | 35002 | Guthrie | Oklahoma | Neg | Neg | 0.76 | 0.75 | 0.55 | 0.67 | 1 | 2 | 6 | 5 | 3 | 4 |
45 | 35003 | Guthrie | Oklahoma | 0.68 | 0.68 | 0.79 | 0.78 | 0.80 | 0.81 | 1 | 2 | 4 | 3 | 5 | 6 |
46 | 35008 | Guthrie | Oklahoma | 0.19 | 0.41 | 0.67 | 0.66 | 0.67 | 0.74 | 1 | 2 | 4 | 3 | 5 | 6 |
47 | 35010 | Guthrie | Oklahoma | 0.30 | 0.40 | 0.66 | 0.64 | 0.68 | 0.74 | 1 | 2 | 4 | 3 | 5 | 6 |
48 | 35011 | Guthrie | Oklahoma | Neg | Neg | Neg | Neg | Neg | Neg | 1 | 2 | 5 | 4 | 3 | 6 |
49 | 37001 | Stillwater | Oklahoma | 0.84 | 0.88 | 0.89 | 0.88 | 0.89 | 0.89 | 1 | 2 | 5 | 3 | 4 | 6 |
50 | 37002 | Stillwater | Oklahoma | 0.72 | 0.74 | 0.77 | 0.75 | 0.78 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
51 | 42008 | Riesel | Texas | 0.68 | 0.73 | 0.69 | 0.68 | 0.75 | 0.75 | 2 | 4 | 3 | 1 | 5 | 6 |
52 | 42010 | Riesel | Texas | 0.70 | 0.74 | 0.81 | 0.80 | 0.80 | 0.83 | 1 | 2 | 5 | 4 | 3 | 6 |
53 | 42012 | Riesel | Texas | 0.64 | 0.67 | 0.73 | 0.72 | 0.73 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
54 | 42013 | Riesel | Texas | 0.27 | 0.54 | 0.71 | 0.70 | 0.74 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
55 | 42014 | Riesel | Texas | 0.55 | 0.59 | 0.71 | 0.70 | 0.74 | 0.77 | 1 | 2 | 4 | 3 | 5 | 6 |
56 | 42015 | Riesel | Texas | 0.66 | 0.69 | 0.77 | 0.76 | 0.76 | 0.78 | 1 | 2 | 5 | 3 | 4 | 6 |
57 | 42016 | Riesel | Texas | 0.63 | 0.63 | 0.69 | 0.68 | 0.72 | 0.76 | 1 | 2 | 4 | 3 | 5 | 6 |
58 | 42017 | Riesel | Texas | 0.72 | 0.74 | 0.78 | 0.77 | 0.79 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
59 | 42037 | Riesel | Texas | 0.80 | 0.82 | 0.83 | 0.82 | 0.87 | 0.87 | 1 | 3 | 4 | 2 | 5 | 6 |
60 | 42038 | Riesel | Texas | 0.75 | 0.75 | 0.71 | 0.69 | 0.78 | 0.78 | 3 | 4 | 2 | 1 | 5 | 6 |
61 | 42039 | Riesel | Texas | 0.75 | 0.78 | 0.75 | 0.74 | 0.83 | 0.83 | 3 | 4 | 2 | 1 | 5 | 6 |
62 | 42040 | Riesel | Texas | 0.77 | 0.80 | 0.77 | 0.75 | 0.85 | 0.85 | 2 | 4 | 3 | 1 | 5 | 6 |
63 | 44001 | Hastings | Nebraska | 0.61 | 0.61 | 0.74 | 0.72 | 0.74 | 0.77 | 1 | 2 | 5 | 3 | 4 | 6 |
64 | 44002 | Hastings | Nebraska | 0.71 | 0.71 | 0.79 | 0.78 | 0.83 | 0.84 | 1 | 2 | 4 | 3 | 5 | 6 |
65 | 44003 | Hastings | Nebraska | 0.73 | 0.73 | 0.76 | 0.74 | 0.80 | 0.86 | 1 | 2 | 4 | 3 | 5 | 6 |
66 | 44004 | Hastings | Nebraska | 0.67 | 0.67 | 0.79 | 0.78 | 0.79 | 0.85 | 1 | 2 | 5 | 3 | 4 | 6 |
67 | 44005 | Hastings | Nebraska | 0.58 | 0.59 | 0.62 | 0.60 | 0.66 | 0.71 | 1 | 2 | 4 | 3 | 5 | 6 |
68 | 44006 | Hastings | Nebraska | 0.57 | 0.59 | 0.50 | 0.48 | 0.60 | 0.60 | 3 | 4 | 2 | 1 | 5 | 6 |
69 | 44007 | Hastings | Nebraska | 0.83 | 0.83 | 0.83 | 0.80 | 0.85 | 0.85 | 3 | 4 | 2 | 1 | 5 | 6 |
70 | 44008 | Hastings | Nebraska | 0.81 | 0.81 | 0.85 | 0.83 | 0.85 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
71 | 44009 | Hastings | Nebraska | 0.81 | 0.82 | 0.87 | 0.85 | 0.87 | 0.88 | 1 | 2 | 4 | 3 | 5 | 6 |
72 | 44010 | Hastings | Nebraska | 0.77 | 0.77 | 0.81 | 0.78 | 0.84 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
73 | 44011 | Hastings | Nebraska | 0.72 | 0.72 | 0.75 | 0.73 | 0.78 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
74 | 44012 | Hastings | Nebraska | 0.75 | 0.76 | 0.82 | 0.80 | 0.81 | 0.83 | 1 | 2 | 5 | 3 | 4 | 6 |
75 | 44013 | Hastings | Nebraska | 0.59 | 0.62 | 0.75 | 0.72 | 0.76 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
76 | 44014 | Hastings | Nebraska | 0.56 | 0.60 | 0.65 | 0.61 | 0.71 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
77 | 44015 | Hastings | Nebraska | 0.72 | 0.72 | 0.80 | 0.78 | 0.81 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
78 | 44016 | Hastings | Nebraska | 0.48 | 0.50 | 0.63 | 0.61 | 0.63 | 0.67 | 1 | 2 | 5 | 3 | 4 | 6 |
79 | 44017 | Hastings | Nebraska | 0.66 | 0.68 | 0.78 | 0.76 | 0.83 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
80 | 44018 | Hastings | Nebraska | 0.66 | 0.68 | 0.79 | 0.77 | 0.83 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
81 | 44019 | Hastings | Nebraska | 0.52 | 0.55 | 0.70 | 0.67 | 0.71 | 0.76 | 1 | 2 | 4 | 3 | 5 | 6 |
82 | 44020 | Hastings | Nebraska | 0.72 | 0.72 | 0.79 | 0.76 | 0.81 | 0.83 | 1 | 2 | 4 | 3 | 5 | 6 |
83 | 44021 | Hastings | Nebraska | 0.68 | 0.69 | 0.78 | 0.75 | 0.80 | 0.81 | 1 | 2 | 4 | 3 | 5 | 6 |
84 | 44022 | Hastings | Nebraska | 0.31 | 0.34 | 0.70 | 0.70 | 0.60 | 0.67 | 1 | 2 | 6 | 5 | 3 | 4 |
85 | 44023 | Hastings | Nebraska | 0.75 | 0.75 | 0.81 | 0.79 | 0.82 | 0.83 | 1 | 2 | 4 | 3 | 5 | 6 |
86 | 44024 | Hastings | Nebraska | 0.05 | 0.23 | 0.42 | 0.38 | 0.46 | 0.56 | 1 | 2 | 4 | 3 | 5 | 6 |
87 | 44025 | Hastings | Nebraska | 0.64 | 0.66 | 0.74 | 0.72 | 0.76 | 0.78 | 1 | 2 | 4 | 3 | 5 | 6 |
88 | 44026 | Hastings | Nebraska | 0.63 | 0.63 | 0.78 | 0.76 | 0.79 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
89 | 44027 | Hastings | Nebraska | 0.53 | 0.56 | 0.69 | 0.66 | 0.74 | 0.76 | 1 | 2 | 4 | 3 | 5 | 6 |
90 | 44028 | Hastings | Nebraska | 0.66 | 0.66 | 0.78 | 0.76 | 0.79 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
91 | 45001 | Safford | Arizona | 0.06 | 0.16 | 0.43 | 0.40 | 0.43 | 0.52 | 1 | 2 | 4 | 3 | 5 | 6 |
92 | 45002 | Safford | Arizona | 0.77 | 0.79 | 0.82 | 0.81 | 0.78 | 0.80 | 1 | 3 | 6 | 5 | 2 | 4 |
93 | 47002 | Albuquerque | New Maxico | 0.25 | 0.28 | 0.50 | 0.47 | Neg | 0.48 | 2 | 3 | 6 | 4 | 1 | 5 |
94 | 47003 | Albuquerque | New Maxico | Neg | Neg | Neg | Neg | Neg | Neg | 2 | 3 | 5 | 4 | 1 | 6 |
95 | 61001 | Monticello | Illinois | Neg | Neg | 0.71 | 0.70 | 0.62 | 0.74 | 1 | 2 | 5 | 4 | 3 | 6 |
96 | 61002 | Monticello | Illinois | Neg | Neg | 0.67 | 0.66 | 0.53 | 0.67 | 1 | 2 | 5 | 4 | 3 | 6 |
97 | 61003 | Monticello | Illinois | Neg | 0.42 | 0.66 | 0.63 | 0.69 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
98 | 61004 | Monticello | Illinois | Neg | 0.22 | 0.52 | 0.49 | 0.44 | 0.61 | 1 | 2 | 5 | 4 | 3 | 6 |
99 | 62001 | Oxford | Mississippi | 0.56 | 0.58 | 0.75 | 0.75 | 0.76 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
100 | 62002 | Oxford | Mississippi | 0.81 | 0.82 | 0.82 | 0.81 | 0.85 | 0.85 | 2 | 4 | 3 | 1 | 5 | 6 |
101 | 62005 | Oxford | Mississippi | 0.60 | 0.60 | 0.82 | 0.82 | 0.84 | 0.87 | 1 | 2 | 4 | 3 | 5 | 6 |
102 | 62007 | Oxford | Mississippi | 0.71 | 0.77 | 0.85 | 0.85 | 0.83 | 0.85 | 1 | 2 | 6 | 4 | 3 | 5 |
103 | 62010 | Oxford | Mississippi | 0.73 | 0.74 | 0.76 | 0.76 | 0.79 | 0.81 | 1 | 2 | 4 | 3 | 5 | 6 |
104 | 62011 | Oxford | Mississippi | Neg | 0.14 | 0.32 | 0.30 | 0.33 | 0.55 | 1 | 2 | 4 | 3 | 5 | 6 |
105 | 62012 | Oxford | Mississippi | 0.24 | 0.27 | 0.50 | 0.49 | 0.46 | 0.55 | 1 | 2 | 5 | 4 | 3 | 6 |
106 | 62014 | Oxford | Mississippi | 0.73 | 0.74 | 0.73 | 0.70 | 0.79 | 0.80 | 3 | 4 | 2 | 1 | 5 | 6 |
107 | 62018 | Oxford | Mississippi | 0.52 | 0.63 | 0.79 | 0.79 | 0.74 | 0.79 | 1 | 2 | 6 | 5 | 3 | 4 |
108 | 63103 | Tombstone | Arizona | 0.65 | 0.91 | 0.95 | 0.95 | 0.89 | 0.92 | 1 | 3 | 6 | 5 | 2 | 4 |
109 | 63104 | Tombstone | Arizona | 0.78 | 0.83 | 0.88 | 0.87 | 0.83 | 0.86 | 1 | 2 | 6 | 5 | 3 | 4 |
110 | 63106 | Tombstone | Arizona | 0.47 | 0.55 | 0.72 | 0.70 | Neg | 0.63 | 2 | 3 | 6 | 5 | 1 | 4 |
111 | 63112 | Tombstone | Arizona | 0.63 | 0.64 | 0.63 | 0.57 | 0.75 | 0.77 | 3 | 4 | 2 | 1 | 5 | 6 |
112 | 76001 | Santa Rita | Arizona | 0.37 | 0.53 | 0.70 | 0.68 | 0.50 | 0.65 | 1 | 3 | 6 | 5 | 2 | 4 |
113 | 76002 | Santa Rita | Arizona | Neg | 0.40 | 0.64 | 0.64 | Neg | 0.51 | 2 | 3 | 6 | 5 | 1 | 4 |
114 | 76003 | Santa Rita | Arizona | 0.39 | 0.42 | 0.59 | 0.57 | 0.48 | 0.60 | 1 | 2 | 5 | 4 | 3 | 6 |
S. No. . | WS ID . | Location . | State . | Model rank based on NSE . | Obtained score based on rank . | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | ||||
1 | 9004 | Americus | Georgia | Neg | 0.26 | 0.69 | 0.67 | 0.76 | 0.88 | 1 | 2 | 4 | 3 | 5 | 6 |
2 | 13007 | Blacksburg | Virginia | Neg | Neg | 0.08 | 0.08 | Neg | Neg | 1 | 2 | 6 | 5 | 3 | 4 |
3 | 13008 | Blacksburg | Virginia | Neg | 0.62 | 0.89 | 0.89 | 0.79 | 0.92 | 1 | 2 | 5 | 4 | 3 | 6 |
4 | 13009 | Blacksburg | Virginia | 0.42 | 0.44 | 0.67 | 0.67 | 0.53 | 0.65 | 1 | 2 | 6 | 5 | 3 | 4 |
5 | 13010 | Blacksburg | Virginia | Neg | Neg | 0.57 | 0.56 | 0.21 | 0.59 | 1 | 2 | 5 | 4 | 3 | 6 |
6 | 13012 | Blacksburg | Virginia | 0.13 | 0.13 | 0.58 | 0.57 | 0.41 | 0.61 | 1 | 2 | 5 | 4 | 3 | 6 |
7 | 13014 | Blacksburg | Virginia | 0.83 | 0.87 | 0.95 | 0.95 | 0.92 | 0.94 | 1 | 2 | 6 | 5 | 3 | 4 |
8 | 13015 | Blacksburg | Virginia | Neg | Neg | 0.89 | 0.89 | 0.66 | 0.90 | 1 | 2 | 5 | 4 | 3 | 6 |
9 | 17001 | Edwardsville | Illinois | 0.75 | 0.75 | 0.79 | 0.78 | 0.80 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
10 | 17002 | Edwardsville | Illinois | 0.72 | 0.72 | 0.77 | 0.76 | 0.79 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
11 | 17003 | Edwardsville | Illinois | 0.72 | 0.72 | 0.72 | 0.71 | 0.78 | 0.80 | 2 | 4 | 3 | 1 | 5 | 6 |
12 | 17004 | Edwardsville | Illinois | 0.70 | 0.70 | 0.81 | 0.80 | 0.80 | 0.84 | 1 | 2 | 5 | 3 | 4 | 6 |
13 | 19001 | Lafayette | Indiana | Neg | Neg | 0.07 | Neg | 0.15 | 0.39 | 1 | 2 | 4 | 3 | 5 | 6 |
14 | 19004 | Lafayette | Indiana | 0.55 | 0.57 | 0.58 | 0.56 | 0.63 | 0.68 | 1 | 3 | 4 | 2 | 5 | 6 |
15 | 19005 | Lafayette | Indiana | 0.81 | 0.84 | 0.84 | 0.83 | 0.86 | 0.87 | 1 | 4 | 3 | 2 | 5 | 6 |
16 | 19006 | Lafayette | Indiana | 0.29 | 0.29 | 0.51 | 0.45 | 0.43 | 0.58 | 1 | 2 | 5 | 4 | 3 | 6 |
17 | 19007 | Lafayette | Indiana | 0.50 | 0.57 | 0.65 | 0.64 | 0.65 | 0.73 | 1 | 2 | 5 | 3 | 4 | 6 |
18 | 19008 | Lafayette | Indiana | 0.78 | 0.79 | 0.81 | 0.78 | 0.84 | 0.84 | 2 | 3 | 4 | 1 | 5 | 6 |
19 | 19009 | Lafayette | Indiana | 0.77 | 0.83 | 0.78 | 0.76 | 0.87 | 0.88 | 2 | 4 | 3 | 1 | 5 | 6 |
20 | 19010 | Lafayette | Indiana | 0.85 | 0.85 | 0.83 | 0.80 | 0.90 | 0.90 | 3 | 4 | 2 | 1 | 5 | 6 |
21 | 19011 | Lafayette | Indiana | 0.81 | 0.85 | 0.89 | 0.87 | 0.91 | 0.91 | 1 | 2 | 4 | 3 | 5 | 6 |
22 | 22003 | Fourmile CK | Iowa | 0.40 | 0.46 | 0.70 | 0.68 | 0.68 | 0.70 | 1 | 2 | 5 | 4 | 3 | 6 |
23 | 22004 | Fourmile CK | Iowa | 0.43 | 0.47 | 0.69 | 0.68 | 0.68 | 0.69 | 1 | 2 | 5 | 4 | 3 | 6 |
24 | 25001 | Kingdom City | Missouri | 0.78 | 0.78 | 0.81 | 0.80 | 0.81 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
25 | 26001 | Coshocton | Ohio | 0.19 | 0.34 | 0.70 | 0.69 | 0.66 | 0.71 | 1 | 2 | 5 | 4 | 3 | 6 |
26 | 26010 | Coshocton | Ohio | 0.45 | 0.46 | 0.68 | 0.66 | 0.62 | 0.70 | 1 | 2 | 5 | 4 | 3 | 6 |
27 | 26013 | Coshocton | Ohio | Neg | Neg | 0.27 | 0.26 | 0.01 | 0.27 | 1 | 2 | 6 | 4 | 3 | 5 |
28 | 26014 | Coshocton | Ohio | 0.64 | 0.65 | 0.70 | 0.69 | 0.70 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
29 | 26016 | Coshocton | Ohio | 0.19 | 0.35 | 0.65 | 0.64 | 0.53 | 0.63 | 1 | 2 | 6 | 5 | 3 | 4 |
30 | 26018 | Coshocton | Ohio | 0.59 | 0.69 | 0.74 | 0.72 | 0.75 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
31 | 26030 | Coshocton | Ohio | 0.55 | 0.57 | 0.70 | 0.69 | 0.64 | 0.71 | 1 | 2 | 5 | 4 | 3 | 6 |
32 | 26031 | Coshocton | Ohio | Neg | Neg | 0.52 | 0.49 | 0.24 | 0.48 | 1 | 2 | 6 | 5 | 3 | 4 |
33 | 26035 | Coshocton | Ohio | 0.35 | 0.35 | 0.72 | 0.72 | 0.55 | 0.74 | 1 | 2 | 5 | 4 | 3 | 6 |
34 | 26036 | Coshocton | Ohio | 0.56 | 0.61 | 0.71 | 0.71 | 0.66 | 0.68 | 1 | 2 | 6 | 5 | 3 | 4 |
35 | 26863 | Coshocton | Ohio | 0.84 | 0.84 | 0.88 | 0.87 | 0.87 | 0.89 | 1 | 2 | 5 | 3 | 4 | 6 |
36 | 33002 | Bentonville | Arkansas | Neg | Neg | 0.36 | 0.33 | Neg | 0.32 | 1 | 2 | 6 | 5 | 3 | 4 |
37 | 33005 | Bentonville | Arkansas | 0.92 | 0.93 | 0.96 | 0.96 | 0.95 | 0.97 | 1 | 2 | 5 | 4 | 3 | 6 |
38 | 33006 | Bentonville | Arkansas | 0.76 | 0.80 | 0.82 | 0.82 | 0.82 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
39 | 34002 | Cherokee | Oklahoma | 0.68 | 0.68 | 0.70 | 0.68 | 0.73 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
40 | 34006 | Cherokee | Oklahoma | 0.48 | 0.48 | 0.59 | 0.57 | 0.60 | 0.64 | 1 | 2 | 4 | 3 | 5 | 6 |
41 | 34007 | Cherokee | Oklahoma | 0.55 | 0.57 | 0.61 | 0.59 | 0.66 | 0.69 | 1 | 2 | 4 | 3 | 5 | 6 |
42 | 34008 | Cherokee | Oklahoma | 0.50 | 0.50 | 0.58 | 0.56 | 0.61 | 0.65 | 1 | 2 | 4 | 3 | 5 | 6 |
43 | 35001 | Guthrie | Oklahoma | 0.66 | 0.66 | 0.78 | 0.77 | 0.78 | 0.79 | 1 | 2 | 5 | 3 | 4 | 6 |
44 | 35002 | Guthrie | Oklahoma | Neg | Neg | 0.76 | 0.75 | 0.55 | 0.67 | 1 | 2 | 6 | 5 | 3 | 4 |
45 | 35003 | Guthrie | Oklahoma | 0.68 | 0.68 | 0.79 | 0.78 | 0.80 | 0.81 | 1 | 2 | 4 | 3 | 5 | 6 |
46 | 35008 | Guthrie | Oklahoma | 0.19 | 0.41 | 0.67 | 0.66 | 0.67 | 0.74 | 1 | 2 | 4 | 3 | 5 | 6 |
47 | 35010 | Guthrie | Oklahoma | 0.30 | 0.40 | 0.66 | 0.64 | 0.68 | 0.74 | 1 | 2 | 4 | 3 | 5 | 6 |
48 | 35011 | Guthrie | Oklahoma | Neg | Neg | Neg | Neg | Neg | Neg | 1 | 2 | 5 | 4 | 3 | 6 |
49 | 37001 | Stillwater | Oklahoma | 0.84 | 0.88 | 0.89 | 0.88 | 0.89 | 0.89 | 1 | 2 | 5 | 3 | 4 | 6 |
50 | 37002 | Stillwater | Oklahoma | 0.72 | 0.74 | 0.77 | 0.75 | 0.78 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
51 | 42008 | Riesel | Texas | 0.68 | 0.73 | 0.69 | 0.68 | 0.75 | 0.75 | 2 | 4 | 3 | 1 | 5 | 6 |
52 | 42010 | Riesel | Texas | 0.70 | 0.74 | 0.81 | 0.80 | 0.80 | 0.83 | 1 | 2 | 5 | 4 | 3 | 6 |
53 | 42012 | Riesel | Texas | 0.64 | 0.67 | 0.73 | 0.72 | 0.73 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
54 | 42013 | Riesel | Texas | 0.27 | 0.54 | 0.71 | 0.70 | 0.74 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
55 | 42014 | Riesel | Texas | 0.55 | 0.59 | 0.71 | 0.70 | 0.74 | 0.77 | 1 | 2 | 4 | 3 | 5 | 6 |
56 | 42015 | Riesel | Texas | 0.66 | 0.69 | 0.77 | 0.76 | 0.76 | 0.78 | 1 | 2 | 5 | 3 | 4 | 6 |
57 | 42016 | Riesel | Texas | 0.63 | 0.63 | 0.69 | 0.68 | 0.72 | 0.76 | 1 | 2 | 4 | 3 | 5 | 6 |
58 | 42017 | Riesel | Texas | 0.72 | 0.74 | 0.78 | 0.77 | 0.79 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
59 | 42037 | Riesel | Texas | 0.80 | 0.82 | 0.83 | 0.82 | 0.87 | 0.87 | 1 | 3 | 4 | 2 | 5 | 6 |
60 | 42038 | Riesel | Texas | 0.75 | 0.75 | 0.71 | 0.69 | 0.78 | 0.78 | 3 | 4 | 2 | 1 | 5 | 6 |
61 | 42039 | Riesel | Texas | 0.75 | 0.78 | 0.75 | 0.74 | 0.83 | 0.83 | 3 | 4 | 2 | 1 | 5 | 6 |
62 | 42040 | Riesel | Texas | 0.77 | 0.80 | 0.77 | 0.75 | 0.85 | 0.85 | 2 | 4 | 3 | 1 | 5 | 6 |
63 | 44001 | Hastings | Nebraska | 0.61 | 0.61 | 0.74 | 0.72 | 0.74 | 0.77 | 1 | 2 | 5 | 3 | 4 | 6 |
64 | 44002 | Hastings | Nebraska | 0.71 | 0.71 | 0.79 | 0.78 | 0.83 | 0.84 | 1 | 2 | 4 | 3 | 5 | 6 |
65 | 44003 | Hastings | Nebraska | 0.73 | 0.73 | 0.76 | 0.74 | 0.80 | 0.86 | 1 | 2 | 4 | 3 | 5 | 6 |
66 | 44004 | Hastings | Nebraska | 0.67 | 0.67 | 0.79 | 0.78 | 0.79 | 0.85 | 1 | 2 | 5 | 3 | 4 | 6 |
67 | 44005 | Hastings | Nebraska | 0.58 | 0.59 | 0.62 | 0.60 | 0.66 | 0.71 | 1 | 2 | 4 | 3 | 5 | 6 |
68 | 44006 | Hastings | Nebraska | 0.57 | 0.59 | 0.50 | 0.48 | 0.60 | 0.60 | 3 | 4 | 2 | 1 | 5 | 6 |
69 | 44007 | Hastings | Nebraska | 0.83 | 0.83 | 0.83 | 0.80 | 0.85 | 0.85 | 3 | 4 | 2 | 1 | 5 | 6 |
70 | 44008 | Hastings | Nebraska | 0.81 | 0.81 | 0.85 | 0.83 | 0.85 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
71 | 44009 | Hastings | Nebraska | 0.81 | 0.82 | 0.87 | 0.85 | 0.87 | 0.88 | 1 | 2 | 4 | 3 | 5 | 6 |
72 | 44010 | Hastings | Nebraska | 0.77 | 0.77 | 0.81 | 0.78 | 0.84 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
73 | 44011 | Hastings | Nebraska | 0.72 | 0.72 | 0.75 | 0.73 | 0.78 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
74 | 44012 | Hastings | Nebraska | 0.75 | 0.76 | 0.82 | 0.80 | 0.81 | 0.83 | 1 | 2 | 5 | 3 | 4 | 6 |
75 | 44013 | Hastings | Nebraska | 0.59 | 0.62 | 0.75 | 0.72 | 0.76 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
76 | 44014 | Hastings | Nebraska | 0.56 | 0.60 | 0.65 | 0.61 | 0.71 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
77 | 44015 | Hastings | Nebraska | 0.72 | 0.72 | 0.80 | 0.78 | 0.81 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
78 | 44016 | Hastings | Nebraska | 0.48 | 0.50 | 0.63 | 0.61 | 0.63 | 0.67 | 1 | 2 | 5 | 3 | 4 | 6 |
79 | 44017 | Hastings | Nebraska | 0.66 | 0.68 | 0.78 | 0.76 | 0.83 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
80 | 44018 | Hastings | Nebraska | 0.66 | 0.68 | 0.79 | 0.77 | 0.83 | 0.85 | 1 | 2 | 4 | 3 | 5 | 6 |
81 | 44019 | Hastings | Nebraska | 0.52 | 0.55 | 0.70 | 0.67 | 0.71 | 0.76 | 1 | 2 | 4 | 3 | 5 | 6 |
82 | 44020 | Hastings | Nebraska | 0.72 | 0.72 | 0.79 | 0.76 | 0.81 | 0.83 | 1 | 2 | 4 | 3 | 5 | 6 |
83 | 44021 | Hastings | Nebraska | 0.68 | 0.69 | 0.78 | 0.75 | 0.80 | 0.81 | 1 | 2 | 4 | 3 | 5 | 6 |
84 | 44022 | Hastings | Nebraska | 0.31 | 0.34 | 0.70 | 0.70 | 0.60 | 0.67 | 1 | 2 | 6 | 5 | 3 | 4 |
85 | 44023 | Hastings | Nebraska | 0.75 | 0.75 | 0.81 | 0.79 | 0.82 | 0.83 | 1 | 2 | 4 | 3 | 5 | 6 |
86 | 44024 | Hastings | Nebraska | 0.05 | 0.23 | 0.42 | 0.38 | 0.46 | 0.56 | 1 | 2 | 4 | 3 | 5 | 6 |
87 | 44025 | Hastings | Nebraska | 0.64 | 0.66 | 0.74 | 0.72 | 0.76 | 0.78 | 1 | 2 | 4 | 3 | 5 | 6 |
88 | 44026 | Hastings | Nebraska | 0.63 | 0.63 | 0.78 | 0.76 | 0.79 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
89 | 44027 | Hastings | Nebraska | 0.53 | 0.56 | 0.69 | 0.66 | 0.74 | 0.76 | 1 | 2 | 4 | 3 | 5 | 6 |
90 | 44028 | Hastings | Nebraska | 0.66 | 0.66 | 0.78 | 0.76 | 0.79 | 0.80 | 1 | 2 | 4 | 3 | 5 | 6 |
91 | 45001 | Safford | Arizona | 0.06 | 0.16 | 0.43 | 0.40 | 0.43 | 0.52 | 1 | 2 | 4 | 3 | 5 | 6 |
92 | 45002 | Safford | Arizona | 0.77 | 0.79 | 0.82 | 0.81 | 0.78 | 0.80 | 1 | 3 | 6 | 5 | 2 | 4 |
93 | 47002 | Albuquerque | New Maxico | 0.25 | 0.28 | 0.50 | 0.47 | Neg | 0.48 | 2 | 3 | 6 | 4 | 1 | 5 |
94 | 47003 | Albuquerque | New Maxico | Neg | Neg | Neg | Neg | Neg | Neg | 2 | 3 | 5 | 4 | 1 | 6 |
95 | 61001 | Monticello | Illinois | Neg | Neg | 0.71 | 0.70 | 0.62 | 0.74 | 1 | 2 | 5 | 4 | 3 | 6 |
96 | 61002 | Monticello | Illinois | Neg | Neg | 0.67 | 0.66 | 0.53 | 0.67 | 1 | 2 | 5 | 4 | 3 | 6 |
97 | 61003 | Monticello | Illinois | Neg | 0.42 | 0.66 | 0.63 | 0.69 | 0.75 | 1 | 2 | 4 | 3 | 5 | 6 |
98 | 61004 | Monticello | Illinois | Neg | 0.22 | 0.52 | 0.49 | 0.44 | 0.61 | 1 | 2 | 5 | 4 | 3 | 6 |
99 | 62001 | Oxford | Mississippi | 0.56 | 0.58 | 0.75 | 0.75 | 0.76 | 0.82 | 1 | 2 | 4 | 3 | 5 | 6 |
100 | 62002 | Oxford | Mississippi | 0.81 | 0.82 | 0.82 | 0.81 | 0.85 | 0.85 | 2 | 4 | 3 | 1 | 5 | 6 |
101 | 62005 | Oxford | Mississippi | 0.60 | 0.60 | 0.82 | 0.82 | 0.84 | 0.87 | 1 | 2 | 4 | 3 | 5 | 6 |
102 | 62007 | Oxford | Mississippi | 0.71 | 0.77 | 0.85 | 0.85 | 0.83 | 0.85 | 1 | 2 | 6 | 4 | 3 | 5 |
103 | 62010 | Oxford | Mississippi | 0.73 | 0.74 | 0.76 | 0.76 | 0.79 | 0.81 | 1 | 2 | 4 | 3 | 5 | 6 |
104 | 62011 | Oxford | Mississippi | Neg | 0.14 | 0.32 | 0.30 | 0.33 | 0.55 | 1 | 2 | 4 | 3 | 5 | 6 |
105 | 62012 | Oxford | Mississippi | 0.24 | 0.27 | 0.50 | 0.49 | 0.46 | 0.55 | 1 | 2 | 5 | 4 | 3 | 6 |
106 | 62014 | Oxford | Mississippi | 0.73 | 0.74 | 0.73 | 0.70 | 0.79 | 0.80 | 3 | 4 | 2 | 1 | 5 | 6 |
107 | 62018 | Oxford | Mississippi | 0.52 | 0.63 | 0.79 | 0.79 | 0.74 | 0.79 | 1 | 2 | 6 | 5 | 3 | 4 |
108 | 63103 | Tombstone | Arizona | 0.65 | 0.91 | 0.95 | 0.95 | 0.89 | 0.92 | 1 | 3 | 6 | 5 | 2 | 4 |
109 | 63104 | Tombstone | Arizona | 0.78 | 0.83 | 0.88 | 0.87 | 0.83 | 0.86 | 1 | 2 | 6 | 5 | 3 | 4 |
110 | 63106 | Tombstone | Arizona | 0.47 | 0.55 | 0.72 | 0.70 | Neg | 0.63 | 2 | 3 | 6 | 5 | 1 | 4 |
111 | 63112 | Tombstone | Arizona | 0.63 | 0.64 | 0.63 | 0.57 | 0.75 | 0.77 | 3 | 4 | 2 | 1 | 5 | 6 |
112 | 76001 | Santa Rita | Arizona | 0.37 | 0.53 | 0.70 | 0.68 | 0.50 | 0.65 | 1 | 3 | 6 | 5 | 2 | 4 |
113 | 76002 | Santa Rita | Arizona | Neg | 0.40 | 0.64 | 0.64 | Neg | 0.51 | 2 | 3 | 6 | 5 | 1 | 4 |
114 | 76003 | Santa Rita | Arizona | 0.39 | 0.42 | 0.59 | 0.57 | 0.48 | 0.60 | 1 | 2 | 5 | 4 | 3 | 6 |
(a) Average values of rainfall (P), runoff (Q) and antecedent five days rainfall (P5); (b) number of available events, number of selected events (runoff coefficient C ≥ 0.12) and drainage area of the studied 114 US watersheds.
(a) Average values of rainfall (P), runoff (Q) and antecedent five days rainfall (P5); (b) number of available events, number of selected events (runoff coefficient C ≥ 0.12) and drainage area of the studied 114 US watersheds.
Here, P/S = 0.46 put into Equation (14), and finds Q/P as 0.12. It mean we can replace P/S ≥ 0.46 by Q/P ≥ 0.12. Thus, this study excluded lower runoff producing rainfall events (runoff coefficient value is less than 0.12) and sorted only those events for which C > 0.12. After adopting this criterion out of 28,849 events of 114 US watersheds, 11,784 events were selected for this study.
Parameter estimation
Model M1 used a fixed value of S (using Equation (3)) while the rest of the models obtained their S value through the optimization process. The initial estimate of S in the M2 model was taken as 125 mm and allowed to vary in between 1 and 500, while in other models S was allowed to vary in the range of 1 to 1,000 with an initial estimate of 250 mm. Model M6 optimized both the S and λ value. In the M6 model, the initial estimate of λ was assumed as 0.05 and permitted to vary between 0 and 1. The statistical summary of S and λ value for different models are presented in Table 3.
Parameter statistics of different models over 114 US watersheds (Smed of M1 model obtained from storm-event data and rest parameters for M2 to M6 model obtained by optimization)
Statistic . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | |
---|---|---|---|---|---|---|---|
Smed, mm . | S, mm . | S, mm . | S, mm . | S, mm . | λ . | S, mm . | |
Minimum | 8.96 | 6.76 | 26.37 | 24.67 | 25.73 | 0.00 | 35.07 |
Maximum | 58.41 | 203.04 | 339.01 | 338.81 | 394.93 | 0.53 | 580.50 |
Mean | 25.36 | 33.04 | 95.94 | 95.30 | 80.68 | 0.02 | 129.08 |
Median | 23.33 | 22.70 | 74.09 | 73.37 | 59.21 | 0.00 | 98.50 |
SD | 11.36 | 33.19 | 62.74 | 62.75 | 58.86 | 0.08 | 94.28 |
SE | 1.06 | 3.11 | 5.88 | 5.88 | 5.51 | 0.01 | 8.83 |
CI | 1.75 | 5.11 | 9.66 | 9.67 | 9.07 | 0.01 | 14.52 |
Q1 | 16.46 | 18.08 | 57.34 | 56.94 | 50.07 | 0.00 | 76.54 |
Q3 | 31.98 | 33.72 | 115.64 | 114.82 | 86.65 | 0.00 | 149.11 |
UB | 27.11 | 38.15 | 105.60 | 104.97 | 89.75 | 0.03 | 143.61 |
LB | 23.61 | 27.93 | 86.27 | 85.63 | 71.61 | 0.01 | 114.56 |
Statistic . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | |
---|---|---|---|---|---|---|---|
Smed, mm . | S, mm . | S, mm . | S, mm . | S, mm . | λ . | S, mm . | |
Minimum | 8.96 | 6.76 | 26.37 | 24.67 | 25.73 | 0.00 | 35.07 |
Maximum | 58.41 | 203.04 | 339.01 | 338.81 | 394.93 | 0.53 | 580.50 |
Mean | 25.36 | 33.04 | 95.94 | 95.30 | 80.68 | 0.02 | 129.08 |
Median | 23.33 | 22.70 | 74.09 | 73.37 | 59.21 | 0.00 | 98.50 |
SD | 11.36 | 33.19 | 62.74 | 62.75 | 58.86 | 0.08 | 94.28 |
SE | 1.06 | 3.11 | 5.88 | 5.88 | 5.51 | 0.01 | 8.83 |
CI | 1.75 | 5.11 | 9.66 | 9.67 | 9.07 | 0.01 | 14.52 |
Q1 | 16.46 | 18.08 | 57.34 | 56.94 | 50.07 | 0.00 | 76.54 |
Q3 | 31.98 | 33.72 | 115.64 | 114.82 | 86.65 | 0.00 | 149.11 |
UB | 27.11 | 38.15 | 105.60 | 104.97 | 89.75 | 0.03 | 143.61 |
LB | 23.61 | 27.93 | 86.27 | 85.63 | 71.61 | 0.01 | 114.56 |
Performance evaluation
RESULTS AND DISCUSSION
The performance of all 114 US watersheds resulting from applications of each of the models has been compared using RMSE, NSE, PBIAS, n(t), rank and grading system, and by visual assessment. The performance of all models for individual watersheds was compared by using a scatter plot (Figure 3,) and the collective performance of models can be seen in a Box and Whisker plot for all statistical indices (Figure 4,). The best model suggestion was based on total score obtained using rank and grading system (RGS) for all 114 US watersheds. The value of S was optimized for all six models which are presented in Table 3. The mean and median value of S was found to be higher for the M6 model and lowest for the M1 model. The higher S value also increases the standard deviation (SD) and standard error (SE) value of the M6 model.
Variation in (a) Root Mean Square Error (RMSE, mm); (b) Nash-Sutcliffe Efficiency (NSE); (c) PBIAS (%) and (d) n(t) values with watershed serial no. using different models.
Variation in (a) Root Mean Square Error (RMSE, mm); (b) Nash-Sutcliffe Efficiency (NSE); (c) PBIAS (%) and (d) n(t) values with watershed serial no. using different models.
(a) RMSE (mm); (b) NSE; (c) PBIAS (%) and (d) n(t) based performance evaluation of different models using Box and Whisker plot.
(a) RMSE (mm); (b) NSE; (c) PBIAS (%) and (d) n(t) based performance evaluation of different models using Box and Whisker plot.
The RMSE values for all models are presented in Figure 3(a). The lower the RMSE, the better the performance of the model, and vice versa. It can be seen that the existing SCS-CN model shows a worse performance than the other models. The median value of RMSE for M1, M2, M3, M4, M5, and M6 models were found to be 7.54, 7.23, 5.70, 5.88, 5.85 and 5.32 mm, respectively, which is lowest for the M6 model. Its mean value was also lowest (5.53 mm) for the M6 model. When we compared all models based on RMSE value, out of 114 watersheds the M6 model performs best with minimum RMSE values in 95 watersheds. Next is the model M3, which had the lowest RMSE values in the remaining 19 watersheds. From the RMSE value, it can be inferred that the M6 model performs well followed by M3, M5, M4, M2, and M1. The higher RMSE values exhibit the worst performance and are found mostly in the M1 and M2 models. Figure 4(a) exhibits the overall RMSE performance of all models by using a Box and Whisker plot. Noteworthy, the M3 and M4 models follow the same trend and the RMSE value of the M3 model is better than the M4 model.
The NSE value indicates the model efficiency and a high value means a better model. The NSE value was found to be better in the M6 model for most of the watersheds (Figure 3(b)). NSE values fall in a good range (0.80 ≤ NSE < 0.90) in 41 watersheds followed by 30, 25, 19, 15, and 11 for M5, M3, M4, M2, and M1, respectively. The cumulative median value for all watersheds was found to be highest for the M6 model as 0.78 followed by M5 (0.75) > M3 (0.73) > M4 (0.72) > M2 (0.63) > M1 (0.61). The mean value was very low, as 0.62 for the M5 model, since some of the watersheds' NSE values were found to be very low. In some cases it was negative, which indicates model prediction was worse than the mean observed value. From Figure 4(b), it is evident that model M6 performed superiorly, with higher NSE than other models and model M3 and M4 depict nearly the same performance.
PBIAS quantifies a model tendency either to overestimate or underestimate. A PBIAS value of zero indicates perfect fit, its negative value indicates overestimation and vice versa. Models M3 and M4 underestimated (positive PBIAS) the runoff in all 114 watersheds and the mean PBIAS value was also as high as 14.13% and 17.12% respectively compared to the other models. Models M1, M2, and M5 underestimated the runoff in 80, 107, and 101 watersheds and overestimated (negative PBIAS) in 34, 7, and 13 watersheds respectively. The mean and median PBIAS were both lowest and nearer to zero for the M6 model with 4.77% and 2.62% respectively. The PBIAS results indicated that the M6 model performance was very good in 91 watersheds and unsatisfactory in 4 watersheds only. By using the M6 model, most of the watersheds fall either in the very good or good range (Figure 3(c),). The PBIAS statistical index prefers the M6 model because it gives a more consistent and better PBIAS value (Figure 4(c),). The overall statistics of RMSE, NSE and PBIAS values for all models are presented in Table 4. The overall SD and SE values of RMSE, NSE, and PBIAS for 114 watersheds were found to be less for the M6 model. For the M5 model, SD and SE values are quite high because in some watersheds the performance of the model was very poor, which increases dispersion from its mean value, lowers the mean and maximizes their range.
Statistics of performance indicators for various models over 114 US watersheds
Statistic . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
RMSE . | RMSE . | RMSE . | RMSE . | RMSE . | RMSE . | NSE . | NSE . | NSE . | NSE . | NSE . | NSE . | PBIAS . | PBIAS . | PBIAS . | PBIAS . | PBIAS . | PBIAS . | |
Minimum | 2.81 | 2.46 | 1.77 | 1.82 | 2.61 | 2.23 | −6.98 | −1.96 | −0.36 | −0.40 | −1.20 | −0.13 | −63.72 | −11.44 | 1.48 | 2.78 | −6.67 | −7.01 |
Maximum | 15.35 | 13.20 | 12.49 | 12.58 | 12.48 | 11.46 | 0.92 | 0.93 | 0.96 | 0.96 | 0.95 | 0.97 | 57.65 | 45.88 | 40.80 | 45.07 | 58.52 | 41.35 |
Mean | 7.92 | 7.22 | 6.01 | 6.18 | 6.11 | 5.53 | 0.26 | 0.49 | 0.69 | 0.67 | 0.62 | 0.73 | 7.49 | 12.65 | 14.13 | 17.12 | 10.44 | 4.77 |
Median | 7.54 | 7.23 | 5.70 | 5.88 | 5.85 | 5.32 | 0.61 | 0.63 | 0.73 | 0.72 | 0.75 | 0.78 | 7.53 | 10.34 | 12.19 | 15.82 | 7.17 | 2.62 |
SD | 2.61 | 2.14 | 2.06 | 2.09 | 1.74 | 1.82 | 1.14 | 0.45 | 0.20 | 0.21 | 0.40 | 0.18 | 21.55 | 10.44 | 8.39 | 8.41 | 12.07 | 8.32 |
SE | 0.24 | 0.20 | 0.19 | 0.20 | 0.16 | 0.17 | 0.11 | 0.04 | 0.02 | 0.02 | 0.04 | 0.02 | 2.02 | 0.98 | 0.79 | 0.79 | 1.13 | 0.78 |
CI | 0.40 | 0.33 | 0.32 | 0.32 | 0.27 | 0.28 | 0.17 | 0.07 | 0.03 | 0.03 | 0.06 | 0.03 | 3.32 | 1.61 | 1.29 | 1.30 | 1.86 | 1.28 |
Q1 | 6.10 | 5.93 | 4.62 | 4.84 | 4.97 | 4.35 | 0.30 | 0.42 | 0.65 | 0.64 | 0.61 | 0.68 | −1.46 | 5.88 | 8.38 | 11.33 | 1.83 | −0.73 |
Q3 | 9.84 | 8.96 | 7.43 | 7.55 | 7.19 | 6.70 | 0.72 | 0.74 | 0.79 | 0.78 | 0.81 | 0.84 | 18.84 | 18.77 | 16.96 | 19.95 | 12.74 | 6.42 |
UB | 8.32 | 7.55 | 6.32 | 6.50 | 6.38 | 5.81 | 0.44 | 0.56 | 0.72 | 0.70 | 0.68 | 0.76 | 10.81 | 14.26 | 15.42 | 18.41 | 12.30 | 6.05 |
LB | 7.52 | 6.89 | 5.69 | 5.85 | 5.84 | 5.25 | 0.09 | 0.42 | 0.66 | 0.64 | 0.55 | 0.70 | 4.18 | 11.04 | 12.83 | 15.82 | 8.58 | 3.49 |
Statistic . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
RMSE . | RMSE . | RMSE . | RMSE . | RMSE . | RMSE . | NSE . | NSE . | NSE . | NSE . | NSE . | NSE . | PBIAS . | PBIAS . | PBIAS . | PBIAS . | PBIAS . | PBIAS . | |
Minimum | 2.81 | 2.46 | 1.77 | 1.82 | 2.61 | 2.23 | −6.98 | −1.96 | −0.36 | −0.40 | −1.20 | −0.13 | −63.72 | −11.44 | 1.48 | 2.78 | −6.67 | −7.01 |
Maximum | 15.35 | 13.20 | 12.49 | 12.58 | 12.48 | 11.46 | 0.92 | 0.93 | 0.96 | 0.96 | 0.95 | 0.97 | 57.65 | 45.88 | 40.80 | 45.07 | 58.52 | 41.35 |
Mean | 7.92 | 7.22 | 6.01 | 6.18 | 6.11 | 5.53 | 0.26 | 0.49 | 0.69 | 0.67 | 0.62 | 0.73 | 7.49 | 12.65 | 14.13 | 17.12 | 10.44 | 4.77 |
Median | 7.54 | 7.23 | 5.70 | 5.88 | 5.85 | 5.32 | 0.61 | 0.63 | 0.73 | 0.72 | 0.75 | 0.78 | 7.53 | 10.34 | 12.19 | 15.82 | 7.17 | 2.62 |
SD | 2.61 | 2.14 | 2.06 | 2.09 | 1.74 | 1.82 | 1.14 | 0.45 | 0.20 | 0.21 | 0.40 | 0.18 | 21.55 | 10.44 | 8.39 | 8.41 | 12.07 | 8.32 |
SE | 0.24 | 0.20 | 0.19 | 0.20 | 0.16 | 0.17 | 0.11 | 0.04 | 0.02 | 0.02 | 0.04 | 0.02 | 2.02 | 0.98 | 0.79 | 0.79 | 1.13 | 0.78 |
CI | 0.40 | 0.33 | 0.32 | 0.32 | 0.27 | 0.28 | 0.17 | 0.07 | 0.03 | 0.03 | 0.06 | 0.03 | 3.32 | 1.61 | 1.29 | 1.30 | 1.86 | 1.28 |
Q1 | 6.10 | 5.93 | 4.62 | 4.84 | 4.97 | 4.35 | 0.30 | 0.42 | 0.65 | 0.64 | 0.61 | 0.68 | −1.46 | 5.88 | 8.38 | 11.33 | 1.83 | −0.73 |
Q3 | 9.84 | 8.96 | 7.43 | 7.55 | 7.19 | 6.70 | 0.72 | 0.74 | 0.79 | 0.78 | 0.81 | 0.84 | 18.84 | 18.77 | 16.96 | 19.95 | 12.74 | 6.42 |
UB | 8.32 | 7.55 | 6.32 | 6.50 | 6.38 | 5.81 | 0.44 | 0.56 | 0.72 | 0.70 | 0.68 | 0.76 | 10.81 | 14.26 | 15.42 | 18.41 | 12.30 | 6.05 |
LB | 7.52 | 6.89 | 5.69 | 5.85 | 5.84 | 5.25 | 0.09 | 0.42 | 0.66 | 0.64 | 0.55 | 0.70 | 4.18 | 11.04 | 12.83 | 15.82 | 8.58 | 3.49 |
Like the previous three indices, the n(t) value was also found to be best in most of the watersheds using the M6 model (Figure 3(d),). Similar to the NSE, the cumulative mean of the n(t) value was found to be high for the M6 model at 1.19, followed by 1.04 for model M3. It was lowest for the M1 model at just 0.58 followed by the M2 model at 0.70. Table 5 summarises the guidelines for classifying the model performances according to their range as unsatisfactory, satisfactory, good and very good. This table suggests the usefulness and better performance of the M6 model compared to other models. Model M6 found exemplary performance in maximum cases, while poor performance was found comparatively in fewer watersheds.
Comparative performance and identification of the best model using different statistical indicators after studying 114 US watersheds
Performance Index . | Range . | Rating . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . |
---|---|---|---|---|---|---|---|---|
No. of watersheds with ‘–‘ve NSE | NSE < 0 | Unsatisfactory | 18 | 12 | 2 | 3 | 7 | 3 |
NSE performance criteria set by Ritter & Muñoz-Carpena (2013) | NSE < 0.65 | Unsatisfactory | 65 | 60 | 27 | 31 | 34 | 24 |
0.65 ≤ NSE < 0.80 | Satisfactory | 37 | 37 | 59 | 61 | 46 | 42 | |
0.80 ≤ NSE < 0.90 | Good | 11 | 15 | 25 | 19 | 30 | 41 | |
NSE ≥ 0.90 | Very good | 1 | 2 | 3 | 3 | 4 | 7 | |
NSE Performance criteria set by Moriasi et al. (2007) | NSE ≤ 0.50 | Unsatisfactory | 42 | 37 | 11 | 15 | 19 | 8 |
0.50 < NSE ≤ 0.65 | Satisfactory | 23 | 23 | 16 | 16 | 15 | 16 | |
0.65 < NSE ≤ 0.75 | Good | 27 | 29 | 35 | 35 | 24 | 23 | |
NSE ≥ 0.75 | Very good | 22 | 25 | 52 | 48 | 56 | 67 | |
PBIAS performance criteria set by Moriasi et al. (2007) | PBIAS ≥ 25 | Unsatisfactory | 25 | 13 | 16 | 18 | 12 | 4 |
15 ≤ PBIAS < 25 | Satisfactory | 20 | 28 | 23 | 44 | 16 | 9 | |
10 ≤ PBIAS < 15 | Good | 17 | 19 | 36 | 32 | 13 | 10 | |
PBIAS < 10 | Very good | 52 | 54 | 39 | 20 | 73 | 91 | |
n(t) performance criteria set by Ritter & Muñoz-Carpena (2013) | n(t) < 0.7 | Unsatisfactory | 64 | 61 | 27 | 30 | 34 | 24 |
0.7 ≤ n(t) < 1.2 | Satisfactory | 38 | 36 | 55 | 59 | 40 | 36 | |
1.2 ≤ n(t) < 2.2 | Good | 11 | 15 | 29 | 22 | 36 | 47 | |
n(t) > 2.2 | Very good | 1 | 2 | 3 | 3 | 4 | 7 |
Performance Index . | Range . | Rating . | M1 . | M2 . | M3 . | M4 . | M5 . | M6 . |
---|---|---|---|---|---|---|---|---|
No. of watersheds with ‘–‘ve NSE | NSE < 0 | Unsatisfactory | 18 | 12 | 2 | 3 | 7 | 3 |
NSE performance criteria set by Ritter & Muñoz-Carpena (2013) | NSE < 0.65 | Unsatisfactory | 65 | 60 | 27 | 31 | 34 | 24 |
0.65 ≤ NSE < 0.80 | Satisfactory | 37 | 37 | 59 | 61 | 46 | 42 | |
0.80 ≤ NSE < 0.90 | Good | 11 | 15 | 25 | 19 | 30 | 41 | |
NSE ≥ 0.90 | Very good | 1 | 2 | 3 | 3 | 4 | 7 | |
NSE Performance criteria set by Moriasi et al. (2007) | NSE ≤ 0.50 | Unsatisfactory | 42 | 37 | 11 | 15 | 19 | 8 |
0.50 < NSE ≤ 0.65 | Satisfactory | 23 | 23 | 16 | 16 | 15 | 16 | |
0.65 < NSE ≤ 0.75 | Good | 27 | 29 | 35 | 35 | 24 | 23 | |
NSE ≥ 0.75 | Very good | 22 | 25 | 52 | 48 | 56 | 67 | |
PBIAS performance criteria set by Moriasi et al. (2007) | PBIAS ≥ 25 | Unsatisfactory | 25 | 13 | 16 | 18 | 12 | 4 |
15 ≤ PBIAS < 25 | Satisfactory | 20 | 28 | 23 | 44 | 16 | 9 | |
10 ≤ PBIAS < 15 | Good | 17 | 19 | 36 | 32 | 13 | 10 | |
PBIAS < 10 | Very good | 52 | 54 | 39 | 20 | 73 | 91 | |
n(t) performance criteria set by Ritter & Muñoz-Carpena (2013) | n(t) < 0.7 | Unsatisfactory | 64 | 61 | 27 | 30 | 34 | 24 |
0.7 ≤ n(t) < 1.2 | Satisfactory | 38 | 36 | 55 | 59 | 40 | 36 | |
1.2 ≤ n(t) < 2.2 | Good | 11 | 15 | 29 | 22 | 36 | 47 | |
n(t) > 2.2 | Very good | 1 | 2 | 3 | 3 | 4 | 7 |
The superiority of the M6 model over the rest of the models was judged by making a cumulative frequency distribution curve for percentage improvement (r2) criteria (Figure 5,). The M6 model performed better than the M1, M2, and M5 models for all watersheds while for the M3 and M4 models, only 17 and 14% watersheds respectively performed better than M6. To visually assess the performance of different models a scatter plot (Figure 6 ) has been drawn between observed and computed runoff for WS ID- 9004, and 33005. The visual assessment indicates almost equal performance of M6 and M5 models for WS ID 9004 and much better performance of the M6 model than the rest of the models for WS ID 33005.
Cumulative frequency distribution for percentage improvement of M6 model over other models using r2 criteria.
Cumulative frequency distribution for percentage improvement of M6 model over other models using r2 criteria.
Plot of observed runoff versus computed runoff to visually assess the performance of different models in the watershed (a) WS-9004 and (b) WS-33005.
Plot of observed runoff versus computed runoff to visually assess the performance of different models in the watershed (a) WS-9004 and (b) WS-33005.
A NSE-based rank and grading based system (RGS) was adopted to select the preference of the best model. A rank was assigned to each model for the individual watershed. A high NSE value has been given to the best rank as 1 and credit 6 point score in its account. From Table 2, for WS ID 9004, the NSE value was highest for the M6 model (Rank I, Score 6) followed by M5 (Rank II, Score 5), M4 (Rank III, Score 4), M3 (Rank IV, Score 3), M2 (Rank V, Score 2), and M1 (Rank VI, Score 1) as 0.88, 0.76, 0.67, 0.69, 0.26 and a negative NSE respectively. Model M6 gained 6, 5, 4, 3, 2, and 1 score in 95, 3, 16, 0, 0, and 0 watersheds respectively. The cumulative sum of the score was highest for the M6 model at 649 (6 × 95 + 5 × 3 + 4 × 16 + 3 × 0 + 2 × 0 + 1 × 0 = 649) followed by 504 for M3, 471 for M5, 368 for M4, 264 for M2 and 138 for the M1 model (Figure 7 ). Therefore, on the basis of RGS, the M6 model can be also rated as the best model. After the M6 model, the next better performing models were found to be M3, M5, M4, M2, and M1 respectively.
RGS based sum score resulted by all the models over 114 US watersheds.
The results indicate that the indirect approach to categorize runoff conditions on the basis of antecedent five days rainfall as dry, normal, or wet does not reflect the best performing potential. Better is to incorporate P5 directly in the runoff model and this certainly helps in improved model performance. Using trial and error methods, Ajmal and Kim proposed two models for South Korean catchments that directly consider the P5 value in model formulation. Both model performances were found to be better than the SCS-CN model and increase the model efficiency of US watersheds. In this study, the SCS-CN model was modified by incorporating P5 value and provides a more rational basis to M5 and M6 models. Despite being empirical in nature, it is needless to reiterate that the new model proposed in this work shows the promise of better performance using several error metrics.
CONCLUSION
Based on this study, the following can be inferred:
- 1.
The proposed study obviates the problem of the sudden jump and improves the performance of the model. The proposed model changes the maximum potential retention value (S, mm) due to the antecedent 5 days' rainfall values.
- 2.
All statistical criteria were found to be better for the proposed model with less RMSE, high NSE, better PBIAS, high n(t) value, and better overall rank and grading based score.
- 3.
Between M5 and M6 models, M5 performance was poor due to the fixed λ value. The M5 model indicates that a fixed λ value of 0.2 does not fit well and some other value should be used. Model M6 includes variation in λ value and it increases the efficiency of the model. For 97 watersheds, the λ value was found to be zero. The median value of parameter λ was found to also be zero. Therefore, model M6 can be used with λ value as zero (Equation (11)) simplifying the M5 model.
ACKNOWLEDGEMENT
A special thanks to Prof. R.H. Hawkins, Emeritus Professor, University of Arizona for providing rainfall-runoff dataset of US watersheds and Prof. C.S.P. Ojha for supervising and giving useful suggestions to complete this research work.
DATA AVAILABILITY STATEMENT
All relevant data are included in the paper or its Supplementary Information.