Extreme rainfall events leading to severe hydrological impacts warrant an accurate prediction of such events not only on time but also in magnitude. Sri Lanka is a South Asian country that is frequently affected by severe tropical storms. The primary aim of this study was to improve heavy rainfall events forecast during the North-East monsoon over the Badulu Oya catchment, Sri Lanka. This aim was accomplished by simulating precipitation for two extreme North-East monsoon rainfall events using the Weather Research and Forecasting (WRF-ARW) model. A detailed comparison was made between the 24-h spatial distribution of model rainfall and observations obtained from rainfall gauges. Verification was evaluated based on three deterministic approaches. Each rainfall event was simulated multiple times using 15 different parameterization scheme combinations including six microphysics and four cumulus schemes at a 3 km grid resolution. The filtered best model combinations were validated using observations from another two heavy North-East monsoon rainfall events. The key finding from these evaluations was that model configurations with WSM5, WSM6, Kessler and WDM6 microphysics, and KF, BMJ and MKF cumulus schemes displayed the overall best performances. Therefore, these combinations have a good potential for operational use in numerical weather prediction over the said catchment.

  • Extreme precipitation events within the North-East monsoon over Badulu Oya catchment, Sri Lanka were simulated using the WRF-ARW model.

  • Sensitivity studied to MP (Ferrier, WSM3, WSM5, WSM6, Kessler, WDM6) and CU (KF, BMJ, MKF, GF) schemes combinations.

  • Simulations were evaluated with field observations.

  • Combinations of WSM5, WSM6, Kessler, WDM6 along with KF, BMJ and MKF schemes displayed the overall best performances.

Graphical Abstract

Graphical Abstract
Graphical Abstract

The accurate prognosis at different temporal scales ranging from short and medium range (a few hours to some days ahead) can reduce the impacts of water-related hazards and provide the basis for more effective water resources management (Emmanouil et al. 2021). However, the forecasting task is more rigorous due to the complex interactions between the Earth and the atmosphere (Piciullo et al. 2018). There are well-known Global Climate Models (GCMs) that often have oversimplified physics, parameterized structures and coarser horizontal spatial resolution to simulate the interactions among various macro- and microphysical processes of a weather system. Regional Climate Models (RCMs) are applied to overcome the GCM's limitations which are dynamically forced by GCMs and have high spatial and temporal resolution and improved physics (such as convection) (Bliznak et al. 2019). With the advent of recent high-performance computing facilities, they can also resolve the regional features related to topography, local climate and the associated precipitation. All-weather centers and meteorological services employ the GCMs to simulate weather and climate over the area of interest at desired resolutions (Srinivas et al. 2013; Ji et al. 2014).

The WRF model (Weather Research and Forecasting model) is one of the most widely applied, cutting-edge RCMs designed to combine the expertise and experience of mesoscale meteorology, land surface and climate science over the last few decades (Skamarock et al. 2019; Scaff et al. 2020). The model provides a comprehensive range of options for selecting physics schemes: microphysics, cumulus, land surface, boundary layer and long/short wave radiation schemes that can be modified and fine-tuned to suit its regional environment (Tian et al. 2017; Skamarock et al. 2019). Advanced Research WRF (ARW) and Nonhydrostatic Mesoscale Model (NMM) are two dynamical cores of the model which have Eulerian mass dynamical cores with terrain-following vertical coordinates (Skamarock et al. 2019). The WRF-ARW is widely used in regional climate and seasonal time-scale research, chemistry applications, global simulations and idealized simulations at many scales (convection, baroclinic waves, extensive eddy simulations, etc.). This model performs better than the fifth-generation Penn State/NCAR (National Center for Atmospheric Research) Mesoscale Model (MM5), while rainfall is still one of the most challenging variables to simulate and predict (Tian et al. 2017; Skamarock et al. 2019). Distinct physical parameterization combinations within the WRF model must be applied in different cases because each physics scheme emphasizes a different physical process and has its unique structure and complexity to storm formation and development (Tian et al. 2017).

Previous studies have proven that the microphysics and cumulus parameterization schemes directly affect precipitation predictions of the WRF model, whereas the precipitation simulation is less susceptible to microphysics in contrast to the cumulus convection scheme (Chawla et al. 2018; Liu et al. 2018). The microphysics scheme includes particular water vapor, cloud and precipitation processes. The cumulus parameterization scheme is responsible for the subgrid-scale effects of convective or shallow clouds and it is theoretically valid only for coarser grid sizes. Activating the cumulus scheme within the high-resolution inner domain improves the precipitation forecasting skill in explicit microphysics alone (Lee et al. 2011; Sun & Barros 2014). Model horizontal resolutions between 2 and 10 km are referred to as the ‘gray zone’, and users must either avoid the grid scale or perform some basic testing to decide whether utilizing a cumulus scheme is ideal for their specific grid scale beyond certain limits (On et al. 2018).

Sri Lanka is an island nation in the Asia-Pacific region prone to severe tropical storms that cause widespread flooding and landslides in the country, destroying dwellings and submerging entire villages. In Sri Lanka, landslides threaten several districts and spread over a land area with the Badulla district being the most vulnerable (Jayasinghe et al. 2017). Rainfall is a significant cause of landslides in Sri Lanka, and sloped agricultural lands in the Badulla district might experience landslides after two days of continuous rainfall of 75–100 mm (Perera et al. 2017). As a result, the Badulu Oya catchment area in the Badulla district is a significant area where large-scale landslides are observed during intense rainfall events that have disastrous effects on infrastructure and result in significant monetary and human losses in a short period.

The numerical studies employing the WRF-ARW model are more rigorous in Sri Lanka due to its complex topographical features, notably its central mountainous area. Previous research utilizing the WRF model to forecast heavy rainfall events in Sri Lanka discovered that the model's results did not accurately estimate rainfall amounts and that rainfall patterns varied depending on the model's configurations (Nandalal et al. 2012; Darshika & Premalal 2015; De-Silva et al. 2016; Rodrigo et al. 2018; Samarasingha et al. 2021). Hence, there is no definitive conclusion regarding physics systems in Sri Lanka, necessitating additional research. Hopefully, this study will address this research vacuum with appropriate content for operational usage and future research into the WRF model's use in rainfall forecasting.

The purpose of this study is to simulate extreme rainfall events that occur during the North-East monsoon over the Badulu Oya basin with an emphasis on evaluating the performance of the physics schemes combinations to predict the spatial distribution of daily accumulated rainfall accurately. In an initial desk study, more accurate precipitation amounts are obtained with activated cumulus parameterization schemes inside the finer grid resolution consistent with previous investigations (Chawla et al. 2018; Rodrigo et al. 2018). The model outputs on model grid points were interpolated and extracted to each observation location to perform an inter-comparison. The deterministic approach was used to examine the accuracy of the amount and position of precipitation using a categorical verification method and two continuous verification methods by comparing the simulated 24-h precipitation output with the observed 24-h precipitation levels.

The structure of this paper is as follows: in Section 2, the methodology including the study area, selected precipitation events, model set-up, data and results comparison methods used for all test events are described. The results are discussed in Section 3 and the conclusions in Section 4.

Study area and precipitation events

Sri Lanka is a South Asian country located within the tropics between 5° 55′ and 9° 51′ North latitude and between 79° 42′ and 81° 53′ East longitude in the Indian Ocean. Rainfall in Sri Lanka varies significantly due to the development of highly low-pressure conditions in the Bay of Bengal. The climate on the island can be characterized by two distinct seasons; the North-East Monsoon season (December–March) and the South-West Monsoon season (May–September) (Rajapaksha et al. 2020). Mahaweli River is the longest river in Sri Lanka and Badulu Oya catchment is a sub-catchment of the upper Mahaweli River catchment which covers 404 km2 of land area within Badulla District. Badulu Oya originates from the Namunukula mountain range and traverses approximately 59 km through the eastern slopes of the central highland (Figure 1). Badulu Oya covers a few main urban areas furnishing domestic water requirements, especially the densely populated middle of the stream (Rajapaksha et al. 2020). The North-East monsoon season is an easterly disturbance that results in heavy rainfall over the Badulu Oya catchment area. Mesoscale weather features of the North-East monsoon are more dominant than synoptic scale features due to weak north-easterly wind flow and weak large-scale pressure gradient. Annual rainfall is approximately 1,500–2,000 mm/year within the catchment (Ruwangika et al. 2020).
Figure 1

Badulu Oya catchment and selected rainfall stations, Source: Department of Survey, Sri Lanka.

Figure 1

Badulu Oya catchment and selected rainfall stations, Source: Department of Survey, Sri Lanka.

Close modal

In December 2019, extensive rainfall events were recorded in the Badulu Oya catchment area with 100–140 mm large cumulative rainfall per day during the North-East monsoon which instigated severe damage for residential people in that area (Ministry of Defence 2019). The dates and recorded maximum daily rainfall amounts within the study area are 1–8 December (130 mm) (First Rainfall Event) and 15–22 December (135 mm) (Second Rainfall Event) (DMSL 2020).

These two recorded extreme rainfall events which caused considerable damage within the 2019 year were selected as model testing events for this study: 1–8 December (First Rainfall Event) and 15–22 December (Second Rainfall Event). To model the validation process, another two extreme precipitation events were selected within the North-East monsoon: 21–28 December 2018 and 17–24 December 2020 (DMSL 2020).

Experimental set-up

The multi-nest capable WRF-ARW model was used for the study which offers several physics options for cloud microphysics, radiation schemes, boundary layer processes and cumulus parameterization schemes. Figure 2 shows the WRF domain set-up using interactive nested domains inside the parent domain. The two-way nested domain set-up consists of a mother domain with a horizontal resolution of 27 km and parent grid ratios of 1, 3 and 3 with the remaining domains (27 km/9 km/3 km domain configuration). Horizontal and vertical grid points of this domain configuration were selected as 100 × 100, 100 × 100 and 34 × 34, respectively. It was opted to encompass the entire Bay of Bengal, while placing Sri Lanka at the center based on the significant influences of low-pressure systems in the Bay of Bengal on the heavy precipitation in Sri Lanka (De-Silva et al. 2016). This domain set-up shares Badulla town as its center in the Mercator projection system and geographic data resolution is taken as 30 s. The inner grid covers the Badulu Oya catchment which is within the ‘gray zone’ (On et al. 2018), and only the meteorological information from the inner grid was used in this research study.
Figure 2

WRF domain set-up using an outer grid resolution of 27 km (D1), 9 km (D2) and inner grid resolution of 3 km (D3).

Figure 2

WRF domain set-up using an outer grid resolution of 27 km (D1), 9 km (D2) and inner grid resolution of 3 km (D3).

Close modal

Fifteen physics combinations (CM1–CM15) were configured to evaluate a series of mesoscale simulations with various parameterization schemes for the study. The WRF-ARW uses Yonsei University planetary boundary layer scheme (YSU) (Hong et al. 2006), RRTM longwave radiation scheme (Mlawer et al. 1997), Dudhia shortwave radiation scheme (Dudhia 1989), Unified Noah land surface scheme (Mukul Tewari et al. 2004), Revised MM5 surface layer scheme (Jimenez et al. 2012) as default schemes which were not changed within the selected combinations. The microphysics and cumulus schemes were changed among the physics combinations which are sensitive to the numerical weather prediction over tropical areas (Nandalal et al. 2012; Chawla et al. 2018; Liu et al. 2018). Eta (Ferrier) scheme (Rogers et al. 2001), WRF single–moment 3–class scheme (WSM3) (Han & Hong 2018), WRF single–moment 5–class scheme (WSM5) (Hong et al. 2004), WRF single–moment 6–class scheme (WSM6) (Hong & Lim 2006), Kessler scheme (Kessler 1969), WRF double-moment 6–class scheme (WDM6) (Lim & Hong 2010) were selected as microphysics schemes for the study. Kain–Fritsch scheme (KF) (Kain 2004), Betts–Miller–Janjic scheme (BMJ) (Janjic 1994), Multi–scale Kain–Fritsch scheme (MKF) (Zheng et al. 2016), Grell–Freitas Ensemble scheme (GF) (Grell & Freitas 2014) were used as cumulus schemes for the tested combinations. Table 1 provides a list of the tested physics scheme combinations that interchange the selected microphysics scheme and cumulus schemes with the default remaining schemes. Moreover, the same microphysics scheme and cumulus scheme were inserted into all the nested domains for a given model simulation in an attempt to minimize inconsistencies at the interface of the computation grids (Warner et al. 1997).

Table 1

Proposed physics combinations for the research study

Reference NumberCM1CM2CM3CM4CM5
Microphysics Scheme Ferrier WSM3 WSM5 WSM6 Kessler 
Cumulus Scheme KF KF KF KF KF 
Reference NumberCM6CM7CM8CM9CM10
Microphysics Scheme Ferrier WSM3 WSM5 WSM6 Kessler 
Cumulus Scheme BMJ BMJ BMJ BMJ BMJ 
Reference NumberCM11CM12CM13CM14CM15
Microphysics Scheme WDM6 WSM6 WDM6 WSM6 WDM6 
Cumulus Scheme MKF MKF GF GF KF 
Reference NumberCM1CM2CM3CM4CM5
Microphysics Scheme Ferrier WSM3 WSM5 WSM6 Kessler 
Cumulus Scheme KF KF KF KF KF 
Reference NumberCM6CM7CM8CM9CM10
Microphysics Scheme Ferrier WSM3 WSM5 WSM6 Kessler 
Cumulus Scheme BMJ BMJ BMJ BMJ BMJ 
Reference NumberCM11CM12CM13CM14CM15
Microphysics Scheme WDM6 WSM6 WDM6 WSM6 WDM6 
Cumulus Scheme MKF MKF GF GF KF 

Selected heavy rainfall events were simulated in WRF-ARW software for an 8-day period where the first day (24 h) was considered as the spin-up period. The models were initialized at 0600 UTC and rainfall periods of 24 h ending at 0600 UTC on each day within 7 days were investigated during this study. This is the same as the 24-h rainfall criterion used in the Department of Meteorology, Sri Lanka (DMSL) while considering slight deviations of the actual recording time (0300 UTC) of field precipitation measurements. Boundary conditions for the finer domain were updated every 6 h. It should be noted that each model combination used identical configurations and initialization data, other than marginally different parameterization schemes. All the proposed combinations (CM1–CM15) were run for the selected two rainfall periods separately within December 2019. For verification and validation of the selected final five best models, these models were tested for the two North-East monsoon rainfall events: 21–28 December 2018 and 17–24 December 2020.

Data

NCEP FNL (Final) high-resolution analyses data were used as initial and lateral boundary conditions to the atmospheric model which are on 1-degree by 1-degree grids available at 6 hourly intervals (National Center for Atmospheric Research 2019). The initial and lateral boundary conditions were forced onto the outer domain and the model was left to solve its nested domain numerically using the forcing from the mother domain. Required terrestrial datasets were applied from the WRF users’ website which is the most commonly used dataset for the WRF model simulations (National Center for Atmospheric Research 2020). Surface observations of DMSL stations were utilized for the investigated periods of the events with the intention of assessing the model performance. Five rain gauging stations within the Badulu Oya catchment including Kandaketiya (7.167 N, 81.017 E), Ledgerwatte Estate (7.033 N, 81.017 E), Badulla (6.983 N, 81.050 E), Telbedda Estate (6.978 N, 81.084 E) and Lower Spring Valley (6.917 N, 81.100 E) were selected for the study (Figure 1) considering their data availability. Among these stations, only Kandaketiya and Badulla stations are auto record type gauges (3 h period), while the rest are manually operated rain gauges. According to the Department of Meteorology, all rainfall observations are for the cumulative rainfall at 0300 UTC (08.30 a.m. in Sri Lanka time). However, the actual recording time of field precipitation measurements has few deviations. The manually operated rain gauges have an accuracy of 0.1 mm. These surface observations were used as ground-truth observations in this study.

Model results comparison

The quality of rainfall predictions was compared in this study based on the deterministic approach considering the categorical verification method, as well as continuous verification methods after the WRF model grid point values were interpolated and extracted to each observation location.

Categorical verification

The joint distribution of forecast and observation can be described using the dichotomous categorical verification technique (contingency tables). A 2 × 2 contingency table based on forecast categories that were established on 24-h total precipitation accumulated thresholds of above 10 mm, above 25 mm and above 50 mm was used to evaluate a total of 35 (5 × 7) data pairs that were relevant to the 5 rainfall gauging stations for a period of 7 days. The observed daily rainfall data and the simulated data were evaluated to determine the proportion correct (PC), probability of detection (POD), false alarm ratio (FAR), bias (B) and Equitable Threat Score (ETS) for each threshold category across the entire domain (Wilks 2011). The PC determines the fraction of all correct forecasts, which is sensitive to both hits and correct rejections. The value ranges between 0 and 1, and the perfect score is 1. The POD displays the percentage of stations at which WRF correctly simulated precipitation when precipitation was observed, which is also called the hit rate. The value ranges between 0 and 1 and the perfect score is 1. The FAR determines the percentage of falsely simulated events of precipitation when compared to the total number of simulated precipitation events. The value varies between 0 and 1, and the perfect score is 0. B determines whether WRF simulated precipitation at more stations than observed, or fewer than observed. The value can range between 0 and infinity, and the perfect score is 1. The ETS or Gilbert Skill Score determines overall skill when simulating precipitation. It includes a correction term that reduces the effect of a correct precipitation simulation by chance. An ETS score of 0 indicates the same accuracy as a random precipitation simulation and positive ETS scores indicate some level of accuracy. In contrast, a perfect precipitation simulation would have an ETS score equal to 1. To summarize all results related to the three rainfall thresholds, average values of the ETS and B were employed to represent the overall performance of the model rainfall predictions. Appendix A contains formulae for the above precipitation statistics indices. The study primarily focused on the higher thresholds of precipitation due to the hazardous consequences of high precipitation rates.

Continuous verification – normalized version of the Taylor diagram

Precipitation forecasts can be compared by direct comparison with observed and calculation of various statistical parameters which include the measures of distributional properties (mean, variance), forecast confidence (sample size), correlation statistics (scatter plots, correlation coefficient) and accuracy statistics (Mean Absolute Error, Root Mean Square Error (RMSE)). The most common option for illustrating the phase association (correlation) and amplitude (standard deviation) errors in the field of weather research forecasting is the normalized version of Taylor diagrams (NCAR 2019). After obtaining the forecasted 24-h accumulated rainfall at the five rainfall stations from the WRF output data, a total of 35 (5 × 7) data pairs pertinent to the 5 rainfall gauging stations for a period of 7 days were used to calculate the statistics mentioned above indices which are listed in Appendix B. These indices were presented graphically using the Taylor diagram after reviewing technical details at the NCAR website (NCAR 2019). In the diagram, WRF models that agree well with observations lie nearest to the point marked ‘REF’ on the x-axis. These WRF models have relatively high correlation and low normalized RMSE. WRF models lying on the reference have the correct Normalized Standard Deviation (which indicates that the model variations are of the correct amplitude). Furthermore, lower bias values indicate that the model's outputs do not significantly deviate from the observations.

Continuous verification – analysis of spatial distribution

The WRF output data and observed rainfall data on the day of the highest daily rainfall already recorded were spatially distributed within 3 km × 3 km horizontal grids (a total of 44 grids) over the Badulu Oya catchment and compared using the Inverse Distance Weighting (IDW) technique of the ArcGIS software. The discrepancy between the daily rainfall prediction and the observed rainfall was illustrated using Mean Absolute Model Error percentage (MAME, Appendix C) (Samarasingha et al. 2021). The tested models’ overall skill was compared using the cumulative correctly predicted area (CCPA) percentage within the −50 to 50% range of MAME over the basin.

Model training results

First rainfall event – from 1st to 8th December 2019

The area-averaged mean precipitation values within the study area relevant to the five rainfall stations based on the Thiessen polygon method are presented in Figure 3 for the simulated first rainfall event, December 2019. CM3, CM4, CM12 and CM15 combinations reasonably produce the track of area-averaged mean observed value plot. The observed peak on 4th December 2019 was captured by CM3, CM4, CM8, CM9, CM10, CM11, CM12, CM14 and CM15, while the predicted peak precipitation values did not tally with the peak observed value (86.4 mm/day).
Figure 3

Area-averaged mean precipitation values in the first rainfall event, December 2019.

Figure 3

Area-averaged mean precipitation values in the first rainfall event, December 2019.

Close modal

The computed statistical indices in each accumulated precipitation threshold for the combinations (CM1-CM15) are displayed in Table 2. Overall, the highest PC values are in the largest threshold; 50 mm. CM9 displays the highest PC values in the 10 mm (PC value is 0.74) and 25 mm (PC value is 0.83) thresholds, while CM3 and CM11 record the highest PC value in the 50 mm (PC value is 0.94) threshold. CM12 has the highest POD value in the 10 mm (POD value is 0.95) and 25 mm (POD value is 1.00) thresholds. In the largest threshold, CM8, CM10 and CM12 have the best POD value which is 1.00. The lowest FAR value in the 10 mm (FAR value is 0.08) threshold belongs to CM5, while CM7 has the lowest FAR value in the 25 mm (FAR value is 0.00) threshold. CM3 and CM11 both record the lowest FAR value in the 50 mm threshold (FAR value is 0.17). The FAR value relevant to the CM7 in the 50 mm threshold could not be calculated due to both hits and false alarms being zero in the largest threshold category. CM1 and CM2 display the lowest skill in each category with Ferrier and WSM3 microphysics, respectively. Considering the overall statistical indices, CM9 and CM12 which include the WSM6 microphysics scheme display positive forecast skills among others in the 10 and 25 mm threshold categories. The highest threshold category has the best overall results from CM3 and CM11, including the KF and MKF cumulus schemes. The overall performance of the first rainfall event analysis was identified using the average values of the ETS and B related to the three threshold categories (Table 2). CM3 displays the best performance with the largest ETS value (ETS value is 0.38) and bias value of 0.95. Next, CM4 records positive skill similar to CM3 which has an ETS value of 0.36 and a bias value of 1.04. After the CM3 and CM4 combinations, CM11, CM9 and CM8 record good skill among the remaining combinations which have ETS values of 0.31, 0.31, 0.34 and bias values of 1.03, 1.45, 1.50, respectively. CM1 and CM2 are less-performed models which also agree with the above threshold categories’ findings. These two combinations have Ferrier and WSM3 microphysics, respectively. Considering the best-performing two models, WSM5 and WSM6 microphysics schemes with KF cumulus scheme simulated the first rainfall event more accurately than the other schemes.

Table 2

Statistical indices for the first rainfall event, December 2019 for three precipitation thresholds

PC
POD
FAR
ETS
Threshold (mm)102550102550102550B
CM1 0.60 0.51 0.77 0.77 0.58 0.00 0.35 0.63 1.00 1.03 0.01 
CM2 0.54 0.60 0.80 0.59 0.25 0.00 0.35 0.63 1.00 0.58 0.01 
CM3 0.63 0.77 0.94 0.64 0.67 0.83 0.26 0.33 0.17 0.95 0.38 
CM4 0.63 0.80 0.91 0.64 0.75 0.83 0.26 0.31 0.29 1.04 0.36 
CM5 0.69 0.80 0.74 0.55 0.67 0.33 0.08 0.27 0.71 0.89 0.24 
CM6 0.69 0.57 0.46 0.73 0.58 0.17 0.24 0.59 0.93 1.62 0.06 
CM7 0.69 0.69 0.83 0.59 0.08 0.00 0.13 0.00 – 0.26 0.10 
CM8 0.71 0.80 0.80 0.73 0.92 1.00 0.20 0.35 0.54 1.50 0.34 
CM9 0.74 0.83 0.69 0.73 0.92 0.67 0.16 0.31 0.69 1.45 0.31 
CM10 0.71 0.71 0.80 0.73 0.92 1.00 0.20 0.45 0.54 1.58 0.30 
CM11 0.60 0.69 0.94 0.68 0.58 0.83 0.32 0.46 0.17 1.03 0.31 
CM12 0.69 0.69 0.74 0.95 1.00 1.00 0.32 0.48 0.60 1.94 0.22 
CM13 0.57 0.69 0.74 0.64 0.67 0.67 0.33 0.47 0.64 1.35 0.15 
CM14 0.63 0.60 0.80 0.86 0.83 0.83 0.34 0.55 0.55 1.66 0.17 
CM15 0.69 0.74 0.86 0.59 0.50 0.33 0.13 0.33 0.33 0.64 0.24 
PC
POD
FAR
ETS
Threshold (mm)102550102550102550B
CM1 0.60 0.51 0.77 0.77 0.58 0.00 0.35 0.63 1.00 1.03 0.01 
CM2 0.54 0.60 0.80 0.59 0.25 0.00 0.35 0.63 1.00 0.58 0.01 
CM3 0.63 0.77 0.94 0.64 0.67 0.83 0.26 0.33 0.17 0.95 0.38 
CM4 0.63 0.80 0.91 0.64 0.75 0.83 0.26 0.31 0.29 1.04 0.36 
CM5 0.69 0.80 0.74 0.55 0.67 0.33 0.08 0.27 0.71 0.89 0.24 
CM6 0.69 0.57 0.46 0.73 0.58 0.17 0.24 0.59 0.93 1.62 0.06 
CM7 0.69 0.69 0.83 0.59 0.08 0.00 0.13 0.00 – 0.26 0.10 
CM8 0.71 0.80 0.80 0.73 0.92 1.00 0.20 0.35 0.54 1.50 0.34 
CM9 0.74 0.83 0.69 0.73 0.92 0.67 0.16 0.31 0.69 1.45 0.31 
CM10 0.71 0.71 0.80 0.73 0.92 1.00 0.20 0.45 0.54 1.58 0.30 
CM11 0.60 0.69 0.94 0.68 0.58 0.83 0.32 0.46 0.17 1.03 0.31 
CM12 0.69 0.69 0.74 0.95 1.00 1.00 0.32 0.48 0.60 1.94 0.22 
CM13 0.57 0.69 0.74 0.64 0.67 0.67 0.33 0.47 0.64 1.35 0.15 
CM14 0.63 0.60 0.80 0.86 0.83 0.83 0.34 0.55 0.55 1.66 0.17 
CM15 0.69 0.74 0.86 0.59 0.50 0.33 0.13 0.33 0.33 0.64 0.24 

B and ETS are averaged values over three thresholds. Bold values indicate the most accurate tested physics combinations for the given analysis.

The normalized Taylor diagram in Figure 4 displays the results relevant to the first rainfall event. CM3 and CM11 models generally agree best with observation data, which have correlation coefficients (r) of about 0.76 and 0.72, respectively, with normalized root mean square error (NRMSE) of about 0.72. Considering the bias of these two models, CM11 (bias value is −5.15) has lower values than CM3 (bias value is 9.10). Moreover, the CM4 model also lies near the reference, but it has a lower correlation coefficient (r) (0.65 with NRMSE of 0.81 and bias of 0.12) than the CM3 and CM11 models. CM5, CM8, CM9, CM10, CM12 and CM13 have standard deviation values of more than 1.65. CM3, CM11, CM4 and CM14 display positive performances in descending order, respectively, which also agree with the above categorical verification findings.
Figure 4

Normalized Taylor Diagram for 15 models in the first rainfall event, December 2019. Standard deviations >1.65 are displayed as text at the bottom of the figure. Upper value indicates the standard deviation, while the bottom value indicates the correlation coefficient.

Figure 4

Normalized Taylor Diagram for 15 models in the first rainfall event, December 2019. Standard deviations >1.65 are displayed as text at the bottom of the figure. Upper value indicates the standard deviation, while the bottom value indicates the correlation coefficient.

Close modal
Figure 5 indicates the spatial distribution results with the obtained WRF Model data on 04/12/2019 day which had the highest rainfall during the first rainfall event. In addition, the relevant CCPA within the −50 to 50% range of MAME over the catchment is indicated below in each plot. Considering the obtained CCPA values, CM9, CM11, CM10 and CM8 are shown positive skills in descending order among the remaining models and the CM9 has the highest CCPA value (CCPA value is 97.7%). These combinations include WSM6, Kessler and WDM6 physics schemes with BMJ and MKF cumulus schemes, respectively. Moreover, CM6 and CM7 have zero skill when considering their CCPA values (CCPA value is 0%). These physics combinations have Ferrier, WSM3 microphysics with BMJ cumulus scheme.
Figure 5

CCPA percentages for MAME between −50 and 50% on 04/12/2019 – first rainfall event.

Figure 5

CCPA percentages for MAME between −50 and 50% on 04/12/2019 – first rainfall event.

Close modal

Second rainfall event – from 15th to 22nd of December 2019

Figure 6 indicates obtained area-averaged mean precipitation values over the study area relevant to the five rainfall stations based on the Thiessen polygon method for the simulated second rainfall event, December 2019. None of the combinations exactly generate the track of the area-averaged mean observed value plot. The observed peak on 19th December 2019 was captured by CM6, CM12, CM13 and CM14, while the predicted peak precipitation values did not tally with the peak observed value (99.5 mm/ day). CM1, CM2, CM3, CM4, CM5, CM7, CM8, CM9, CM10, CM11, CM13 and CM15 noticed the peak on 20th December 2019. Moreover, CM3, CM4, CM7, CM8, CM9, CM11, CM12, CM13 and CM15 have a peak on 22nd December 2019, which is not captured by the area-averaged mean observed precipitation graph.
Figure 6

Area-averaged mean precipitation values in the second rainfall event, December 2019.

Figure 6

Area-averaged mean precipitation values in the second rainfall event, December 2019.

Close modal

The statistical indices in each accumulated precipitation threshold category for the second rainfall event are indicated in Table 3. CM12 displays the highest PC value in the 10 mm (PC value is 0.80) threshold category, while CM10 records the highest PC value in the 25 mm (PC value is 0.69) and 50 mm (PC value is 0.77) threshold categories. CM12 has the highest POD value in the 10 mm (POD value is 0.91) and 25 mm (POD value is 0.63) thresholds, while CM14 has the highest POD value in the 50 mm (POD value is 0.46) threshold category. CM10 records the lowest FAR value in all three threshold categories (FAR value is 0.0), while CM8 also has zero FAR value in the 25 and 50 mm threshold categories. The FAR value relevant to the CM5, CM6 and CM9 in the 25 mm threshold and CM3, CM4, CM5, CM6 and CM9 in the 50 mm threshold could not be calculated due to hits and false alarms being zero during the calculation steps. CM1 and CM2 display the lowest skill in each category with Ferrier, WSM3 microphysics scheme and KF cumulus scheme, respectively. Considering the overall statistical indices, CM9 and CM5 display positive forecast skill among others in the 10 and 25 mm threshold categories, including WSM6 and Kessler micro physic schemes with BMJ and KF cumulus schemes, respectively.

Table 3

Statistical indices for the second rainfall event, December 2019 for three precipitation thresholds

PC
POD
FAR
BETS
Threshold (mm)102550102550102550
CM1 0.51 0.63 0.71 0.43 0.25 0.23 0.29 0.20 0.00 0.38 0.11 
CM2 0.66 0.66 0.63 0.57 0.31 0.08 0.13 0.17 0.50 0.39 0.13 
CM3 0.57 0.54 0.63 0.52 0.19 0.00 0.25 0.50 – 0.36 0.04 
CM4 0.57 0.54 0.63 0.52 0.19 0.00 0.25 0.50 – 0.36 0.04 
CM5 0.43 0.54 0.63 0.13 0.00 0.00 0.00 – – 0.04 0.02 
CM6 0.34 0.54 0.63 0.04 0.00 0.00 0.50 – – 0.03 0.00 
CM7 0.54 0.63 0.71 0.43 0.31 0.31 0.23 0.29 0.20 0.46 0.13 
CM8 0.54 0.66 0.69 0.39 0.25 0.15 0.18 0.00 0.00 0.29 0.12 
CM9 0.46 0.54 0.63 0.30 0.00 0.00 0.30 – – 0.14 0.01 
CM10 0.49 0.69 0.77 0.22 0.31 0.38 0.00 0.00 0.00 0.30 0.19 
CM11 0.69 0.60 0.69 0.65 0.25 0.31 0.17 0.33 0.33 0.54 0.15 
CM12 0.80 0.60 0.63 0.91 0.63 0.31 0.19 0.44 0.50 0.96 0.18 
CM13 0.51 0.57 0.54 0.48 0.38 0.08 0.31 0.45 0.80 0.59 0.01 
CM14 0.57 0.49 0.60 0.70 0.50 0.46 0.33 0.56 0.54 1.06 0.03 
CM15 0.63 0.49 0.57 0.65 0.25 0.00 0.25 0.60 1.00 0.55 0.01 
PC
POD
FAR
BETS
Threshold (mm)102550102550102550
CM1 0.51 0.63 0.71 0.43 0.25 0.23 0.29 0.20 0.00 0.38 0.11 
CM2 0.66 0.66 0.63 0.57 0.31 0.08 0.13 0.17 0.50 0.39 0.13 
CM3 0.57 0.54 0.63 0.52 0.19 0.00 0.25 0.50 – 0.36 0.04 
CM4 0.57 0.54 0.63 0.52 0.19 0.00 0.25 0.50 – 0.36 0.04 
CM5 0.43 0.54 0.63 0.13 0.00 0.00 0.00 – – 0.04 0.02 
CM6 0.34 0.54 0.63 0.04 0.00 0.00 0.50 – – 0.03 0.00 
CM7 0.54 0.63 0.71 0.43 0.31 0.31 0.23 0.29 0.20 0.46 0.13 
CM8 0.54 0.66 0.69 0.39 0.25 0.15 0.18 0.00 0.00 0.29 0.12 
CM9 0.46 0.54 0.63 0.30 0.00 0.00 0.30 – – 0.14 0.01 
CM10 0.49 0.69 0.77 0.22 0.31 0.38 0.00 0.00 0.00 0.30 0.19 
CM11 0.69 0.60 0.69 0.65 0.25 0.31 0.17 0.33 0.33 0.54 0.15 
CM12 0.80 0.60 0.63 0.91 0.63 0.31 0.19 0.44 0.50 0.96 0.18 
CM13 0.51 0.57 0.54 0.48 0.38 0.08 0.31 0.45 0.80 0.59 0.01 
CM14 0.57 0.49 0.60 0.70 0.50 0.46 0.33 0.56 0.54 1.06 0.03 
CM15 0.63 0.49 0.57 0.65 0.25 0.00 0.25 0.60 1.00 0.55 0.01 

B and ETS are averaged values over three thresholds. Bold values indicate the most accurate tested physics combinations for the given analysis.

CM3 and CM11 with KF and MKF cumulus schemes have the overall best performance in the largest threshold category. Considering the obtained ETS values, CM10 indicates the best performance with an ETS value of 0.19 and bias value of 0.30. Although CM12 has a higher ETS value (ETS value is 0.18), it exhibits a considerably higher bias value (bias value is 0.96) than CM10. Next, CM2, CM7 and CM11 have good skill among the remaining combinations which have ETS values of 0.13, 0.13, 0.15 and bias values of 0.39, 0.46, 0.54, respectively. Considering the calculated ETS values in the second rainfall event, the first rainfall event has higher ETS values than the second event. This resulted in a higher predicting skill of the models during the first rainfall event than the second rainfall event. However, the first rainfall has higher bias values which exceed 1.0 (over forecasting) than the second rainfall event (under forecasting). CM9 and CM6 are less performing combinations with Ferrier and WSM6 microphysics with BMJ cumulus scheme, respectively. Considering the two best-performing configurations, WSM6 and Kessler microphysics schemes with MKF and BMJ cumulus schemes could simulate the second rainfall event more accurately than the other schemes.

The normalized Taylor diagram in Figure 7 displays the results relevant to the second rainfall event. The CM10 model generally agrees best with observation data, with the highest correlation coefficient (r) of about 0.40 and an NRMSE of about 1.06. The CM7 model has a correlation coefficient (r) of about 0.34 and NRMSE of about 1.15 with observation data. Considering the bias of these two models, CM7 (bias value is −42.78) has a lower value than CM10 (bias value is −64.38) which has a negative sign (underestimated). CM10, CM7, CM12 and CM11 display good performances in descending order, respectively.
Figure 7

Normalized Taylor Diagram for 15 models in the second rainfall event, December 2019.

Figure 7

Normalized Taylor Diagram for 15 models in the second rainfall event, December 2019.

Close modal
The analysis of spatial distribution on 19/12/2019, the with the highest rainfall, is indicated in Figure 8. Considering the calculated CCPA values, CM1 to CM10 have higher negative values which exceed −50% of MAME (CCPA value is zero). This indicates poor forecasting skills. CM14, CM12, CM13 and CM11 display positive forecasting ability in descending order with CCPA values of 75, 52.3, 34.1 and 11.4%, respectively. These simulations consist of WDM6 and WSM6 microphysics schemes. Moreover, the second rainfall event forecasting does not have a positive trend compared to the first rainfall event forecasting considering the obtained CCPA values.
Figure 8

CCPA percentages for MAME between −50 and 50% on 19/12/2019 – second rainfall event.

Figure 8

CCPA percentages for MAME between −50 and 50% on 19/12/2019 – second rainfall event.

Close modal

The simulation of rain events over complex orography is still challenging, as WRF is influenced by the albedo, wind speed and direction (Lorente-Plazas et al. 2016). The surface wind was calm and varied throughout the first rainfall event, while it changed to a north-easterly direction during the second rainfall event with wind speeds ranging from 5 to 20 kmph over the country (DMSL 2020). The differences in wind characteristics and tropical weather features of the two tested rainfall events may have influenced the first rainfall event in this study to have better statistical parameters than the second rainfall event. Besides, the physics sensitivity of the parameterization schemes might need further optimization and fine tuning based on many more event tests. This could be an extended work of this study.

Summary of model training results

The model training was conducted for the selected two rainfall events in December 2019 and predicting skills of the tested models were evaluated based on the deterministic approach considering a categorical verification method and continuous verification methods in the above sections. Table 4 has a summary of the findings of the conducted evaluation process. The first four best-performing model combinations identified in each verification method relevant to the tested two rainfall events are presented in Table 4. The selected combinations are listed in descending order considering their identified performance skills in each verification method.

Table 4

Summary of model training results

OrderFirst rainfall event (1 to 8/12/2019)
Second rainfall event (15 to 22/12/2019)
Categorical verificationTaylor diagramTwo-dimensional variationCategorical verificationTaylor diagramTwo-dimensional variation
CM3 CM3 CM9 CM12 CM10 CM14 
CM4 CM11 CM11 CM10 CM7 CM12 
CM11 CM4 CM10 CM11 CM12 CM13 
CM9 CM14 CM8 CM7 CM11 CM11 
OrderFirst rainfall event (1 to 8/12/2019)
Second rainfall event (15 to 22/12/2019)
Categorical verificationTaylor diagramTwo-dimensional variationCategorical verificationTaylor diagramTwo-dimensional variation
CM3 CM3 CM9 CM12 CM10 CM14 
CM4 CM11 CM11 CM10 CM7 CM12 
CM11 CM4 CM10 CM11 CM12 CM13 
CM9 CM14 CM8 CM7 CM11 CM11 

Bold values indicate the most accurate tested physics combinations for the given analysis.

Considering the obtained summary of model training results, CM3, CM4 and CM11 display more positive skills than the remaining tested model combinations for the first rainfall event simulation considering the outcomes of the three deterministic approaches. In the second rainfall event simulation, CM10, CM11 and CM12 performed better than other models based on the three deterministic approaches. Among these mentioned best model combinations, CM11 performs well in first rainfall and second rainfall simulations. Finally, CM3, CM4, CM10, CM11 and CM12 model combinations were filtered to achieve an improved station-wise forecast within the North-East monsoon season over the Badulu Oya catchment.

The selected best-performing five models were WSM5, WSM6, Kessler and WDM6 microphysics schemes, and KF, BMJ and MKF cumulus schemes. The WSM5 is an enhanced microphysics scheme developed from the simple WSM3 scheme. The mixed phase WSM5 includes prognostic water substance variables of water vapor, cloud, ice, rain and snow (Hong & Lim 2006). Hong & Lim (2006) stated that increasing the number of hydrometers increases the rainfall amount for the finer grid resolution. Moreover, their study specified that sedimentation of cloud ice is an essential factor for better simulations of monsoonal precipitation and large-scale features within the East Asian summer monsoon (Hong & Lim 2006). The WSM6 includes graupel as another predictive variable added to WSM5. These schemes better represent the ice cloud properties considering the cloud radiation feedback. The ice cloud affects longwave heating more significantly than shortwave heating in terms of upper-level mean temperature (Hong & Lim 2006). The Kessler microphysics scheme is the oldest microphysics scheme in the WRF model. This liquid-only scheme includes water vapor, cloud water and rain. The production, fall and evaporation of rain, the accretion, auto-conversion of cloud water and the production of cloud water from condensation are the main processes within this scheme (Mielikainen et al. 2013). The Kessler scheme uses a lower threshold to convert cloud water to rain which occurs early automatically, increases rainfall rates and shifts precipitation upstream (Mielikainen et al. 2013). The WDM6 microphysics scheme is a double-moment warm-rain microphysics scheme that predicts the mixing ratio of the hydrometeors and their number concentration of cloud and rainwater. These have been added to the WSM6 scheme. The WDM6 scheme can allow flexibility in variable raindrop size distribution by predicting the number of concentrations of clouds and rain (Lim & Hong 2010).

The KF cumulus scheme is a mass flux parameterization scheme that uses the Lagrangian parcel method including vertical momentum dynamics. It can be generally grouped into three parts: (1) convective trigger function, (2) mass flux formulation and (3) closure assumptions which can represent the subgrid scale feature of the updraft and downdraft process that lead to the development of strong convection (Kain 2004). Notably, experiments with KF cumulus parameterization often perform better with WSM5 and WSM6 schemes. This statement is in line with the results of Pennelly et al. (2014), who examined three flooding events in Alberta, Canada, using five different cumulus parameterization schemes (Pennelly et al. 2014). However, the KF scheme does not perform much better when the spatial distribution of the catchment is investigated. This concurs with Gallus Jr.'s (1999) findings which showed that more precisely simulating excessive rainfall happening at high resolutions with the ascent facilitates activation of the scheme and shifts the maximum by several hundred kilometers (Gallus 1999). The BMJ cumulus scheme is a convective adjustment scheme that includes deep and shallow convection. The deep convection uses empirically based quasi-equilibrium thermodynamic profiles as a reference state rather than a moist adiabat. The construction of the reference profiles and the specification of the relaxation time scale are two significant components of this scheme (Vaidya & Singh 2000). Earlier research revealed that the BMJ scheme is more consistent with land-based data during the spatial analysis when compared to the other cumulus schemes (Ratna et al. 2014; Remesan et al. 2015). Additionally, Vaidya & Singh (2000) found that the spurious rainfall spread in the Arabian Sea and in the Bay of Bengal is suppressed in the BMJ scheme (Vaidya & Singh 2000). Despite the BMJ scheme not explicitly defining subgrid updrafts and downdrafts in addition to the mesoscale microphysical processes, it performs better in this assessment with the Kessler microphysics scheme (CM10). The MKF cumulus scheme is an updated version of the KF scheme which includes subgrid-scale cloud radiation interactions, a dynamic adjustment time scale, the impact of subgrid-scale cloud updraft mass fluxes on grid-scale vertical velocity and an entrainment methodology based on the lifting condensation level. These changes introduce scale dependency for some of these critical parameters in the KF scheme, and are expected to improve weather forecasts at 9 and 3 km grid spacings (Zheng et al. 2016).

In the evaluated two extreme rainfall events, the WSM5-KF combination (CM3) records excellent statistical indices among other combinations. Although the WSM6 scheme generally outperformed the WSM5 scheme (Kar & Tiwari 2016), the WSM6 scheme performed less well in this evaluation even when a graupel particle was introduced to make it more complicated than the WSM5 with the KF scheme. This phenomenon might be caused by a slowdown in the direct conversion of snow and cloud particles into rainwater (Akinola & Yin 2019). The KF scheme outperformed the BMJ system overall during the tested first rainfall event. This statement is consistent with a study by Bukovsky & Karoly (2009) that examined several WRF modeling systems including two land surface models and two cumulus schemes over the United States (Bukovsky & Karoly 2009).

The location and topography greatly influence the effectiveness of short-term rainfall forecasting and the WRF can capture the intricate interactions between land and lower atmospherics in generally flat terrains but tends to over- or under-simulate in mountainous terrains (Maussion et al. 2011). In our case, a similar observation was made regarding the deviations in the rainfall magnitudes estimated by the model combinations. This also influences the selected five model combinations that outperformed others in the mountainous Badulu Oya catchment. Yet again, the model and physics uncertainties could be reasons for such performance.

In the above physics selection process, findings of the categorical verification and Taylor diagram were considered more than the analysis of spatial distribution. The reason for this decision is that the conducted analysis approach using the IDW technique of the ArcGIS software does not consider the inhomogeneity in the topography or circulation over the catchment. The filtered best five model combinations were evaluated in verification simulations.

Model validation results

The obtained average values of ETS and B over the three threshold categories are indicated in Table 5 relevant to the December 2018 rainfall event (from 21st to 28th of December 2018) and December 2020 rainfall event (from 17th to 24th of December 2020). During the analyzed December 2018 rainfall event, CM12 had the highest ETS value (ETS value is 0.20). Thereafter, ETS values of CM4 and CM3 are 0.17 and 0.13 in descending order, respectively. CM10 and CM11 are less-performed models which have zero ETS value. The highest bias value (bias value is 1.61) belongs to the CM3 model. Only the CM10 model has zero value for both hits and false alarms within the three threshold categories which produced zero value of average ETS and bias. Considering the tested December 2020 rainfall event, CM10 has the highest ETS value (ETS value is 0.18) and the lowest bias value (bias value is 0.26). After CM10, CM11 has a higher ETS value (ETS value is 0.11), while the remaining tested combinations have lower ETS values of less than 0.10. CM12 and CM4 have higher bias values among the tested models (bias values are 1.46 and 1.42).

Table 5

ETS and B values of the model validation

December 2018 rainfall event
December 2020 rainfall event
CM3CM4CM10CM11CM12CM3CM4CM10CM11CM12
ETS 0.13 0.17 0.00 0.00 0.20 0.02 0.02 0.18 0.11 0.03 
1.61 1.14 0.00 0.61 0.91 1.16 1.42 0.26 0.81 1.46 
December 2018 rainfall event
December 2020 rainfall event
CM3CM4CM10CM11CM12CM3CM4CM10CM11CM12
ETS 0.13 0.17 0.00 0.00 0.20 0.02 0.02 0.18 0.11 0.03 
1.61 1.14 0.00 0.61 0.91 1.16 1.42 0.26 0.81 1.46 

Bold values indicate the most accurate tested physics combinations for the given analysis.

The obtained area-averaged mean precipitation values within the study area relevant to the five rainfall stations based on the Thiessen polygon method are presented in Figure 9 for the simulated two rainfall events separately. During the December 2018 rainfall event (Figure 9(a)), the first peak on the 22nd is captured by the tested combinations except for CM10, while CM3, CM4 and CM12 capture the second peak on the 26th. The recorded peak on 20th December 2020 (Figure 9(b)) is forecasted by all the combinations, while the CM10 combination precisely captures the peak. Although the tested combinations predict the peak events, predicted daily averaged mean precipitation values do not tally with the relevant observed values.
Figure 9

Area-averaged mean precipitation values; (a) December 2018 rainfall event & (b) December 2020 rainfall event.

Figure 9

Area-averaged mean precipitation values; (a) December 2018 rainfall event & (b) December 2020 rainfall event.

Close modal
The outputs of the tested combinations with the observed data were further analyzed using the normalized Taylor diagram in Figure 10. The December 2018 event (Figure 10(a)) indicates that CM12 and CM4 models generally agree best with observation data near the reference. Although these two models have a lower NRMSE, both of them have relatively small correlation coefficients (r) (correlation coefficient values are 0.23 and 0.30). Considering the bias of these two models (bias values are 27.15 and 35.56), both have positive values (overestimated) which are less than 40. After these two models, the CM10 model has an NRMSE of 1.01 which lies near the zero standard deviation value. CM3 model has a normalized standard deviation of more than 1.65, marked outside the figure. The obtained results relevant to the December 2020 rainfall event are in Figure 10(b). The CM11 model lies near the reference with a correlation coefficient value (r) of 0.35 and NRMSE of 1.11, while CM10 has the highest correlation coefficient (r) (0.57 with NRMSE is 0.83). These two models generally agree best with observation data near the reference. The remaining tested models have fewer skills, with higher NRMSE values and lower correlation coefficient values (r).
Figure 10

Normalized Taylor Diagram; (a) December 2018 rainfall event & (b) December 2020 rainfall event. Standard deviations >1.65 are displayed as text at the bottom of the figure. Upper value indicates the standard deviation, while bottom value indicates the correlation coefficient.

Figure 10

Normalized Taylor Diagram; (a) December 2018 rainfall event & (b) December 2020 rainfall event. Standard deviations >1.65 are displayed as text at the bottom of the figure. Upper value indicates the standard deviation, while bottom value indicates the correlation coefficient.

Close modal
The analysis of spatial distribution on 26/12/2018 with the highest rainfall in the December 2018 event is in Figure 11(a). The relevant CCPA within the −50 to 50% range of MAME is indicated below in each plot for comparison. Considering the calculated CCPA values, CM3 and CM4 models performed better than the remaining models. After the CM3 and CM4 models, CM12 has a CCPA value of 34.1%. Finally, the remaining two models, CM10 and CM11, record lower CCPA values. The results of the analysis of spatial distribution on the 20/12/2020 with the highest rainfall in December 2020 event are in Figure 11(b). Considering the calculated CCPA values, the CM3 model has the highest skill. CM10 and CM4 record higher CCPA values above 50% after the CM3 model.
Figure 11

CCPA percentages for MAME between −50 and 50%; (A) December 2018 rainfall event & (B) December 2020 rainfall event.

Figure 11

CCPA percentages for MAME between −50 and 50%; (A) December 2018 rainfall event & (B) December 2020 rainfall event.

Close modal

The model outputs showed acceptable predictability for all the tested cases. In contrast, model predictions displayed high sensitivity for the physical parameterization and the atmospheric features during the tested seasons because each model's physical parameterization has unique methods for resolving weather features at different scales. The corresponding results of the heavy rain cases showed seasonal and physical parameterization effects. Considering obtained overall results of the three verification methods, CM12, CM4 and CM3 models can be selected as the best-performed models in the December 2018 rainfall event, while CM10, CM11 and CM3 models are the best-performed models in the December 2020 rainfall event. Hence, CM3, CM4, CM10, CM11 and CM12 models have noticeable forecasting skills relevant to the North-East monsoon season over the Badulu Oya catchment.

Overall, the sensitivities of the model physics to different spatial resolutions and areas of interest might need more scrutiny. Nevertheless, this study remains essential as this has helped to highlight and shortlist the good/poor combinations of physics options which can be studied in detail under more numerical simulations and examinations as necessary. Such an exercise would lead to better optimizing the WRF model over this tropical island of Sri Lanka.

The simulations of heavy rainfall events relevant to the North-East monsoon season performed in this research over the Badulu Oya catchment with different parameterization schemes demonstrated significant sensitivity for microphysics and cumulus schemes.

CM3, CM4, CM10, CM11 and CM12 model configurations with the WSM5, WSM6, Kessler and WDM6 microphysics schemes along with the KF, BMJ and MKF cumulus parameterization schemes displayed the overall best performances during the North-East monsoon season.

Among these models, the CM3 model configuration including the WSM5 microphysics scheme, KF cumulus scheme along with the remaining default parameterization schemes of WRF-ARW records the best statistics; ETS value of 0.38, bias value of 0.95, correlation coefficient of 0.76, NRMSE of 0.72, normalized standard deviation of 1.06 and CCPA value of 75%.

The output of the five developed model combinations displayed tremendous sensitivity with seasonal and physical parameterization effects during the model validation due to their unique methods for resolving weather features at different scales. The ETS value of 0.20, correlation coefficient value of 0.35 and CCPA value of 88.6% are the highest statistical indices among the two rainfall events assessed during the model validation.

Although the model outcomes indicated large deviations in the rainfall magnitudes estimated by the model combinations, several combinations (CM3, CM4, CM10, CM11 and CM12) could capture spatial distribution similar to the spatial distribution obtained from the ground observation network.

To conclude, the filtered five model combinations can be used to predict the future significant rainfall events over the Badulu Oya catchment within the North-East monsoon season and those data can be used to deliver early warnings for the landslides within the study area. Moreover, several studies can also use the five model combinations to predict soil moisture content, wind characteristics and radiation characteristics in the area.

The results of this study imply that more precise predictions can be produced by taking into account other parameterization schemes, including radiation, boundary layer and land surface physics. Increasing the number of simulations of extreme rainfall events within different seasons to find better combinations of physics for heavy rainfall forecasting for all seasons would be valuable. Additional sensitivity testing may be desired to determine the sensitivity of global model data such as NOAA and ECMWF due to the WRF-ARW model predictions being highly dependent on the lateral boundary and initial conditions provided for initialization.

P. G. S. G. conceptualized the whole work, developed the methodology, performed simulations using the software, validated the model results, conducted a formal analysis, investigation, data curation, wrote the original draft, visualized the article, wrote the review and edited the article. P. N. conceptualized the whole work, brought resources, wrote the review, edited the article and supervised the work. R. A. A. supervised the work. S. V. R. wrote the review, edited the article and supervised the work.

The authors acknowledge Computer Department of University of Peradeniya for giving accessibility to their high-performance computing (HPC) for conducting research simulations. Moreover, the authors are grateful to Department of Meteorology, Sri Lanka (DMSL) for providing their recorded precipitation data throughout the study.

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

All relevant data are included in the paper or its Supplementary Information.

The authors declare there is no conflict.

Bliznak
V.
,
Kaspar
M.
,
Muller
M.
&
Zacharov
P.
2019
Sub-daily temporal reconstruction of extreme precipitation events using NWP model simulations
.
Atmospheric Research
224
,
65
80
.
https://doi.org/10.1016/j.atmosres.2019.03.019
.
Bukovsky
M. S.
&
Karoly
D. J.
2009
Precipitation simulations using WRF as a nested regional climate model
.
Journal of Applied Meteorology and Climatology
48
(
10
),
2152
2159
.
https://doi.org/10.1175/2009jamc2186.1
.
Chawla
I.
,
Osuri
K. K.
,
Mujumdar
P. P.
&
Niyogi
D.
2018
Assessment of the Weather Research and Forecasting (WRF) model for simulation of extreme rainfall events in the upper Ganga Basin
.
Hydrology and Earth System Sciences
22
(
2
),
1095
1117
.
https://doi.org/10.5194/hess-22-1095-2018
.
Darshika
D. W. T. T.
&
Premalal
K. H. M. S.
2015
Simulate heavy rainfall during 19th to 28th December 2014 using WRF for different atmospheric physics
.
Sri Lanka Journal of Meteorology
1
,
32
40
.
De-Silva
G.
,
Weerakoon
S. B.
&
Herath
S.
2016
Event based flood inundation mapping under the impact of climate change: a case study in Lower Kelani River Basin, Sri Lanka
.
Hydrology Current Research
7
(
1
).
https://doi.org/10.4172/2157-7587.1000228
.
DMSL
2020
Department of Meteorology, Sri Lanka
.
Available from: http://www.meteo.gov.lk/index.php?lang=en (accessed 23 March 2020)
.
Dudhia
J.
1989
Numerical study of convection observed during the winter monsoon experiment using a mesoscale two-dimensional model
.
Journal of Atmospheric Sciences
46
(
20
),
3077
3107
.
https://doi.org/10.1175/1520-0469(1989)046%3C3077:nsocod%3E2.0.co;2
.
Emmanouil
G.
,
Vlachogiannis
D.
&
Sfetsos
A.
2021
Exploring the ability of the WRF-ARW atmospheric model to simulate different meteorological conditions in Greece
.
Atmospheric Research
247
,
105226
.
https://doi.org/10.1016/j.atmosres.2020.105226
.
Gallus
W. A.
Jr.
1999
Eta simulations of three extreme precipitation events: sensitivity to resolution and convective parameterization
.
Weather and Forecasting
14
(
3
),
405
426
.
https://doi.org/10.1175/1520-0434(1999)014%3C0405:esotep%3E2.0.co;2
.
Grell
G. A.
&
Freitas
S. R.
2014
A scale and aerosol aware stochastic convective parameterization for weather and air quality modeling
.
Atmospheric Chemistry and Physics
14
(
10
),
5233
5250
.
https://doi.org/10.5194/acp-14-5233-2014
.
Han
J. Y.
&
Hong
S. Y.
2018
Precipitation forecast experiments using the Weather Research and Forecasting (WRF) model at gray-zone resolutions
.
Weather and Forecasting
33
(
6
),
1605
1616
.
https://doi.org/10.1175/waf-d-18-0026.1
.
Hong
S. Y.
&
Lim
J. O. J.
2006
The WRF single-moment 6-class microphysics scheme (WSM6)
.
Asia-Pacific Journal of Atmospheric Sciences
42
(
2
),
129
151
.
Hong
S. Y.
,
Dudhia
J.
&
Chen
S. H.
2004
A revised approach to ice microphysical processes for the bulk parameterization of clouds and precipitation
.
Monthly Weather Review
132
(
1
),
103
120
.
https://doi.org/10.1175/1520-0493(2004)132%3C0103:aratim%3E2.0.co;2
.
Hong
S. Y.
,
Noh
Y.
&
Dudhia
J.
2006
A new vertical diffusion package with an explicit treatment of entrainment processes
.
Monthly Weather Review
134
(
9
),
2318
2341
.
https://doi.org/10.1175/mwr3199.1
.
Janjic
Z. I.
1994
The step-mountain eta coordinate model: further developments of the convection, viscous sublayer, and turbulence closure schemes
.
Monthly Weather Review
122
(
5
),
927
945
.
https://doi.org/10.1175/1520-0493(1994)122%3C0927:tsmecm%3E2.0.co;2
.
Jayasinghe
G. J. M. S. R.
,
Wijekoon
P.
&
Gunatilake
J.
2017
Landslide susceptibility assessment using statistical models: a case study in Badulla district, Sri Lanka
.
Ceylon Journal of Science
46
(
4
),
26
41
.
https://doi.org/10.4038/cjs.v46i4.7466
.
Ji
F.
,
Ekstrom
M.
,
Evans
J. P.
&
Teng
J.
2014
Evaluating rainfall patterns using physics scheme ensembles from a regional atmospheric model
.
Theoretical and Applied Climatology
115
(
1
),
297
304
.
https://doi.org/10.1007/s00704-013-0904-2
.
Jimenez
P. A.
,
Dudhia
J.
,
Gonzalez-Rouco
J. F.
,
Navarro
J.
,
Montavez
J. P.
&
Garcia-Bustamante
E.
2012
A revised scheme for the WRF surface layer formulation
.
Monthly Weather Review
140
(
3
),
898
918
.
https://doi.org/10.1175/mwr-d-11-00056.1
.
Kain
J. S.
2004
The Kain–Fritsch convective parameterization: an update
.
Journal of Applied Meteorology
43
(
1
),
170
181
.
https://doi.org/10.1175/1520-0450(2004)043%3C0170:tkcpau%3E2.0.co;2
.
Kar
S. C.
&
Tiwari
S.
2016
Model simulations of heavy precipitation in Kashmir, India, in September 2014
.
Natural Hazards
81
(
1
),
167
188
.
https://doi.org/10.1007/s11069-015-2073-3
.
Kessler
E.
1969
On the Distribution and Continuity of Water Substance in Atmospheric Circulations
.
American Meteorological Society
,
Boston, MA
, pp.
1
84
.
https://doi.org/10.1007/978-1-935704-36-2_1
.
Lee
S. W.
,
Lee
D. K.
&
Chang
D. E.
2011
Impact of horizontal resolution and cumulus parameterization scheme on the simulation of heavy rainfall events over the Korean Peninsula
.
Advances in Atmospheric Sciences
28
(
1
),
1
15
.
https://doi.org/10.1007/s00376-010-9217-x
.
Lim
K. S. S.
&
Hong
S. Y.
2010
Development of an effective double-moment cloud microphysics scheme with prognostic cloud condensation nuclei (CCN) for weather and climate models
.
Monthly Weather Review
138
(
5
),
1587
1612
.
https://doi.org/10.1175/2009mwr2968.1
.
Liu
D.
,
Yang
B.
,
Zhang
Y.
,
Qian
Y.
,
Huang
A.
,
Zhou
Y.
&
Zhang
L.
2018
Combined impacts of convection and microphysics parameterizations on the simulations of precipitation and cloud properties over Asia
.
Atmospheric Research
212
,
172
185
.
https://doi.org/10.1016/j.atmosres.2018.05.017
.
Lorente-Plazas
R.
,
Jimenez
P. A.
,
Dudhia
J.
&
Montavez
J. P.
2016
Evaluating and improving the impact of the atmospheric stability and orography on surface winds in the WRF model
.
Monthly Weather Review
144
(
7
),
2685
2693
.
https://doi.org/10.1175/mwr-d-15-0449.1
.
Maussion
F.
,
Scherer
D.
,
Finkelnburg
R.
,
Richters
J.
,
Yang
W.
&
Yao
T.
2011
WRF simulation of a precipitation event over the Tibetan Plateau, China – an assessment using remote sensing and ground observations
.
Hydrology and Earth System Sciences
15
(
6
),
1795
1817
.
https://doi.org/10.5194/hess-15-1795-2011
.
Mielikainen
J.
,
Huang
B.
,
Wang
J.
,
Huang
H. L. A.
&
Goldberg
M. D.
2013
Compute unified device architecture (CUDA)-based parallelization of WRF Kessler cloud microphysics scheme
.
Computers & Geosciences
52
,
292
299
.
https://doi.org/10.1016/j.cageo.2012.10.006
.
Ministry of Defence
2019
Situation Report Summary (Heavy Rains, Flooding, Landslides), Sri Lanka, 1800 Hours, 20-12-2019
.
Ministry of Defence
,
Colombo
.
Mlawer
E. J.
,
Taubman
S. J.
,
Brown
P. D.
,
Iacono
M. J.
&
Clough
S. A.
1997
Radiative transfer for inhomogeneous atmospheres: RRTM, a validated correlated-k model for the longwave
.
Journal of Geophysical Research: Atmospheres
102
(
D14
),
16663
16682
.
https://doi.org/10.1029/97jd00237
.
Mukul Tewari
N. C. A. R.
,
Tewari
M.
,
Chen
F.
,
Wang
W.
,
Dudhia
J.
,
LeMone
M. A.
,
Mitchell
K.
,
Ek
M.
,
Gayno
G.
,
Wegiel
J.
&
Cuenca
R. H.
2004
Implementation and verification of the unified NOAH land surface model in the WRF model (Formerly Paper Number 17.5)
. In
20th Conference on Weather Analysis and Forecasting/16th Conference on Numerical Weather Prediction
. pp.
11
15
.
Nandalal
K. D. W.
,
Sachindra
D. A.
&
Ratnayake
U. R.
2012
Application of WRF weather model to forecast precipitation in Nilwala river basin
.
Engineer: Journal of the Institution of Engineers, Sri Lanka
45
(
1
),
51
64
.
https://doi.org/10.4038/engineer.v45i1.6949
.
National Center for Atmospheric Research
2019
WRF USERS PAGE. Available from: https://www2.mmm.ucar.edu/wrf/users/namelist_best_prac_wps.html (accessed 30 February 2019)
.
National Center for Atmospheric Research
2020
WRF USERS PAGE. Available from: https://www2.mmm.ucar.edu/wrf/users/download/get_sources_wps_geog.html (accessed 25 March 2020)
.
NCAR
2019
NCL. Available from: https://www.ncl.ucar.edu/index.shtml (accessed 13 March 2019)
.
On
N.
,
Kim
H. M.
&
Kim
S.
2018
Effects of resolution, cumulus parameterization scheme, and probability forecasting on precipitation forecasts in a high-resolution limited-area ensemble prediction system
.
Asia-Pacific Journal of Atmospheric Sciences
54
(
4
),
623
637
.
https://doi.org/10.1007/s13143-018-0081-4
.
Pennelly
C.
,
Reuter
G.
&
Flesch
T.
2014
Verification of the WRF model for simulating heavy precipitation in Alberta
.
Atmospheric Research
135
,
172
192
.
https://doi.org/10.1016/j.atmosres.2013.09.004
.
Perera
E. N. C.
,
Jayawardana
D. T.
&
Jayasinghe
P.
2017
A rainfall intensity-duration threshold for mass movement in Badulla, Sri Lanka
.
Journal of Geoscience and Environment Protection
5
,
135
152
.
https://doi.org/10.4236/gep.2017.512010
.
Piciullo
L.
,
Calvello
M.
&
Cepeda
J. M.
2018
Territorial early warning systems for rainfall-induced landslides
.
Earth-Science Review
179
,
228
247
.
https://doi.org/10.1016/j.earscirev.2018.02.013
.
Rajapaksha
R. M. G. N.
,
Dharmagunawardhane
H. A.
,
Attanayake
A. M. A. N. B.
&
Rekha Nianthi
K. W.
2020
Altitudinal and temporal variation of surface water quality: an assessment in Badulu Oya Catchment, Sri Lanka
.
GSC Biological and Pharmaceutical Sciences
11
(
3
),
226
236
.
https://doi.org/10.30574/gscbps.2020.11.3.0181
.
Ratna
S. B.
,
Ratnam
J. V.
,
Behera
S. K.
,
Rautenbach
C. D.
,
Ndarana
T.
,
Takahashi
K.
&
Yamagata
T.
2014
Performance assessment of three convective parameterization schemes in WRF for downscaling summer rainfall over South Africa
.
Climate Dynamics
42
(
11
),
2931
2953
.
https://doi.org/10.1007/s00382-013-1918-2
.
Remesan
R.
,
Bellerby
T.
,
Holman
I.
&
Frostick
L.
2015
WRF model sensitivity to choice of parameterization: a study of the ‘York Flood 1999’
.
Theoretical and Applied Climatology
122
(
1
),
229
247
.
https://doi.org/10.1007/s00704-014-1282-0
.
Rodrigo
C.
,
Kim
S.
&
Jung
I. H.
2018
Sensitivity study of WRF numerical modeling for forecasting heavy rainfall in Sri Lanka
.
Atmosphere
9
(
10
),
378
.
https://doi.org/10.3390/atmos9100378
.
Rogers
E.
,
Black
T.
,
Ferrier
B.
,
Lin
Y.
,
Parrish
D.
&
DiMego
G.
2001
Changes to the NCEP Meso Eta analysis and forecast system: increase in resolution, new cloud microphysics, modified precipitation assimilation, modified 3DVAR analysis
.
NWS Technical Procedures Bulletin
488
,
15
.
Ruwangika
A. M.
,
Perera
A.
&
Rathnayake
U.
2020
Comparison of statistical, graphical, and wavelet transform analyses for rainfall trends and patterns in Badulu Oya Catchment, Sri Lanka
.
Complexity
,
1
13
.
https://doi.org/10.1155/2020/7146593
.
Samarasingha
S. M. T. C.
,
Sandaruwan
M. S.
,
Sampath
D. S.
&
Neluwala
N. G. P. B.
2021
Dynamic downscaling of rainfall data for Deduru Oya River Basin using WRF weather model
.
ENGINEER
54
(
02
),
69
75
.
https://doi.org/10.4038/engineer.v54i2.7443
.
Scaff
L.
,
Prein
A. F.
,
Li
Y.
,
Liu
C.
,
Rasmussen
R.
&
Ikeda
K.
2020
Simulating the convective precipitation diurnal cycle in North America's current and future climate
.
Climate Dynamics
55
(
1
),
369
382
.
https://doi.org/10.1007/s00382-019-04754-9
.
Skamarock
W. C.
,
Klemp
J. B.
,
Dudhia
J.
,
Gill
D. O.
,
Liu
Z.
,
Berner
J.
,
Wang
W.
,
Powers
J. G.
,
Duda
M. G.
,
Barker
D. M.
&
Huang
X. Y.
2019
A Description of the Advanced Research WRF Model Version 4
.
National Center for Atmospheric Research
,
Boulder, CO
,
USA
, p.
145
.
Srinivas
C. V.
,
Hariprasad
D.
,
Bhaskar Rao
D. V.
,
Anjaneyulu
Y.
,
Baskaran
R.
&
Venkatraman
B.
2013
Simulation of the Indian summer monsoon regional climate using advanced research WRF model
.
International Journal of Climatology
33
(
5
),
1195
1210
.
https://doi.org/10.1002/joc.3505
.
Sun
X.
&
Barros
A. P.
2014
High resolution simulation of tropical storm Ivan (2004) in the Southern Appalachians: role of planetary boundary-layer schemes and cumulus parametrization
.
Quarterly Journal of the Royal Meteorological Society
140
(
683
),
1847
1865
.
https://doi.org/10.1002/qj.2255
.
Tian
J.
,
Liu
J.
,
Yan
D.
,
Li
C.
&
Yu
F.
2017
Numerical rainfall simulation with different spatial and temporal evenness by using a WRF multiphysics ensemble
.
Natural Hazards and Earth System Sciences
17
(
4
),
563
579
.
https://doi.org/10.5194/nhess-17-563-2017
.
Vaidya
S. S.
&
Singh
S. S.
2000
Applying the Betts–Miller–Janjic scheme of convection in prediction of the Indian monsoon
.
Weather and Forecasting
15
(
3
),
349
356
.
https://doi.org/10.1175/1520-0434(2000)015%3C0349:atbmjs%3E2.0.co;2
.
Warner
T. T.
,
Peterson
R. A.
&
Treadon
R. E.
1997
A tutorial on lateral boundary conditions as a basic and potentially serious limitation to regional numerical weather prediction
.
Bulletin of the American Meteorological Society
78
(
11
),
2599
2618
.
https://doi.org/10.1175/1520-0477(1997)078%3C2599:atolbc%3E2.0.co;2
.
Wilks
D. S.
2011
Statistical Methods in the Atmospheric Sciences
, 3rd edn. Vol.
100
.
Academic Press
,
USA
.
Zheng
Y.
,
Alapaty
K.
,
Herwehe
J. A.
,
Del Genio
A. D.
&
Niyogi
D.
2016
Improving high-resolution weather forecasts using the Weather Research and Forecasting (WRF) model with an updated Kain–Fritsch scheme
.
Monthly Weather Review
144
(
3
),
833
860
.
https://doi.org/10.1175/mwr-d-15-0005.1
.
This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (CC BY-NC-ND 4.0), which permits copying and redistribution for non-commercial purposes with no derivatives, provided the original work is properly cited (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Supplementary data