Some open-source precipitation products offer viable options for hydrological simulation in the absence/limited rain gauge station networks. This study examined the hydrologic performance of reanalysis (CFSR), satellite (CHIRPS) and regional climate model (RACMO22T) based precipitation estimates through Hydrologiska Byråns Vattenbalansavdelning (HBV) model. The performance of these precipitation products were evaluated by the graphical and statistical indices such as coefficient of determination (R2), Nash–Sutcliffe efficiency (NSE), percentage of bias (PBIAS), and mean square error (RMSE) at daily and monthly scales. RACMO22T precipitation product was competent based on all the evaluation statistical indices criteria to simulate flow whereas; CHIRPS and CFSR were unsatisfactory based on the PBIAS and RSME. Flow duration curves indicated that, RACMO22T was able to better estimate high, medium and low flow than CHIRPS and CFSR. The outcome suggested that, RACMO22T is thought to be a more feasible option for the hydrologic simulation than CHIRPS and CFSR in the UARB. Furthermore, the hydrologic performance was improved on monthly scales compared with daily for all precipitation products. The study therefore, suggested that the use of regional climate model-based precipitation products for hydrologic simulation would be of great benefit considering the difficulties in accessing data across and similar basin.

  • This study evaluated & compared the hydrological performance of precipitation products from CHIRPS, CFSR and RACMO22T using HBV model.

  • The performance of these precipitation products were examined by graphical and statistical indices such as R2, NSE, PBIAS & RMSE.

  • The outcome suggested that, RACMO22T precipitation product thought to be a more viable option than CHIRPS and CFSR for hydrological modelling in the UARB.

In remote areas where there are absent or limited rain gauge station networks, hydrological simulation is significantly lacking for the planning, designing and managing of water resources. A number of open-source precipitation products offer viable options for hydrological simulation as an alternative or as a supplement to station observations. Through diverse hydrological models to simulate streamflow, precipitation products derived from various data sources such as satellite, reanalysis, and global and regional climate models are crucial. Assessing and verifying the performance of these precipitation products in relation to precipitation measured from ground stations is essential to building confidence in these datasets for further usage (Hughes 2006; Javanmard et al. 2010; Adjei et al. 2015; Musie et al. 2019; Abdulahi et al. 2022; Ougahi & Mahmood 2022). Experiences in the past demonstrated that using precipitation data from ground measuring stations can generally provide high quality and accuracy of the hydrological modelling (Sharannya et al. 2020). However, direct and accurate networks of ground rain gauge measuring stations are unavailable due to sparse distribution, nonexistence, lack of high spatial resolution, political instability, orographic effect, harsh climate, rough topography and even in some developing countries lack of commitment to fund the hydro-meteorological stations because of many other immediate socio-economic problems (Michaels et al. 1998; Javanmard et al. 2010; Ougahi & Mahmood 2022). The growing availability of high-resolution satellite driven precipitation products, reanalysis, and global and regional climate model forecasting systems can help the hydrologists to obtain alternative precipitation products for streamflow modelling where conventional (ground measuring) hydro-meteorological stations are difficult to build (Bitew et al. 2012; Worqlul et al. 2014).

Precipitation is the most significant part of the water cycle balance and the primary input for hydrological modelling. Recently, different open-source precipitation products with high quality on the basis of spatial and temporal resolutions particularly from satellite, reanalysis and climate models are increasingly available with almost global coverage; their supplies are cost effective and, hence, they are alternative means of input sources for hydrological modelling (Adane et al. 2021). Thus, finding and adopting reliable precipitation products for quality hydrological modelling for the ungauged/limited data regions is an essential and even a controversial issue. Recently, different precipitation products with diverse temporal and spatial resolutions are available as input for the hydrological modelling where there is no adequate gauged streamflow for planning and management of water resources (Bitew et al. 2012; Reda et al. 2015; Babur et al. 2016; Gebremicael et al. 2017; Hu et al. 2017; Liu et al. 2017; Sharannya et al. 2020; Abdulahi et al. 2022; Ougahi & Mahmood 2022). The common ways of obtaining reliable and high quality precipitation products for accurate streamflow modelling could be by comparing and evaluating the predictive ability of different open-source precipitation products with the gauged precipitation data from ground stations and/or through hydrological modelling. Some of the precipitation product categories are: ground/in situ observation, ground-based radar, satellite, reanalysis and climate model-based. The most commonly available spatially and temporally distributed satellite and reanalysis precipitation forcing data for hydrological modelling are: Tropical Rainfall Measuring Mission (TRMM), Climate Forecast System Reanalysis (CFSR), the NOAA/Climate Prediction Centre, Precipitation Estimation from Remotely Sensed Information using Artificial Neural Network (PERSIANN), Climate Hazards Group Infrared Precipitation with Stations (CHIRPS), Modern-Era Retrospective Analysis for Research and Application (MERRA2), European Centre for Medium-Range Weather Forecast (ECMWF) Reanalysis-5 (ERA-5) (Javanmard et al. 2010; Worqlul et al. 2014; Adjei et al. 2015; Liu et al. 2017; Colston et al. 2018; Tolera et al. 2018; Bhattacharya et al. 2020; Nkunzimana et al. 2020; Adane et al. 2021; Ougahi & Mahmood 2022), and regional and global climate models like Canadian Centre for Climate Modelling and Analysis (CGCM), Commonwealth Scientific and Industrial Research Organisation (CSIRO), Meteorological Research Institute (MRI) Max-Planck Institute for Meteorology, Germany (ECHAM5), Regional Climate Model (RACMO22T) version 2.2 (Reda et al. 2015; Babur et al. 2016; Abdulahi et al. 2022). The results obtained from these precipitation products suggested various performance levels in hydrological modelling both temporally and spatially over diverse climate/topographic conditions. Despite their few uncertainties, these products are a promising alternative means of obtaining precipitation to fill the gaps in data-scarce regions to support the assessment, planning and management of water resources.

Numerous studies have been conducted using different hydrological models from lumped to fully distributed models using precipitation data from multiple products as an input for modelling of streamflow to identify the best precipitation products for hydrological modelling. Some of the common hydrological models that have been in use are: Hydrologiska Byråns Vattenbalansavdelning model (HBV), hydrological model (HYMOD), Artificial Neural Network (ANN)-based, Génie Rural à four paramètres Journalier (GR4J), Snowmelt Runoff Model (SRM), Simplified version of the HYDROLOG (SIMHYD), Soil and Water Assessment Tool (SWAT), Variable Infiltration Capacity (VIC), Hydrologic Engineering Center-Hydrologic Modeling System (HEC-HMS), Visualizing Ecosystem Land Management Assessments (VELMA) and Variant of Système Hydrologique Européen (MIKE SHE) (Bitew et al. 2012; Worqlul et al. 2014; Reda et al. 2015; Babur et al. 2016; Hu et al. 2017; Gebremicael et al. 2017;Liu et al. 2017; Colston et al. 2018; Tolera et al. 2018; Musie et al. 2019; Bhattacharya et al. 2020; Abdulahi et al. 2022; Ougahi & Mahmood 2022). However, they indicated different performance levels as their accuracy can be affected by geographical position, topography and climate, and the algorithms they are derived from. For instance, the study conducted by Ougahi & Mahmood (2022) using CFSR, CHIRPS, ERA5, MERR2, PERSIANN-CDR precipitation products to simulate streamflow suggested that ERA5 was the most reliable from the five precipitation products, while CHIRPS showed the worst performance both at daily and monthly scales. The study described in the works of Musie et al. (2019) to evaluate the hydrologic performance of SWAT using precipitation from CFSR, CHIRPS, PERCIANN-CDR and TRMM(3B427) concluded that, while all the other precipitation products performed well to capture gauged streamflow, CFSR showed the worst performance at daily scale. Conversely, CHIRPS showed a promising result in capturing streamflow modelling at both daily and monthly time scales. Similarly, Duan et al. (2016), who evaluated the capability of precipitation products from CHIRPS, CFSR and TRMM, to simulate streamflow with SWAT hydrological model, reported that CHIRPS performed better than the other (CFSR and TRMM) precipitation products. The simulated streamflow using Global Land Data Assimilation System (GLDAS) and PERSIANN-CDR precipitation products have similar good performance with simulated streamflow from gauge-based precipitation (Liu et al. 2017). A study conducted by Bhattacharya et al. (2020) concluded that simulated streamflow with the VIC hydrological model forced by ERA-Interim precipitation has a good agreement with observed streamflow while MERRA overestimated. Precipitation products with JRA-55 (Japanese 55-year Reanalysis), WFDEI (WATCH Forcing Data ERA Interim), and CFSR datasets underestimated the streamflow. CFSR was extremely poor in modelling streamflow compared to the other products especially at daily time scale.

Precipitation products from global and regional climate models with different downscaling systems are also promising alternative precipitation sources for hydrological simulations (Gleckler et al. 2008; Räisänen et al. 2010; Yira et al. 2017; Abdulahi et al. 2022). For instance Abdulahi et al. (2022) evaluated precipitation product from climate model (RACMO22T) under RCP4.5 and RCP8.5 as an input to HBV hydrological model to investigate the future streamflow availability. The result demonstrated that simulated streamflow with RACMO22T precipitation product in the baseline period was in good agreement with gauged streamflow, particularly after bias correction was applied. Precipitation data can be obtained from various sources including ground measuring gauges, satellite remote sensing, ground radar, reanalysis, or a combination of them. Each of these sources has its strengths and weaknesses, and their performance is region- and regime-dependent; hence, they need to be evaluated against available ground measuring station networks.

A number of studies were conducted and published regarding how well different open-source precipitation products capture gauged precipitation at different regions. For instance, Adane et al. (2021), Adjei et al. (2015), Bitew et al. (2012), Gebremicael et al. (2017) and Hordofa et al. (2021) compared the applicability of different satellite precipitation products to capture gauged precipitation products over various topographies. Similarly, precipitation products from reanalysis precipitation products were also evaluated to detect their hydrologic performance by Bhattacharya et al. (2020), Hu et al. (2017), Musie et al. (2019) and Tolera et al. (2018). On the other hand, some studies have been conducted by comparing between satellite and reanalysis precipitation products (Javanmard et al. 2010; Worqlul et al. 2014; Ougahi & Mahmood 2022). A few global and regional climate models have been investigated to study the availability of streamflow in the future under the climate change scenarios (Gleckler et al. 2008; Räisänen et al. 2010; Reda et al. 2015; Babur et al. 2016; Yira et al. 2017; Abdulahi et al. 2022). However, as far as we are aware, no studies have been conducted to examine the hydrologic performance of precipitation products from the satellite, reanalysis and climate model as an input to a single hydrological model (HBV) and compared their performance to each other, particularly in the Upper Awash River basin (UARB). Therefore, this study was intended to compare and evaluate the hydrologic performance of precipitation products selected from satellite, reanalysis and regional climate model using HBV hydrological model to gauged/recorded streamflow in the UARB. The selected precipitation products were CHIRPS from satellite products, CFSR from reanalysis product and RACMO22T from regional climate model. The choice of these datasets and reason for that choice are elaborated under the dataset section. The HBV model is selected for this particular study because of its popularity, immense application proficiency, user-friendliness, the ability to simulate streamflow in data-limited regions and relatively low data input requirement for simulation of streamflow as has been tested by many researchers (Abdulahi et al. 2022).

There are two approaches to evaluate the applicability of different precipitation products: (1) comparison and evaluation of precipitation products from different data sources with precipitation from ground rain gauge measuring stations; (2) using these precipitation products as an input into the hydrological models, and the outputs/simulated flows are compared and evaluated against recorded gauge-based streamflow (Worqlul et al. 2014; Meng et al. 2015; Ougahi & Mahmood 2022). The second approach was followed for this particular study. The result of this study would help and contribute to the selection of the best and most reliable precipitation products for streamflow modelling in the limited ground-based station networks and particularly in the UARB.

Study area

One of the 12 river basins that drain through the central and eastern highlands of Ethiopia, the Awash River basin has a catchment area of approximately 110,000 km2 (Edossa et al. 2010; Tadese et al. 2019). Based on the agricultural activities, socio-economic, climatological, physical and water resources characteristics, Awash River basin is divided into Upper valley, Middle valley and Lower valley (Edossa et al. 2010). Upper Awash sub-basin (study area) is one of the most highly populated sub-basins in the western highland part of Awash River basin, Ethiopia. The Upper Awash sub-basin is located between latitude 8°10′57″N and 9°13′54″N and between longitude 37°57′E and 39°11′E covering a total area of about 11,232 km2 (Figure 1). The basin altitude ranges from 250 to 3,000 m above mean sea level. The mean annual rainfall over the entire sub-basin is about 1,092 mm/year. Average daily temperature varies from about 12 to 31 °C. The total annual water demand of the sub-basin for irrigation, domestic water supply, livestock and industrial is estimated to be around 3.4 billion cubic metres (BMC) (Awash Basin Authority 2017; Abdulahi et al. 2022). Most of the precipitation is unimodal and falls during the main monsoon season between June and September while minor rainfall occurs starting from March to May, and the remaining months are mainly dry. This study area is selected due to its large mechanized irrigated farms, rapidly expanding industries and increasing population, which will intensify the water consumption rates in the future but with sparse networks of hydro-meteorological stations.
Figure 1

Location map of UARB boundary with hydro-meteorological stations.

Figure 1

Location map of UARB boundary with hydro-meteorological stations.

Close modal

Ground measured precipitation and streamflow

Daily precipitation data of the six meteorological stations were collected from Ethiopian National Meteorological Service Agency (ENMSA) for 24 years (1991 to 2013). These meteorological stations were selected based on their long record years, less missing data (<10%), and the extent of the catchment networks. Ground measured precipitation stations were used to extract other precipitation products (CFRS, CHIRPS and RACMO22T). Measured flow at the inlet of Koka reservoir was collected from Ethiopian Ministry of Water and Energy office (MoWE) for 14 years (2000–2013). This stream flow was used to calibrate and validate HBV hydrological model and used as a reference for hydrologic performance of considered precipitation products. The details of selected ground measured precipitation stations are presented in Table 1.

Table 1

Meteorological stations

NoGround measuring stationsLat.Long.Elev. (m)Annual avg. rainfall (mm)Annual avg. temp (°C)
Addis Ababa 9.02 38.75 2,386 1,256 17.2 
Akaki 8.87 38.79 2,057 986 19.9 
Dabre-Zeyt 8.73 38.95 1,900 929 20.0 
Koka-dam 8.47 39.16 1,618 1,028 22.1 
Ginchi 9.02 38.13 2,132 1,150 17.0 
Tulu Bolo 8.66 38.20 2,190 1,200 16.8 
NoGround measuring stationsLat.Long.Elev. (m)Annual avg. rainfall (mm)Annual avg. temp (°C)
Addis Ababa 9.02 38.75 2,386 1,256 17.2 
Akaki 8.87 38.79 2,057 986 19.9 
Dabre-Zeyt 8.73 38.95 1,900 929 20.0 
Koka-dam 8.47 39.16 1,618 1,028 22.1 
Ginchi 9.02 38.13 2,132 1,150 17.0 
Tulu Bolo 8.66 38.20 2,190 1,200 16.8 

CHIRPS, CFSR and climate model (RACMO22T) precipitation datasets

The most precise data comes from individual rain gauges and gauge networks since precipitation events are highly localized, especially when they are severe. Yet, they suffer from sample measurement, under-catch problems, and geographic sparsity, particularly in remote areas. Satellite, reanalysis and climate model-based precipitation products mitigate some of the shortcomings of the gauges (Sharannya et al. 2020).

CHIRPS (Climate Hazards Group Infra-Red Precipitation with Station data) Version 2 (CHIRPS-2.0) is an open-source precipitation dataset available at daily and monthly time resolution and incorporates fine (0.05° × 0.05° to 0.25° × 0.25°) spatial resolution. CHIRPS data set was developed to provide comprehensive, dependable, and current data sets for various early warning goals, such as trend analysis and seasonal drought monitoring. It was developed for monitoring drought-sensitive areas and also tested in countries like Ethiopia. It is available from 1981 to the near present (Musie et al. 2019; Sharannya et al. 2020; Hordofa et al. 2021). CHIRPS dataset is constructed from the NOAA Climate Forecast System (CFS), TRMM-3B42V7 data and monthly precipitation climatology data (CHPclim) and rain gauge stations (Hordofa et al. 2021; Ougahi & Mahmood 2022). The spatial and temporal coverage and resolution in CHIRPS provide the ability to study hydroclimate, precipitation extremes, and droughts, especially in historically data-sparse regions such as the Caribbean and Africa (Sharannya et al. 2020; Ougahi & Mahmood 2022). Currently, CHIRPS does not have coverage outside of 50°S–50°N) and is constructed using ground observed stations. Therefore it has limitations outside this range and ground station data-sparse regions. Despite its limitations, CHIRPS rainfall product agreed well with the benchmark rainfall patterns of different topographies. CHIRPS precipitation product, which is in the satellite gauge category with the 0.05 × 0.05 degree spatial resolution, is freely available and downloaded from (ftp://ftp.chg.uscb.edu/pub/org/chg/product/CHIRPS-2.O/) and used for analysis for this study.

CFSR global weather data was chosen as an alternative to the ground-based conventional weather data as an input for the hydrological model to evaluate the applicability and performance in modelling the streamflow (Tolera et al. 2018). Data assimilation systems that integrate available observations (both in-situ and remotely sensed data) into numerical models provide useful reanalysis outputs (Sharannya et al. 2020). The ground observations and satellite rainfall product are merged to output product with 38 by 38 km spatial resolution and daily time resolution at a global scale (Ougahi & Mahmood 2022). Reanalysis products depend on the observational restrictions for their dependability, even though they offer an extended temporal estimation of precipitation. These constraints might change greatly over time and place (Moriasi et al. 2013). CFSR is derived from the Global Forecast System that was developed in the National Centre for Environmental Prediction (NCEP). One of the great advantages of reanalysis product is that it was developed by combining historical observations going back several decades, with model-based global estimates using data assimilation provide near real-time (Bhattacharya et al. 2020). Because of its great temporal and spatial resolution, the CFSR precipitation product is the most extensively utilized precipitation product used for hydrologic modelling. SWAT formatted file at high spatial and longer time series is widely and readily available and has been used in hydrological modelling. CFSR precipitation data which is freely available was downloaded from the web (https://swat.tamu.edu/data/cfsr/) from the period of 1979 to 2014. The accuracy of CFSR dataset has been improved by including the coupling of the atmosphere-ocean-land surface-sea ice system (Bhattacharya et al. 2020).

Regional Climate Models (RCMs) were widely used due to high resolution and resolved information, and their ability to model atmospheric processes and land cover changes explicitly, wider range of variables, and better representation of some weather extremes than in Global Climate Models (GCMs) (Yira et al. 2017). The regional climate model (RACMO22T) version 2.2 was downloaded from the African CORDEX domain for the period of 1991–2013. CORDEX promotes international downscaling coordination, and facilitates easier analysis by scientists and end-user communities at the local level of regional climate changes with many methods of RCMs for Africa. The daily time series precipitation data of RACMO22T was downloaded from the web (http://cordexesg.dmi.dk/esgf-web-fe/). The selection of this climate model was based on vintage, resolution, validity and the ability to capture observed precipitation in the baseline period (Gleckler et al. 2008; Rojanamon et al. 2009; Räisänen et al. 2010; Yira et al. 2017) The performance of RACMO22T climate model precipitation output in capturing the gauged precipitation product was improved after bias correction is applied (Abdulahi et al. 2022). The detailed description of RACMO22T R|M and bias correction was presented by Abdulahi et al. (2022).

Figure 2 shows monthly precipitation products in mm from reanalyse (CFSR), satellite (CHIRPS) and climate model (RACMO22T) compared to measured precipitation from ground stations from 1991 to 2013. The differences in precipitation between CFSR, CHIRPS and RACMO22T and ground measured precipitation were 55.4, 14.1 and 4.6 mm respectively. Despite the different magnitudes, both base and peak precipitation are well reproduced with correlation coefficient (R2) equal to 0.88, 0.83 and 0.78 for RACMO22T, CHIRPS and CFSR respectively which shows they are within the acceptable range (Figure 2). The performance of each precipitation product is more likely examined as an input to HBV hydrological model and the results are discussed in the Results and discussion section.
Figure 2

Plot of monthly precipitation from CFSR, climate model (RACMO22T) and CHIRPS with measured precipitation from ground station from 1991 to 2013 in UARB.

Figure 2

Plot of monthly precipitation from CFSR, climate model (RACMO22T) and CHIRPS with measured precipitation from ground station from 1991 to 2013 in UARB.

Close modal

HBV hydrological model setup

HBV is a semi-distributed conceptual hydrological model which was developed in the Swedish Meteorological and Hydrological Institute (SHMI) in 1970s. It is used to forecast and simulate streamflow throughout the world including Ethiopia. The advantages of HBV model over the other hydrological models are the possibility of disaggregating the basin into a number of sub-basins, elevation and vegetation zones and relatively less data required for input for streamflow simulation (Seibert 2011; Gebre et al. 2015; Gragn et al. 2019). The required input parameters for HBV model are: daily areal rainfall (mm), daily average temperature for areas with snow cover (°C) and long term daily/monthly potential evapotranspiration (mm) (Abdulahi et al. 2022). Streamflow is also required for the calibration and validation of the model at the outlet. For this particular study, Hargreaves method was used to estimate potential evapotranspiration because of its simplicity and because it requires relatively less data input compared to the other methods like Penman (Hargreaves & Riley 1985; Nadrah et al. 2012). Detailed descriptions of the HBV hydrological model and Hargreaves method were presented in the work of Abdulahi et al. (2022) and Seibert (2011).

Model calibration and validation

The predictive ability, reliability and accuracy of hydrological model simulation should be evaluated before further usage for different purposes (Rientjes 2007). HBV hydrological model parameters during simulation were calibrated and validated with gauged daily or monthly streamflow along with daily or monthly gauged precipitation as input. Five to ten years of streamflow is sufficient to calibrate and validate HBV model (Seibert 2011). A number of statistical parameters were used by the scholars and researchers to evaluate the performance of the hydrological models (Bitew et al. 2012; Adjei et al. 2015; Tolera et al. 2018; Hordofa et al. 2021). In this study, coefficient of determination (R2) and Nash–Sutcliffe efficiency (NSE) were used to evaluate the performance of HBV model (Krause & Boyle 2005). Nash–Sutcliffe efficiency indicates how well the plot of the observed value versus simulated value fits the 1:1 line and ranges from [−∞ to 1] with the higher values indicating less error variance or better agreement. Values between 0 and 1 are generally viewed as acceptable levels of performance while values <0 indicates unacceptable performance. NSE performance ratings are classified as unsatisfactory (≤0.50), satisfactory (0.50 < to ≤ 0.65), good (0.65 < to ≤ 0.75) and very good (0.75 < to ≤ 1.0) (Moriasi et al. 2013; Tolera et al. 2018). NSE was also found to be the best objective function for reflecting the overall fit of a hydrograph and less sensitive to high extreme values due to the squared differences (Moriasi et al. 2013). The strength of linear correlation between simulated and observed streamflow is determined by R2 and ranges from 0 to 1. The best simulation is considered close to 1, while its values of >0.5 are generally acceptable (Krause & Boyle 2005; Moriasi et al. 2013). The model performance ratings based on R2 values are classified as unsatisfactory (≤0.50), satisfactory (0.50 < to ≤ 0.60), good (0.60 < to ≤ 0.70) and very good (0.70 < to ≤ 1.0).

For this study, from a total of 14 years (2000–2013) streamflow data, two years (2000–2001) was used for warmup period, seven years (2002–2008) for calibration and five years (2009–2013) for validation.

Precipitation products derived from different data sources such as satellite, reanalysis and climate models are essential in hydrological model simulations where ground measured precipitations are unavailable. The performances of such products are detected mainly using two approaches: (1) comparing the performance of each precipitation obtained from these data sources with the long years precipitation from in-situ or station recorded daily, monthly, and quarterly and even annually; (2) assessing the performance of each of the precipitation products through hydrological modelling as an input data. The second approach is followed in this particular study. The procedure is summarized as follows:

  • 1. Daily areal precipitation from six ground measured stations from 2000–2013 was fed into HBV hydrological model as an input and simulate streamflow keeping the outlet at the inlet of Koka Reservoir/lake (Figure 1).

  • 2. HBV hydrological model was calibrated and validated by the measured flow at the inlet of Koka reservoir at monthly time series. The predictive ability of the HBV model was investigated by coefficient of determination (R2) and Nash–Sutcliffe efficiency (NSE).

  • 3. After successful calibration and validation of HBV model, each precipitation product from CFSR, CHIRPS and RACMO22T was plugged as an input to HBV model and flow was simulated for each precipitation product separately keeping the optimum parameters during calibration constant.

  • 4. Finally, the performance of simulated flow with each precipitation product was compared and quantified against measured flow through graphical plots and statistical indices (R2, NSE, RMSE and PBIAS).

The two most commonly used graphical techniques to compare simulated with measured flow are hydrographs and percentage of exceedance probability curves and provide a first overview of model performance (Moriasi et al. 2013). The hydrographs indicate how simulated flow captures the measured flow especially low and high flow. On the other hand, flow duration curves (FDC) show how well the simulated flow frequency reproduces the frequency of measured flow (Rojanamon et al. 2009; Babur et al. 2016; Abdulahi et al. 2022). The FDC can be applied to study hydropower, water resources management, and low and high flow management for drought and flood management respectively.

Root mean square error (RMSE) and percentage of bias (PBIAS) are the statistical parameters used to examine the hydrologic performance of precipitation products in addition to coefficient of determination (R2) and Nash–Sutcliffe efficiency (NSE) as was suggested by Krause & Boyle (2005). R2 and NSE were discussed in the Model calibration and validation section. PBIAS measures the average tendency of the model simulated flow to be smaller or larger than measured flow at a common outlet point for the same period of time. Its value ranges from (−∞ to +∞). Under optimal conditions PBIAS is 0, where positive value indicates overestimation and negative shows underestimation. PBIAS is the deviation of data being evaluated and expressed as a percentage (Adjei et al. 2015; Babur et al. 2016). Performance rating of PBIAS is classified as very good (≤± 10%), good (±10% < to ≤ ±15%), satisfactory (±15% < to ≤ ±25%) and unsatisfactory (>± 25%) (Moriasi et al. 2013; Adjei et al. 2015; Babur et al. 2016). RMSE is also another important and commonly used error index statistic. It computes the standard deviation of the model prediction error (difference between measured and simulated values). The lower the RMSE value, the better model performance, and vice versa. RMSE varies from the optimal value of 0, which indicates zero residual variation and therefore perfect model simulation, to a large positive value (Moriasi et al. 2013). Recommended RMSE performance ratings for both daily and monthly flow are: (0–49) very good, (50–59) good, (60–70) satisfactory, and (>70) unsatisfactory (Tolera et al. 2018). A summary of the statistical measures used to check the level of hydrologic performance of the precipitation products is presented in Table 2.

Table 2

Summary of statistical indices used and their performance ratings (Moriasi et al. 2013; Tolera et al. 2018)

Performance ratingRMSER2NSEPBIAS%
Very Good 0 ≤ to ≤ 50 0.7 < to ≤ 1.0 0.75 < to ≤ 1.0 < ± 10 
Good 50 < to ≤ 60 0.60 < to ≤ 0.70 0.65 < to ≤ 0.75 ±10 ≤ to < ±15 
Satisfactory 60 < to ≤ 70 0.50 < to ≤ 0.60 0.50 < to ≤ 0.65 ±15 ≤ to < ±25 
Unsatisfactory >70 ≤0.50 ≤0.50 ≥± 25 
Performance ratingRMSER2NSEPBIAS%
Very Good 0 ≤ to ≤ 50 0.7 < to ≤ 1.0 0.75 < to ≤ 1.0 < ± 10 
Good 50 < to ≤ 60 0.60 < to ≤ 0.70 0.65 < to ≤ 0.75 ±10 ≤ to < ±15 
Satisfactory 60 < to ≤ 70 0.50 < to ≤ 0.60 0.50 < to ≤ 0.65 ±15 ≤ to < ±25 
Unsatisfactory >70 ≤0.50 ≤0.50 ≥± 25 

Calibration and validation results

Precipitation is the main input for hydrological model to simulate discharge. It greatly influences the output of a hydrological model by its volume, spatial and temporal distribution. Figure 3 shows the pattern of monthly simulated versus measured streamflow during calibration and validation at the outlet. The result indicated that hydrologic performance of HBV model was very good in simulating streamflow both during calibration and validation periods. Simulated streamflow showed very good performance with R2 (=0.95 & = 0.93) and NSE (=0.89 & =0.74) during calibration and validation period respectively. R2 and NSE showed slightly improved performance during calibration than validation period. This could be due to larger calibration period than validation period. Gragn et al. (2019) reported similar results. The hydrograph of simulated flow both during calibration and validation was highly comparable to measured flow even though a little bit under or over estimation (Figure 3). Generally speaking, the results of R2 and NSE demonstrated that the performance of HBV model was very good suggesting HBV hydrological model is applicable for simulating the flow with an acceptable accuracy for the UARB. This calibration result agreed with the study conducted by Abdulahi et al. (2022), on the same study area with R2 = 0.89 and NSE = 0.88, which is comparable to our result. The difference could be that in our case we used relatively higher number of data years during calibration and total number of model runs. The shapes of the simulated hydrograph are well captured by the shape of recorded streamflow both during calibration and validation periods. However, some of the peak and low flows were underestimated and measured flow overestimated. The same result was reported by Abdulahi et al. (2022).
Figure 3

Simulated vs. observed flow during calibration and validation period.

Figure 3

Simulated vs. observed flow during calibration and validation period.

Close modal

Comparison and evaluation of simulated flow against measured flow

In this section, the hydrologic performance of each precipitation product (CHIRPS, RACMO22T and CFSR) was evaluated at daily and monthly time scales to distinguish the best precipitation product for modelling streamflow in the UARB using statistical indices (R2, NSE, RMSE and PBIAS) and graphical techniques. Table 3 displays daily, monthly and annually simulated flow of each precipitation product and their relative change compared to measured flow at the outlet of UARB. At both daily and annual the simulated flow from each precipitation product overestimated measured flow. The magnitude of changes was accentuated for CFSR and CHIRPS. CFSR overestimated measured flow by far, followed by CHIRPS, whereas RACMO22T showed less overestimation of the measured flow (Table 3). CFSR is the worst while RACMO22T is the most promising precipitation product in modelling streamflow compared to the other products. Conversely, at monthly time scale, simulated flow with each precipitation product showed both overestimation and underestimation. The highest overestimation was seen during August for CHIRPS and CFSR and July for RACMO22T (Figure 4). Large magnitude change of simulated flow was experienced for CFSR (1,072.6 m3/s), followed by CHIRPS (429.9 m3/s) and RACMO22T (115.4 m3/s). As indicated by Figure 4(b), the magnitude differences were more visible from July to September following the precipitation increment. The reasons behind the maximum difference occurring during these months were associated with the HBV model performance to simulate high flow (Abdulahi et al. 2022). On the other hand, the difference was more articulated for CFSR which confirms CFSR precipitation product fails to capture the measured peak precipitation (Ougahi & Mahmood 2022). Simulated flow with RACMO22T precipitation was well captured by measured flow throughout the year with a little deviation compared to CHIRPS and CFSR (Figure 4(a)).
Table 3

Simulated flow amounts and their changes with respect to measured flow (m3/s)

TimeMeasured flowSimulated flow amounts from:
Changes in flow (m3/s)
CHIRPSObsRACMO22TCFSRCHIRPSObsRACMO22TCFSR
Daily 7.7 13.1 8.5 8.7 23.7 5.4 0.8 1.0 16.0 
Jan 99.9 165.6 107.1 113.7 293.2 65.7 7.3 13.9 193.4 
Feb 8.5 0.3 2.4 10.6 7.4 −8.2 −6.2 2.1 −1.1 
Mar 13.9 0.1 8.1 8.2 10.6 −13.8 −5.8 −5.6 −3.2 
Apr 21.6 0.2 24.7 18.5 30.4 −21.3 3.1 −3.1 8.9 
May 25.2 0.2 36.6 21.3 62.6 −25.1 11.4 −3.9 37.3 
Jun 60.1 7.5 83.9 59.6 81.1 − 52.6 23.7 −0.5 20.9 
Jul 291.5 563.4 387.3 406.9 807.3 271.9 95.8 115.4 515.8 
Aug 474.4 899.3 446.6 532.8 1,547.1 424.9 − 27.8 58.3 1,072.6 
Sep 224.4 431.1 245.7 174.1 963.7 206.7 21.4 − 50.3 739.4 
Oct 35.8 100.3 58.4 46.4 123.5 64.5 22.6 10.7 87.7 
Nov 17.6 16.8 18.3 32.7 24.6 −0.8 0.7 15.1 7.0 
Dec 11.0 4.4 4.9 19.5 8.2 −6.6 −6.0 8.6 −2.8 
Annual 107.0 182.4 118.7 120.4 330.0 75.4 11.7 13.4 223.0 
TimeMeasured flowSimulated flow amounts from:
Changes in flow (m3/s)
CHIRPSObsRACMO22TCFSRCHIRPSObsRACMO22TCFSR
Daily 7.7 13.1 8.5 8.7 23.7 5.4 0.8 1.0 16.0 
Jan 99.9 165.6 107.1 113.7 293.2 65.7 7.3 13.9 193.4 
Feb 8.5 0.3 2.4 10.6 7.4 −8.2 −6.2 2.1 −1.1 
Mar 13.9 0.1 8.1 8.2 10.6 −13.8 −5.8 −5.6 −3.2 
Apr 21.6 0.2 24.7 18.5 30.4 −21.3 3.1 −3.1 8.9 
May 25.2 0.2 36.6 21.3 62.6 −25.1 11.4 −3.9 37.3 
Jun 60.1 7.5 83.9 59.6 81.1 − 52.6 23.7 −0.5 20.9 
Jul 291.5 563.4 387.3 406.9 807.3 271.9 95.8 115.4 515.8 
Aug 474.4 899.3 446.6 532.8 1,547.1 424.9 − 27.8 58.3 1,072.6 
Sep 224.4 431.1 245.7 174.1 963.7 206.7 21.4 − 50.3 739.4 
Oct 35.8 100.3 58.4 46.4 123.5 64.5 22.6 10.7 87.7 
Nov 17.6 16.8 18.3 32.7 24.6 −0.8 0.7 15.1 7.0 
Dec 11.0 4.4 4.9 19.5 8.2 −6.6 −6.0 8.6 −2.8 
Annual 107.0 182.4 118.7 120.4 330.0 75.4 11.7 13.4 223.0 

Note: Bold values indicate maximum changes/deviations of each precipitation product from the measured value.

Figure 4

Plots of simulated flow amounts (a) and their relative changes and (b) with respect to measured flow (m3/s).

Figure 4

Plots of simulated flow amounts (a) and their relative changes and (b) with respect to measured flow (m3/s).

Close modal
Graphical techniques are one of the methods used to evaluate hydrologic performance of precipitation products, and provide a first overview of model performance. Figures 5 and 6 show the plots of daily and monthly simulated flow with each precipitation product with respect to measured flow respectively. The hydrography of simulated flow with RACMO22T precipitation data was deeply continual with measured flow at both daily and monthly scales compared to CHIRPS and CFSR (Figure 5(b) and 6(b)). CHIRPS and CFSR underestimated measured base flow at daily time series (Figure 5(c) and 5(d)) and overestimated peak flows at monthly scales (Figure 6(c) and 6(d)). Similar findings were reported by Sharannya et al. (2020), which indicated that satellite-based precipitation, particularly CHIRPS-0.05 and CHIRPS-0.25, was unable to detect base and high flows. RACMO22T was better able to capture both peaks and base flows (Yira et al. 2017; Abdulahi et al. 2022). CHIRPS and CFSR were the worst precipitation products to capture measured base flow at daily scale This result agrees with the results of Ougahi & Mahmood (2022). Similarly, plots of daily simulated flow with precipitation from gauging stations underestimated base flow but better captured both peaks and base flows at monthly time series (Figure 5(a)) and (Figure 6(a)). CHIRPS and CFSR overestimated measured peak flows at monthly time scale (Figure 6(c) and 6(d)). The differences between plots of simulated and measured flows were more visible on daily time series than monthly (Sharannya et al. 2020).
Figure 5

Plots of daily simulated streamflow in logarithmic of base 10 with precipitation from (a) gauged station, (b) RACMO22T, (c) CHIRPS and (d) CFSR against measured streamflow.

Figure 5

Plots of daily simulated streamflow in logarithmic of base 10 with precipitation from (a) gauged station, (b) RACMO22T, (c) CHIRPS and (d) CFSR against measured streamflow.

Close modal
Figure 6

Plots of monthly simulated flow with rainfall product from (a) gauge station, (b) RACMO22T, (c) CHIRPS and (d) CFSR against measured flow.

Figure 6

Plots of monthly simulated flow with rainfall product from (a) gauge station, (b) RACMO22T, (c) CHIRPS and (d) CFSR against measured flow.

Close modal
The hydrologic performance of these precipitation products is better understood through the statistical indices (R2, NSE, PBIAS and RMSE) because they present quantitative results rather than the graphical visualization. Figure 7(a)–7(d) presents the plots of statistical indices of simulated streamflow from each precipitation product at daily and monthly time series. The outcome showed that there were differences in the statistical parameters from one product to another and from daily to monthly. R2 is an important statistical metric used to evaluate the performance of simulated flow against measured flow. Based on R2, the hydrologic performance of all precipitation products was good (R2 > 0.5). The highest R2 was registered for precipitation from gauging station R2 (0.72), followed by CFSR (0.61), CHIRPS (0.55) and RACMO22T (0.5) at daily time scale (Figure 7(a)). The lowest R2 (0.5) was registered for RACMO22T at daily scales. In terms of R2 (=0.61) CFSR showed the best performance of all precipitation products. The hydrologic performance of all precipitation products was significantly improved in terms of R2 from daily to monthly time series which is compatible with the study of Ougahi & Mahmood (2022). For example, R2 for RACMO22T was improved from 0.5 (daily) to 0.81 (monthly) which is transformed from good to very good range (Figure 7(a)). R2 values are almost the same at monthly scale for all precipitation products. Simulated flow from rain gauge precipitation showed greater magnitude of R2 compared to the other precipitation products and implied that simulation of flow with ground measuring precipitation can provide high quality and accuracy of flow (Sharannya et al. 2020).
Figure 7

Comparison of the average simulated flow metrics for (a) gauge based, (b) RACMO22T, (c) CHIRPS and (d) CFSR at daily and monthly time scales in the UARB.

Figure 7

Comparison of the average simulated flow metrics for (a) gauge based, (b) RACMO22T, (c) CHIRPS and (d) CFSR at daily and monthly time scales in the UARB.

Close modal

Another very important statistical parameter used to check the hydrologic performance of precipitation products is NSE, which indicates how well the plot of measured value fits the simulated value. NSE varies from 0.43 to 0.71 at daily time series and 0.52 to 0.98 at monthly time series. In terms of NSE, CFSR performance was unsatisfactory (NSE = 0.43), which is <0.5 at daily time series, whereas RACMO22T performance was very good (NSE = 0.7) at daily time scale (Figure 7(b)). CHIRPS showed good performance (NSE = 0.63) at daily time series but performed worse than RACMO22T. On monthly scale, the performance of all precipitation products in hydrologic simulation in terms of NSE was very good (NSE > 0.7) except CFSR (NSE = 0.52) which was satisfactory. CHIRPS was the second best precipitation product next to RACMO22T in terms of NSE. Like R2 there was a significant improvement of NSE from daily to monthly time scale (Figure 7(b)).

PBIAS and RMSE are other important statistical indices used to examine the hydrologic performance of precipitation data. Simulated flow with CFSR, CHIRPS and RACMO22T resulted in positive PBIAS which means overestimated measured flow at various levels. The simulated flow with RACMO22T was good in terms of PBIAS (<± 20%) while CHIRPS and CFSR showed unsatisfactory performance (PBIAS > ±25) at both daily and monthly time scale (Figure 7(c)). Extremely large values of PBIAS (>± 180%) and (>± 75%) were seen for CFSR and CHIRPS respectively which showed worst performance. Generally the hydrologic performance of RACMO22T precipitation product showed satisfactory results whereas CFSR and CHIRPS showed unsatisfactory results in terms of PBIAS. Similarly, CFSR showed the highest RMSE both at daily and monthly scale. Greater magnitude (RMSE) error was exhibited on monthly scale. The lowest RMSE was registered for simulated streamflow from RACMO22T precipitation product. The RACMO22T performance was in the very good ranges in terms of RMSE (21.8% and 17.3%) at monthly and daily scales, respectively, compared to the other precipitation products. Generally, the hydrologic performance of RACMO22T precipitation product was considered to be the best in terms of all statistical indices (R2 > 0.50, NSE > 0.70, −20 <PBIAS < +20%, and RMSE < 20).

Flow duration curves and relative changes in low, medium and high flow

Percentage exceedance probability curve is one of the graphical techniques used to evaluate the performance of precipitation data for hydrologic modelling (Moriasi et al. 2013). Simulated flow using each precipitation product was plotted as a flow duration curve to show how well the simulated flow matches the frequency of measured flow from the gauged station at the outlet. Figure 8 depicts the monthly flow frequency curves of the simulated flow from each precipitation product in relation to the measured flow. The outcome shows that more than 50% of the simulated flow from all precipitation products were underestimates of the corresponding measured flow except RACMO22T which noticeably overlapped measured flow. The magnitude of deviation of the low flow simulated from CHIRPS precipitation was high compared with the other products (Figure 8(c)). Simulated flow from RACMO22T precipitation product closely matched the measured flow (Figure 8(b)). Table 4 depicts the variations between the simulated high flow (Q10 and Q20), medium flow (Q50), and low flow (Q95 and Q100) in relation to the corresponding measured flow. The CFSR and CHIRPS showed greatest changes of high flow (Q10 and Q20). RACMO22T precipitation product provides the smallest changes in simulated flow when compared to CFSR and CHIRPS, with variations between −10% and +16.2%. Less magnitude can be seen in the relative changes of Q50 of the simulated flow from all precipitation products (Table 3). Simulated flow using the RACMO22T precipitation product demonstrated less percentage error in all considered flow percentages (Q10, Q20, Q50, Q95, and Q100) compared to the other precipitation products, suggesting that the RACMO22T precipitation product is a promising alternative in hydrological modelling for the UARB. Overall, RACMO22T's precipitation product's hydrologic performance showed the greater quality in all the statistical indices and graphical techniques utilized, and was ranked the first, with CHIRPS coming in second and CFSR last. The variations between the simulated and measured flow can be traced to a variety of agents, including: errors in precipitation predictions caused by regional and temporal variability, resolutions, and vintage; errors in stream gauge observation; and errors in model structure/setup and calibration and validation.
Table 4

Simulated flow at different percentage of time and their relative changes with respect to measured flow

Simulated flow (m3/s) with precipitation products from:
% of time of flowMeasured flowGauge sta.% changeRACMO22T% changeCHIRPS% changeCFSR% change
Q10 349.2 422.6 21.0 405.8 16.2 746.2 113.7 1,347.7 285.9 
Q20 238.8 283.6 18.8 218.3 −8.6 460.0 92.6 803.4 236.4 
Q50 26.0 38.2 46.9 25.9 −0.4 7.5 −71.2 36.9 41.9 
Q95 9.1 2.2 −75.8 8.1 −11.0 0.1 −98.9 2.9 −68.1 
Q100 8.3 1.3 −84.3 7.4 −10.8 0.1 −98.8 2.3 −72.3 
Simulated flow (m3/s) with precipitation products from:
% of time of flowMeasured flowGauge sta.% changeRACMO22T% changeCHIRPS% changeCFSR% change
Q10 349.2 422.6 21.0 405.8 16.2 746.2 113.7 1,347.7 285.9 
Q20 238.8 283.6 18.8 218.3 −8.6 460.0 92.6 803.4 236.4 
Q50 26.0 38.2 46.9 25.9 −0.4 7.5 −71.2 36.9 41.9 
Q95 9.1 2.2 −75.8 8.1 −11.0 0.1 −98.9 2.9 −68.1 
Q100 8.3 1.3 −84.3 7.4 −10.8 0.1 −98.8 2.3 −72.3 
Figure 8

Simulated flow against recorded flow with their corresponding frequency of flow.

Figure 8

Simulated flow against recorded flow with their corresponding frequency of flow.

Close modal

The findings show that streamflow in the UARB may be predicted by the HBV model more accurately utilizing climate model (RACMO22T) precipitation data than satellite (CHIRPS) and reanalysis (CFSR) precipitation products. We have applied linear bias adjustment to the RACMO22T precipitation product prior to using it as an input for the HBV model for simulation, which could be one of the reasons why it was better in the performance. Applying bias correction to climate model-based precipitation products has been studied by Abdulahi et al. (2022) and Yira et al. (2017). The result shows that applying bias correction greatly improved precipitation data to capture the precipitation from ground stations. When compared to gauged flow, the hydrologic performance of the satellite-based precipitation (CHIRPS) product performed marginally better than the reanalysis precipitation (CFSR) product. Hydrologic performance of satellite-based precipitation data is more reliable in flat regions than mountainous because in the mountainous regions satellite products use passive microwave or infrared sensors which mostly fail to detect high rainfall over complex topography (Ougahi & Mahmood 2022). Similarly, a study conducted on a flat region by Sharannya et al. (2020) revealed that the satellite-based precipitation product in the flat regions has better performance than reanalysis (CFSR) in modelling flow which is in agreement with our result. Among all the precipitation products, only RACMO22T precipitation data qualified for hydrologic performance based on all four evaluation indices (R2 > 0.50, NSE > 0.70, PBIAS < ±20% and RMSE < 20). The result implied that, based on the evaluation criterion applied, RACMO22T was considered to be the viable option for hydrologic modelling in the UARB. The hydrologic performance of all precipitation products was very good based on (R2 > 0.70) and (NSE > 0.75) at monthly scale except CFSR (NSE = 0.52) which is in the satisfactory range. The hydrologic performance of the CHIRPS and CFSR were unsatisfactory based on PBIAS (>+ 65) both at daily and monthly scale as recommended by Adjei et al. (2015) and Babur et al. (2016). CFSR shows extremely large value of PBIAS (>+ 180) both at daily and monthly scale compared with CHIRPS. Hydrologic performance of all precipitation data based on the RMSE evaluation indices were in the very good range (<50) both at daily and monthly scales, except for the CFSR (=91.8) which is unsatisfactory as suggested by Moriasi et al. (2013) and Tolera et al. (2018).

Figure 8 depicts the simulated FDC for all precipitation products at the outlet of the UARB at a monthly time scale. It is observed that simulated flow with RACMO22T precipitation follows the same patterns as that of the gauged/measured flow (Figure 8(b)). This means that RACMO22T precipitation product is capable of simulating high, medium and low flow for UARB since the FDC exactly corresponds to observed flow FDC with a little deviation. The same finding was reported by Abdulahi et al. (2022). On the other hand, regarding the CHIRPS and CFSR precipitation products, it is difficult to judge one dataset as the best; rather it should be based on the application of the study. For example, to simulate high flows, CHIRPS may be suitable, whereas for low flow CFSR is better than CHIRPS (Figure 8(c) and 8(d)). Minimum flow corresponds to Q95 and Q100 whereas a high flows/extreme flow event corresponds to Q10 and Q20. Q50 represents medium or average flow. CHIRPS rainfall product was capable of capturing high flows with a little deviation, and underestimated low flow by far. A Report by Sharannya et al. (2020) also reveals the same kind of situation. CFSR overestimated high flow and underestimated low flow (Figure 8(d)). CHIRPS and CFSR showed nearly the same kind of medium flow (Q50) distribution. The differences observed between the simulated flow for precipitation estimates and measured flow could be attributed to a variety of agents, such as: errors in precipitation predictions because of high temporal and spatial variability, resolution, and algorithm; errors in stream gauge observation; errors in model structure/setup; and number of data years and model runs during calibration and validation. In general, considering the uncertainties, the result implied that the hydrologic performance of regional climate model-based precipitation product (RACMO22T) means that it is a promising alternative compared to the satellite (CHIRPS) and reanalysis (CFSR) precipitation products in the UARB. To determine the most promising precipitation products for the management and mitigation of water resources, additional research using a variety of regional climate models and an ensemble of them will be necessary in order to increases confidence in the results obtained.

The present work examined the hydrologic performance of open-source precipitation estimates particularly CHIRPS, reanalysis (CFSR) and regional climate model (RACMO22T) through HBV hydrological model in the UARB. First, precipitation measured from rain gauges stations was used as an input to HBV model to simulate the flow. Then the predictive ability/performance of HBV was evaluated against gauged flow at the outlet through calibration and validation. The optimum parameters obtained during calibration of HBV were kept constant during simulation of flow with each precipitation estimate (CHIRPS, CFSR and RACMO22T). Finally, the simulated flow from each precipitation estimate was compared and evaluated against gauged flow at the outlet of the basin to examine their hydrologic performance through statistical indices (R2, NSE, RMSE and PBIAS) and graphical visualization at daily and monthly scales. The result indicated that the performance indicators (R2, NSE, RMSE and PBIAS) were within the acceptable ranges for all precipitation estimates even though their performance levels were different, except PBIAS for CFSR and CHIRPS estimates. The performance of the RACMO22T precipitation product was ranked the first based on all performance indicators. It is observed that the performance of precipitation data widely differs based on the statistical indices. The performance indicators (R2, NSE, PBIAS and RMSE) were in the ranges of 0.5–0.72, 0.43–0.72, +11.1– + 182, and 11.4–38.8 at daily scale and 0.81–0.90, 0.52–0.98, +10.5– + 207.7, and 14.1–91 at monthly scale, respectively. The hydrologic performance of these precipitation products was significantly improved from daily to monthly scales. The hydrologic performance of the CHIRPS and CFSR were unsatisfactory based on PBIAS values at both daily and monthly scales. And, CFSR was unable to detect measured flow based on the RMSE. For instance, all precipitation datasets show very good to satisfactory performance based on R2 and NSE. Only RACMO22T precipitation estimates qualified for hydrologic performance based on all four evaluation indices used in the UARB.

In addition to the statistical parameters, the flow duration curve (FDC) simulated by RACMO22T precipitation product has the same patterns as that of the gauged/measured flow duration curve which confirms that the RACMO22T precipitation estimates are better in predicting flow in the UARB. This means that RACMO22T precipitation product is capable of simulating high flow (Q10 and Q20), medium (Q50) and low flows (Q95 and Q100) for UARB. Regarding the CHIRPS and CFSR precipitation products, it is challenging to choose a single dataset as the best option; instead the purpose and the application of the study should be considered to select the best precipitation estimates for further application. For instance, CHIRPS might be appropriate to simulate high flows, whereas CFSR performed better in low flow modelling scenarios.

This result implied that, overall, the hydrologic performance of climate model (RACMO22T) based precipitation estimates using HBV model would be of great benefit considering the difficulties in accessing data across and in similar basins compared to the satellite (CHIRPS) and reanalysis (CFSR) precipitation estimates. However, to build more confidence in the results obtained, further study will be required by employing a number of climate models and even their ensembles.

We are grateful to the Ethiopian Ministry of Water and Energy (MoWE) and National Meteorology Service Agency (NMSA) for providing hydro-meteorological and GIS data. We thank the Climate Forecast System Reanalysis (CFSR) centre and Climate Hazards Group Infrared Precipitation with Station (CHIRPS) centre for providing the essential and valuable data for this study.

All relevant data are included in the paper or its Supplementary Information.

The authors declare there is no conflict.

Abdulahi
S. D.
,
Abate
B.
,
Harka
A. E.
&
Husen
S. B.
2022
Response of climate change impact on stream flow : The case of the Upper Awash
.
Journal of Water and Climate Change
13
(
2
),
607
628
.
https://doi.org/10.2166/wcc.2021.251
.
Adane
G. B.
,
Hirpa
B. A.
,
Lim
C. H.
&
Lee
W. K.
2021
Evaluation and comparison of satellite-derived estimates of rainfall in the diverse climate and terrain of central and north eastern Ethiopia
.
Remote Sensing
13
(
7
),
1275
.
https://doi.org/10.3390/rs13071275
.
Adjei
K. A.
,
Ren
L.
,
Appiah-Adjei
E. K.
&
Odai
S. N.
2015
Application of satellite-derived rainfall for hydrological modelling in the data-scarce Black Volta trans-boundary basin
.
Hydrology Research
46
(
5
),
777
791
.
https://doi.org/10.2166/nh.2014.111
.
Awash Basin Authority
.
2017
Awash River Basin Strategic Plan Main Report
.
Addis Ababa, Ethiopia
:
Awash Basin Authority
.
Babur
M.
,
Babel
M. S.
,
Shrestha
S.
,
Kawasaki
A.
&
Tripathi
N. K.
2016
Assessment of climate change impact on reservoir inflows using multi climate-models under RCPs: The case of Mangla Dam in Pakistan
.
Water (Switzerland)
8
(
9
).
https://doi.org/10.3390/w8090389
.
Bhattacharya
T.
,
Khare
D.
&
Arora
M.
2020
Evaluation of reanalysis and global meteorological products in Beas river basin of North-Western Himalaya
.
Environmental Systems Research
9
(
1
),
24
.
https://doi.org/10.1186/s40068-020-00186-1
.
Bitew
M. M.
,
Gebremichael
M.
,
Ghebremichael
L. T.
&
Bayissa
Y. A.
2012
Evaluation of high-resolution satellite rainfall products through streamflow simulation in a hydrological modeling of a small mountainous watershed in Ethiopia
.
Journal of Hydrometeorology
13
(
1
),
338
350
.
https://doi.org/10.1175/2011JHM1292.1
.
Colston
J. M.
,
Ahmed
T.
,
Mahopo
C.
,
Kang
G.
,
Kosek
M.
,
de Sousa Junior
F.
,
Shrestha
P. S.
,
Svensen
E.
,
Turab
A.
&
Zaitchik
B.
2018
Evaluating meteorological data from weather stations, and from satellites and global models for a multi-site epidemiological study
.
Environmental Research
165
,
91
109
.
https://doi.org/10.1016/j.envres.2018.02.027
.
Duan
H.
,
Deng
Z.
,
Deng
F.
&
Wang
D.
2016
Assessment of groundwater potential based on multicriteria decision making model and decision tree algorithms
.
Mathematical Problems in Engineering
2016
,
1
12
.
https://doi.org/10.1155/2016/2064575
.
Edossa
D. C.
,
Babel
M. S.
&
Das Gupta
A.
2010
Drought analysis in the Awash River Basin, Ethiopia
.
Water Resources Management
24
(
7
),
1441
1460
.
https://doi.org/10.1007/s11269-009-9508-0
.
Gebre
S. L.
,
Tadele
K.
&
Mariam
B. G.
2015
Potential impacts of climate change on the hydrology and water resources availability of didessa catchment, Blue Nile River Basin, Ethiopia
.
Geology & Geosciences
4
(
1
),
1
7
.
https://doi.org/10.4172/2329-6755.1000193
.
Gebremicael
T.
,
Mohamed
Y.
,
van der Zaag
P.
,
Berhe
A.
,
Haile
G.
,
Hagos
E.
&
Hagos
M.
2017
Comparison and validation of eight satellite rainfall products over the rugged topography of Tekeze-Atbara Basin at different spatial and temporal scales
.
Hydrology and Earth System Sciences Discussions
[preprint], https://doi.org/10.5194/hess-2017-504, 2017
.
Gleckler
P. J.
,
Taylor
K. E.
&
Doutriaux
C.
2008
Performance metrics for climate models
.
Journal of Geophysical Research
113
,
1
20
.
https://doi.org/10.1029/2007JD008972
.
Hargreaves
G.
&
Riley
J.
1985
Agricultural benefits for Senegal River Basin
.
Journal of Irrigation and Drainage Engineering
111
(
2
),
113
124
.
Hordofa
A. T.
,
Leta
O. T.
,
Alamirew
T.
,
Kawo
N. S.
&
Chukalla
A. D.
2021
Performance evaluation and comparison of satellite-derived rainfall datasets over the Ziway lake basin, Ethiopia
.
Climate
9
(
7
).
https://doi.org/10.3390/cli9070113
.
Hu
S.
,
Qiu
H.
,
Yang
D.
,
Cao
M.
,
Song
J.
,
Wu
J.
,
Huang
C.
&
Gao
Y.
2017
Evaluation of the applicability of climate forecast system reanalysis weather data for hydrologic simulation: A case study in the Bahe River Basin of the Qinling Mountains, China
.
Journal of Geographical Sciences
27
(
5
),
546
564
.
https://doi.org/10.1007/s11442-017-1392-6
.
Hughes
D. A.
2006
Comparison of satellite rainfall data with observations from gauging station networks
.
Journal of Hydrology
327
(
3–4
),
399
410
.
https://doi.org/10.1016/j.jhydrol.2005.11.041
.
Javanmard
S.
,
Yatagai
A.
,
Nodzu
M. I.
,
Bodaghjamali
J.
&
Kawamoto
H.
2010
Comparing high-resolution gridded precipitation data with satellite rainfall estimates of TRMM-3b42 over Iran
.
Advances in Geosciences
25
,
119
125
.
https://doi.org/10.5194/adgeo-25-119-2010
.
Krause
P.
&
Boyle
D. P.
2005
Comparison of different efficiency criteria for hydrological model assessment
.
Advances in Geosciences
5
,
89
97
.
https://doi.org/10.5194/adgeo-5-89-2005
.
Liu
X.
,
Yang
T.
,
Hsu
K.
,
Liu
C.
&
Sorooshian
S.
2017
Evaluating the streamflow simulation capability of PERSIANN-CDR daily rainfall products in two river basins on the Tibetan Plateau
.
Hydrology and Earth System Sciences
21
(
1
),
169
181
.
https://doi.org/10.5194/hess-21-169-2017
.
Meng
J.
,
Yu
Z.
,
Yao
Q.
,
Bianchi
T. S.
,
Paytan
A.
,
Zhao
B.
,
Pan
H.
&
Yao
P.
2015
Distribution, mixing behavior, and transformation of dissolved inorganic phosphorus and suspended particulate phosphorus along a salinity gradient in the Changjiang Estuary
.
Marine Chemistry
168
,
124
134
.
https://doi.org/10.1016/j.marchem.2014.09.016
.
Michaels
P. J.
,
Balling
R. C.
,
Vose
R. S.
&
Knappenberger
P. C.
1998
Analysis of trends in the variability of daily and monthly historical temperature measurements
.
Climate Research
10
(
1
),
27
33
.
https://doi.org/10.3354/cr010027
.
Moriasi
D.
,
Arnold
J.
&
Van Liew
M. W.
2013
Model evaluation guidelines for systematic quantification of accuracy in watershed simulations
.
Transactions of the ASABE (American Society of Agricultural and Biological Engineers)
50
(
3
),
885
900
.
https://doi.org/10.13031/2013.23153
.
Musie
M.
,
Sen
S.
&
Srivastava
P.
2019
Comparison and evaluation of gridded precipitation datasets for streamflow simulation in data scarce watersheds of Ethiopia
.
Journal of Hydrology
579
,
124168
.
https://doi.org/10.1016/j.jhydrol.2019.124168
.
Nadrah
N.
,
Tukimat
A.
,
Harun
S.
&
Shahid
S.
2012
Comparison of different methods in estimating potential evapotranspiration at Muda Irrigation Scheme of Malaysia
.
Journal of Agriculture and Rural Development in the Tropics and Subtropics
113
(
2
),
77
85
http://nbn-resolving.de/urn:nbn:de:hebis:34-2012091441739
Nkunzimana
A.
,
Bi
S.
,
Alriah
M. A. A.
,
Zhi
T.
&
Kur
N. A. D.
2020
Comparative analysis of the performance of satellite-based rainfall products over various topographical unities in Central East Africa : Case of Burundi
.
Earth and Space Science
7
,
e2019EA000834
.
https://doi.org/10.1029/2019EA000834
.
Ougahi
J. H.
&
Mahmood
S. A.
2022
Evaluation of satellite-based and reanalysis precipitation datasets by hydrologic simulation in the Chenab river basin
.
Journal of Water and Climate Change
13
(
3
),
1563
1582
.
https://doi.org/10.2166/wcc.2022.410
.
Räisänen
J.
,
Ruokolainen
L.
&
Yilhaisi
J.
2010
Weighting of model results for improving best estimates of climate change
.
Climate Dynamics
35
,
407
422
.
https://doi.org/10.1007/s00382-009-0659-8
.
Reda
D. T.
,
Engida
A. N.
,
Asfaw
D. H.
&
Hamdi
R.
2015
Analysis of precipitation based on ensembles of regional climate model simulations and observational databases over Ethiopia for the period 1989-2008
.
International Journal of Climatology
35
(
6
),
948
971
.
https://doi.org/10.1002/joc.4029
.
Rientjes
T. H. M.
2007
Modelling in Hydrology. Department of Water Resources
.
ITC
,
Enschede, The Netherlands
.
Rojanamon
P.
,
Chaisomphob
T.
&
Bureekul
T.
2009
Application of geographical information system to site selection of small run-of-river hydropower project by considering engineering/economic/environmental criteria and social impact
.
Renewable and Sustainable Energy Reviews
13
(
9
),
2336
2348
.
https://doi.org/10.1016/j.rser.2009.07.003
.
Seibert
J.
2011
Introduction to Hydrological Modelling and the HBV Model
.
Department of Geography, University of Zurich
,
Stockholm
. https://www.geo.uzh.ch/dam/jcr:fb0a59f7-c54d-43ce-b3b3-e33ade4679eb/HBV_intro_lecture.pdf
Sharannya
T. M.
,
Al-Ansari
N.
,
Barma
S. D.
&
Mahesha
A.
2020
Evaluation of satellite precipitation products in simulating streamflow in a humid tropical catchment of India using a semi-distributed hydrological model
.
Water (Switzerland)
12
(
9
).
https://doi.org/10.3390/w12092400
.
Tadese
M. T.
,
Kumar
L.
,
Koech
R.
&
Zemadim
B.
2019
Hydro-climatic variability: A characterisation and trend study of the Awash River Basin, Ethiopia
.
Hydrology
6
(
2
),
35
.
https://doi.org/10.3390/hydrology6020035
.
Tolera
M. B.
,
Chung
I. M.
&
Chang
S. W.
2018
Evaluation of the climate forecast system reanalysis weather data for watershed modeling in Upper Awash Basin, Ethiopia
.
Water (Switzerland)
10
(
6
).
https://doi.org/10.3390/w10060725
.
Worqlul
A. W.
,
Maathuis
B.
,
Adem
A. A.
,
Demissie
S. S.
,
Langan
S.
&
Steenhuis
T. S.
2014
Comparison of rainfall estimations by TRMM 3b42, MPEG and CFSR with ground-observed data for the Lake Tana basin in Ethiopia
.
Hydrology and Earth System Sciences
18
(
12
),
4871
4881
.
https://doi.org/10.5194/hess-18-4871-2014
.
Yira
Y.
,
Diekkrüger
B.
,
Steup
G.
&
Bossa
A. Y.
2017
Impact of climate change on hydrological conditions in a tropical West African catchment using an ensemble of climate simulations
.
Hydrology and Earth System Sciences
21
,
2143
2161
.
https://doi.org/10.5194/hess-21-2143-2017
.
This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (CC BY-NC-ND 4.0), which permits copying and redistribution for non-commercial purposes with no derivatives, provided the original work is properly cited (http://creativecommons.org/licenses/by-nc-nd/4.0/).