The uncertainty in the climate projection arising from various climate models is very common, and averaging such results poses a risk of underestimation or sometimes overestimation of impact in magnitude and frequency. Further, the performance of various climate models in monsoon degrades drastically due to the skewed nature. Under these circumstances, the performance of the climate model in the monsoon and non-monsoon periods is critical for accurate assessment. A multimodal approach has been used in the present work to quantify the uncertainty involved in the climate model using reliability ensemble averaging (REA). Based on AR6 of IPCC, the ensemble of 26 global climate models (GCMs) was used to evaluate the model performance and possible change in seasonal precipitation in four cities with distinct climate conditions, namely, Coimbatore, Rajkot, Udaipur, and Siliguri. The results show that non-monsoon and monsoon rainfall are expected to increase in all the regions. Most of the models perform poorly in simulating monsoon climate, especially in the monsoon period and are highly inconsistent spatially. The study also finds that the model performance is largely linked to the ratio of natural variability and mean.

  • The paper discusses multimodal performance in climate change assessment in a monsoon-fed climate where the precipitation pattern is skewed.

  • Model bias for each climate model was quantified on a seasonal scale using Reliability Ensemble Averaging.

  • The performance of the GCMs largely depends on the ratio of natural variability to mean at regional level.

  • A reliable estimate of the change in climate variables is made using REA in CMIP6 framework for four climate scenarios, namely, SSP126, SSP245, SSP370, and SSP585.

Climate change assessment is essential to strategically plan the various resources under different climate regions. Climate change prediction in a monsoon type of climate is challenging for the following reasons: (i) the rainfall distribution over the year is very much skewed to monsoon; (ii) the rainfall is primarily influenced by the development of a climate in the surrounding ocean; and (iii) the temperature is an essential variable in the climate change. The problem becomes more complex with high variability in the output of different climate models. The reliability of a single model is debatable. The increase in global surface temperature in the 21st century is mainly attributed to anthropogenic greenhouse gas (GHG) emissions (Wilby et al. 2002; IPCC Climate Change 2014; IPCC 2021). In several parts of the world, extreme weather conditions with abrupt changes in the atmosphere are experienced (IPCC Climate Change 2014; IPCC 2021). An increase in the total precipitation on land, frequent climate extremes (such as heatwaves, droughts, floods, cyclones, and wildfires), the overall rise in surface temperature, shift in the rainfall pattern and its distribution, and mean sea level rise are some of the major issues which are being faced today, due to climate change.

The future climate mainly depends on the amount of anthropogenic GHG emissions and the response of the climate system to these emissions (Lowe & Jenkins 2003). Several organisations have come together to quantify this climate change based on the IPCC projection, known as global climate models (GCMs). GCMs are the primary tool for accurate prediction and demonstration of the possible future impacts of climate change to the policymakers due to increasing various GHGs and anthropogenic events without the need for expensive laboratory experimental setup (Fowler et al. 2007; Maraun et al. 2010; Dastagir 2015).

The Intergovernmental Panel on Climate Change (IPCC), in its sixth assessment (AR6) report, has projected eight possible emission scenarios based on a component of climate and its interaction and range of socioeconomic factors (such as demography and economic growth), namely, SSP119, SSP126, SSP435, SSP534OS, SSP245, SSP460, SSP370, and SSP585. SSP370 and SSP585 correspond to high and very high GHG emissions, with double CO2 emissions from current levels by 2100 and 2050, respectively. SSP245 is an intermediate GHG emission scenario. SSP119 and SSP126 scenarios are based on varying net negative CO2 emission levels. The AR6 report is the successor of the AR5 report and provides a better assessment of climate projection. Hamed et al. (2022) compared the output of CMIP6 to CMIP5 and concluded that the CMIP6 ensemble displays less uncertainty in the simulation than CMIP5.

The findings of the IPCC in its AR6 highlight several aspects of climate change all over the globe. The global averaged annual surface precipitation is likely to change by −0.2 to +4.7% during 2081–2011 relative to 1995–2014 in the low-emissions scenario SSP1–1.9 and 0.9–12.9% in the high-emissions scenario SSP585 (IPCC Climate Change 2021). Although the confidence in precipitation change averaged over the global land area is low due to insufficient data, a shift in the rainfall pattern and increased extreme weather conditions have been reported. Droughts with greater magnitude, severity and longer duration (since the beginning of the 20th century, rise in the number of heavy precipitation events (post-1950)) are some of the critical findings related to precipitation and temperature reported in IPCC reports with high confidence.

The spatial resolution of output from GCMs is in the range of 100–250 km, which is quite large for the regional assessment of the climate of a small region. Regional-scale studies require high-resolution climate projections. The regional climate change projection can only be assessed after downscaling the GCM output to the local region (Hay et al. 2000; Wilby et al. 2000; Lowe & Jenkins 2003; Wood et al. 2004; Maraun et al. 2010; Wetterhall et al. 2012). Apart from the regional and global scale mismatch of the climate variables, these models show biased representations of observed time series (Teutschbein & Seibert 2012). On the temporal scale, the GCM output is available at the hourly to annual level. The reliability of GCMs decreases with finer temporal scales (Anandhi et al. 2011). The uncertainty in the near-future projection is high due to natural variability, model uncertainty, and uncertainty in natural and anthropogenic aerosol forcing (IPCC 2021). The problem becomes more complex due to considerable scatter and differences in the sign of projected climate change from a set of models as well as the same model with different downscaling techniques (Mearns et al. 1999; Lowe & Jenkins 2003; Vavrus et al. 2015). Different models may differ greatly on the projected magnitude of the change, which raises questions about the reliability of a model. It is mainly due to the high variability in the interaction between different components of different climate models. The uncertainty in the projection can be due to several factors, such as the emission of various gases, transfer function relating these emissions to the abundance of forcing; climate sensitivity to external forcing; and ocean mixing (Wigley & Raper 2001).

Several researchers have advocated multimodal climate data to quantify uncertainty (Singh et al. 2016). The arithmetic average or multimodal mean among a set of model simulations is a crucial metric to quantify the uncertainty and increase the reliability of the climate projection (Diaz-Nieto & Wilby 2005; Chen et al. 2015; Vavrus et al. 2015). However, simple arithmetic averaging of the projection of different models may nullify the overall impact if there is a significant difference in the projection results. In the context of multiple GCMs where the variability of GCMs projection is high, some researchers have proposed a sign change method in which the projection is estimated by the dominant sign change from various models. However, these averaging methods do not provide a reliable projection. Presently, two methods are widely used in multimodal climate assessment: Bayesian model averaging (Hoeting et al. 1999) and reliability ensemble averaging (REA; Mearns et al. 1999; Giorgi & Mearns 2002, 2003). In the probabilistic approach, the weight of each model is determined based on the historical relationship between forecasts and observations, which enhances the performance of the ensemble compared to a simple average where each model is weighted equally (Krishnamurti et al. 2000). In the REA, the weightage for each model is calculated based on model bias in replicating the present-day climate and the variations in the projection of different models. Xu et al. (2010) extended the REA method by introducing the interannual coefficient of variation (CV) and spatial correlation to the original REA. The multimodal ensemble techniques reduce the individual model uncertainty significantly (Yang et al. 2018). The weightage of different GCMs can be tuned to have a reliable estimate of climate. Yang et al. (2018) applied an evolutionary multi-objective optimisation algorithm to optimise the weightage of each GCM such that the weightage ensemble mean is close to the observed data.

Multimodal climate studies have been conducted on various regions under various climatic conditions. However, ensemble averaging becomes difficult in a monsoon climate due to its skewed behaviour. India has a monsoon climate where most precipitation occurs in less than 3 months. The performance of GCMs under such climatic conditions is highly diverse. Several studies have been conducted to assess the climate change impact in a monsoon region. Kothawale & Kumar (2005) reported an increase in India's mean annual temperature by 0.22 °C/10 years between 1971 and 2003. There is a major shift in the seasonal asymmetry of temperature trends, with no region or season showing a cooling trend. The projections of monsoon precipitation over South Asia and East Asia show an increase in precipitation frequency and intensity (Jourdain et al. 2013; Chevuturi et al. 2018). Singh et al. (2016), in their work on the Indian regional (Roorkee) climate, projected an increase in precipitation intensity (7–96% depending upon the RCP scenario, return period, and climate model) for all the return periods and duration. The high variability in projected precipitation intensity for different models in a particular RCP and return period make it difficult for policymakers to make strategies. Iqbal et al. (2020) analysed 22 CMIP5 GCMs in the sub-Himalayan region of Pakistan and found significant heterogeneity in precipitation change for different future periods and RCP scenarios.

A comparative study conducted by Dutta et al. (2022) concludes that the latest CMIP6 models improve the model bias in the Indian subcontinent and are in better agreement with the observation. A multimodal climate study over the Tibetan plateau using 25 GCMs in the CMIP6 framework by Chen et al. (2022) predicts an overall increase in the precipitation by about 23% in autumn. Liu et al. (2022) studied the capability of the CMIP6 model on seasonal precipitation over Central Asia and concluded that most models have a consistent bias in extreme precipitation and have high variability in future projections. Pimonsree et al. (2023) conducted a study in the Southeast Asian region based on the CMIP6 framework. They concluded that the performance of most of the models is not good in the mountainous region. Anil & Raj (2022) applied multimodal averaging of selected CMIP6 GCM and found the performance of the REA is satisfactory in mimicking the observed precipitation in the Krishna basin of the Indian subcontinent. The study also shows an overall rise in precipitation with a higher impact in the far-end future in the region.

In this paper, a multimodal approach has been developed and adopted to handle the uncertainty arising from different climate models and, thus, predict changes in precipitation. In multimodal analysis, the statistical parameters of several models are considered, and a weightage is given to each model based on its performance. This performance is based on two parameters, namely, model bias and model convergence. The weightage average of each model is finally used to compute a multimodal average projection. Climate change prediction was carried out for precipitation based on IPCC's AR6 report. Twenty-six GCMs, with four Shared Socioeconomic Pathways (SSPs), namely, SSP126, SSP245, SSP370, and SSP585, are considered on a seasonal scale. The present study can be used for long-term planning based on the projected change in annual precipitation frequency and change in temperature.

In the present study, the AR6 of the IPCC is used to perform the climate change impact assessment. The climate model under four SSP scenarios, namely, SSP126, SSP245, SSP370, and SSP585, is considered. The work of Giorgi & Mearns (2003) on REA is used to bias correct and quantify the uncertainty in the climate projection of precipitation and temperature. The data and methodology adopted in the present work are discussed in the subsequent sections.

GCM data

The 26 GCMs used in the present study for the projection of precipitation are listed in Table 1. The realisation of each of the models is r1i1p1 for the four selected scenarios, namely, SSP126, SSP245, SSP370, and SSP585. The future climate projection of each model is classified into two categories, near-end future (2021–2050) and far-end future (2051–2080), and the change is compared with the historical variables. The GCMs output was taken from different models at the nearest grid location available. These outputs were interpolated using the inverse distance method to the study area. The distances were calculated using the Haversine equation, considering the curvature of the Earth.

Table 1

Global climate models

S NoExperimentCentreLocation
ACCESS-CM2 Australian Research Council Centre of Excellence for Climate System Science Australia 
ACCESS-ESM1-5 Australian Research Council Centre of Excellence for Climate System Science Australia 
AWI-CM-1-1-MR Alfred Wegener Institute Germany 
BCC-CSM2-MR Beijing Climate Center, China China 
CAMS-CSM1-0 Chinese Academy of Meteorological Sciences China 
CAS-ESM2-0 Chinese Academy of Sciences Earth System Model China 
CESM2-WACCM National Center for Atmospheric Research (NCAR) USA 
CMCC-CM2-SR5 Euro-Mediterranean Centre on Climate Change coupled climate model Italy 
CMCC-ESM2 Euro-Mediterranean Centre on Climate Change coupled climate model Italy 
10 CanESM5 Canadian Centre for Climate Modelling and Analysis Canada 
11 EC-Earth3-Veg-LR EC-Earth-Consortium (Europe) Europe 
12 EC-Earth3-Veg EC-Earth-Consortium (Europe) Europe 
13 EC-Earth3 EC-Earth-Consortium (Europe) Europe 
14 FGOALS-f3-L Chinese Academy of Sciences Flexible Global Ocean-Atmosphere–Land System model China 
15 FGOALS-g3 Chinese Academy of Sciences Flexible Global Ocean-Atmosphere–Land System model China 
16 GFDL-ESM4 Geophysical Fluid Dynamics Laboratory USA 
17 IITM-ESM Centre for Climate Change Research, Indian Institute of Tropical Meteorology India 
18 INM-CM4-8 Institute for Numerical Mathematics, Russian Academy of Science Russia 
19 INM-CM5-0 Institute for Numerical Mathematics, Russian Academy of Science Russia 
20 IPSL-CM6A-LR Institute Pierre Simon Laplace France 
21 MIROC6 Japan Agency for Marine-Earth Science and Technology Japan 
22 MPI-ESM1-2-HR Max Planck Institute for Meteorology Germany 
23 MPI-ESM1-2-LR Max Planck Institute for Meteorology Germany 
24 MRI-ESM2-0 Meteorological Research Institute Japan 
25 NorESM2-LM Norwegian Climate Centre Norway 
26 NorESM2-MM Norwegian Climate Centre Norway 
S NoExperimentCentreLocation
ACCESS-CM2 Australian Research Council Centre of Excellence for Climate System Science Australia 
ACCESS-ESM1-5 Australian Research Council Centre of Excellence for Climate System Science Australia 
AWI-CM-1-1-MR Alfred Wegener Institute Germany 
BCC-CSM2-MR Beijing Climate Center, China China 
CAMS-CSM1-0 Chinese Academy of Meteorological Sciences China 
CAS-ESM2-0 Chinese Academy of Sciences Earth System Model China 
CESM2-WACCM National Center for Atmospheric Research (NCAR) USA 
CMCC-CM2-SR5 Euro-Mediterranean Centre on Climate Change coupled climate model Italy 
CMCC-ESM2 Euro-Mediterranean Centre on Climate Change coupled climate model Italy 
10 CanESM5 Canadian Centre for Climate Modelling and Analysis Canada 
11 EC-Earth3-Veg-LR EC-Earth-Consortium (Europe) Europe 
12 EC-Earth3-Veg EC-Earth-Consortium (Europe) Europe 
13 EC-Earth3 EC-Earth-Consortium (Europe) Europe 
14 FGOALS-f3-L Chinese Academy of Sciences Flexible Global Ocean-Atmosphere–Land System model China 
15 FGOALS-g3 Chinese Academy of Sciences Flexible Global Ocean-Atmosphere–Land System model China 
16 GFDL-ESM4 Geophysical Fluid Dynamics Laboratory USA 
17 IITM-ESM Centre for Climate Change Research, Indian Institute of Tropical Meteorology India 
18 INM-CM4-8 Institute for Numerical Mathematics, Russian Academy of Science Russia 
19 INM-CM5-0 Institute for Numerical Mathematics, Russian Academy of Science Russia 
20 IPSL-CM6A-LR Institute Pierre Simon Laplace France 
21 MIROC6 Japan Agency for Marine-Earth Science and Technology Japan 
22 MPI-ESM1-2-HR Max Planck Institute for Meteorology Germany 
23 MPI-ESM1-2-LR Max Planck Institute for Meteorology Germany 
24 MRI-ESM2-0 Meteorological Research Institute Japan 
25 NorESM2-LM Norwegian Climate Centre Norway 
26 NorESM2-MM Norwegian Climate Centre Norway 

Reliability ensemble averaging

The REA assigns different weights to each model based on its performance in terms of (i) reproducing different aspects of present-day climate and (ii) convergence of simulations by different models for a given forcing scenario. These performance indices are known as ‘bias factor’ and ‘convergence factor’. In REA, the average change in a variable, , is given by a weighted average of the ensemble members:
(1)
where is the projected change in the variable in the model, and is the model reliability factor, which depends on model bias and model convergence as
(2)
where and are the bias factor and convergence factor of model, respectively. It should be noted that in the present equation, the weightage of both factors is given the same as 1.

Model bias

Model bias is quite common in almost all models. However, these biases are more pronounced in a monsoon climate. The reliability factor estimated from Equation (2) consists of two parts: (i) bias factor and (ii) convergence factor. The first part of Equation (2) represents the bias factor, i.e., the bias of each model in simulating the present climate variable. If the simulated value is in the range of the natural variation of the variable, then the bias factor of the model is 1. Hence, the bias factor is calculated as follows:
(3)
where represents the model bias defined as the difference between simulated and observed mean variable (y) for the present-day period and is a measure of natural variability in the 30-year average regional variable. The natural variability is the difference between the maximum and minimum value of the 30-years moving average after detrending it linearly. It should be noted that the model bias can be positive or negative. However, the above equation shows only the extent of bias factor in the range of 0 and 1. Any value less than 1 indicates a model bias.

Model convergence

The output of a climate model significantly varies from other models, since every climate model has a different setup in terms of initial and boundary conditions, parameter setting, etc. In multimodal analysis, model averaging has been in use for a very long time. Hence, this index is calculated from the deviation of each model from the mean of all the models. It is given by
(4)
where is the distance of the change calculated by a given model i, from the REA average, and is a measure of natural variability in the 30-year average regional variable.
Hence, the overall reliability of a model can be given by
(5)
In the above equation, the reliability of a model, , gives equal weightage to the model bias and model convergence. The uncertainty range around the REA average change is given by
(6)

The upper and lower limit will be .

Four cities with distinct climate conditions, namely, Coimbatore, Udaipur, Siliguri, and Rajkot, have been chosen, as shown in Figure 1. Rajkot and Udaipur lie in the western part of India, Siliguri in the northeast, and Coimbatore in the southern part of India. Coimbatore is surrounded by the Western Ghats mountains at about 400 m. Udaipur is in the desert lands of Rajasthan, with hot weather during most of the year. Rajkot City has an elevation of 128 m. Several cyclones have been experienced in this city from the Arabian Sea. Coimbatore has a tropical wet and dry climate, and Udaipur and Rajkot have semi-arid climates. Siliguri is in the eastern Himalayas and has a humid subtropical climatic condition. As per India Meteorological Department (IMD), the Indian climate can be divided into four seasons: winter (January–March), pre-monsoon (April–June), southwest monsoon (July–September), and post-monsoon (October–December). The same classification has been used in the present study.
Figure 1

Location of the study area.

Figure 1

Location of the study area.

Close modal

The data used, and the areal characteristics of all four cities, are shown in Table 2. Precipitation data from 1901 to 2010 obtained from IMD was first checked for any data errors and missing data. Any missing data were filled using interpolation and statistical correlation methods.

Table 2

Natural variability (in mm) of precipitation from the 30-year moving average and mean precipitation (1971–2000)

CoordinatesArea (sq. km)Seasonε30 (mm)Mean, μ30 (mm)
Coimbatore, Tamil Nadu 11° N
76°58′ E 
256.32 Annual 508.93 1,311.1 
Winter 22.84 41.7 
Pre-monsoon 164.72 343.2 
Monsoon 282.76 561.2 
Post-monsoon 61.58 365 
Udaipur, Rajasthan 24°37′ N
73°53′ E 
63.4 Annual 60.39 651.8 
Winter 9.88 5.9 
Pre-monsoon 37.39 90.8 
Monsoon 82.72 522.4 
Post-monsoon 16.1 32.7 
Rajkot, Gujrat 22°18′ N
70°47′ E 
123.32 Annual 84.28 533.3 
Winter 2.53 1.2 
Pre-monsoon 45 107.2 
Monsoon 102.68 391.3 
Post-monsoon 19.65 33.6 
Siliguri, West Bengal 26°72′ N
88°41′ E 
37.49 Annual 279.46 3,159.4 
Winter 44.15 80.6 
Pre-monsoon 92.23 975.6 
Monsoon 184.14 1,925.4 
Post-monsoon 72.83 177.8 
CoordinatesArea (sq. km)Seasonε30 (mm)Mean, μ30 (mm)
Coimbatore, Tamil Nadu 11° N
76°58′ E 
256.32 Annual 508.93 1,311.1 
Winter 22.84 41.7 
Pre-monsoon 164.72 343.2 
Monsoon 282.76 561.2 
Post-monsoon 61.58 365 
Udaipur, Rajasthan 24°37′ N
73°53′ E 
63.4 Annual 60.39 651.8 
Winter 9.88 5.9 
Pre-monsoon 37.39 90.8 
Monsoon 82.72 522.4 
Post-monsoon 16.1 32.7 
Rajkot, Gujrat 22°18′ N
70°47′ E 
123.32 Annual 84.28 533.3 
Winter 2.53 1.2 
Pre-monsoon 45 107.2 
Monsoon 102.68 391.3 
Post-monsoon 19.65 33.6 
Siliguri, West Bengal 26°72′ N
88°41′ E 
37.49 Annual 279.46 3,159.4 
Winter 44.15 80.6 
Pre-monsoon 92.23 975.6 
Monsoon 184.14 1,925.4 
Post-monsoon 72.83 177.8 

Table 2 shows the mean precipitation of the selected location between 1971 and 2000 and the natural variability in the precipitation from the 30-years moving average. From the precipitation data of 110 years for all four cities, the 30-years moving average series was prepared. The linear trend in the series was removed, if any. The detrending was done by removing the linear trend from the 30-years moving average data series. The slope and intercept for a linear equation, fitted to the 30-years moving average series, were calculated. Later, the values from the linear equation at each data point from the 30-years moving average were removed. The difference between the maximum and minimum values of the detrended data was then used to calculate the natural variability in the precipitation. It can be observed that most of the rainfall is received during monsoon and pre-monsoon seasons, except for Coimbatore, which also receives rainfall in the post-monsoon season. Udaipur, Rajkot, and Siliguri receive most of the rainfall during June to September, while in Coimbatore, most of the rainfall is received during September and November. Rajkot has higher monthly rainfall variability compared to other cities. Out of the four cities, Siliguri receives the highest annual rainfall.

The natural variability in the 30-years moving average for precipitation is calculated from 100-years monthly data after detrending the time series. The natural variability in Coimbatore is relatively high compared to that of other cities, which indicates a high variation in the precipitation pattern. On a seasonal scale, the natural variability in winter is comparatively higher than in other seasons due to the skewed nature of the precipitation pattern. Hence, it is likely that the performance of the model will be good in the winter season and for Coimbatore. Coimbatore has natural variability of 61.6 mm with a mean seasonal precipitation of 365 mm in post-monsoon, much less than in other seasons. For all the other cities, Udaipur, Rajkot, and Siliguri, the natural variability in the monsoon season is significantly less compared to other seasons.

The relative change in precipitation is estimated based on the difference in mean seasonal precipitation from the future projected rainfall to the baseline scenario, with 1971–2000 taken as the baseline period. The bias factor is in the range of 0–1, with 1 being no bias in the climate model. Hence, the higher the bias factor, the better the model. For example, if a climate model has a bias factor value of 0.6, the climate model has a 0.4 or 40% bias from the observed mean variable. Since the bias factor depends only on the performance of a model in simulating the present-day climate, another index, CV, has also been used for assessing the performance of each model. The prediction of precipitation for near-end and far-end futures has been carried out, and the results are compared with the baseline scenario.

Model performance

The key criteria of GCM's performance are model bias. Any model which can replicate the present-day climate with the least systematic bias is generally considered a good GCM and likely to offer reliable future projections (Liu et al. 2022).

In this section, the seasonal model bias of each GCM is compared to another. The heat map of the season-wise model bias of different models at different locations is shown in Figure 2. The seasonal bias factor shows a high variability at the regional level for all the seasons, and hence, no model has a definite superiority over the other. The general observation that can be made from Figure 2 is that most of the models perform very well in the winter season at all locations. However, the performance is relatively poor in other seasons. A similar conclusion has been reported by Chen et al. (2022) in their assessment of seasonal precipitation extremes over Central Asia, where most models show a consistent bias of extreme precipitation, and none of the models produces equally good extreme precipitation metrics. However, in their study, the models perform poorly in winter, which is contradictory to our results. The better performance of models in the winter season may likely be linked to the wider range of natural variability.
Figure 2

Heat map of model bias in precipitation (dark blue = 1 and light blue = 0). Please refer to the online version of this paper to see this figure in colour: https://dx.doi.org/10.2166/wcc.2023.393.

Figure 2

Heat map of model bias in precipitation (dark blue = 1 and light blue = 0). Please refer to the online version of this paper to see this figure in colour: https://dx.doi.org/10.2166/wcc.2023.393.

Close modal

In Coimbatore, most of the models perform better in all seasons relative to other cities. AWI-CM-1-1-MR, EC-Earth3-Veg-LR, and IPSL-CM6A-LR are the best-performing models for all the seasons with no bias factor, as shown in Figure 2. CMCC-CM2-SR5, INM-CM4-8, and INM-CM5-0 models perform poorly in winter and post-monsoon seasons with bias factor values less than 0.3.

The performance of all the models except for IITESM (in winter) and CAS-ESM2-0 (in post-monsoon) shows no bias in winter and post-monsoon seasons in Udaipur. However, the bias factor is quite high in pre-monsoon and monsoon. For monsoon, except for IPSL-CM6A-LR and AWI-CM-1-1-MR, all the models have a significant bias with a bias factor of 0–0.8. The performance of models in Rajkot is similar to Udaipur, where in post-monsoon, except for CAMS-CSM1-0, all models have no bias. In pre-monsoon, the model performance is very poor, with relatively better performance in the monsoon season. AWI-CM-1-1-MR, BCC-CSM2-MR, CMCC-CM2-SR5, and CMCC-ESM2 models have no bias in simulating the present-day climate. The bias factor for Udaipur and Rajkot shows some similarity, mainly due to similar climatic conditions. The rainfall pattern of Siliguri is similar to Udaipur and Rajkot, but the amount of precipitation is quite high in all the seasons. Most of the models perform better in post-monsoon in Udaipur, Rajkot, and Siliguri. The model bias in winter and post-monsoon seasons is negligible in all the models and hence, performs well. However, the performance of models is very poor in simulating the pre-monsoon monsoon climate. Only two models, CMCC-CM2-SR5 and CMCC-ESM2, have no bias in any season for Siliguri.

Model bias only shows the difference in the mean of GCM and the observed mean. Hence, to assess the performance of GCM based on spread around the mean, another index, CV, is also considered. Figure 3 shows the heat map of CV for each of the models calculated for each season. The performance of most of the models is poor for Udaipur and Rajkot. In Siliguri, most of the models were able to capture the CV to the observed data, except in the post-monsoon season. In Coimbatore, except in winter, in other seasons the model performed well. It can also be seen from the figure that most of the models underestimate CV in winter for Coimbatore and Rajkot. The CV of Udaipur in pre-monsoon is shown in blue colour with a value of 0.49. This means that all GCMs are overestimating the CV. The CV of Rajkot in winter is shown in red colour with an observed value of 3.65, which indicates that all GCMs are underestimating the CV for Rajkot in winter. In these two cases, pre-monsoon in Udaipur and winter in Rajkot, none of the models were able to capture the observed CV. Hence, one conclusion that can be drawn from the heat map is that the performance of models is poor for highly skewed precipitation. The models, AWI-CM-1-1-MR, BCC-CSM2-MR, CMCC-CM2-SR5, EC-Earth3-Veg-LR, EC-Earth3-Veg, INM-CM5-0, and MIRCO6, were able to perform better than other GCMs in an overall aspect. However, these GCMs perform poorly in the region with the season having a high CV, especially in winter.
Figure 3

Heat map of coefficient of variation in precipitation (red colour shows a value higher than the observed value, while blue colour shows lower). Please refer to the online version of this paper to see this figure in colour: https://dx.doi.org/10.2166/wcc.2023.393.

Figure 3

Heat map of coefficient of variation in precipitation (red colour shows a value higher than the observed value, while blue colour shows lower). Please refer to the online version of this paper to see this figure in colour: https://dx.doi.org/10.2166/wcc.2023.393.

Close modal
In Figure 4, a bar chart is plotted to show the number of models with no bias against the ratio of seasonal natural variability to the 30-year mean. It can be observed that most of the models tend to perform better in regions with a higher ratio of natural variability to mean. Hence, it can be concluded that the ability of most of the models to capture the seasonal mean increases in increase in mean. Another obvious conclusion is the dependence of model performance on the natural variability of the variable. Higher natural variability provides a large range around the mean, and hence, more models are likely to perform well.
Figure 4

Comparison of the ratio of natural variability to mean and number of models with no bias.

Figure 4

Comparison of the ratio of natural variability to mean and number of models with no bias.

Close modal
The natural variability in winter for Udaipur and Rajkot is 9.88 and 2.53 mm, against the seasonal mean of 5.9 and 1.2 mm, respectively. In these two cases, the natural variability is much higher than the mean. Considering them as an outlier, a plot is shown in Figure 5 on the ratio of models with no bias to total models against the ratio of natural variability to seasonal mean. It can be observed that the two ratios are linearly correlated with R2 at 0.78. Hence, it can be said that a region with a higher ratio of natural variability to mean leads to better model performance.
Figure 5

Model performance vs. ratio of natural variability to mean (after removing the outlier).

Figure 5

Model performance vs. ratio of natural variability to mean (after removing the outlier).

Close modal

In terms of overall model performance, it can be observed that the performance of most of the models is very poor in replicating monsoon precipitation, except for Coimbatore. The precipitation pattern for Coimbatore is comparatively less skewed, resulting in better performance of models in the monsoon season. Similarly, the model performance, in terms of CV, was also found to be poor in regions with high variability. Out of all the models tested here, GCMs, namely AWI-CM-1-1-MR, BCC-CSM2-MR, CMCC-CM2-SR5, and EC-Earth3-Veg-LR, show promising results in several seasons at certain regions considering both the aspects of precipitation, model bias and CV.

Model prediction

Near-end projection

Figure 6 shows the near-end seasonal projection of precipitation for all four locations. The projection shows a clear rise in precipitation in the monsoon. In winter, the average ensemble change in precipitation varies from 0 mm in Udaipur and Rajkot to 10 mm in Coimbatore and Siliguri under various scenarios. The impact on seasonal precipitation for Coimbatore, Udaipur, and Rajkot is mainly in monsoon and post-monsoon seasons, while in Siliguri, the impact is high in pre-monsoon and monsoon seasons.
Figure 6

Change in mean seasonal precipitation (a) Coimbatore, (b) Udaipur, (c) Rajkot, and (d) Siliguri in 2021–2050.

Figure 6

Change in mean seasonal precipitation (a) Coimbatore, (b) Udaipur, (c) Rajkot, and (d) Siliguri in 2021–2050.

Close modal

In Coimbatore, the pre-monsoon season has little impact on climate change, as shown in Figure 6(a). The pre-monsoon of Coimbatore is expected to have a marginal change in precipitation with a rise in the mean by 7–10 mm in SSP126 and SSP585 scenarios and a negative change in SSP245 and SSP585 scenarios. A similar trend is observed in the post-monsoon season as well, with an expected rise in mean rainfall by 10–20 mm. The monsoon rainfall is expected to rise by about 40 mm under all the scenarios in Coimbatore, with a high variability of 40–50 mm. The pattern in the change of precipitation for Udaipur and Rajkot is similar. The pre-monsoon impact is minimal for Udaipur and Rajkot, as shown in Figure 6(b) and 6(c), respectively. The REA precipitation in Udaipur and Rajkot is expected to rise by 40–50 mm. The rise is comparatively higher in the SSP126 scenario. It should also be noted that the variability in the change for Udaipur and Rajkot is quite high, in the range of 50–60 mm, while the present mean monsoon seasonal precipitation of Udaipur and Rajkot is 80 and 100 mm, respectively. The uncertainty range is also skewed on the positive side, suggesting a possible rise in monsoon precipitation. The post-monsoon projection shows a possible rise in mean precipitation by 10 mm under all the scenarios for both cities. In Siliguri, the pre-monsoon and monsoon seasons show a rise in precipitation, as shown in Figure 6(d). The monsoon rainfall is expected to rise by 20–30 mm under various scenarios, which is insignificant compared to its monsoon precipitation of 1,725 mm. The pre-monsoon rainfall is expected to rise, ranging from 0 mm under SSP126 to 50 mm in SSP585.

The seasonal mean of precipitation in each season in all the regions varies acutely. On a regional scale, the impact is higher for Coimbatore and Siliguri in winter, and for Udaipur and Rajkot, the impact is more in the post-monsoon season. In overall percentage, the winter precipitation in Coimbatore and Siliguri is likely to fall by 13%, and the post-monsoon precipitation in Udaipur and Rajkot is likely to rise by 24 and 26%, respectively. It should also be noted that the change in the monsoon rainfall, as shown in Figure 6, is higher than in any other season. Since the rainfall pattern is mostly skewed to the monsoon season, the change in precipitation in the non-monsoon period is very smaller compared to the monsoon rainfall. However, in terms of percentage change from the mean seasonal rainfall, the non-monsoon percentage change is quite high.

Far-end projection

The projection of the mean seasonal rainfall in the far-end period for all the regions is shown in Figure 7. The pattern of change in the seasonal precipitation in the far-end future is similar to what was observed in the near-end but with a higher magnitude. Except for Coimbatore and Siliguri in the winter season, all the regions show a clear sign of a rise in seasonal precipitation under all the scenarios.
Figure 7

Change in mean seasonal precipitation (a) Coimbatore, (b) Udaipur, (c) Rajkot, and (d) Siliguri in 2051–2080.

Figure 7

Change in mean seasonal precipitation (a) Coimbatore, (b) Udaipur, (c) Rajkot, and (d) Siliguri in 2051–2080.

Close modal

In Coimbatore, the mean seasonal rainfall in winter is likely to fall in the far-end future, with a maximum fall of 5–7 mm under SSP245 and SSP370 scenarios and a negligible impact under SSP126 and SSP585. In pre-monsoon, the mean precipitation is likely to rise by 10–25 mm with a maximum rise under the SSP585 scenario. A similar trend is observed in post-monsoon with a rise in the mean seasonal precipitation by 32–54 mm. In pre-monsoon and post-monsoon, the impact is minimum under SSP370 and maximum in SSP585. The monsoon precipitation of Coimbatore is likely to rise by 54–81 mm with a maximum rise under SSP585 and a minimum in the SSP126 scenario.

Udaipur and Rajkot show a rise in precipitation in the monsoon and post-monsoon seasons, as shown in Figure 7(b) and 7(c), respectively. The mean monsoon precipitation is likely to rise by 68–79 mm, and the post-monsoon precipitation may rise by 10–14 mm. In monsoon, the impact is minimum under the SSP370 scenario with a mean rise of 68 mm and maximum under scenario SSP245 with a mean rise of 79 mm. The mean precipitation rise in monsoon for Rajkot is likely to rise by 77–100 mm, maximum in the SSP585 scenario. Post-monsoon precipitation of Udaipur and Rajkot is likely to rise by 16 mm in the SSP585 scenario. The far-end change pattern of precipitation in Siliguri is similar to what was observed in the near-end, where SSP126 has the least impact and SSP585 has the maximum impact.

The seasonal rise in monsoon is expected to be about 80–185 mm, and the pre-monsoon impact is around 30–102 mm. At a regional level, the far-end impact is mainly in Udaipur and Rajkot, with about 30 and 40% rise in winter and post-monsoon precipitation. Rajkot is likely to be the severely impacted region with the rise in precipitation in all the seasons in the far-end future.

The above results indicate that the monsoon precipitation is likely to increase in all the cities. Hence, it can be expected that the southern peninsula is likely to receive more rainfall in the post-monsoon season. The eastern region of the Indian subcontinent is likely to receive more pre-monsoon rainfall. The projected precipitation indicates that Coimbatore, Udaipur, and Rajkot will show a rise in post-monsoon rainfall. This may indicate an early arrival of the monsoon in the eastern region and delayed rainfall in the southern and western regions. On a spatial scale, the impact is higher for Udaipur and Rajkot than Siliguri and Coimbatore, based on the expected rise and the current mean precipitation.

Model uncertainty is a key challenge in climate change modelling. Several GCMs show a considerable variation in the projected climatic variable, especially in a monsoon climatic condition. Hence, there is a need for the selection of a suitable GCM or ensemble of GCMs to address the uncertainty in various GCMs.

It is found that many of the GCMs may not work well for the skewed distribution of rainfall, and hence, the REA method using a weighted bias approach has been adopted for a reliable prediction of climate change. The study shows that the REA method minimises the uncertainty in various GCMs when it was tested for four stations located with high climate variability, based on the AR6 framework. Further, it was also found that the performance of any GCM is largely linked to the ratio of natural variability to the mean, with an R2 value of 0.78. This index may be used as a potential tool to choose the number of models for further climate studies in other regions.

The uncertainty band from the multimodal analysis does suggest a considerable variation in the projected rainfall pattern, especially in the monsoon period, and is highly inconsistent spatially. Further studies involving different variables can provide a better understanding of model uncertainty in a monsoon climatic condition. In the present work, the model averaging was carried out by weighing each model based on the model bias from the observed mean and model variability from the average of all models. The work may be extended by considering other statistical parameters, such as standard deviation, correlation etc., in the model bias.

All relevant data are available from an online repository or repositories (https://esgf-node.llnl.gov/search/cmip6 and https://imdpune.gov.in/library/publication.html).

The authors declare there is no conflict.

Anandhi
A.
,
Frei
A.
,
Pierson
D. C.
,
Schneiderman
E. M.
,
Zion
M. S.
,
Lounsbury
D.
&
Matonse
A. H.
2011
Examination of change factor methodologies for climate change impact assessment
.
Water Resources Research
47
(
3
).
https://doi.org/10.1029/2010WR009104
.
Anil
S.
&
Raj
P. A.
2022
Deciphering the projected changes in CMIP-6 based precipitation simulations over the Krishna River Basin
.
Journal of Water and Climate Change
13
(
3
),
1389
1407
.
https://doi.org/10.2166/wcc.2022.399
.
Chen
J.
,
Brissette
F. P.
&
Lucas-Picher
P.
2015
Assessing the limits of bias-correcting climate model outputs for climate change impact studies
.
Journal of Geophysical Research
120
(
3
),
1123
1136
.
https://doi.org/10.1002/2014JD022635
.
Chen
R.
,
Duan
K.
,
Shang
W.
,
Shi
P.
,
Meng
Y.
&
Zhang
Z.
2022
Increase in seasonal precipitation over the Tibetan Plateau in the 21st century projected using CMIP6 models
.
Atmospheric Research
277
.
https://doi.org/10.1016/j.atmosres.2022.106306
.
Chevuturi
A.
,
Klingaman
N. P.
,
Turner
A. G.
&
Hannah
S.
2018
Projected changes in the Asian-Australian monsoon region in 1.5 °C and 2.0 °C global-warming scenarios
.
Earth's Future
6
(
3
),
339
358
.
https://doi.org/10.1002/2017EF000734
.
Dastagir
M. R.
2015
Modeling recent climate change induced extreme events in Bangladesh: a review
.
Weather and Climate Extremes
7
,
49
60
.
https://doi.org/10.1016/j.wace.2014.10.003
.
Dutta
U.
,
Hazra
A.
,
Chaudhari
H. S.
,
Saha
S. K.
,
Pokhrel
S.
&
Verma
U.
2022
Unraveling the global teleconnections of Indian summer monsoon clouds: expedition from CMIP5 to CMIP6
.
Global and Planetary Change
215
.
https://doi.org/10.1016/j.gloplacha.2022.103873
.
Fowler
H. J.
,
Blenkinsop
S.
&
Tebaldi
C.
2007
Linking climate change modelling to impacts studies: recent advances in downscaling techniques for hydrological modelling
.
International Journal of Climatology
27
(
12
),
1547
1578
.
https://doi.org/10.1002/joc.1556
.
Giorgi
F.
&
Mearns
L. O.
2003
Probability of regional climate change based on the reliability ensemble averaging (REA) method
.
Geophysical Research Letters
30
(
12
).
https://doi.org/10.1029/2003GL017130
.
Hamed
M. M.
,
Nashwan
M. S.
,
Shahid
S.
,
Ismail
T. B.
,
Wang
X. J.
,
Dewan
A.
&
Asaduzzaman
M.
2022
Inconsistency in historical simulations and future projections of temperature and rainfall: a comparison of CMIP5 and CMIP6 models over Southeast Asia
.
Atmospheric Research
265
,
1
15
.
https://doi.org/10.1016/j.atmosres.2021.105927
.
Hay
L. E.
,
Wilby
R. L.
&
Leavesley
G. H.
2000
A comparison of delta change and downscaled GCM scenarios for three mountainous basins in the United States
.
Journal of the American Water Resources Association
36
(
2
),
387
397
.
https://doi.org/10.1111/j.1752-1688.2000.tb04276.x
.
Hoeting
J. A.
,
Madigan
D.
,
Raftery
A. E.
&
Volinsky
C. T.
1999
Bayesian model averaging: a tutorial
.
Statistical Science
14
(
4
),
382
417
.
IPCC
2014
IPCC climate change 2014: synthesis report
.
Contribution of Working Groups I, II and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change
(Core Writing Team, R. K. Pachauri & L. A. Meyer (eds.)). IPCC, Geneva, Switzerland
.
IPCC
2021
IPCC climate change 2021: the physical science basis
.
Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change
(Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R. & Zhou, B. (eds.)). Cambridge University Press, Cambridge, UK and New York, NY, USA. https://doi.org/10.1017/9781009157896
.
Iqbal
Z.
,
Shahid
S.
,
Ahmed
K.
,
Ismail
T.
,
Khan
N.
,
Virk
Z. T.
&
Johar
W.
2020
Evaluation of global climate models for precipitation projection in sub-Himalaya region of Pakistan
.
Atmospheric Research
245
.
https://doi.org/10.1016/j.atmosres.2020.105061
.
Jourdain
N. C.
,
Gupta
A. S.
,
Taschetto
A. S.
,
Ummenhofer
C. C.
,
Moise
A. F.
&
Ashok
K.
2013
The Indo-Australian monsoon and its relationship to ENSO and IOD in reanalysis data and the CMIP3/CMIP5 simulations
.
Climate Dynamics
41
(
11–12
),
3073
3102
.
https://doi.org/10.1007/s00382-013-1676-1
.
Kothawale
D. R.
&
Rupa Kumar
K.
2005
On the recent changes in surface temperature trends over India
.
Geophysical Research Letters
32
(
18
),
1
4
.
https://doi.org/10.1029/2005GL023528
.
Krishnamurti
T. N.
,
Kishtawal
C. M.
,
Zhang
Z.
,
Larow
T.
,
Bachiochi
D.
,
Williford
E.
,
Gadgil
S.
&
Surendran
S.
2000
Multimodel ensemble forecasts for weather and seasonal climate
.
Journal of Climate
13
,
4196
4216
.
Liu
Z.
,
Huang
J.
,
Xiao
X.
&
Tong
X.
2022
The capability of CMIP6 models on seasonal precipitation extremes over Central Asia
.
Atmospheric Research
278
.
https://doi.org/10.1016/j.atmosres.2022.106364
.
Lowe
J.
&
Jenkins
G.
2003
Handling Uncertainties in the UKCIP02 Scenarios of Climate Change
.
Maraun
D.
,
Wetterhall
F.
,
Ireson
A. M.
,
Chandler
R. E.
,
Kendon
E. J.
,
Widmann
M.
,
Brienen
S.
,
Rust
H. W.
,
Sauter
T.
,
Themel
M.
,
Venema
V. K. C.
,
Chun
K. P.
,
Goodess
C. M.
,
Jones
R. G.
,
Onof
C.
,
Vrac
M.
&
Thiele-Eich
I.
2010
Precipitation downscaling under climate change: recent developments to bridge the gap between dynamical models and the end user
.
Reviews of Geophysics
48
(
3
),
1
34
.
https://doi.org/10.1029/2009RG000314
.
Mearns
L. O.
,
Bogardi
I.
,
Giorgi
F.
,
Matyasovszky
I.
&
Palecki
M.
1999
Comparison of climate change scenarios generated from regional climate model experiments and statistical downscaling
.
Journal of Geophysical Research: Atmospheres
104
(
D6
),
6603
6621
.
https://doi.org/10.1029/1998JD200042
.
Pimonsree
S.
,
Kamworapan
S.
,
Gheewala
S. H.
,
Thongbhakdi
A.
&
Prueksakorn
K.
2023
Evaluation of CMIP6 GCMs performance to simulate precipitation over Southeast Asia
.
Atmospheric Research
282
.
https://doi.org/10.1016/j.atmosres.2022.106522
.
Singh
R.
,
Arya
D. S.
,
Taxak
A. K.
&
Vojinovic
Z.
2016
Potential impact of climate change on rainfall intensity-duration-frequency curves in Roorkee, India
.
Water Resources Management
30
(
13
),
4603
4616
.
https://doi.org/10.1007/s11269-016-1441-4
.
Teutschbein
C.
&
Seibert
J.
2012
Bias correction of regional climate model simulations for hydrological climate-change impact studies: review and evaluation of different methods
.
Journal of Hydrology
456–457
,
12
29
.
https://doi.org/10.1016/j.jhydrol.2012.05.052
.
Vavrus
S. J.
,
Notaro
M.
&
Lorenz
D. J.
2015
Interpreting climate model projections of extreme weather events
.
Weather and Climate Extremes
10
,
10
28
.
https://doi.org/10.1016/j.wace.2015.10.005
.
Wetterhall
F.
,
Pappenberger
F.
,
He
Y.
,
Freer
J.
&
Cloke
H. L.
2012
Conditioning model output statistics of regional climate model precipitation on circulation patterns
.
Nonlinear Processes in Geophysics
19
(
6
),
623
633
.
https://doi.org/10.5194/npg-19-623-2012
.
Wigley
T. M. L.
&
Raper
S. C. B.
2001
Interpretation of high projections for global-mean warming
.
Science
293
,
451
454
.
Wilby
R. L.
,
Hay
L. E.
,
Gutowski
W. J.
,
Arritt
R. W.
,
Takle
E. S.
,
Pan
Z.
,
Leavesley
G. H.
&
Clark
M. P.
2000
Hydrological responses to dynamically and statistically downscaled climate model output
.
Geophysical Research Letters
27
(
8
),
1199
1202
.
https://doi.org/10.1029/1999GL006078
.
Wilby
R. L.
,
Dawson
C. W.
&
Barrow
E. M.
2002
SDSM – a decision support tool for the assessment of regional climate change impacts
.
Environmental Modelling & Software
17
,
147
159
.
Wood
A. W.
,
Leung
L. R.
,
Sridhar
V.
&
Lettenmaier
D. P.
2004
Hydrologic implications of dynamic approaches to downscaling climate model outputs
.
Climate Change
62
,
189
216
.
Yang
T.
,
Tao
Y.
,
Li
J.
,
Zhu
Q.
,
Su
L.
,
He
X.
&
Zhang
X.
2018
Multi-criterion model ensemble of CMIP5 surface air temperature over China
.
Theoretical and Applied Climatology
132
,
1057
1072
.
This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (CC BY 4.0), which permits copying, adaptation and redistribution, provided the original work is properly cited (http://creativecommons.org/licenses/by/4.0/).