Although computer scientists have attempted to use newly emerged social network data to estimate rainfall, as mentioned in the previous section, it is like a ‘dessert’; the main data sources of rainfall measurement are rain gauges, weather radars and satellites, which are the ‘main course’. The ‘dessert’ has some obvious shortages apart from its advantage on data cost and quick response. The use of Twitter data to estimate rainfall or flood situation, as mentioned in the previous section, requires the prevalence of Twitter at a local level, e.g., developed urban area with a large number of users and a wide internet access, which implies the spatial coverage and resolution of the data can be poor in less developed cities and rural areas. The temporal length of the Twitter data is significantly less than the meteorological records, which can be traced back to 1861, while Twitter was launched in 2006. Despite the low cost and quick response of the new data sources foretelling a possible future direction, the existing data sources for rainfall measurement have accumulated a vast quantity of data which can substantially benefit from the big data technology. Table 1 shows information of some widely used datasets containing precipitation data. The features of precipitation data from different sources vary significantly due to the different measuring mechanisms and processing algorithms.
Information of some datasets containing precipitation
Datasets . | Data source . | Data size . | Spatial and temporal coverage and resolution . | . |
---|---|---|---|---|
GPCC Global Precipitation Climatology Centre monthly precipitation dataset | Gauge based | 4.2 GB | Monthly values from 1901/01. Varys, 0.5 °, 1.0 ° and 2.5 ° global grid | Beck et al. (2005) |
The Next Generation Weather Radar (NEXRAD) | Radar | 73.1 TB | Comprising 160 sites throughout the USA. 1 ° grid. 1 hour, 3 hour and total storm accumulated data since 1988 | NCEI (2015) |
Global Historical Climatology Network Daily Database | Station record | 22 GB | Daily since 1861. Contains records from over 80,000 stations in 180 countries and territories | Menne et al. (2012) |
CPC Global Summary of Day/Month Observations | Station record | 13.7 GB | Approx. 8,900 actively reporting stations in global daily data since 1979 | Climate Prediction Center National Centers for Environmental Prediction National Weather Service NOAA US Department of Commerce (1987) |
GPCP (Daily): Global Precipitation Climatology Project- 1DD product | Geostationary infrared satellite | 0.78 GB | Daily rainfall accumulation globally on a 1 ° grid in latitude and longitude starting in October 1996 | Pendergrass (2015) |
The Tropical Rainfall Measuring Mission (TRMM) | Satellite | 236 GB | 3 hourly from Jan 1st 1998 to mid-2017. 0.25 ° latitude/longitude grid over the domain 50 °S–50 °N | NASA (2013) |
The Global Precipitation Measurement Mission (GPM) | Satellite | N/A | Provide half-hourly and monthly precipitation estimates on a 0.1 ° latitude/longitude grid over the domain 60 °N–S | NASA (2011) |
NCEP Climate Forecast System Reanalysis | Model reanalysis | 67 TB | 6 hourly from 1979. 0.1 ° latitude/longitude grid globally | (Saha et al. 2010) |
Datasets . | Data source . | Data size . | Spatial and temporal coverage and resolution . | . |
---|---|---|---|---|
GPCC Global Precipitation Climatology Centre monthly precipitation dataset | Gauge based | 4.2 GB | Monthly values from 1901/01. Varys, 0.5 °, 1.0 ° and 2.5 ° global grid | Beck et al. (2005) |
The Next Generation Weather Radar (NEXRAD) | Radar | 73.1 TB | Comprising 160 sites throughout the USA. 1 ° grid. 1 hour, 3 hour and total storm accumulated data since 1988 | NCEI (2015) |
Global Historical Climatology Network Daily Database | Station record | 22 GB | Daily since 1861. Contains records from over 80,000 stations in 180 countries and territories | Menne et al. (2012) |
CPC Global Summary of Day/Month Observations | Station record | 13.7 GB | Approx. 8,900 actively reporting stations in global daily data since 1979 | Climate Prediction Center National Centers for Environmental Prediction National Weather Service NOAA US Department of Commerce (1987) |
GPCP (Daily): Global Precipitation Climatology Project- 1DD product | Geostationary infrared satellite | 0.78 GB | Daily rainfall accumulation globally on a 1 ° grid in latitude and longitude starting in October 1996 | Pendergrass (2015) |
The Tropical Rainfall Measuring Mission (TRMM) | Satellite | 236 GB | 3 hourly from Jan 1st 1998 to mid-2017. 0.25 ° latitude/longitude grid over the domain 50 °S–50 °N | NASA (2013) |
The Global Precipitation Measurement Mission (GPM) | Satellite | N/A | Provide half-hourly and monthly precipitation estimates on a 0.1 ° latitude/longitude grid over the domain 60 °N–S | NASA (2011) |
NCEP Climate Forecast System Reanalysis | Model reanalysis | 67 TB | 6 hourly from 1979. 0.1 ° latitude/longitude grid globally | (Saha et al. 2010) |