Many water quality parameters such as concentrations of suspended matter, nutrients and algae directly or indirectly change the electromagnetic reflectance and transmission properties of surface water bodies. Optical measurement approaches have shown great potential to partially substitute water sampling and laboratory analyses, but are obstructed by limited flexibility or high maintenance demands. In order to overcome these problems and to bridge the gap between in situ and remote sensing measurements, the use of close-range, above-surface reflectance measurements in the VIS-NIR domain to measure water quality parameters in surface water bodies was investigated. Remote sensing reflectance in a 1 m³ water tank with increasing, known concentrations of suspended solids was measured. A partial least squares model was trained to predict concentrations from reflectance curves, which performed well, considering the wide range of concentrations and illumination conditions (R²cal = 0.96, R²val = 0.97). The approach was then transferred to the field and further parameters were tested. Using a semi-autonomous spectrometer mounted to a boom stand on a motor boat, we traced substance concentrations in close intervals along a longitudinal gradient from inflow to dam in a drinking water reservoir in Brazil. The method is suitable for parameters directly influencing the reflection properties of the water body (e.g. suspended solids (R²cal = 0.93), chlorophyll-a (R²cal = 0.74)), or for parameters closely related to those (e.g. total phosphorus (R²cal = 0.97)). For chemical oxygen demand, the method is not well suited (R²cal = 0.14, R²val = 0.45). Once calibrated to the local conditions, the spectrometer can be used stationary or on moving platforms to map and monitor surface waters. The integration of the procedure into acoustic and imaging techniques is further investigated.
Due to their significance for human health and well-being, surface waters require thorough protection measures based on extensive water quality monitoring. Impacts of climate change and land use change as well as increasing usage requirements underline the need for monitoring in high spatial and temporal resolutions. Many water quality parameters such as concentrations of suspended solids, nutrients and algae directly or indirectly change the electromagnetic reflectance and transmission properties of surface water bodies. These features are increasingly used to retrieve concentrations from various substances, e.g. from recurring aerial and satellite imagery (Gholizadeh et al. 2016) and from stationary submerged optical sensors (Martínez-Carreras et al. 2016). While these methods have shown great potential to supplement and substitute traditional water sampling, they are obstructed by limited flexibility or high maintenance demands. Submerged, stationary optical sensors can provide continuous data for various parameters, but are subject to biofouling and subsequent drifts in recorded data as well as high sensor maintenance efforts. Remote sensing techniques have the advantage of covering spatial variations over large areas. However, ground truthing has to be accomplished within a close time-span of the satellite or airplane overpass, which limits the amount of training samples. Further limitations are the dependency on cloud-free conditions and the spatial resolution, which can be insufficient for small water bodies. In order to overcome these problems and to bridge the gap between in situ and remote sensing measurements, we investigate the use of close-range, above-surface reflectance measurements in the visual and near infrared (VIS-NIR) domain to measure water quality parameters in surface water bodies. Simultaneously, reference spectra for remote sensing imagery can be retrieved.
Total suspended solids (TSS) was selected as the main water quality target parameter for this study. It is, by weight and volume, the most important pollutant in the Earth's river systems (Ritchie et al. 2003). Also, it has proxy capabilities for nutrients, heavy metals, pesticides and pharmaceuticals, is insufficiently monitored and has great ecological and economic implications (Apitz & White 2003; Horowitz 2013). Lastly, the influence of TSS on remote sensing reflectance is well described (Ritchie et al. 1976; Schalles et al. 2001), which makes it suitable for a method development.
The goal of this study was to test a new method for the estimation of TSS concentrations from remote sensing reflectance using a relatively inexpensive and light-weight spectrometer combined with partial least squares (PLS) regression (Wold et al. 2001). First, results of an experimental study using a 1 m³ mesocosm and controlled TSS concentrations are outlined. Secondly, an operational application using a hyperspectral boat-mounted sensor on a Brazilian reservoir characterized by high-TSS spatial gradients is described. We additionally used the approach to estimate total phosphorus (TP), chlorophyll-a (chl-a), phycocyanin (PC), dissolved oxygen (DO) and chemical oxygen demand (COD) concentrations as well as turbidity, pH-value and Secchi disk depth (ZSD). COD was chosen because the reservoir is suspected to receive untreated waste water and periodically suffers from dropping oxygen levels near the inflow. Additional parameters, relevant for drinking water reservoirs (e.g. total organic carbon, UV absorbance) could not be measured at that time.
The presented method is transferable to a variety of applications such as mobile campaign-based measurements using boats or drones, as well as stationary lake and river monitoring from buoys or bridges.
Two setups were tested, one using a controlled mesocosm environment, the other using a boat on a reservoir. The materials and workflow are briefly described in the following.
Data acquisition of the mesocosm experiments
In order to define the potential range of TSS detection from above-water measurements, we measured remote sensing reflectance in a water tank (L × W × H: 148 × 105 × 80 cm), painted flat black. Silt and clay sediment was collected from a wet detention basin of the Weingarter Bach, the upper Rhine valley, shortly after a series of high flow events. The material was then suspended in municipal tap water using an immersion pump to create gradually increasing concentrations of TSS between 0 and 2,200 mg/L.
Hyperspectral data were acquired with an AISA+ Eagle spectrometer: a pushbroom scanner with an instantaneous field of view (IFOV) of 0.648 mRad and a field of view (FOV) of 36.04°. The AISA+ Eagle was equipped with a mirror scanner (Specim Limited, Oulu, Finland) to enable the recording of hyperspectral frames. The scanner was mounted on a scaffold at a height of 1.3 m above the water tank. We recorded scans in four times spectral binning mode to achieve an appropriate trade-off between signal-to-noise ratio and spectral resolution (Silván-Cárdenas & Wang 2010). The corresponding data features 61 spectral bands between 398 and 957 nm with a full width at half maximum (FWHM) of 8.5–9.5 nm. The final data set was restricted to 55 spectral bands, as bands above 900 nm were removed due to very low reflectance.
Two separate data sets were acquired, i.e. one during cloud-free conditions and the other during homogeneous cloud cover. Spectral acquisitions involved internal dark current measurements before each scan to account for systematic scan artefacts. During the scans we recorded the incoming radiance data, which enabled an absolute radiometric calibration to reflectance. The calibration was performed in the ENVI plugin CaliGeoPro (Specim Limited, Oulu, Finland). We averaged the signal from a section of the water surface area free of sun glint or shading. From each curve, a baseline was subtracted measured in clear water in the shaded inside of the tank.
Data acquisition of the boat-based reservoir spectrometry
We transferred and expanded the approach to estimate concentrations during two campaigns (spring and autumn) in the Passauna drinking water reservoir in southern Brazil. We used a ‘RoX’ instrument (JB Hyperspectral Devices, Düsseldorf, DE) to measure the reflectance of the reservoir. The device is based on a FLAME-S-VIS spectrometer (Ocean Optics, Dunedin FL, USA) and is an advanced development of a spectroscopy setup described in Burkart et al. (2014) to perform unsupervised reflectance measurements. The two ends of a bifurcated glass fibre leave the spectrometer point at the nadir and zenith, respectively. The downward-looking fibre measures upwelling radiance within an opening angle of about 20°. Shutters alternately close one and both fibres to measure up- and downwelling radiance as well as dark current in each measuring cycle. After subtracting the dark current, reflectance is calculated as the quotient between downwelling and upwelling radiance. We mounted the spectrometer to a boom stand on a small motor boat (Figure 1). From about 1.2 m above the water surface, the device pointed at the water surface outside the boat shadow and measured reflectance curves in short time intervals (about 10 seconds), while we drove transects across the impoundment. This way, we recorded water surface reflectance curves from 400 to 900 nm with corresponding location and time information. In the presented case, water surface is defined as the part of the water column from which sunlight is reflected back into the upper hemisphere, or the water column above the attenuation depth. In 24–49 reference samples, nine water quality parameters were measured (see Table 1). Only optically deep water was measured.
|Data set||Param.||Unit||n||Mean||Min||Max||SD||LV||R²cal||RP% cal||R²val||RP% val|
|Data set||Param.||Unit||n||Mean||Min||Max||SD||LV||R²cal||RP% cal||R²val||RP% val|
RP%: Root mean square error of prediction, given as percentage of the maximum subtracted by the minimum measured value. LV: latent vectors, SD: standard deviation, Res.: reservoir, M: mesocosm with subscripts S (sunny), Cl (cloudy) and Co (combined), numbers indicating TSS range.
All water samples were taken from the first 20 cm of the water column. Samples were stored in dark and cold (4 °C) until analysis in the laboratory. The parameters ranged from directly optical active (e.g. TSS) to indirect (e.g. particle bound TP) or optical inactive (e.g. DO) parameters.
For both the mesocosm experiment and the boat-based campaign, TSS concentrations were measured by filtering known volumes of the samples through pre-weighted 0.6 μm glass-fibre filters by means of a vacuum pump, drying them for several hours at 105 °C and weighing them again to obtain the total mass of suspended solids in the sample volume. We then calculated TSS concentrations by dividing the masses by the respective volumes. Phycocyanin (cyanobacteria proxy), chlorophyll-a (green algae) and turbidity were measured in situ using TriOS nanoFlu fluorescence sensors and turbidimeter, respectively. DO and the pH were also directly measured in the field using a Horiba U52 multi probe. ZSD was determined by slowly lowering a 25 cm black and white plastic disk into the water until it was no longer visible. TP was analysed colorimetrically using the ascorbic acid method and light absorption at 880 nm (Method 4500-P E). COD was determined by the closed reflux titrimetric method (Clesceri 1998).
All spectral data was processed in R (R Core Team 2017). Raw spectra were smoothed using a Savitzky–Golay filter (Savitzky & Golay 1964). Only for the reservoir data, boundary reflectance values for each band were defined based on visual inspections to eliminate distorted spectra. From each reflectance value, we subtracted the mean value of the corresponding curve to minimize the effect of overall curve intensity shifts caused by changing light conditions during the measurement. The first derivative of each curve was determined.
The processed curves and their first derivative were jointly used as predictors for substance concentrations in PLS regression models using the orthogonal scores algorithm. We made use of the R package ‘pls’ (Mevik & Wehrens 2007). PLS decomposes the entire feature space (here hyperspectral bands) into fewer latent variables that explain the essential variation of the response variable (here substance concentrations) via a linear regression (Wold et al. 2001). PLS is thus well suited for the high dimensionality and redundancy in hyperspectral data. Pairs of concentration values and corresponding (mean) spectra were split in a training (75%) and test set (25%) to calibrate and validate the empirical models using cross-validation. This process was iterated 100 times to extract mean goodness-of-fit measures. The models with one to five latent vectors were then evaluated by their root mean square error of prediction (RMSEP) and their R² for the test and training sets. The setup with the smallest number of latent vectors and the lowest RMSEP was deemed optimal. For the reservoir data set, the selected PLS was used to estimate concentrations from the remaining spectra which were not used to train or test the model.
RESULTS AND DISCUSSION
The developed work flow and the obtained results from the mesocosm experiments allowed for the transfer of the described measurement approach to a drinking water reservoir. Results are presented in the corresponding order.
For both sets collected, an increase of TSS concentrations leads to an increase of reflectance most pronounced in the wavelength regions of 450–550 nm and especially 700–900 nm, the latter with a local maximum at around 815 nm. This is in accordance with previous findings and highlights the importance of the near infrared to detect suspended matter concentrations (Lodhi et al. 1998; Knaeps et al. 2010; Wu et al. 2014). The illumination conditions were found to have a strong impact on the shape of the reflectance curves. Reflectance from diffusive sunlight shows an about three-times steeper increase between 400 and 500 nm. For direct sunlight, the spectra appear flatter. The PLS predictions are best when test and training data sets are acquired under similar illumination conditions (Table 1). However, a regression model built from data from both sets, sunny and overcast (Figure 2), is still well within the performance range of linear or second-order regressions used in similar setups (Lodhi et al. 1998). This finding is particularly important for the transfer of the approach to permanent or campaign-based measurements, where changes in illumination conditions happen frequently. From the experiences, frequent measurements of the downwelling irradiance are recommended, ideally one for each measurement of the upwelling radiance. By subsetting the data set, PLS calibrations using smaller TSS concentration ranges (0–200 mg l−1 and 0–600 mg l−1) were made (Table 1). The predictive power of these models is in the same range as the model using the entire data set. This suggests that if calibrated accordingly, a wide range of TSS concentrations can be precisely estimated from close-range reflectance measurements.
Boat-based reservoir spectrometry
During subsequent spectra processing, PLS models were built from reflectance spectra and corresponding reference data for several parameters (Table 1). For TSS, the predictive power of the in-field data is only slightly lower compared with the controlled mesocosm experiments. It is also within the range of accuracy reached with designated turbidimeters (Rügner et al. 2014). Considering the often less-than-ideal measurement conditions caused by waves, movements of the boat or rapidly changing illumination conditions, the results are encouraging. Even at a boat speed of up to 20 kmh−1, usable reflectance curves and hence concentrations could be retrieved. For submerged optical sensors such as turbidimeters, an elaborate mounting and a much slower cruising speed (from our experience less than 5 km h−1) are needed to obtain accurate data. Moving measurements with sensors in the water are likely to be biased by, e.g., air bubbles in front of the measurement window. In airborne systems, total sunlight reflection (i.e. glint, on waves) can distort measurements over extensive water surface areas. We measured with a ∼0.14 m² footprint much closer to the water surface and filtered and normalized the spectra, which minimized the effect of varying amounts of glint within the footprint. Although we did not notice pronounced differences in concentration estimated due to changing illumination conditions, measuring during overcast conditions is recommended. Large waves could cause boat movements making measuring at nadir difficult without a gimbal. Also, whitecap conditions should be avoided.
Turbidity, ZSD and TP, the latter being mostly particle-bound, are directly related to TSS concentrations. Due to this covariance, they can be determined with a similar precision as TSS itself. From these parameters, ZSD shows the greatest uncertainty mainly because of the subjective way the reference data is collected. More surprisingly, the data show that the optically inactive parameters DO and pH can also be derived from reflectance with a reasonable precision. It is important to stress at this point, that such specific relations may only be valid for this individual surface water body. At Passauna reservoir, the inflowing and often highly turbid water can have low oxygen contents as well as low pH values. This is likely to be due to oxygen-consuming processes associated with suspended, acidic erosion material. In this case, suspended matter has great proxy capabilities, which may not be the same in other catchments. Spatial and temporal transferability are often pointed out as limitations of empirical procedures like PLS regression (Ritchie et al. 2003). In the presented case, the temporal transferability of the approach could be successfully demonstrated. Measurements from spring and autumn were combined in the training and test data sets for the models, which reached a similar precision compared with the models based on just one campaign.
In contrast to the general expectation, the presented approach only shows a fair precision for predicting the optically active substances chl-a and phycocyanin, which may have several reasons. At least for chl-a, there are only a few higher values and many low concentrations in the data set, which is a less-than-ideal situation for training a model. Furthermore, the reference measurements themselves are based on a (possibly biased) optical procedure, which uses a global calibration of the manufacturer. Lastly, both in situ reference sensors for chl-a and phycocyanin do not seem optimal for the highly turbid waters of the inflow area, where the sensor readings were less stable than in waters with low TSS concentrations. The influence of turbidity and species composition on optical phycocyanin measurements is described in more detail by Brient et al. (2008).
For similar reasons, estimating COD from reflectance in the reservoir does not show good results. Any changes of water surface reflectance due to COD are presumably covered by the dominant changes induced by suspended sediment. Other studies have considered COD a parameter difficult to assess by remote sensing techniques (Gholizadeh et al. 2016). For this parameter, absorption-based submerged UV–visible spectrometers are better suited (Torres & Bertrand-Krajewski 2008).
Figure 3 shows the surface TSS concentration estimates based on hundreds of spectral point measurements from a moving boat. Here, the concentration gradient from the reservoir inflow area towards deeper parts of the impoundment is traced. At the narrow point between the shallow inflow (mean depth of about 2 m) area to the north and the deeper main reservoir to the south, the concentration changes rapidly. The presented results show which parts of the reservoir surface are impacted by the TSS input caused by a heavy rain event, or to what extend the inflow area is inhibiting substance flux to the main reservoir. This is valuable information for the reservoir operator, which would have been difficult to obtain with traditional methods.
There need to be considerations for which part of the water column the modelled concentrations are valid. One way to approach this issue is to use the attenuation depth as the lower boundary of the water column layer which contributes to the spectral measurement. It is defined as the depth from which 90% of the water-leaving radiance emerges and can be calculated from attenuation measurements. If such measurements are not available, ZSD can be used as a proxy to calculate the attenuation coefficient and subsequently attenuation depth. Using the nonlinear equation for neotropical systems introduced by Padial & Thomaz (2008), the attenuation depth in Passauna reservoir ranges from 0.12 m (ZSD: 0.15 m) in the highly turbid buffer to 1.37 m (ZSD: 3.7 m) near the dam. Even though the presented method is either limited to the uppermost layer of stagnant water bodies or relies on the full mixing of water bodies, like in rivers, the characterization of the epilimnion (e.g. trophic state) serves as crucial information for reservoir management.
To further improve the understanding of implications between the uppermost water layer and deeper volumes, we are currently examining the combination of proximal spectroscopy and acoustic backscatter measurements from the same boat to cover the entire water column. The concentration estimates from the spectrometer can be used as calibration for the acoustic data, which is only able to record relative intensities. The spectra can also be used as reference for remote sensing techniques such as multi- and hyperspectral drone and satellite imagery.
CONCLUSIONS AND OUTLOOK
We tested close-range water reflectance measurements to retrieve water quality parameters under different illumination conditions in a mesocosm experiment and from a boat in a reservoir. The method is suitable and time-saving for parameters directly influencing the reflection properties of the water body, or for parameters closely related to those. Possible applications are campaign-based spectral measurements from mobile platforms like boats and drones as well as stationary deployment at weirs, bridges or on buoys for lake and river monitoring. Empirical procedures like PLS are highly sensitive to the training data used and their validity must be monitored, especially when applied to other regions or seasons. Alternatively, physical-based modelling can be considered to retrieve concentrations from spectral measurements. As next steps, the integration of the method with remote sensing imagery and with acoustic data will be investigated, as a high temporal and spatial resolution for monitoring the water surface and water column is pursued. In this context, we believe that above-surface water spectrometry is a valuable contribution to monitoring and mapping water quality in rivers, reservoirs and lakes.
Research was supported by the Graduate School for Climate and Environment (grace.kit.edu). Stefan Hinz of the KIT-IPF is thanked. We thank Tobias Bleninger, Cristovão Fernandes, Heloise Knapik and the staff of UFPR-DHS (dhs.ufpr.br). Thanks go out to Mauricio Scheer and the staff of SANEPAR (site.sanepar.com.br). Andreas Burkart of JB Hyperspectral (jb-hyperspectral.com) is thanked.