Wastewater treatment is an environmental issue of the utmost importance. Pesticides, industrial waste, chemical fertilizers, and radioactive waste are some of the causes for water pollution. Several models exist for treating contaminated wastewater. In this study an application-specific review of various wastewater treatment models is performed. Extensions to existing treatment models are discussed to improve their performance. The treatment models are compared statistically based on performance metrics such as quality of treated water, sludge percentage at output, complexity of treatment, time needed for treatment, and deployment cost. The treatment models are ranked using a novel parameter called Model Rank, which combines all performance metrics into a single number. According to the results, six models, including Advanced Oxidation Processes with Ozone treatment (AOPO), Kernel Principal Components Analysis based one-class Support Vector Machine (KPCA SVM), and four others, have a rank greater than 3.5. The AOPO model has the highest model rank of 3.85 and performs better than all other models. This study might aid major stakeholders in the waste treatment industry, including researchers, in selecting the appropriate waste water treatment method per their requirements.

  • Application-specific pragmatic review of various wastewater treatment models.

  • Assistance in identification of various advantages, limitations, and future research scope in these models.

  • Statistical comparison of various performance metrics of different models.

  • Using statistical analysis, identifying the best possible method or methods.

  • Recommendations of various extensions to models for improving process performance

Graphical Abstract

Graphical Abstract
Graphical Abstract
Water pollution is an immediate and probably one of the most important environmental issues facing humanity. Various factors such as pesticides, industrial wastes, chemical fertilizers, mining activities, radioactive waste, sewage, and wastewater are responsible for water pollution. The design of wastewater management system is thus an environmentally essential field and it involves accurate analysis of various factors such as chemical compositions, biological effects, and wastage analysis. In order to design an effective wastewater treatment model, a wide variety of system components must be integrated. These include but are not limited to grit screens for removing visibly large particles, sedimentation for large sludge removal, aeration for small-sized sludge removal, and chemical treatment for purity improvement. A typical treatment process can be visualized from Figure 1, wherein multiple sedimentation layers are combined with chemical treatment, and other processes in order to obtain usable water (Elnakar & Buchanan 2020).
Figure 1

A typical wastewater treatment model.

Figure 1

A typical wastewater treatment model.

Close modal

Different wastewater sources generate different kinds of impurities, which must be treated using impurity-specific processes. These processes also depend upon the application or use of the treated water. For example, chlorination is used for treating water that will be used in swimming pools, while drinking water is treated with disinfectants. Similarly, coagulants are added to drinking water (Elnakar & Buchanan 2020), while multiple anticorrosion agents are used for industrial cleaning water (Comber et al. 2019). Thus, a wide variety of inter-process variations are required, which directly depend upon the type of application for which the water is being treated. Machine learning has been utilized in a few approaches to counter the inter-process variations and analyze the effect of treatment on resulting water quality (Mokhtari et al. 2020).

In this study, a review of machine learning approaches is performed, which will allow researchers to evaluate various nuances, advantages, limitations, and future improvements in these models. A parametric analysis of the reviewed models is carried out, in terms of quality of treated water, sludge percentage at output (SL), complexity of treatment, time needed for treatment, and deployment cost (DC). Upon referring this analysis, researchers would be able to identify the most optimum models for application-specific water treatment. This is done because there is such a large range of performance, it can be challenging for users to choose the strategy that will work best for the deployment they are responsible for.

In this study, an application-specific and pragmatic review of various wastewater treatment models is performed. A statistical comparison of these models in terms of various performance metrics such as the quality of treated water, the percentage of sludge at output, the complexity of treatment, the amount of time required for treatment, and DC is carried out. Recommendations for extending the reviewed models are proposed in order to improve their overall performance. These additions can be tested in labs for the purpose of developing a wastewater treatment that is both quick and effective. This study also recommends a variety of machine learning techniques for streamlining the purification processes, which can contribute to an improvement in overall efficiency. The main objectives of the study are to empirically review various wastewater treatment models, propose improvement techniques for these models, and pragmatically analyze these models in terms of performance metrics.

The review is going to help readers identify various advantages, nuances, limitations, and future research scope in each of the models, and it will do so by providing them with information. Researchers are able to determine the most effective methods for their use cases by making use of this statistical analysis, and they are also able to combine the reviewed methods in order to design an effective hybrid method for the treatment of wastewater if this proves to be necessary.

Various system models are available for the treatment of wastewater, and each of them is applicable for different usage scenarios. For instance, the work in Zhou et al. (2020) discusses a topology-controlled hydration model that uses hydrogels for treating wastewater. In order to make the process more effective, solar irradiation is used for improving filtering capabilities of hydrogels, leading to formation of interpenetrating polymer networks (IPNGs). IPNG has the capability of activating over 50% contained water, thereby taking it to the intermediate filtering stage. The model has been tested on different levels of IPNG variants, and IPNG5 was observed to be the most effective in treating water. It results in higher purity than its counterparts with better sludge treatment but has a higher cost and greater treatment complexity than its counterparts.

The treatment complexity can be reduced via the use of effluent treatment as suggested in Mehralian et al. (2020), wherein authors have demonstrated that the use of sequencing batch reactors (SBRs) for agriculture targeted water treatment has better efficiency than sedimentation and aeration processes. The model has lower complexity, and better water quality, but higher cost due to use of different SBRs. It is currently applied for agricultural applications but can be extended to other types of water treatments via chemical modifications. Such modifications are proposed in Cheriyamundath & Vavilala (2021), wherein authors have proposed the use of nanomaterials including metal-based nano adsorbents (MBNAs), carbon nanotube (CN), nano membranes (NMs), and nano photocatalysts (NPs) for improving water quality. They are used to remove various oil contaminants, microbes, dyes, mycotoxins, etc. These materials, however, have some side-effects on local flora and fauna, which must be countered using effective safety measures.

Textile-based water treatment also makes use of similar models (Deng et al. 2020). Apart from nanomaterials authors have proposed the use of photodegradation (PD), advanced oxidation processes with ozone treatment (AOPO), electrochemical processes (EPs), coagulation–flocculation (CF), membrane and absorption (MA), and sonication (SC) for improving water quality. Authors recommend that a combination of these processes can further improve water quality; thus engineers must focus on analyzing the effects of combining these models on the resulting quality of water. Environmental effects of these processes are discussed in Choudri et al. (2020), wherein authors have proposed that the treatment of water from pharmaceuticals, personal care products, heavy metals, nanoparticles, etc. can cause genotoxicity, cytotoxicity, ecotoxicity, etc. This can accelerate the process of antibiotic-resistant bacteria formation, parasites and virus formation, thus, management of biosolids and sludge must be carried out carefully. Furthermore, the resulting water must be used for quality-specific scenarios.

Health implications of this usage are discussed in Kesari et al. (2021), wherein authors have estimated that fresh water has values of lower nitrogen, ammonia, phosphorus, potassium, calcium, and magnesium, when compared with municipal water, but it has higher sodium content, which makes it useful for drinking purposes. Variations of these levels can cause disastrous effects on human and plant health, which can be observed from Figure 2, wherein diseases such as cholera, anemia, ecotoxic yield, etc. are directly linked with the quality of water. In order to avoid these issues, a novel high-quality wastewater treatment model is proposed in Kesari et al. (2021), which uses multistage filtering model (MSFM). These include multiple screens, grit chambers, aeration tanks, gravity-based thickening tanks, centrifuge dewatering tanks, ultrasonication, etc.
Figure 2

Impact of improper wastewater treatment on flora and fauna health (Kesari et al. 2021).

Figure 2

Impact of improper wastewater treatment on flora and fauna health (Kesari et al. 2021).

Close modal

Due to use of these stages, the MFSM technique is capable of improving water quality for drinking purposes, but has greater complexity, and requires higher cost than other models. This model is currently operated manually, which reduces its processing speed.

A self-organizing sliding mode-based controlling process improves the processing speed as discussed in Han et al. (2019). Here, authors have combined fuzzy neural networks with sliding mode-based control, for automatic quality checking and reducing structural complexity of treated water. This process generates a model for fixed and adaptive structural analysis of water, which makes it useful for a wide variety of applications. After examination of the internal working of this model, it is observed that the self-organizing fuzzy neural network (SOFNN) model improves quality of resulting water, but is highly complex, and requires a larger DC when compared with application-specific models.

A highly efficient wastewater treatment model is described in Tung et al. (2018), where authors have used a synthetic version of ‘superparamagnetic iron oxide @ carbon’ (SPIC) for reducing carbon shell, and arsenic particles. The SPIC method is highly expensive, and thus is used for treatment of highly corrupted water, in rare cases. But the model has low complexity, high efficiency of treatment, and requires very low delay for processing the water, and thus can be used for epidemic like global situations. The cost of this model is also affected due to the use of oxidization processes and security concerns, which can be reduced via the models proposed in dos Santos Silva et al. (2019) and Adepu & Mathur (2021), where authors have used Kalman filters for oxygen intake optimization, and distributed attack detection for securing wastewater management sites. Addition of these models, however, would further increase the complexity of deployment.

The model's reliability performance can be improved via use of sensor failure detection as proposed in Thiyagarajan et al. (2018), which would intimate plant operator(s) about any faulty water quality observations. This would assist in reduction of redundant operations for fixing water treatment equipment. The work in Malisa et al. (2019) discusses various recycling methods and proposes an urban wastewater recycling (UWWR) model for treatment, which assists in 50% better water reuse. Similar methods are proposed in Cheng et al. (2019a), wherein authors have deployed nonlinear data-based techniques for monitoring influent water conditions. The model uses Kernel Principal Components Analysis-based one-class Support Vector Machine (KPCA SVM) for anomaly detection during water treatment and can be used for securing large-scale treatment plants with minimum error, and high throughput.

Microwave heating (MWH) can be used for improving the quality of sewage sludge as proposed in Karlsson et al. (2019), wherein authors have used 2.45 GHz ranged waves for penetrating certain depths of wastewater. Due to this, porous sewage sludge along with other heavy metal and invisible impurities are removed from water. This process is depicted in Figure 3, where it is observed that the proposed model reduces sludge settlement delay from 6 months to almost less than 1 day, thereby improving the overall speed of operation.
Figure 3

(a) Non-microwave process and (b) microwave-based water treatment process.

Figure 3

(a) Non-microwave process and (b) microwave-based water treatment process.

Close modal

Although the delay in water treatment reduces drastically, but it increases the cost of treatment due to the requirement of high-speed and high-efficiency microwave equipment. This model finds its application in a wide variety of scenarios that demand high purity of water. Efficiency of such processes can be improved via the addition of influent load forecasting in wastewater, and then scheduling treatment activities accordingly. The work in Heo et al. (2021) proposes such a model, wherein authors have discussed use of multimodal and ensemble deep learning (MEDL) for prediction of wastewater output from systems, which assists in scheduling treatment activities. Due to this scheduling, delay needed for treatment reduces drastically, and availability of usable water is improved. Such deep learning models are also useful for scheduling treatment activities, and automating them.

A multiple objective predictive control (MOPC) method that uses an adaptive fuzzy neural network (AFNN) for estimation of coagulants, and other chemicals are proposed in Han et al. (2020). Here, authors are able to achieve better water quality than manual processes, but the model showcases large computational delay, and high complexity of deployment. This complexity is reduced via the use of Transfer Multiple Objective Optimization Algorithm (TMOOA), which assists in reducing complexity, and delay of treatment via coarse grained control of internal process timings. A similar model is proposed in Han et al. (2021a), wherein authors have used intelligent optimal control system with flexible objective function (IOCS-FOF), and Multiple Objective Optimization Algorithm for Flexible Objective (MOAFO) for scheduling treatment activities. It is observed that the IOCS-FOF model has better water quality than MOAFO, but the former has higher complexity, and requires larger delays for control. The IOCS-FOF model, however, is useful for yielding drinking water, and thus is used in a wide variety of treatment plants.

The efficiency of models can be improved if instead of process-based methods for prediction of treatment steps, data-based prediction is used. An example of this improvement is discussed in Han et al. (2018), wherein authors have used prediction models for controlling dissolved oxygen (DO) levels via a self-organizing fuzzy neural network (SOFNN). This network is trained using adaptive second-order Levenberg-Marquardt, which assists in reducing computational complexity via reduction of redundant training and validation steps. Due to use of SOFNN as observed from Figure 4, this model is capable of highly efficient water quality output, with moderate level of complexity, and moderate DC.
Figure 4

Use of SOFNN for scheduling treatment activities (Han et al. 2018).

Figure 4

Use of SOFNN for scheduling treatment activities (Han et al. 2018).

Close modal

The SOFNN model's utility can be further extended via use of Integrated Magnetics Current Doubling Rectifier (IMCDR), which uses electrosynthesis to remove unwanted particles from wastewater. The IMCDR model has lower cost than most other methods, but has chances of contamination due to use of metal electrodes for cleaning. This model is highly useful for treating water intended to be used in agriculture, industrial cleaning, and other applications that are non-intrusive to human and animal bodies.

Performance of treatment scheduling can be further improved via use of deep neural network (DNN)-based models, such as long-short-term-memory (LSTM) and deep reinforcement learning (DRL) proposed in Pisa et al. (2019) and Seo et al. (2021), wherein control of activated sludge reactors, thickeners, anaerobic digestors, etc. is done via deep learning-based prediction. The LSTM and DRL models have better scheduling capabilities than artificial neural networks (ANNs), due to storage and analysis of a larger number of events. These models, however, require more memory, and have higher complexity than ANN, thereby are being used only under high-performance computing environments.

The complexity of models must be reduced for improving their scalability. The work in Liu et al. (2021) proposes such a low-complexity LSTM-based model, which utilizes particle swarm optimization (PSO) with attention mechanism (AM) for prediction of chemical oxygen demand (COD) during treatment. The combined model is observed to have lower complexity, and better speed of operation than LSTM, but it requires larger storage and has higher DC due to combination of multiple processing models.

Image processing can also be used for estimation of water quality, and then recommend treatment steps depending upon the estimation. Work in Khan et al. (2018) proposes an image processing model that estimates sludge volume index (SVI) in estimating locations of sludge in amplified wastewater images. Image processing models are highly useful for non-intrusive analysis, and can be combined with deep learning models such as the ones proposed in Cheng et al. (2020). Here, authors have compared LSTM, gated recurrent unit (GRU), bi-directional LSTM (BiLSTM), and a combination of these models for improving wastewater treatment efficiency. These models utilize various treatment parameters including hardness, coagulation effects, application of use, etc. and derive an automatic plan for achieving high accuracy of treatment. These models are useful for small-scale to medium-scale applications (scale indicates quantity of water processed per unit time), and can be extended to large-scale processing units via modeling of adaptive multiple output softening sensors. This is possible because these sensors are capable of reducing delay needed for softening via parallel processing of water lines.

Design of sensors is discussed in Wu et al. (2019), wherein multiple output partial least square (MOPLS) method is used for modelling. The MOPLS method is capable of achieving higher speeds than linear models, but requires costlier equipments, which limits its applicability to large-scale water treatment plants. Similar models are proposed in Liu et al. (2020a) and Cheng et al. (2019b), wherein authors have discussed the use of Dynamic Bayesian Networks Based on Fuzzy PLS (DBNFPLS) and optimized forest model with SVM (OFSVM) for fault diagnosis during wastewater treatment. Both these models are equally capable of high-quality water output but require higher delays than the MOPLS model, which restricts them to very large-scale treatment plants.

Fuzzy logic and bioinspired approaches are very useful when planning impurity detection systems, because impurity levels are also represented in fuzzy ranges. The work in Lamas & Giacaglia (2021) and Han et al. (2021b) proposes fuzzy logic small wastewater treatment plant (FLSWTP), and dynamic multiple objective particle swarm optimization (DMOPSO) models for small to moderate scaled water treatment plants. These models have better impurity removal capabilities when compared with Multiple Objective Genetic Algorithm (MOGA), virtual reference feedback tuning control strategy (VRFT-CS), adaptive multiple objective differential evolution control strategy (AMODCS), and Nondominated Sorting Genetic Algorithm-based Optimal Controller (NSGAOC) models, thereby improving their applicability to real-time treatment environments. These models are useful for scheduling any kind of treatment process, and can be applied to wet-type nonthermal plasma reactor (WTNPR) defined in Kuroki et al. (2020), which is used for nitrogen, arsenic, and sulphur removal. The experimental setup for this model is visualized in Figure 5, wherein different analysis engines, and sampling models are depicted. These engines are connected to a wet-type plasma reactor, which assists in analysis of different gas types in contaminated water samples. The model is observed to have high efficiency, moderate level of complexity and cost, but has low scalability because it requires different gas chambers for different types of impurities. Efficiency of this model might be improved if deep learning methods for scheduling and material saving are applied to it.
Figure 5

Treatment of nitrogen, arsenic, and sulphur using different treatment engines (Kuroki et al. 2020).

Figure 5

Treatment of nitrogen, arsenic, and sulphur using different treatment engines (Kuroki et al. 2020).

Close modal

Design of energy and material saving management using deep networks (EMSMDNs), and cooperative fuzzy neural network (CoFNN) is proposed in Wang et al. (2020) and Han et al. (2021c) for reducing redundancies for material use, energy use, component use, etc. during wastewater treatment. Due to this optimization, the proposed model is capable of reducing cost of wastewater deployment systems by 10–15%, which makes them highly useful for a wide variety of system deployments. These models are further expanded to cyber physical systems (CPSs) (Elsahwi et al. 2018), which assist in providing a user-friendly approach toward wastage reduction and monitoring via cloud infrastructures.

Electrochemical methods (EMs) (Saetta et al. 2019) are also useful for cyanide removal from wastewater with higher efficiency than chemical or sedimentation processes. While, data-driven iterative adaptive critic (DDIAC) strategy (Wang et al. 2021), stacking ensemble learning (SEL) (Liu et al. 2020b), chemical treatment of anaerobic reactor (CTAR) (Zeb et al. 2020), and discharged plasma-based reactor (DPBR) design (Xiang et al. 2019) are proposed by authors, these models are highly application-specific, and do not scale well due to their inherent internal compositions. Thus, water output from these models is used for non-drinking purposes only. Inspired by these approaches the work in Harrou et al. (2021) and Chistiakova et al. (2020) propose designs of data-driven soft sensors (DDSSs), and feedback and feedforward aeration control (FFAC) models. These models have a general purpose, and utilize chemical composition for reducing impurities, thereby assisting in better quality of water, which can be used for human and animal use. Even after several treatment steps, many concerns are raised by the authors, which include, preservation of genetic data, flora and fauna privacy issues, etc. A survey of these issues can be observed in Jacobs et al. (2021), wherein authors have aggregated these issues, and suggested recommendations for countering them. Based on these recommendations, work in Iratni & Chang (2019) suggests different control techniques including proportional integral control (PI), PI differential control (PID), feedback-based control, etc. These strategies will assist in mitigating genetic issues by analyzing and preserving water samples which pose privacy threats to the governments, and other monitoring agencies.

Based on this review it is observed that wastewater treatment is a very diverse field, and a large number of methods are available for it. All these models vary in terms of algorithmic performance, thus next section compares them w.r.t. various parameters which include quality of treated water, SL, complexity of treatment, time needed for treatment, and DC. Upon referring this comparison, researchers would be able to identify optimum methods for their water treatment requirements.

Based on the detailed discussion, it can be observed that the reviewed models have vast differences in terms of performance, type of application, scalability, etc. Thus, in this section these models are compared with respect to quality of treated water (Q), SL, complexity of treatment (C), time needed for treatment (T), and DC. All these parameters are converted into fuzzy ranges of low (L), medium (M), high (H), and very high (VH) depending upon components used in each internal process. These observations are tabulated in Table 1.

Table 1

Empirical analysis of different wastewater treatment models

MethodQSLCTDC
IPNG (Zhou et al. 2020VH 
SBR (Mehralian et al. 2020
MBNA (Cheriyamundath & Vavilala 2021VH VH VH 
CN (Cheriyamundath & Vavilala 2021VH VH 
NM (Cheriyamundath & Vavilala 2021
NP (Cheriyamundath & Vavilala 2021VH VH 
PD (Deng et al. 2020
AOPO (Deng et al. 2020
EP (Deng et al. 2020VH 
CF (Deng et al. 2020VH 
MA (Deng et al. 2020
SC (Deng et al. 2020
MSFM (Kesari et al. 2021VH 
SOFNN (Han et al. 2019VH VH VH 
SPIC (Tung et al. 2018VH VH VH 
KPCA SVM (Cheng et al. 2019a
MWH (Karlsson et al. 2019VH VH 
MEDL (Heo et al. 2021
MOPC (Han et al. 2020
TMOOA (Han et al. 2020
IOCS-FOF (Han et al. 2021a
MOAFO (Han et al. 2021a
SOFNN (Han et al. 2018VH VH VH 
IMCDR (Elsahwi et al. 2019
LSTM (Pisa et al. 2019VH VH 
DRL (Seo et al. 2021VH VH 
LSTM PSO (Liu et al. 2021VH VH 
SVI (Khan et al. 2018
LSTM (Cheng et al. 2020VH VH 
GRU (Cheng et al. 2020
BiLSTM (Cheng et al. 2020VH VH VH 
MOPLS (Wu et al. 2019VH 
DBNFPLS (Liu et al. 2020aVH 
OFSVM (Cheng et al. 2019bVH VH 
FLSWTP (Lamas & Giacaglia 2021
DMOPSO (Han et al. 2021b
MOGA (Han et al. 2021bVH 
VRFT-CS (Han et al. 2021bVH 
AMODCS (Han et al. 2021bVH 
NSGAOC (Han et al. 2021bVH VH VG 
WTNPR (Kuroki et al. 2020VH 
EMSMDN (Wang et al. 2020VH VH 
CoFNN (Han et al. 2021cVH VH 
EM (Saetta et al. 2019
DDIAC (Wang et al. 2021VH VH 
SEL (Liu et al. 2020bVH VH 
CTAR (Zeb et al. 2020VH 
DPBR (Xiang et al. 2019VH VH 
DDSS (Harrou et al. 2021VH VH 
FFAC (Chistiakova et al. 2020VH 
MethodQSLCTDC
IPNG (Zhou et al. 2020VH 
SBR (Mehralian et al. 2020
MBNA (Cheriyamundath & Vavilala 2021VH VH VH 
CN (Cheriyamundath & Vavilala 2021VH VH 
NM (Cheriyamundath & Vavilala 2021
NP (Cheriyamundath & Vavilala 2021VH VH 
PD (Deng et al. 2020
AOPO (Deng et al. 2020
EP (Deng et al. 2020VH 
CF (Deng et al. 2020VH 
MA (Deng et al. 2020
SC (Deng et al. 2020
MSFM (Kesari et al. 2021VH 
SOFNN (Han et al. 2019VH VH VH 
SPIC (Tung et al. 2018VH VH VH 
KPCA SVM (Cheng et al. 2019a
MWH (Karlsson et al. 2019VH VH 
MEDL (Heo et al. 2021
MOPC (Han et al. 2020
TMOOA (Han et al. 2020
IOCS-FOF (Han et al. 2021a
MOAFO (Han et al. 2021a
SOFNN (Han et al. 2018VH VH VH 
IMCDR (Elsahwi et al. 2019
LSTM (Pisa et al. 2019VH VH 
DRL (Seo et al. 2021VH VH 
LSTM PSO (Liu et al. 2021VH VH 
SVI (Khan et al. 2018
LSTM (Cheng et al. 2020VH VH 
GRU (Cheng et al. 2020
BiLSTM (Cheng et al. 2020VH VH VH 
MOPLS (Wu et al. 2019VH 
DBNFPLS (Liu et al. 2020aVH 
OFSVM (Cheng et al. 2019bVH VH 
FLSWTP (Lamas & Giacaglia 2021
DMOPSO (Han et al. 2021b
MOGA (Han et al. 2021bVH 
VRFT-CS (Han et al. 2021bVH 
AMODCS (Han et al. 2021bVH 
NSGAOC (Han et al. 2021bVH VH VG 
WTNPR (Kuroki et al. 2020VH 
EMSMDN (Wang et al. 2020VH VH 
CoFNN (Han et al. 2021cVH VH 
EM (Saetta et al. 2019
DDIAC (Wang et al. 2021VH VH 
SEL (Liu et al. 2020bVH VH 
CTAR (Zeb et al. 2020VH 
DPBR (Xiang et al. 2019VH VH 
DDSS (Harrou et al. 2021VH VH 
FFAC (Chistiakova et al. 2020VH 

Based on this evaluation, it can be observed that MBNA (Cheriyamundath & Vavilala 2021), CN (Cheriyamundath & Vavilala 2021), NP (Cheriyamundath & Vavilala 2021), SOFNN (Han et al. 2019), SPIC (Tung et al. 2018), MWH (Karlsson et al. 2019), LSTM PSO (Liu et al. 2021), BiLSTM (Cheng et al. 2020), CTAR (Zeb et al. 2020), and DDSS (Harrou et al. 2021) methods have highest water treatment quality, and thus can be used for large-scale wastewater plants. Similarly, sludge levels for MBNA (Cheriyamundath & Vavilala 2021), SOFNN (Han et al. 2019), SPIC (Tung et al. 2018), MWH (Karlsson et al. 2019), SBR (Mehralian et al. 2020), and IOCS-FOF (Han et al. 2021a) are observed to be lowest, which makes them suitable for drinking water-based treatment applications. From these models the MBNA model is observed to be most effective in terms of quality and sludge levels. While in terms of computational complexity PD (Deng et al. 2020), AOPO (Deng et al. 2020), SVI (Khan et al. 2018), IMCDR (Elsahwi et al. 2019), FLSWTP (Lamas & Giacaglia 2021), and MA (Deng et al. 2020) are the most effective, MEDL (Heo et al. 2021), FLSWTP (Lamas & Giacaglia 2021), MBNA (Cheriyamundath & Vavilala 2021), SPIC (Tung et al. 2018), MWH (Karlsson et al. 2019), and NP (Cheriyamundath & Vavilala 2021) have the lowest treatment delay. This is because the later models utilize chemical reactions in order to speed-up the treatment process. In terms of deployment costs, TMOOA (Han et al. 2020), IMCDR (Elsahwi et al. 2019), EP (Deng et al. 2020), MOPC (Han et al. 2020), PD (Deng et al. 2020), AOPO (Deng et al. 2020), SC (Deng et al. 2020), and EM (Saetta et al. 2019) outperform other models; thus, are widely used for low-cost wastewater treatment. Based on this comparison, researchers can select the best model for their application, but it is difficult to identify a model with optimum quality, sludge level, complexity, delay, and cost, thus, a novel model rank (MR) is estimated for these models using Equation (1),
formula
(1)

This metric is evaluated for each model by converting the fuzzy ranges into numerical entities. Results of this evaluation are tabulated in Table 2, which will assist in identification of the most optimum models for treatment of wastewater.

Table 2

MR for each method

MethodMR
IPNG (Zhou et al. 20202.86 
SBR (Mehralian et al. 20202.67 
MBNA (Cheriyamundath & Vavilala 20212.67 
CN (Cheriyamundath & Vavilala 20212.50 
NM (Cheriyamundath & Vavilala 20212.50 
NP (Cheriyamundath & Vavilala 20212.14 
PD (Deng et al. 20202.73 
AOPO (Deng et al. 20203.85 
EP (Deng et al. 20203.57 
CF (Deng et al. 20202.31 
MA (Deng et al. 20203.57 
SC (Deng et al. 20202.86 
MSFM (Kesari et al. 20212.31 
SOFNN (Han et al. 20192.14 
SPIC (Tung et al. 20181.88 
KPCA SVM (Cheng et al. 2019a3.64 
MWH (Karlsson et al. 20193.33 
MEDL (Heo et al. 20213.00 
MOPC (Han et al. 20201.43 
TMOOA (Han et al. 20202.86 
IOCS-FOF (Han et al. 2021a2.31 
MOAFO (Han et al. 2021a2.31 
SOFNN (Han et al. 20182.14 
IMCDR (Elsahwi et al. 20192.86 
LSTM (Pisa et al. 20191.25 
DRL (Seo et al. 20212.31 
LSTM PSO (Liu et al. 20212.00 
SVI (Khan et al. 20181.33 
LSTM (Cheng et al. 20202.50 
GRU (Cheng et al. 20201.67 
BiLSTM (Cheng et al. 20201.76 
MOPLS (Wu et al. 20192.50 
DBNFPLS (Liu et al. 2020a3.13 
OFSVM (Cheng et al. 2019b2.67 
FLSWTP (Lamas & Giacaglia 20211.67 
DMOPSO (Han et al. 2021b2.22 
MOGA (Han et al. 2021b2.50 
VRFT-CS (Han et al. 2021b2.35 
AMODCS (Han et al. 2021b2.35 
NSGAOC (Han et al. 2021b3.57 
WTNPR (Kuroki et al. 20203.57 
EMSMDN (Wang et al. 20203.33 
CoFNN (Han et al. 2021c3.33 
EM (Saetta et al. 20192.86 
DDIAC (Wang et al. 20212.67 
SEL (Liu et al. 2020b3.13 
CTAR (Zeb et al. 20202.50 
DPBR (Xiang et al. 20192.94 
DDSS (Harrou et al. 20212.35 
FFAC (Chistiakova et al. 20202.22 
MethodMR
IPNG (Zhou et al. 20202.86 
SBR (Mehralian et al. 20202.67 
MBNA (Cheriyamundath & Vavilala 20212.67 
CN (Cheriyamundath & Vavilala 20212.50 
NM (Cheriyamundath & Vavilala 20212.50 
NP (Cheriyamundath & Vavilala 20212.14 
PD (Deng et al. 20202.73 
AOPO (Deng et al. 20203.85 
EP (Deng et al. 20203.57 
CF (Deng et al. 20202.31 
MA (Deng et al. 20203.57 
SC (Deng et al. 20202.86 
MSFM (Kesari et al. 20212.31 
SOFNN (Han et al. 20192.14 
SPIC (Tung et al. 20181.88 
KPCA SVM (Cheng et al. 2019a3.64 
MWH (Karlsson et al. 20193.33 
MEDL (Heo et al. 20213.00 
MOPC (Han et al. 20201.43 
TMOOA (Han et al. 20202.86 
IOCS-FOF (Han et al. 2021a2.31 
MOAFO (Han et al. 2021a2.31 
SOFNN (Han et al. 20182.14 
IMCDR (Elsahwi et al. 20192.86 
LSTM (Pisa et al. 20191.25 
DRL (Seo et al. 20212.31 
LSTM PSO (Liu et al. 20212.00 
SVI (Khan et al. 20181.33 
LSTM (Cheng et al. 20202.50 
GRU (Cheng et al. 20201.67 
BiLSTM (Cheng et al. 20201.76 
MOPLS (Wu et al. 20192.50 
DBNFPLS (Liu et al. 2020a3.13 
OFSVM (Cheng et al. 2019b2.67 
FLSWTP (Lamas & Giacaglia 20211.67 
DMOPSO (Han et al. 2021b2.22 
MOGA (Han et al. 2021b2.50 
VRFT-CS (Han et al. 2021b2.35 
AMODCS (Han et al. 2021b2.35 
NSGAOC (Han et al. 2021b3.57 
WTNPR (Kuroki et al. 20203.57 
EMSMDN (Wang et al. 20203.33 
CoFNN (Han et al. 2021c3.33 
EM (Saetta et al. 20192.86 
DDIAC (Wang et al. 20212.67 
SEL (Liu et al. 2020b3.13 
CTAR (Zeb et al. 20202.50 
DPBR (Xiang et al. 20192.94 
DDSS (Harrou et al. 20212.35 
FFAC (Chistiakova et al. 20202.22 

Higher value models are more effective than lower values models, and thus must be used for real-time wastewater treatment purposes. From this evaluation and from Figure 6, it can be observed that AOPO (Deng et al. 2020), KPCA SVM (Cheng et al. 2019a), EP (Deng et al. 2020), MA (Deng et al. 2020), NSGAOC (Han et al. 2021b), WTNPR (Kuroki et al. 2020), MWH (Karlsson et al. 2019), EMSMDN (Wang et al. 2020), and CoFNN (Han et al. 2021c) have better overall performance than other models, and must be used for efficient deployment of wastewater treatment plants.
Figure 6

Pragmatic analysis of reviewed models.

Figure 6

Pragmatic analysis of reviewed models.

Close modal

As a result of the evaluation that was conducted as part of the review, it has been determined that the water treatment processes of MBNA, CN, NP, SOFNN, SPIC, MWH, LSTM PSO, BiLSTM, CTAR, and DDSS have the highest quality, and as a consequence, they are appropriate for use in large-scale wastewater plants. This conclusion was reached due to these processes having been shown to be suitable for use. In a similar vein, it has been claimed that the levels of sludge that are observed for MBNA, SOFNN, SPIC, MWH, SBR, and IOCS-FOF are the lowest, which qualifies them for usage in treatment applications that include the treatment of drinking water. It has been found that, among these models, the MBNA model is the most effective in terms of both the quality and the levels of sludge. This conclusion was reached after it was investigated. MEDL, FLSWTP, MBNA, SPIC, MWH, and NP have the shortest treatment delay, but PD, AOPO, SVI, IMCDR, FLSWTP, and MA are the most effective in terms of computational complexity. This is because the algorithms in question are more effective than their counterparts. This is owing to the fact that later iterations use chemical techniques in order to speed-up the treatment process. Because of their superior performance in comparison to other models in terms of deployment costs, TMOOA, IMCDR, EP, MOPC, PD, AOPO, SC, and EM are often used for low-cost wastewater treatment. It is essential that models with higher values be used for the goal of real-time wastewater treatment. This is due to the fact that models with higher values have a better success rate than models with lower values. It was also shown that AOPO, KPCA SVM, EP, MA, NSGAOC, WTNPR, MWH, and EMSMDN have a better overall performance than other models, and it is imperative that these models be used for the efficient deployment of wastewater treatment plants.

To summarize, various wastewater treatment methods are compared based on their performance metrics. MR is calculated for each method and higher value of the MR denotes higher effectiveness of the model. Although an extensive review of treatment methods was carried out, it might be argued that an in-person investigation of all the treatment methods could perhaps make the results of this study more usable for industry stakeholders. Due to the heavy potential cost and manpower requirement for such an investigation, however, the authors had to decide not to go along with it. Another limitation of the study is that particular performance metric might be more important than others in specific applications. In such scenarios the formula for MR will have to be modified in order to compare the models.

From this study, it can be observed that a wide variety of computational models are available for wastewater treatment, and each of them vary in terms of different performance measures. Upon detailed analysis of these models, it was also observed that very few methods are used for core-treatment of water, and a vast majority of proposed models optimize these core-treatment methods using deep learning. Deep learning models assist in scheduling tasks for water treatment, which assists in reducing redundancies, and improving quality of resulting water purity level. This also reduces running cost, and complexity of deployment, which is highly recommended for any wastewater treatment model. Thus, MBNA (Cheriyamundath & Vavilala 2021), CN (Cheriyamundath & Vavilala 2021), NP (Cheriyamundath & Vavilala 2021), SOFNN (Han et al. 2019), SPIC (Tung et al. 2018), MWH (Karlsson et al. 2019), and LSTM PSO (Liu et al. 2021), have better water quality, than its counterparts, and thus must be used for real-time processing purposes. In terms of overall efficiency, AOPO (Deng et al. 2020), KPCA SVM (Cheng et al. 2019a), EP (Deng et al. 2020), MA (Deng et al. 2020), NSGAOC (Han et al. 2021b), and WTNPR (Kuroki et al. 2020), outperform all other techniques, and must be used for designing an effective wastewater treatment plant. In future, researchers can fuse these models, and estimate their performance for drinking, and non-drinking types of water. Furthermore, ensemble deep learning models must be used to improve scheduling efficiency of the treatment plant, thereby reducing wastage, and saving running costs for small, medium and large-scale wastewater treatment scenarios.

All relevant data are included in the paper or its Supplementary Information.

The authors declare there is no conflict.

Adepu
S.
&
Mathur
A.
2021
Distributed attack detection in a water treatment plant: method and case study
.
IEEE Transactions on Dependable and Secure Computing
18
(
1
),
86
99
.
doi:10.1109/TDSC.2018.2875008
.
Cheng
T.
,
Dairi
A.
,
Harrou
F.
,
Sun
Y.
&
Leiknes
T.
2019a
Monitoring influent conditions of wastewater treatment plants by nonlinear data-based techniques
.
IEEE Access
7
,
108827
108837
.
doi:10.1109/ACCESS.2019.2933616
.
Cheng
H.
,
Liu
Y.
,
Huang
D.
&
Liu
B.
2019b
Optimized forecast components-SVM-based fault diagnosis with applications for wastewater treatment
.
IEEE Access
7
,
128534
128543
.
doi:10.1109/ACCESS.2019.2939289
.
Cheng
T.
,
Harrou
F.
,
Kadri
F.
,
Sun
Y.
&
Leiknes
T.
2020
Forecasting of wastewater treatment plant Key features using deep learning-based models: a case study
.
IEEE Access
8
,
184475
184485
.
doi:10.1109/ACCESS.2020.3030820
.
Cheriyamundath
S.
&
Vavilala
S. L.
2021
Nanotechnology-based wastewater treatment
.
Water and Environment Journal
35
,
123
132
.
https://doi.org/10.1111/wej.12610
.
Chistiakova
T.
,
Wigren
T.
&
Carlsson
B.
2020
Combined L₂ stable feedback and feedforward aeration control in a wastewater treatment plant
.
IEEE Transactions on Control Systems Technology
28
,
1017
1024
.
doi:10.1109/TCST.2019.2891410
.
Choudri
B. S.
,
Al-Awadhi
T.
,
Charabi
Y.
&
Al-Nasiri
N.
2020
Wastewater treatment, reuse, and disposal-associated effects on environment and health
.
Water Environment Research
92
,
1595
1602
.
https://doi.org/10.1002/wer.1406
.
Comber
S.
,
Gardner
M.
&
Ellor
B.
2019
Seasonal variation of contaminant concentrations in wastewater treatment works effluents and river waters
.
Environmental Technology
41
,
36
.
doi:10.1080/09593330.2019.1579872
.
Deng
D.
,
Lamssali
M.
,
Aryal
N.
,
Ofori-Boadu
A.
,
Jha
M. K.
&
Samuel
R. E.
2020
Textiles wastewater treatment technology: a review
.
Water Environment Research
92
,
1805
1810
.
https://doi.org/10.1002/wer.1437
.
dos Santos Silva
F. J.
,
Catunda
S. Y. C.
,
Dorea
C. E. T.
,
van Haandel
A. C.
&
Santos
H. R. d.
2019
Oxygen uptake rate measurement using Kalman filter and PWM control in activated sludge systems
.
IEEE Transactions on Instrumentation and Measurement
68
(
11
),
4493
4501
.
doi:10.1109/TIM.2018.2886941
.
Elnakar
H.
&
Buchanan
I.
2020
Treatment of bypass wastewater using potassium ferrate(VI): assessing the role of mixing
.
Environmental Technology
41
(
25
),
3354
3362
.
doi:10.1080/09593330.2019.1609589
.
Elsahwi
E. S.
,
Hopp
C. E.
,
Dawson
F. P.
,
Ruda
H. E.
&
Kirk
D. W.
2018
Principles and economic considerations of electrochemical treatment of Cyanide-Laden wastewater
. In
2018 IEEE Industry Applications Society Annual Meeting (IAS)
. pp.
1
8
.
doi:10.1109/IAS.2018.8544483
.
Elsahwi
E. S.
,
Ruda
H. E.
&
Dawson
F. P.
2019
Principles and design of an integrated magnetics structure for electrochemical applications
. In
2019 IEEE Industry Applications Society Annual Meeting
. pp.
1
7
.
doi:10.1109/IAS.2019.8912018
.
Han
H.
,
Zhang
L.
&
Qiao
J.
2018
Data-based predictive control for wastewater treatment process
.
IEEE Access
6
,
1498
1512
.
doi:10.1109/ACCESS.2017.2779175
.
Han
H.
,
Wu
X.
&
Qiao
J.
2019
A self-organizing sliding-mode controller for wastewater treatment processes
.
IEEE Transactions on Control Systems Technology
27
(
4
),
1480
1491
.
doi:10.1109/TCST.2018.2836358
.
Han
H.
,
Liu
Z.
,
Hou
Y.
&
Qiao
J.
2020
Data-driven multiobjective predictive control for wastewater treatment process
.
IEEE Transactions on Industrial Informatics
16
(
4
),
2767
2775
.
doi:10.1109/TII.2019.2940663
.
Han
H.
,
Zhang
L.
,
Liu
H.-X.
,
Yang
C.
&
Qiao
J.
2021a
Intelligent optimal control system with flexible objective functions and its applications in wastewater treatment process
.
IEEE Transactions on Systems, Man, and Cybernetics: Systems
51
(
6
),
3464
3476
.
doi:10.1109/TSMC.2019.2927631
.
Han
H. G.
,
Liu
Z.
,
Lu
W.
,
Hou
Y.
&
Qiao
J. F.
2021b
Dynamic MOPSO-based optimal control for wastewater treatment process
.
IEEE Transactions on Cybernetics
51
(
5
),
2518
2528
.
doi:10.1109/TCYB.2019.2925534
.
Han
H.
,
Liu
H.
,
Li
J.
&
Qiao
J.
2021c
Cooperative fuzzy-neural control for wastewater treatment process
.
IEEE Transactions on Industrial Informatics
17
(
9
),
5971
5981
.
doi:10.1109/TII.2020.3034335
.
Harrou
F.
,
Cheng
T.
,
Sun
Y.
,
Leiknes
T.
&
Ghaffour
N.
2021
A data-driven soft sensor to forecast energy consumption in wastewater treatment plants: a case study
.
IEEE Sensors Journal
21
(
4
),
4908
4917
.
doi:10.1109/JSEN.2020.3030584
.
Heo
S.
,
Nam
K.
,
Loy-Benitez
J.
&
Yoo
C.
2021
Data-driven hybrid model for forecasting wastewater influent loads based on multimodal and ensemble deep learning
.
IEEE Transactions on Industrial Informatics
17
(
10
),
6925
6934
.
doi:10.1109/TII.2020.3039272
.
Iratni
A.
&
Chang
N.
2019
Advances in control technologies for wastewater treatment processes: status, challenges, and perspectives
.
IEEE/CAA Journal of Automatica Sinica
6
(
2
),
337
363
.
doi:10.1109/JAS.2019.1911372
.
Jacobs
D.
,
McDaniel
T.
,
Varsani
A.
,
Halden
R. U.
,
Forrest
S.
&
Lee
H.
2021
Wastewater monitoring raises privacy and ethical considerations
.
IEEE Transactions on Technology and Society
2
(
3
),
116
121
.
doi:10.1109/TTS.2021.3073886
.
Karlsson
M.
,
Carlsson
H.
,
Idebro
M.
&
Eek
C.
2019
Microwave heating as a method to improve sanitation of sewage sludge in wastewater plants
.
IEEE Access
7
,
142308
142316
.
doi:10.1109/ACCESS.2019.2944210
.
Kesari
K. K.
,
Soni
R.
,
Jamal
Q. M. S.
,
Tripathi
P.
,
Lal
J. A.
,
Jha
N. K.
,
Siddiqui
M. H.
,
Kumar
P.
,
Tripathi
V.
&
Ruokolainen
J.
2021
Wastewater treatment and reuse: a review of its applications and health implications
.
Water, Air, & Soil Pollution
232
,
208
.
https://doi.org/10.1007/s11270-021-05154-8
.
Kuroki
T.
,
Nomura
S.
,
Yamasaki
H.
&
Okubo
M.
2020
Performance of a wet-type nonthermal plasma reactor for NOx, SOx, and wastewater treatment
.
IEEE Transactions on Industry Applications
56
(
6
),
6978
6982
.
doi:10.1109/TIA.2020.3019229
.
Lamas
W.
&
Giacaglia
G.
2021
Fuzzy logic application in multi-period performance analysis of a SWTP
.
IEEE Latin America Transactions
19
(
3
),
500
506
.
doi:10.1109/TLA.2021.9447700
.
Liu
H.
,
Zhang
H.
,
Zhang
Y.
,
Zhang
F.
&
Huang
M.
2020a
Modeling of wastewater treatment processes using dynamic Bayesian networks based on fuzzy PLS
.
IEEE Access
8
,
92129
92140
.
doi:10.1109/ACCESS.2020.2995068
.
Liu
H.
,
Xin
C.
,
Zhang
H.
,
Zhang
F.
&
Huang
M.
2020b
Effluent quality prediction of papermaking wastewater treatment processes using stacking ensemble learning
.
IEEE Access
8
,
180844
180854
.
doi:10.1109/ACCESS.2020.3028683
.
Malisa
R.
,
Schwella
E.
&
Batinge
B.
2019
Augmenting water supplies through urban wastewater recycling (March 2019)
.
IEEE Systems Journal
,
1
8
.
doi:10.1109/JSYST.2019.2921246
.
Mehralian
M.
,
Gholamrezapour
E.
,
Fatahi
H.
,
Izadian
M.
&
Khashij
M.
2020
Investigating the quantitative and qualitative status of effluent in the wastewater treatment plant in Iran central iron ore
.
Environmental Quality Management
29
.
doi:10.1002/tqem.21678
.
Mokhtari
H. A.
,
Bagheri
M.
,
Mirbagheri
S. A.
&
Akbari
A.
2020
Performance evaluation and modelling of an integrated municipal wastewater treatment system using neural networks
.
Water and Environment Journal
34
,
622
634
.
https://doi.org/10.1111/wej.12565
.
Pisa
I.
,
Santín
I.
,
Morell
A.
,
Vicario
J. L.
&
Vilanova
R.
2019
LSTM-based wastewater treatment plants operation strategies for effluent quality improvement
.
IEEE Access
7
,
159773
159786
.
doi:10.1109/ACCESS.2019.2950852
.
Saetta
D.
,
Padda
A.
,
Li
X.
,
Leyva
C.
,
Mirchandani
P. B.
,
Boscovic
D.
&
Boyer
T. H.
2019
Water and wastewater building CPS: creation of cyber-physical wastewater collection system centered on urine diversion
.
IEEE Access
7
,
182477
182488
.
doi:10.1109/ACCESS.2019.2959992
.
Seo
G.
,
Yoon
S.
,
Kim
M.
,
Mun
C.
&
Hwang
E.
2021
Deep reinforcement learning-based smart joint control scheme for on/off pumping systems in wastewater treatment plants
.
IEEE Access
9
,
95360
95371
.
doi:10.1109/ACCESS.2021.3094466
.
Thiyagarajan
K.
,
Kodagoda
S.
,
Van Nguyen
L.
&
Ranasinghe
R.
2018
Sensor failure detection and faulty data accommodation approach for instrumented wastewater infrastructures
.
IEEE Access
6
,
56562
56574
.
doi:10.1109/ACCESS.2018.2872506
.
Tung
L. M.
,
Huong
P. T. L.
,
Phan
V. N.
,
Thanh Huy
L.
,
Khanh Vinh
L.
,
Quang Hoa
N.
,
Thanh Tuan
H.
,
Hoai Nam
M.
&
Le
A.-T.
2018
Superparamagnetic iron oxide@carbon core–shell nanoparticles as advanced adsorbent for efficient removal of As(V) ions from wastewater
.
IEEE Transactions on Magnetics
54
(
6
),
1
6
.
Art no. 2900206. doi:10.1109/TMAG.2018.2822318
.
Wang
J.
,
Wan
K.
,
Gao
Xu.
,
Cheng
X.
,
Shen
Y.
,
Wen
Z.
,
Tariq
U.
&
Piran
M. J.
2020
Energy and materials-saving management via deep learning for wastewater treatment plants
.
IEEE Access
8
,
191694
191705
.
doi:10.1109/ACCESS.2020.3032531
.
Wang
D.
,
Ha
M.
&
Qiao
J.
2021
Data-driven iterative adaptive critic control toward an urban wastewater treatment plant
.
IEEE Transactions on Industrial Electronics
68
(
8
),
7362
7369
.
doi:10.1109/TIE.2020.3001840
.
Wu
J.
,
Cheng
H.
,
Liu
Y.
,
Liu
B.
&
Huang
D.
2019
Modeling of adaptive multi-output soft-sensors with applications in wastewater treatments
.
IEEE Access
7
,
161887
161898
.
doi:10.1109/ACCESS.2019.2950034
.
Xiang
H.-J.
,
Lei
B.
,
Yuan
X.-C.
,
Lv
Q.-A.
&
Zhang
Q.
2019
Design and simulation of new type reactor in the wastewater treatment system based on discharge plasma
.
IEEE Transactions on Plasma Science
47
(
1
),
952
957
.
doi:10.1109/TPS.2018.2870066
.
Zeb
B. S.
,
Mahmood
Q.
,
Jadoon
S.
,
Pervez
A.
,
Irshad
M.
,
Bilal
M.
&
Bhatti
Z. A.
2020
Corrigendum to ‘Combined industrial wastewater treatment in anaerobic bioreactor post-treated in constructed wetland’
.
BioMed Research International
2020
,
9
.
Article ID 6102379. https://doi.org/10.1155/2020/6102379
.
Zhou
X.
,
Guo
Y.
,
Zhao
F.
,
Shi
W.
&
Yu
G.
2020
Topology-controlled hydration of polymer network in hydrogels for solar-driven wastewater treatment
.
Advanced Materials
32
,
2007012
.
https://doi.org/10.1002/adma.202007012
.
This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (CC BY 4.0), which permits copying, adaptation and redistribution, provided the original work is properly cited (http://creativecommons.org/licenses/by/4.0/).