Nature-based solutions are increasingly used in domestic wastewater treatment, because of their potential to remove contaminants and pathogens from water (e.g., stormwater, river water, wastewater) as well as their provided co-benefits, such as mitigation of the heat island effect or enhanced biodiversity. The transition from traditional grey technologies towards nature-based solutions in domestic wastewater treatment might yield multiple benefits for local communities while enhancing biodiversity. Although some nature-based solutions such as treatment wetlands have been used for decades in domestic wastewater treatment, this is not the case for others such as green walls or roofs, which lack implementation guidelines and design criteria. Aiming to support implementation of nature-based solutions in domestic wastewater treatment, we have developed an online decision-support system for the pre-selection of the best nature-based solution to use in each socio-environmental context and adapted to the needs, as well as an estimate of the required area. Our decision-support system's recommendations are based on an expert knowledge-driven approach, building on two complementary expert knowledge elicitation workshops. We hope the developed online decision-support system will support the transition towards integrating nature-based solutions into urban water and wastewater treatment systems.

  • We lack implementation guidelines and design criteria for nature-based solutions (NBS) in water sanitation.

  • We have developed an online decision-support system to facilitate NBS implementation.

  • NBS implementation in domestic wastewater treatment will support SDG6 achievement.

Nature-based solutions (NBS) have garnered increasing interest over the past few years, including numerous associated research calls and policy initiatives. Following the definition of International Union for Conservation of Nature (IUCN), NBS (Castellar et al. 2021) are ‘actions to protect, sustainably manage and restore natural or modified ecosystems, which address societal challenges (e.g., climate change, food and water security or natural disasters) effectively and adaptively, while simultaneously providing human well-being and biodiversity benefits’ (Cohen-Shacham et al. 2016).

One of the many applications of NBS is domestic wastewater treatment, that is, the removal of contaminants and pathogens from wastewater, greywater, stormwater, and combined sewer overflow (CSO) discharge. There are many NBS that have been traditionally used for wastewater treatment, such as ponds and lagoons (P/L) or treatment wetlands (TWs). Other NBS have been applied more recently in wastewater treatment, such as green roofs (GRs) or green walls (GWs). However, the technical information on these NBS (i.e., guidelines, reports, and tools) on practical application, such as area requirements, energy demand, and skills needed, is scattered across different literature and often limited to specific country and language (e.g., national guidelines) (Cohen-Shacham et al. 2019). Furthermore, most studies do not consistently report the data (e.g., used area, treated wastewater flow, and pollutant concentrations) to understand the efficiency and/or applicability of the different NBS. This fragmentation poses a significant hurdle for making informed decisions when selecting the appropriate NBS for specific water/wastewater treatment needs, considering factors like area constraints, energy requirements, and necessary expertise. Addressing this limitation is vital for ensuring the optimal choice of NBS tailored to distinct wastewater treatment demands and contextual constraints (Langergraber 2013; Raymond et al. 2017; United Nations Environmental Programme 2020; Mayor et al. 2021).

Given this background, and with the overall aim of facilitating the implementation of NBS in domestic wastewater treatment, we have developed an expert knowledge-based online decision-support system (DSS) for the selection of the most adequate NBS to use in each socio-environmental context and needs, and an estimate of the required area. The DSS also provides a qualitative assessment of the environmental and socio-economic benefits provided by each NBS. The knowledge backing the tool was gathered in a series of elicitation workshops and was later validated against data from scientific publications. The DSS is envisioned as a tool to pre-select the most appropriate NBS to use in each case and does require a posterior study to accurately design the selected NBS.

The development of the DSS follows the traditional seven steps process for eliciting views and judgements in decision-making (Poch et al. 2004; Mukherjee et al. 2018): (i) gathering baseline information, (ii) problem definition, (iii) identification of options, (iv) selection of options, (v) generating consensus, (vi) implementation, and (vii) evaluation. Steps (i)–(iv) are the focus of the DSS developed to date, and the remaining steps (from v to vii) are to be elaborated through ongoing projects (e.g., the Horizon 2020 MULTISOURCE project). Note that Section 2.1 deals with everything related to the elicitation workshops, Section 2.3 deals with the compilation of the gathered expert knowledge into a decision-making list, Section 2.3 deals with the literature review to compile scientific evidence to validate the gathered expert knowledge in the elicitation workshops, and Section 2.4 deals with the online DSS.

Elicitation workshops

The goal of the workshops was to gather expert knowledge on the most suitable NBS to use for different socio-environmental context and needs. Specifically, our workshops intended to define the rules of a decision-making table, and therefore we needed consensus among experts to define the rules. Accordingly, we used a modified Delphi method, the IDEA protocol (Hemming et al. 2018), during our workshops in Vienna (on 11 February 2019) and Girona (on 8 November 2019), which is the recommended technique when aiming to gather consensus on complex issues from a group of experts (Mukherjee et al. 2015). The participants attending the workshop were those participating in the NCEAS-SNAPP project (see the Acknowledgements section for details), gathering 42 international experts on NBS. These experts are either co-authors of this study or are listed in the Acknowledgements section and covered the expertise associated with the considered NBS. Furthermore, these experts also covered a wide range of socio-environmental conditions, as there were experts from India, the United States, Brazil, or Italy among others.

During the workshops, participants were firstly asked to list the most common types of NBS for domestic wastewater treatment purposes as well as their respective sub-types (Table 1). Specifically, participants agreed on nine major types of NBS in our DSS as well as its associated 26 sub-types, which are either different varieties of a given NBS (e.g., anaerobic P/L) or typical combinations of different NBS (e.g., horizontal flow TW followed by a maturation pond) (Table 1). Secondly, participants were asked to list the types of wastewaters to be treated, the main treatment targets, common climate categories, and categories of co-benefits. After these preliminary questions to define the decision-making table, participants were asked to answer a series of questions for each NBS under consideration. We then discussed the general capacity of each NBS for the treatment of different types of domestic wastewater (raw domestic wastewater, pre-treated domestic wastewater, secondary treated wastewater, CSO, greywater, and river diluted wastewater) along with the main targeted pollutants (organic matter, ammonium (), nitrate (), and ortho-phosphate ()) for removal. The possible categorical answers for this question were active, inactive, and possible (the latter is a feasible option but would not be recommended since it is not the ideal solution). The next step was to identify the spatial scale at which an NBS might be installed, mainly at the household/building or at the community scale (i.e., a conventional centralised wastewater treatment plant). The possible categorical answers for this question were active and inactive. Subsequently, we discussed the required surface per each NBS to treat one population equivalent under the following climates: tropical/megathermal, dry (desert and semi-arid), temperate/mesothermal, and continental/microthermal. In contrast with other variables in the workshop, participants defined a numerical value of a continuous variable (required surface to treat a population equivalent). In terms of technical requirements, we discussed whether the considered NBS requires external energy, and the possible answer for this question was either yes or no. Then, we also discussed the labour and skill requirements for each NBS as well as the associated biohazard level, and defined them as low (L), medium (M), or high (H). Finally, we discussed the levels of each of the identified co-benefits: biodiversity (fauna), biodiversity (flora), temperature regulation, flood mitigation, storm peak mitigation, carbon sequestration, biomass production, aesthetic value, recreation, pollination, food source, water reuse, and biosolid provisioning. As in the previous questions, the possible categorical answers for this question were L, M, and H.

Table 1

Considered types (in alphabetical order) and sub-types of NBS in this study

TypeSub-typeAcronym
Treatment wetlands CSO CSO_TW 
French vertical flow French_TW 
Vertical flow VSSF_TW 
Horizontal flow HSSF_TW 
Free water surface flow FWS_TW 
Intensified reactive media IRM_TW 
Intensified aeration (aerated) IA_TW 
Intensified recirculation (reciprocating) IR_TW 
Green roof  GR 
Green wall  GW 
Hydroponics/aquaponics Aquaponics A_HA 
Hydroponics H_HA 
In-stream retention systems  I-SRS 
Natural wetlands  NW 
Ponds/lagoons Intensified aerated IA_P/L 
Anaerobic AP_P/L 
Facultative FP_P/L 
Maturation MP_P/L 
Soil infiltration systems Rapid-rate SIS_R 
Slow-rate SIS_S 
Willow systems  WS 
Multi-stage Vertical TW followed by horizontal TW VSSF + HSSF 
Horizontal TW followed by maturation P/L HSSF + MP 
Anaerobic P/L followed by facultative P/L AP + FP 
Anaerobic P/L followed by facultative P/L followed by maturation P/L AP + FP + MP 
Facultative P/L followed by maturation P/L FP + MP 
Facultative P/L followed by free water surface TW FP + FWS 
TypeSub-typeAcronym
Treatment wetlands CSO CSO_TW 
French vertical flow French_TW 
Vertical flow VSSF_TW 
Horizontal flow HSSF_TW 
Free water surface flow FWS_TW 
Intensified reactive media IRM_TW 
Intensified aeration (aerated) IA_TW 
Intensified recirculation (reciprocating) IR_TW 
Green roof  GR 
Green wall  GW 
Hydroponics/aquaponics Aquaponics A_HA 
Hydroponics H_HA 
In-stream retention systems  I-SRS 
Natural wetlands  NW 
Ponds/lagoons Intensified aerated IA_P/L 
Anaerobic AP_P/L 
Facultative FP_P/L 
Maturation MP_P/L 
Soil infiltration systems Rapid-rate SIS_R 
Slow-rate SIS_S 
Willow systems  WS 
Multi-stage Vertical TW followed by horizontal TW VSSF + HSSF 
Horizontal TW followed by maturation P/L HSSF + MP 
Anaerobic P/L followed by facultative P/L AP + FP 
Anaerobic P/L followed by facultative P/L followed by maturation P/L AP + FP + MP 
Facultative P/L followed by maturation P/L FP + MP 
Facultative P/L followed by free water surface TW FP + FWS 

Decision-making table development

The expert knowledge-driven approach allows a selection of the most suitable NBS by means of a decision-making table or list, which is made of decision rules (Sammut & Webb 2011). A decision rule is a simple IF-THEN statement consisting of a condition (also called antecedent) and a prediction. A decision list does not add any order to the decision rules. If the condition of a rule is false for instance, we discard the prediction of the rule. If not, we go to the next rule and check if it applies and so on, so the result should be only with the instances that accomplish all the rules. The decision-making table has been programmed by writing IF-THEN rules, and the knowledge to build these rules was acquired through the elicitation workshops. The collection of all these programmed rules conforms the decision-making list. Note that not all the gathered expert knowledge was used in the decision-making list. Specifically, the considered variables used as conditions in the decision-making list were capacity to treat a given type of domestic wastewater, capacity to treat a given type of pollutant, the spatial scale at which the NBS might be implemented, the requirement of external energy, and the required surface to treat a given wastewater type under a given climate. The rest of the gathered expert knowledge (i.e., co-benefits, labour and skills requirements, and associated biohazard level) was not used in the decision-making list as conditions but were used to illustrate different aspects of the NBS to the tool users.

Review of scientific evidence

Systematic review protocol and defining search parameters

Our scientific review was carried out using a defined systematic approach that answers research questions based on the published evidence, which is gathered using a predefined protocol that was adapted from ‘Guidelines for Systematic Review in Conservation and Environmental Management’ from the Centre for Evidence-Based Conservation (CEBC) (Pullin & Stewart 2006; Pautasso 2013). The protocol comprised the following: (i) defining search parameters (databases to be searched, search times, types of publications), (ii) selecting search terms, (iii) developing eligibility (inclusion/exclusion) criteria, (iv) conducting the literature search, and (v) carrying out the article review and selection process to produce the database and bibliographic analysis. Scientific studies on the use of NBS in the domestic wastewater system were identified using the Web of Science database. The search was performed on 1 September 2023 for studies published in any year. Results were limited to articles published and those in press, and search terms were selected to ensure that all potentially relevant studies were found. Nine separate searches were run, one for each type of NBS. To cover all relevant research, the search terms included keywords referring to the different types of wastewaters, the class of each type of NBS, and all relevant synonyms for each specific solution (Table 2). Finally, the eligibility criteria were defined as follows: (i) full text must be available; (ii) the article must be written in English; (iii) laboratory case studies are excluded, only full-scale or pilot-scale studies are included; (iv) reviews are excluded; and (v) articles must include information on at least three of the selected variables characterising NBS.

Table 2

Used terms for the literature review at Web of Science last on 1 September 2023

NBSSearch terms
Treatment wetlands (“constructed wetland*” OR “treatment wetland*” OR “reed bed*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water” OR “CSO” OR “combined-sewer overflow” OR “combined sewer overflow*”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Green roofs (“green roof*” OR “green-roof*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water” OR “CSO” OR “combined-sewer overflow” OR “combined sewer overflow”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Green walls (“green wall*” OR “green-wall*” OR “living wall*” OR “vertical garden*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Hydroponic/Aquaponic (Hydroponic* OR Aquaponic*) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
In-stream retention (“hydraulic retention structure” OR “river restoration” OR “river rehabilitation” OR “stream restoration” OR “stream rehabilitation”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Natural wetlands “natural wetland” AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Ponds/Lagoons (pond* OR lagoon*) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Soil infiltration systems (“Soil-infiltration system*” OR “infiltration trenche*” OR “infiltration trench*” OR “infiltration basin*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Willow systems (“Willow system*” OR Willow-system* OR “Evaporation system*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
NBSSearch terms
Treatment wetlands (“constructed wetland*” OR “treatment wetland*” OR “reed bed*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water” OR “CSO” OR “combined-sewer overflow” OR “combined sewer overflow*”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Green roofs (“green roof*” OR “green-roof*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water” OR “CSO” OR “combined-sewer overflow” OR “combined sewer overflow”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Green walls (“green wall*” OR “green-wall*” OR “living wall*” OR “vertical garden*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Hydroponic/Aquaponic (Hydroponic* OR Aquaponic*) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
In-stream retention (“hydraulic retention structure” OR “river restoration” OR “river rehabilitation” OR “stream restoration” OR “stream rehabilitation”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Natural wetlands “natural wetland” AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Ponds/Lagoons (pond* OR lagoon*) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Soil infiltration systems (“Soil-infiltration system*” OR “infiltration trenche*” OR “infiltration trench*” OR “infiltration basin*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 
Willow systems (“Willow system*” OR Willow-system* OR “Evaporation system*”) AND (waste-water OR wastewater OR “waste water” OR grey-water OR greywater OR “grey water” OR gray-water OR graywater OR “gray water”) NOT (lab* OR pilot* OR agriculture OR dairy OR industry) 

Article review and selection

Once the literature searches were conducted and all potentially relevant articles were identified, we selected articles for inclusion in the final database if they met the eligibility criteria (see Section 2.2.1). To validate consistent choices in this initial filter, 30% of the articles were reviewed (title and abstract) by two researchers. Each article finally selected and reviewed could include one or more valid case studies, each one representing a different entry in the database. During the abstract review, additional fields were added by the reviewers to the spreadsheet for each case study (Figure 1), which were organised into six domains, namely, removal efficiencies, water sources/type, sustainability indicators, co-benefits, element of the urban wastewater system, and design and operational settings. These additional fields were filled in by reading the abstract or, if necessary, by downloading and reading the full text of the article. These additional fields, and the bibliographic information provided by Web of science database, were utilised to conduct the bibliographic analysis.

Figure 1

Data extracted from each included article, organised in six domains.

Figure 1

Data extracted from each included article, organised in six domains.

Close modal

Data mining and curating

In order to fill gaps in the database, we assume the following: (i) if biological oxygen demand (BOD) concentration in the NBS influent stream was not available, we assumed that BOD (in mg L−1) was 350 in domestic water (Henze & Comeau 2008), 250 in grey water (Henze & Comeau 2008), 244 in pre-treated wastewater (Ekama 2012), 25 in treated wastewater (Council of the European Communities 1991), 108 in water collected in urban drainage systems (Botturi et al. 2021), two in river water, and 50 in mixtures of domestic, industrial, and rain waters; (ii) if total nitrogen (TN) concentration was not available, we assumed that TN (in mg L−1) was 19 in grey water (Henze & Comeau 2008), 60 in domestic water (Henze & Comeau 2008), 50 in pre-treated wastewater (Ekama 2012), 15 in treated wastewater (Council of the European Communities 1991), 9.7 in water collected in urban drainage systems (Botturi et al. 2021), two in river water, and five in mixtures of domestic, industrial, and rain waters; (iii) if there was no inflow data, we estimated inflow (in m3 day−1) from the served population, by assuming that each citizen generated 120 L day−1; and (iv) if there was no mean annual water temperature, we used the reported mean annual air temperature, and if there was neither water nor air temperature in the publication, we used the location of the NBS to estimate mean annual air temperature using the Weatherbase server (https://www.weatherbase.com/).

Data analysis

Incoming and outgoing loads of each one of the considered water quality variables (, , TN, , TP, BOD, Escherichia coli, and Helminth eggs) were calculated as the product of flow per concentration. Then, we analysed the relationship between the differences between incoming (Li) and outgoing (Lo) loads and the surface used (m2). Furthermore, to assess the reliability of the removal capacities obtained during the workshops, we compared those values with the observed values in the literature. First, we directly compared the statistical distribution of the removal capacities for BOD5 from the workshops and from the literature review. Second, using the data from the literature review on treated population, type of water, and climate, we estimated the required surface that an NBS would require when applying the removal capacities expert values; we then compared that estimate with the reported value in the literature (observations). Note that we focused the analysis on BOD5 because it was the variable with more data observations.

Online DSS

Our online DSS (https://snapp.icra.cat) has two sections: ‘find your NBS’ and ‘NBS list’. The first section is the DSS itself, and the second contains a series of factsheets of each considered NBS. Thus, the section ‘find your NBS’ allows the identification (or selection) of the NBS suited for the needs specified by the user. The expert knowledge-based approach is structured according to the questions defined in Section 2.1. The section ‘NBS list’ contains additional information for each considered NBS as downloadable factsheets. Each factsheet provides a general description of the NBS, basic technical information on design and performance, operation and maintenance, description of co-benefits, and project examples. These factsheets were developed by approximately the same group of experts who participated in the deliberative workshops and have been recently published with associated case studies (Cross et al. 2021).

The coding of the online DSS is structured as a front-end and a back-office. The front-end is the webpage that allows interaction with all previously described sections and data. The front-end was developed using HTML/JavaScript with Vue.js framework to provide interactivity to the site.

Expert knowledge-driven approach

The knowledge gathered in the elicitation workshops (Vienna and Girona in 2019) allowed the construction of the decision table (Tables 3 and 4). Such tables are the basis for the logics of the DSS that enables the selection of adequate NBS for domestic wastewater treatment. The columns represent the different filters applied to each NBS concerning its capacity to remove different types of pollutants (organic matter, , , ) and to treat different types of wastewater (raw domestic wastewater, pre-treated domestic wastewater, secondary treated wastewater, CSO discharge, greywater, and river diluted wastewater), system scale (single household or not), treatment capacity (surface required per population equivalent ratios for different climatic conditions), and energy requirements.

Table 3

Knowledge base compiled during the workshops in Vienna and Girona

Treatment level target
Household solutionsType of water
Treatment capacity (m2 p.e.)
Energy
CPathogensRaw domestic WWPre-treated domestic WWGreywaterSecondary treated WWCSO discharge waterRiver diluted WWTropicalDryTemperateContinental
CSO_TW 0.3 0.3 0.3 0.3 
French_TW 0.5 0.5 
VSSF_TW 10 
HSSF_TW 
FWS_TW 10 
IRM_TW 10 
IR_TW 0.33 0.33 0.67 0.33 
GR 
GW 10 
A_H/A 1.5 106 
H_H/A 0.5 0.5 0.5 0.5 
I-SRS 0.5 0.5 0.5 0.5 
NW 0.05 0.05 0.05 0.05  
IA_P/L 10 
AP_P/L 106 
FP_P/L 106 
MP_P/L 10 106 
SIS_R 10 106 
SIS_S 0.5 0.5 0.5 0.5 
WS 0.5 0.5 0.5 0.5 
VSSF + HSSF TW 1.5 1.5 15 
HSSF_TW + MP_P/L 
AP + FP_P/L 10 106 
AP + FP + MP_P/L 106 
Treatment level target
Household solutionsType of water
Treatment capacity (m2 p.e.)
Energy
CPathogensRaw domestic WWPre-treated domestic WWGreywaterSecondary treated WWCSO discharge waterRiver diluted WWTropicalDryTemperateContinental
CSO_TW 0.3 0.3 0.3 0.3 
French_TW 0.5 0.5 
VSSF_TW 10 
HSSF_TW 
FWS_TW 10 
IRM_TW 10 
IR_TW 0.33 0.33 0.67 0.33 
GR 
GW 10 
A_H/A 1.5 106 
H_H/A 0.5 0.5 0.5 0.5 
I-SRS 0.5 0.5 0.5 0.5 
NW 0.05 0.05 0.05 0.05  
IA_P/L 10 
AP_P/L 106 
FP_P/L 106 
MP_P/L 10 106 
SIS_R 10 106 
SIS_S 0.5 0.5 0.5 0.5 
WS 0.5 0.5 0.5 0.5 
VSSF + HSSF TW 1.5 1.5 15 
HSSF_TW + MP_P/L 
AP + FP_P/L 10 106 
AP + FP + MP_P/L 106 

Note: A stands for active, I for inactive, P for possible, 0 for none, L for low, M for medium, and H for high. The treatment capacities for the Continental climate indicating 1,000,000 mean that the considered NBS is not suitable to remove organic matter from wastewater, as it would require a far too large surface.

Table 4

Knowledge base compiled during the workshops in Vienna and Girona

Co-benefits
Technical requirements
Biodiversity (fauna)Biodiversity (flora)Temperature regulationFlood mitigationStorm peak mitigationCarbon sequestrationBiomass provisioningAesthetic valueRecreationPollinationFood provisioningWater reuseBiosolids provisioningManpowerSkillsBiohazard
CSO_TW 
French_TW 
VSSF_TW 
HSSF_TW 
FWS_TW 
IRM_TW 
IR_TW 
GR 
GW 
A_H/A 
H_H/A 
I-SRS 
NW 
IA_P/L 
AP_P/L 
FP_P/L 
MP_P/L 
SIS_R 
SIS_S 
WS 
VSSF + HSSF TW 
HSSF_TW + MP_P/L 
AP + FP_P/L 
AP + FP + MP_P/L 
Co-benefits
Technical requirements
Biodiversity (fauna)Biodiversity (flora)Temperature regulationFlood mitigationStorm peak mitigationCarbon sequestrationBiomass provisioningAesthetic valueRecreationPollinationFood provisioningWater reuseBiosolids provisioningManpowerSkillsBiohazard
CSO_TW 
French_TW 
VSSF_TW 
HSSF_TW 
FWS_TW 
IRM_TW 
IR_TW 
GR 
GW 
A_H/A 
H_H/A 
I-SRS 
NW 
IA_P/L 
AP_P/L 
FP_P/L 
MP_P/L 
SIS_R 
SIS_S 
WS 
VSSF + HSSF TW 
HSSF_TW + MP_P/L 
AP + FP_P/L 
AP + FP + MP_P/L 

Note: A stands for active, I for inactive, P for possible, 0 for none, L for low, M for medium, and H for high.

According to the gathered knowledge, all NBS except the in-stream retention systems were active at removing organic matter. Meanwhile, the majority of NBS were found to be more effective in removing nitrogen than phosphorus since the removal , , and was considered active in, respectively, 80.7, 53.8, and 15.3% of all NBS. Finally, the majority of NBS were active at removing pathogens (92.3%) (Table 3). There were differences between the considered NBS regarding the treatment capacity, with values ranging from 0.05 to 10 m2 per population equivalent (p.e.), which is linked with the specific functioning of the technology and the targeted treatment. The treatment capacity for each NBS also showed differences between the four considered climates, with coefficients of variation ranging from 0 to ca. 125%. Furthermore, there were seven NBS considered inactive in continental climate, thus highlighting the limitations of mainly P/L in that climate type. In fact, treatment capacities were generally much lower in the continental climate, whereas the higher treatment capacities were in tropical and dry climates, mostly due to the temperature effect (Lombard-Latune et al. 2018; Trein et al. 2020). The overall differences between NBS are likely grounded, but the differences between climates for each NBS treatment capacity are likely caused by both knowledge and ignorance. In other words, the expert knowledge is certainly higher for those NBS that have been used for decades (e.g., TW and P/L) with respect to those of a relatively recent appearance (e.g., GW and GR). Regarding the type of water, only six NBS were considered active (and one possible) for raw wastewater, mainly P/L, as well as the French TW (Table 3).

Among the other results of the elicitation workshops, the most interesting are those on co-benefits, as there is limited evidence from empirical studies on NBS co-benefits (Figure 2) (Table 4). On the one hand, most NBS are either inactive or low in most co-benefits, except for the water reuse and the aesthetic value. On the other hand, the NBS with a higher number of high contributions were natural wetlands (10 co-benefits with H), followed by TW free-water surface flow, GRs, GWs, and in-stream retention structures (five co-benefits with H). We believe that this is certainly a novel piece of information that might help decision-makers in the process of selecting a certain NBS for a given socio-environmental framework.

Figure 2

Contributions of the NBS to the considered co-benefits according to the knowledge base compiled during the workshops in Vienna and Girona.

Figure 2

Contributions of the NBS to the considered co-benefits according to the knowledge base compiled during the workshops in Vienna and Girona.

Close modal

Validation against scientific evidence

Our bibliographic analysis originates from the database of case studies created by means of the systematic review of scientific publications and summarises the state of global research on NBS for domestic wastewater treatment until 1 September 2023. Even following strict exclusion criteria, the systematic review identified many peer-reviewed publications on the usage of NBS for wastewater treatment (Table 5). In this table, the initial number of articles returned by our searches is shown, as well as the number of articles excluded during the title and abstract filters. The search for publications returned 7,527 publications that were considered appropriate according to the systematic review protocol. Of these, only 327 publications were used for further analysis after applying the eligibility criteria. The dramatic difference between the publications identified and those considered valid was mainly due to the type of data commonly reported. Transparency in data reporting or a more systematic reporting style would have ensured a much higher number of valid case studies, thus facilitating the analysis we performed, as well as other meta-analysis or review-type manuscripts on NBS performance. Another aspect associated with the valid studies is the reported data, as few studies reported all the data related with their study and the data curation process (described in Section 2.3.3) involved filling a relatively high number of gaps. Specifically, the percentage of case studies with filled data gaps during the curation process was 2.55% for BOD and 2.95% for TN. Overall, the take-home message of this review is to encourage authors to systematically report their data. Specifically, we encourage authors to report as much data as possible, as this would allow other authors to perform meta-analysis. A likely list of variables to report is included in Figure 1, but one might say that the crucial ones would be BOD5 concentration and influent flowrate, BOD5 concentration at the effluent, used surface, configuration of the NBS, and hydraulic residence time. Moreover, we believe it is crucial to foster more research on some emerging NBS such as GRs, GWs, or willow systems. Otherwise, our capacity to properly scale NBS to given needs will remain weak.

Table 5

Results of the literature review, with the articles returned from the nine independent searches in Web of Science database, and the valid case studies

NBS AcronymArticles returned from searchValid case studies
 Total TW = 3,994  
French_TW  
VSSF_TW  89 
HSSF_TW  201 
FWS_TW  28 
IRM_TW  
IA_TW  
IR_TW  
VSSF + HSSF_TW  11 
HSSF_TW + MP_P/L  
GR 92 10 
GW 45 
 Total H/A = 81  
A_H/A  
H_H/A  25 
I-SRS 62 15 
NW 76 19 
 Total P/L = 3,510  
IA_P/L  
AP_P/L  18 
FP_P/L  46 
MP_P/L  31 
AP + FP_P/L  11 
AP + FP + MP_P/L  13 
FP + MP_P/L  19 
FP_P/L + FWS_TW  
 Total SIS = 98  
SIS_R  
SIS_S  15 
WS 50 
NBS AcronymArticles returned from searchValid case studies
 Total TW = 3,994  
French_TW  
VSSF_TW  89 
HSSF_TW  201 
FWS_TW  28 
IRM_TW  
IA_TW  
IR_TW  
VSSF + HSSF_TW  11 
HSSF_TW + MP_P/L  
GR 92 10 
GW 45 
 Total H/A = 81  
A_H/A  
H_H/A  25 
I-SRS 62 15 
NW 76 19 
 Total P/L = 3,510  
IA_P/L  
AP_P/L  18 
FP_P/L  46 
MP_P/L  31 
AP + FP_P/L  11 
AP + FP + MP_P/L  13 
FP + MP_P/L  19 
FP_P/L + FWS_TW  
 Total SIS = 98  
SIS_R  
SIS_S  15 
WS 50 

The mean removal efficiencies and the standard deviations of some of the considered pollutants (BOD5 and TP) are shown in Figure 3. Overall, there are differences among pollutants and NBS, although perhaps the only remarkable difference is the relatively lower removal efficiency of BOD of both GW and soil infiltration systems (SIS). Another remarkable aspect is the higher variability within each NBS of the removal efficiencies of TP with respect to those of BOD. This indicates that the different sub-types of NBS within each type show larger variability in TP removal than in BOD removal (Metcalf & Eddy et al. 2003). The relationships between the independent variable surface and load removal of the considered pollutants are shown in Figure 4. The patterns are shown in a log10 scale, so that the large variability in some of the considered NBS is easily visualised. For some compounds (i.e., BOD, COD, NH4, and TN), a linear pattern emerges, indicating that the relationship between surface and removal capacity is not linear (r2 = 0.05, N = 265) but rather follows a power relationship (r2 = 0.72, N = 265). This implies that the treatment capacity decreases at increasing surface. Another remarkable aspect of the observed pattern is that some NBS are used for rather low load removal requirements (e.g., GW and GR), whereas others are used for rather high load removal requirements (e.g., P/L). In the case of GW and GR, this is explained by the type of wastewater treated, namely, greywater (Boano et al. 2020).

Figure 3

Removal efficiencies (mean ± standard deviation) of some of the considered pollutants and for each considered NBS type.

Figure 3

Removal efficiencies (mean ± standard deviation) of some of the considered pollutants and for each considered NBS type.

Close modal
Figure 4

Scatter plots of NBS surface (x-axis) against the pollutants load removal (y-axis), both expressed in logarithmic scale, and in different colours depending on the considered NBS.

Figure 4

Scatter plots of NBS surface (x-axis) against the pollutants load removal (y-axis), both expressed in logarithmic scale, and in different colours depending on the considered NBS.

Close modal

The comparison between the expert knowledge and the data-driven approaches was done by comparing the removal capacities defined by the experts and obtained from the literature review (Figures 5 and 6). Rather than performing the assessment with all considered pollutants, we focused the comparison on only the removal of organic matter load (as BOD5), as the number of observations in the database is higher than for other pollutants. In Figure 5, we simply compare the removal efficiencies from the literature and from the experts, and we identified similar patterns, with the more spatially extensive and less efficient NBS on the left of Figure 5 (e.g., MP_P/L) and the less spatially extensive and more efficient NBS on the right of Figure 5 (e.g., IA_TW). Likewise, the estimations based on the expert criteria tended to overestimate the performance with low loads (left of Figure 6) and underestimated the performance with high loads (right of Figure 6). The median absolute error (MAE) between observed and estimated surfaces was 506.92 m2 (Q1 = 22.78, Q3 = 11,663,24). Likewise, the median relative error (MRE) was 76.1% (Q1 = 32.41%, Q3 = 99.68%). Furthermore, the NBS with the smallest MRE were WS (25.0%, n = 1) while the NBS with the highest MAE were H/A (99.3%, n = 17). Nonetheless, the MAE of H/A was 8.4 m2. The two types with more case studies were P/L with an MRE of 84.0% (MAE = 8,789 m2, n = 132) and TW with an MRE of 54% (MAE = 48 m2, n = 108). However, the variability of the removal capacities estimated from the literature among the considered NBS is much higher than the removal capacities reported by experts. Regardless of the MAE and differences in variability, there are some NBS showing larger differences between the two estimates, mainly those with HSSF_TW, which are much less efficient according to the literature. To recap, the review of scientific evidence based on scientific publications validates the expert knowledge, although the differences between scientific evidence and expert knowledge are too large for some NBS such as HSSF.

Figure 5

Comparison of the BOD5 removal capacities obtained from the elicitation workshops and the literature review.

Figure 5

Comparison of the BOD5 removal capacities obtained from the elicitation workshops and the literature review.

Close modal
Figure 6

Scatter plots of NBS surface (x-axis) against BOD load removal (y-axis), both expressed in logarithmic scale. Note that the observed values (in grey) are those reported in the literature (as in Figure 4(a)) whereas estimated values (in green) are those obtained using the expert-based removal rates.

Figure 6

Scatter plots of NBS surface (x-axis) against BOD load removal (y-axis), both expressed in logarithmic scale. Note that the observed values (in grey) are those reported in the literature (as in Figure 4(a)) whereas estimated values (in green) are those obtained using the expert-based removal rates.

Close modal

DSS for a simple NBS implementation

A great variety of online decision-support tools including diverse formats have been developed to support knowledge exchange on NBS implementation, operation, and maintenance (e.g., Naturvation and Connecting Nature) (Almassy et al. 2018; Kooijman et al. 2021; Mino et al. 2021). However, the design and implementation of NBS for domestic wastewater treatment is not addressed in detail. Many tools include a wide range of NBS (e.g., parks, community gardens, GWs, and composting) addressing different challenges and not just treatment (IUCN 2020). These are mainly focused on different purposes – NBS impact analysis (e.g., NBS Impact analysis), performance assessment (e.g., Explore and compare Edible city solutions), scenario analysis (e.g., NBS project assessment), exploring NBS features and benefits (e.g., NBS explorer, Edible map, Urban Nature Atlas, Connecting Nature Enterprise Platform), or models for assessing NBS performance (e.g., Diagnostic of your assessment needs). The NBS selection tool aims at selecting best NBS for different purposes, but regarding domestic wastewater treatment, it does not reach the level of detail of our DSS (e.g., including types and sub-types of NBS for water treatment). Some existing DSS are broadly based including enabling environment, management and financial tools, and institutional arrangements (e.g. Global Water Partnership toolbox on integrated water resource management or Sustainable sanitation and water management toolbox), while our DSS is focused on technical details and co-benefits of NBS designed for wastewater treatment, meaning it is a specific tool compatible but not competitive with existing tools. Some of the DSSs are mainly informative/descriptive but lack quantitative design information (Kalbar et al. 2015; Oertlé et al. 2019). Poseidon, an Excel-based DSS, enables identifying and comparing possible wastewater treatment techniques (nature-based or not) to accomplish with local reuse requirements, based on their removal efficiencies, costs, and additional evaluation criteria (Oertlé et al. 2019). Another example is TechSelect 1.0, a scenario-based decision-making tool that includes environmental, economic, and social aspects for the selection of most appropriate wastewater treatment technology (Kalbar et al. 2015). However, both Poseidon and TechSelect 1.0 do not provide an estimate of the required area and, most importantly, do not provide online accessibility and long-term validity of the database. Also, they do not include a qualitative assessment of co-benefits provided by each NBS.

Therefore, the DSS presented in this article, hereafter referred to as SANNAT, differs from previous ones mainly due to the following aspects:

  • It is envisioned as a tool to select the most suitable NBS to given needs, including the estimation of the required surface. As previously stressed, the tool only allows for a pre-selection of the most appropriate NBS to use in each case and does require a posterior study to accurately design the selected NBS.

  • It is specific regarding the type of technologies (only nature-based ones) and the integration of design and operational information for all NBS for domestic wastewater treatment. In this sense, the tool is launched together with a collection of factsheets and real case studies describing all NBS technologies included in the tool (Cross et al. 2021).

  • It is easily accessible, since it is simple, user-friendly, and any user can access it through any device with an Internet connection. Users do not need to be NBS experts, and it can support different stakeholders and decision-makers. However, it should be noted that the tool provides a first step in selecting an NBS and experts should be consulted when designing a system.

  • It showcases a reliable qualitative assessment in terms of potential co-benefits provided, the level of manpower and skills required, and the expected level of biohazard.

The DSS presented here (i.e., SANNAT) is a support tool for screening of the most adequate NBS for a given context, including a preliminary estimate of the area, but it does not substitute the professional assessment of an expert in NBS design. Still, the tool could be very useful for fostering the implementation of NBS for wastewater treatment all over the world, and it has been validated against scientific evidence from the literature. It includes specific information for different world climate regions. Specifically, NBS technologies for wastewater treatment can be of high relevance for providing water and wastewater treatment services in both developed and developing countries and thus help achieving SDG number 6.

This work resulted from the Science for Nature and People Partnership (SNAPP) ‘Water Sanitation & Nature’ Working Group. SNAPP is a partnership of The Nature Conservancy, Wildlife Conservation Society, and the National Center for Ecological Analysis and Synthesis at the University of California, Santa Barbara. Bernhard Pucher is part of the BOKU Doctoral School HR21 (Human River Systems in the 21st century) and their support is appreciated. Furthermore, ICRA's authors acknowledge the support from the Economy and Knowledge Department of the Catalan Government through Consolidated Research Groups (ICRA-ENV 2021 SGR 01282 and ICRA-TiA 2021 SGR 01283), the EU Horizon 2020 Research and Innovation project MULTISOURCE (101003527), as well as from the CERCA program. We acknowledge the contribution from the following participants in the meetings in Santa Barbara, Vienna, and/or Girona other than the co-authors of this manuscript: Lisa M. Andrews, Natasa Atanasova, Robert K. Bastian, Julien Brun, Florent Chazarenc, Ajith Edathoot, Clifford Fedler, Magdalena Gajewska, Ganapathy Ganeshan, Michael Gardner, Robert Gearheart, Tjasa Griessler Bulc, Irene Groot, Samuela Guida, Thomas Hetmank, Andrews Jacob, Rose Kaggwa, Nathan Karres, Ulrike Kelm, Günter Langergraber, Carolina Latorre, Andressa Vianna Mansur, Sara Mason, Paul Mayer, Ania Morvannou, Rohini Pradeep, Stefan Reuter, Mark Schildhauer, Rui Veras, Matthew Verbyla, Alex Viwat Campbell, Stephanie Wear, and Geoff Willard.

Authorship in our manuscript was based on the CRediT system (https://casrai.org/credit/) and on two manuscripts: Hunt's paper (1991 Nature, 352: 187), and Frassl et al. (2019, PLOS Computational Biology). This is an evaluation system on the individual contributions to the paper that allows determining who deserves to become an author. Before joining the team of potential co-authors, co-authors agreed upon this evaluation system, and at the finalisation of the paper reported the marks for each of the established criteria in the CRediT system. These marks were then used to determine authorship. The resulting list of authors includes 14 authors: VA, who led the tasks conceptualisation and writing; LC, who led the task data curation and participated in formal analysis; JCa, who participated in formal analysis and writing; JCo, who participated in data curation, formal analysis, investigation, and writing; KC, who led project management and participated investigation and writing; DI, who participated in data curation, formal analysis, and writing; FM, who participated in data curation, formal analysis, and writing; RM, who led funding acquisition and participated in investigation and writing; BP, who participated in data curation, formal analysis, and writing; JP-R, who participated in formal analysis and writing; AdR, who led software development and participated in formal analysis and writing; AnR, who participated in formal analysis and writing; MR, who participated in formal analysis and writing; KT, who participated in data curation, formal analysis, and writing; and LC, who led methodology and participated in conceptualisation, data curation, formal analysis, investigation, and writing.

All relevant data are included in the paper or its Supplementary Information.

The authors declare there is no conflict.

Almassy
D.
,
Pinter
L.
,
Rocha
S.
,
Naumann
S.
,
Davis
M.
,
Abhold
K.
&
Bulkeley
H.
2018
Urban Nature Atlas: A Database of Nature-Based Solutions Across 100 European Cities. Available at:
https://naturvation.eu/sites/default/files/result/files/urban_nature_atlas_a_database_of_nature-based_solutions_across_100_european_cities.pdf.
Boano
F.
,
Caruso
A.
,
Costamagna
E.
,
Ridolfi
L.
,
Fiore
S.
,
Demichelis
F.
,
Galvão
A.
,
Pisoeiro
J.
,
Rizzo
A.
&
Masi
F.
2020
A review of nature-based solutions for greywater treatment: Applications, hydraulic design, and environmental benefits
.
Science of the Total Environment
.
https://doi.org/10.1016/j.scitotenv.2019.134731
.
Botturi
A.
,
Ozbayram
E. G.
,
Tondera
K.
,
Gilbert
N. I.
,
Rouault
P.
,
Caradot
N.
,
Gutierrez
O.
,
Daneshgar
S.
,
Frison
N.
,
Akyol
Ç.
,
Foglia
A.
,
Eusebi
A. L.
&
Fatone
F.
2021
Combined sewer overflows: A critical review on best practice and innovative solutions to mitigate impacts on environment and human health
.
Critical Reviews in Environmental Science and Technology
51
,
1585
1618
.
https://doi.org/10.1080/10643389.2020.1757957
.
Castellar
J. A. C.
,
Popartan
L. A.
,
Pueyo-Ros
J.
,
Atanasova
N.
,
Langergraber
G.
,
Säumel
I.
,
Corominas
L.
,
Comas
J.
&
Acuña
V.
2021
Nature-based solutions in the urban context: Terminology, classification and scoring for urban challenges and ecosystem services
.
Science of the Total Environment
779
,
146237
.
https://doi.org/10.1016/j.scitotenv.2021.146237
.
Cohen-Shacham
E.
,
Walters
G.
,
Janzen
C.
&
Maginnis
S.
2016
Nature-Based Solutions to Address Global Societal Challenges, Nature-Based Solutions to Address Global Societal Challenges
.
IUCN
,
Gland
,
Switzerland
.
https://doi.org/10.2305/iucn.ch.2016.13.en
.
Cohen-Shacham
E.
,
Andrade
A.
,
Dalton
J.
,
Dudley
N.
,
Jones
M.
,
Kumar
C.
,
Maginnis
S.
,
Maynard
S.
,
Nelson
C. R.
,
Renaud
F. G.
,
Welling
R.
&
Walters
G.
2019
Core principles for successfully implementing and upscaling nature-based solutions
.
Environmental Science & Policy
.
https://doi.org/10.1016/j.envsci.2019.04.014
.
Council of the European Communities
1991
Directive 91/271/EEC concerning urban wastewater treatment
.
Official Journal of the European Union
135
,
40
.
Cross
K.
,
Tondera
K.
,
Rizzo
A.
,
Andrews
L.
,
Pucher
B.
,
Istenič
D.
,
Karres
N.
&
Mcdonald
R.
2021
Nature-Based Solutions for Wastewater Treatment. A Series of Factsheets and Case Studies
.
IWA Publishing, London
,
United Kingdom
.
Ekama
G. A.
,
2012
Biological nutrient removal
. In:
Treatise on Water Science
(
Wilderer
P.
, ed.).
Oxford Academic Press
, Oxford, pp.
409
528
.
Hemming
V.
,
Burgman
M. A.
,
Hanea
A. M.
,
McBride
M. F.
&
Wintle
B. C.
2018
A practical guide to structured expert elicitation using the IDEA protocol
.
Methods in Ecology and Evolution
9
,
169
180
.
https://doi.org/10.1111/2041-210X.12857
.
Henze
M.
&
Comeau
Y.
2008
Wastewater characterization
. In:
Biological Wastewater Treatment: Principles Modelling and Design
.
IWA Publishing
, pp.
33
52
.
https://doi.org/10.2166/9781780408644_001
.
IUCN
2020
Guidance for Using the IUCN Global Standard for Nature-Based Solutions. A User Friendly Framework for the Verification, Design and Scaling up of Nature-Based Solutions
, 1st edn.
IUCN
,
Gland
,
Switzerland
.
https://doi.org/10.2305/iucn.ch.2020.09.en
.
Kalbar
P.
,
Karmakar
S.
&
Asolekar
S. R.
2015
Selection of wastewater treatment alternative: Significance of choosing MADM method
.
Environmental Engineering and Management Journal
14
,
1011
1020
.
Kooijman
E. D.
,
McQuaid
S.
,
Rhodes
M. L.
,
Collier
M. J.
&
Pilla
F.
2021
Innovating with nature: From nature-based solutions to nature-based enterprises
.
Sustainability (Switzerland)
13
,
1
17
.
https://doi.org/10.3390/su13031263
.
Langergraber
G.
2013
Are constructed treatment wetlands sustainable sanitation solutions?
Water Science and Technology
67
,
2133
2140
.
https://doi.org/10.2166/wst.2013.122
.
Lombard-Latune
R.
,
Pelus
L.
,
Fina
N.
,
L'Etang
F.
,
le Guennec
B.
&
Molle
P.
2018
Resilience and reliability of compact vertical-flow treatment wetlands designed for tropical climates
.
Science of the Total Environment
642
,
208
215
.
https://doi.org/10.1016/j.scitotenv.2018.06.036
.
Mayor
B.
,
Toxopeus
H.
,
McQuaid
S.
,
Croci
E.
,
Lucchitta
B.
,
Reddy
S. E.
,
Egusquiza
A.
,
Altamirano
M. A.
,
Trumbic
T.
,
Tuerk
A.
,
García
G.
,
Feliu
E.
,
Malandrino
C.
,
Schante
J.
,
Jensen
A.
&
López Gunn
E.
2021
State of the art and latest advances in exploring business models for nature-based solutions
.
Sustainability (Switzerland)
13
,
1
21
.
https://doi.org/10.3390/su13137413
.
Metcalf, Eddy
I.
,
Burton
F. L.
,
Stensel
H. D.
&
Tchobanoglous
G.
2003
Wastewater Engineering: Treatment and Reuse
, 4th edn.
McGraw-Hill
,
Boston, MA
.
Mino
E.
,
Pueyo-Ros
J.
,
Škerjanec
M.
,
Castellar
J. A. C.
,
Viljoen
A.
,
Istenič
D.
,
Atanasova
N.
,
Bohn
K.
&
Comas
J.
2021
Tools for edible cities: A review of tools for planning and assessing edible nature-based solutions
.
Water (Switzerland)
13
,
1
17
.
https://doi.org/10.3390/w13172366
.
Mukherjee
N.
,
Hugé
J.
,
Sutherland
W. J.
,
Mcneill
J.
,
Van Opstal
M.
,
Dahdouh-Guebas
F.
&
Koedam
N.
2015
The Delphi technique in ecology and biological conservation: Applications and guidelines
.
Methods in Ecology and Evolution
6
,
1097
1109
.
https://doi.org/10.1111/2041-210X.12387
.
Mukherjee
N.
,
Zabala
A.
,
Huge
J.
,
Nyumba
T. O.
,
Adem Esmail
B.
&
Sutherland
W. J.
2018
Comparison of techniques for eliciting views and judgements in decision-making
.
Methods in Ecology and Evolution
9
,
54
63
.
https://doi.org/10.1111/2041-210X.12940
.
Oertlé
E.
,
Hugi
C.
,
Wintgens
T.
&
Karavitis
C. A.
2019
Poseidon-decision support tool for water reuse
.
Water (Switzerland)
11
.
https://doi.org/10.3390/w11010153
.
Pautasso
M.
2013
Ten simple rules for writing a literature review
.
PLoS Computational Biology
9
,
e1003149
.
https://doi.org/10.1371/journal.pcbi.1003149
.
Poch
M.
,
Comas
J.
,
Rodríguez-Roda
I.
,
Sànchez-Marrè
M.
&
Cortés
U.
2004
Designing and building real environmental decision support systems
.
Environmental Modelling and Software
19
,
857
873
.
https://doi.org/10.1016/j.envsoft.2003.03.007
.
Pullin
A. S.
&
Stewart
G. B.
2006
Guidelines for systematic review in conservation and environmental management
.
Conservation Biology
20
,
1647
1656
.
https://doi.org/10.1111/j.1523-1739.2006.00485.x
.
Raymond
C. M.
,
Frantzeskaki
N.
,
Kabisch
N.
,
Berry
P.
,
Breil
M.
,
Nita
M. R.
,
Geneletti
D.
&
Calfapietra
C.
2017
A framework for assessing and implementing the co-benefits of nature-based solutions in urban areas
.
Environmental Science & Policy
77
,
15
24
.
https://doi.org/10.1016/j.envsci.2017.07.008
.
Sammut
C.
&
Webb
G. I.
2011
Encyclopedia of Machine Learning – Reference Book
.
Springer
.
https://doi.org/10.1007/978-0-387-30164-8
.
Trein
C. M.
,
Banc
C.
,
Maciejewski
K.
,
de Moraes Motta
A.
,
Gourdon
R.
,
Molle
P.
,
Gautier
M.
&
von Sperling
M.
2020
French vertical flow treatment wetlands in a subtropical climate: Characterization of the organic deposit layer and comparison with systems in France
.
Science of the Total Environment
742
.
https://doi.org/10.1016/j.scitotenv.2020.140608
.
United Nations Environmental Programme
2020
The Economics of Nature-Based Solutions: Current Status and Future Priorities
.
United Nations Environment Programme
,
Nairobi
.
This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (CC BY 4.0), which permits copying, adaptation and redistribution, provided the original work is properly cited (http://creativecommons.org/licenses/by/4.0/).