Qualitative comparative analysis for WASH research and practice

Qualitative comparative analysis is an established research method that has been underutilized in water, sanitation, and hygiene (WASH) research. It has immense potential for addressing the complexity inherent to WASH projects, and can produce robust and transparent results from intermediate or large numbers of cases. The method enables researchers and practitioners to blend quantitative and qualitative metrics to build more nuanced contextual knowledge, and is able to detect combinations of causal conditions that lead to outcomes of interest. This means that the method is uniquely positioned for building empirically founded theories of change that reflect contextual complexity. In this review paper we use hypothetical data and a review of the existing literature to showcase where and how the method can be productively applied in WASH research


INTRODUCTION
Recent years have seen the water, sanitation, and hygiene (WASH) community increase its focus on evidence-based approaches, monitoring, and evaluation.This move is intended to improve accountability and results for both donors and the communities where projects take place.
In part, this trend towards measurement is a reaction to the most fundamental and important questions for global development: why is it that some projects succeed while others fail?And what, exactly, do we mean by success and failure in WASH projects?While occasionally there may be simple answers to these questions, more often the answers themselves are complex systems of dynamic, contextual factors and decoupled impacts (Meyer & Rowan ).
The gold standard for research methodology is often considered to be the randomized controlled trial (RCT), which emulates clinical trial research methods.For example, a handful of recent RCTs have tested the impact of community-led total sanitation (CLTS) methods (Clasen et  One practical problem is the considerable expense of implementation.Other methodological issues are common to any quantitative approach; closed-ended questionnaires allow statistical analysis but force individual responses into pre-determined schema that may or may not be appropriate.In a related methodological issue, quantitative methods prove relationships but struggle to discover how or why variables contribute to the outcome of interest.For example, why did the previously referenced and welldesigned CLTS studies show differing impacts on outcomes like stunting, incidence of diarrhea, and rates of change in latrine ownership?Different and complementary research methodslike the qualitative comparative analysis (QCA) method described in this paperare needed to answer these important questions.
In contrast to statistical methods, traditional qualitative research approaches allow local knowledge to emerge from the data and are well suited to discovering how and why WASH interventions work in a particular context.However, qualitative findings cannot be statistically generalized, and the very nuance of the answers that qualitative methods generate can mean they are relatively difficult to communicate and apply in different contexts.
Because of these differing strengths and weaknesses, high quality quantitative and qualitative research deeply complement each other.Each type of approachand there are many methods within these broad categoriescan answer different kinds of research questions.For example, the very complexity of factors discovered through qualitative cases may provide an explanation for why it is so difficult to statistically link WASH interventions and health outcomes (Schmidt ).Or, quantitative studies may statistically validate qualitative findings, discovering the importance of each factor relative to the outcome of interest.
QCA (Ragin ) is a research method that blends the strengths of qualitative and quantitative methods.QCA is a set-theoretic method that seeks combinations of causal conditions, or pathways, that lead to an outcome of interest.To do so, deep qualitative and quantitative case knowledge is explicitly represented by calibrated, quantitative measurements in a truth table.This truth table is then simplified using either Boolean algebra or fuzzy logic in a fully reproducible, generalized set theoretic analysis.The method lives between qualitative and quantitative analysis, and can handle either intermediate or large numbers of cases.
While a relatively new research method (Ragin ) which was originally used in the areas of comparative politics and historical sociology, over recent decades it has made significant inroads to a wide range of research communities, including economics, management and engineering.QCA allows us to rigorously analyze different types, quantities, and combinations of qualitative and quantitative data; thus we suggest it is an important addition to the WASH toolkit.
QCA is founded in set theory.The simplest set relation is a subsetfor example, water projects are a subset of WASH projects.This type of set relation defines both water projects (as one kind of a WASH project) and also defines WASH projects (as including, among other things, water projects).
While definitional sets can be trivial, more interesting set relations emerge when researchers seek causal relationships between various phenomena; the causality claim, of course, is founded on theory and sector knowledge.For example, and as discussed below, there are both sustainable and unsustainable school sanitation projects, and we suspect there are reasons why projects turn out to belong to one or the other of these subsets of school sanitation projects.
Causal conditions are the reasons that the researcher believes may influence the outcome of interest.While these are similar to independent variables in a statistical analysis, they do not take on many of the assumptions of variables in a statistical analysis.As we discuss below, set relationships are importantly different than correlational relationships, in part because of the underlying assumptions about the symmetry of theorized relationships between causes and outcomes (see Table 4 and the related discussion for an example of this difference).The thought structure of this paragraph parallels that of the first chapters of Ragin's () book.The reader is referred to that book for more details on the fundamentals of set theoretic thought, which are not limited to the introductory examples provided here.Given the difference and utility of the QCA research method, this paper is a methodological contribution intended to describe how QCA may be useful to the WASH community.This included one of the few identified publications coming from practice rather than academic researchers (Welle et al. ).As will be described in more detail below, many of these authors identified an intermediate number of cases and a need for nuanced yet rigorous quantification of complexity as rationales for choosing the QCA method.

QCA VARIANTS
There are three variants of QCA analysis.These variants describe the way that the causal conditions and outcome of interest are defined.In any of these three variants, and if the analytic decisions discussed here are fully documented, QCA enables a fully replicable analysis with transparent measures of reliability.The simplest is crisp set QCA (csQCA), in which each causal condition is measured as being either fully present or fully absent.For example, Kaminsky & Javernick-Will () use csQCA to describe household toilets that were or were not functional on the day of a research visit.Similarly, Chatterley et al. () use csQCA to analyze schools with and without wellmaintained toilets.In a slightly more complex variant, multiple value QCA (mvQCA) permits the inclusion of non-dichotomous measurements which can take on multiple values.mvQCA is best suited for studies in which the variables can be summarized into a small number of discrete options (Gross & Garvin ).For example, in a study attempting to understand the effect of water supply operators, we might wish to consider three variants: (1) community-managed supply, (2) private operator, and (3) public operator.An mvQCA study can also include variables that are dichotomized.
Finally, in the most conceptually complex variant, fuzzy set QCA (fsQCA) allows for each variable to be assigned a value between zero and one corresponding to its degree of membership in a set.In an fsQCA study, a score of 1 represents full membership in a set and a score of 0 represents full non-membership, with 0.5 as the point of maximum ambiguity of set membership.Values between 0 and 1 represent varying degrees of membership and nonmembership.These scales are not linear, and the way in which the set is defined will affect the values.fsQCA is useful in cases where restricting all conditions to dichotomous values would result in a loss of detail from data as it can represent small, but meaningful, differences between cases.For example, in Chatterley et al. () the set of schools with well-managed sanitation is defined as schools with toilets that are both functional and clean (Table 2 pro sector could include open defecation-free status in a community, functionality of a handpump, or household practice of a hygiene behavior.This step informs the process of case selection, as it is necessary to purposefully identify a set of cases that demonstrate a range of the outcomes for the analysis.For example, in Table 1 the hypothetical outcome of interest is Sustained Water Services, meaning cases with and without sustained water service would be needed for the dataset.The next step is to identify conditions that are expected to influence the outcome(s) of interest.Conditions are the variables that distinguish one case from another.For example, in Table 1 we  However, one of QCA's strengths is the ability to build theory from the analysis.Thus, some of the conditions may be selected for inductive reasons, meaning additional conditions may emerge during the data collection.Indeed, it is likely that a large number of conditions will be identified (Amenta & Poulsen ).However, each new condition adds complexity to the logic space (the space defined by all of the possible value-combinations of the conditions (Ragin )), so it is practically important to limit the number of conditions.A large number of conditions will likely result in a unique explanation for each case, making it difficult to interpret and generalize the results.As such, there are various documented techniques to reduce the causal conditions in a QCA analysis (Ragin ; Rihoux & Ragin ).For example, it is possible that some of the identified causal conditions will not vary significantly between the cases selected because of the research context.As in statistical analysis, the non-varying conditions cannot be included in the analysis.
Such variables are called domain conditions.While these domain conditions cannot be analyzed, they may have an important influence on the outcome through their presence and interactions with other causal conditions.It is important to clearly describe any domain conditions, as these limit the generalizability of the results.It may also be possible to combine initially hypothesized conditions if interrelationships between the conditions can be identified.For example, discriminant analysis can be used to identify strong bivariate relationships, or composite conditions can be created through techniques such as factor analysis ( Jordan et al. ).

Case selection
For QCA analysis, cases are selected to exhibit the greatest possible variety of configurations (a configuration is defined by each case's set of condition and outcome values).
Although many criticize the conscious selection of cases as an improper manipulation of the dataset, this practice is appropriate for QCA because the method's logic is not prob-

Data collection
Data must be collected for each condition in each case.Generally, data will be collected on more conditions than are actually used in the analysis, given the iterative nature of the QCA process.Both qualitative and quantitative data can be used in the analysis, but the researcher must have sufficient knowledge of each case to make determinations about the variable calibration described below.

Variable calibration
Once the cases, outcomes, and preliminary conditions have been determined, raw data for each case (qualitative and/or quantitative) must be collected and calibrated according to set definitions relevant to the research questions, underpinning theory, and the dataset itself.These set definitions rigorously describe each case in terms of the causal conditions that are hypothesized to be relevant to the outcome of interest.For example, and as described in more detail below, set definitions might include what kind of management scheme is used for water system management, the volume of water used by each household, or how wealthy communities are.
The method of calibration depends on the variant of QCA being undertaken.For a csQCA study, all conditions must be calibrated as either a zero or one.Qualitative data are calibrated by defining the features of what is within and outside of the set.For example, Kaminsky & Javernick-Will () coded toilets as either socially sustainable (1, defined as owner maintenance post-construction and unbroken slab, pit rings, and superstructure on the day of the visit) or unsustainable (0, if either the two criteria were not met) on the day of a research visit.Quantitative data are dichotomized through the determination of a numeric cutoff point.
For example, water samples might be coded as having either positive or negative fecal coliform test results, based on international standards for water quality.In contrast, for an mvQCA study a small number of discrete options are defined for each condition.For example, community water supply could be coded as community managed (0), having a private operator (1), or having a public operator (2).
Calibration for an fsQCA study can be more complex, as each variable is represented on a continuous scale between zero and one.The first method for calibration, direct calibration, can be used for quantitative data.However, quantitative data cannot simply be normalized to values between 0 and 1, as the calibrated values represent the degree of membership in a set and must be based on the set definitions.To perform direct calibration, the research must specify three breakpoint values: full membership, full non-membership and the crossover point (equal to a 0.5 score).These points should be anchored in external criteria and theoretical and case knowledge.
For example, in examining country level data for GNP to assess membership in the set of poor countries, the variation between countries that are clearly outside of the set of poor countries is unimportant to the analysis, and the anchor points must be set accordingly.For example, both Sweden and Norway are non-poor, and any variation between the two is unimportant to the set classification of poor countries.As such, the scores for both these nations would be set to 0 (indicating non-membership in the set of poor countries).
The second method for calibrating fsQCA data is indirect calibration.This can be done for either quantitative or qualitative data by creating groupings of cases.To calibrate qualitative data the researcher develops a list of operationalized measures for each of the conditions and outcomes.
Then, qualitative anchors are defined for full membership and non-membership in the set and the case data are evaluated based on these operationalized definitions.As for direct calibration, these points should be anchored in external criteria and theoretical and case knowledge.For example, Table 2 shows an example of indirect calibration from the literature (Chatterley et al. ), where schools that virtually always have clean and functional toilets are defined as being fully in the set of schools with well-managed sanitation.
For any of these methods of calibration, a clear calibration protocol and inter-calibrator reliability checks are needed to support the validity of the findings.Through this process, it is likely that the calibration methods will be iteratively improved to ensure that real differences between cases are captured accurately.

Constructing and analyzing the truth table
The calibrated data are used to populate a truth table that represents the calibrated conditions and outcomes.The truth table (Table 3) consists of columns for each condition and outcome, with rows representing each case.
Once the truth table is generated, the researcher may find contradictory configurations, or cases with identical conditions and differing outcomes.These can be resolved by considering the conditions included to see whether

Necessity and sufficiency of individual conditions
In QCA, sufficiency is a measure of the degree to which an individual causal condition is a subset of the outcome (see Figure 1).If a specific condition always (or nearly always) results in a positive outcome, that condition would be deemed sufficient.For example, when we described the intermediate solution for the hypothetical example given in Table 1, the presence of Community Participation was enough to achieve Sustained Water Services, regardless of the presence or absence of a Municipal Utility.Another way to say this is to say that Community Participation is sufficient to achieve Sustained Water Services.In contrast, necessity measures the degree to which the outcome is a subset of individual causal conditions, meaning that, if all (or nearly all) cases where the outcome is present have a particular condition present, we would consider that condition necessary.For example, Bogler & Meierhofer () find that both trouble-free production and high demand are necessary for sustainable colloidal silver filter businesses in Nepal.
Mathematically, necessity and sufficiency may be represented by Equations ( 1) and (2) respectively, where X i and Y i represent single conditions.Typically, researchers require a necessity score of at least 0.9 to call a condition necessary for the outcome of interest, and a sufficiency score of at least 0.8 to call a condition sufficient for the    outcome of interest.
The analysis of combinations of conditions, a key strength of QCA, is discussed below.

Pathway analysis of combinations of conditions
The truth table is analyzed using Boolean algebra (for csQCA and mvQCA studies) and fuzzy logic (for fsQCA studies).For more details on the mathematics behind these analyses see Ragin (, ).Regardless of which mathematical approach is used, the analysis of the truth table results in the discovery of combinations of conditions (often called pathways) that lead to a particular outcome of interest, with quantitative scores that describe how well each of these pathways describes the dataset.For example, in Table 1 there were multiple cases that showed the con-  2)) but coverage describes a particular combination of conditions rather than considering individual conditions.As such, to measure coverage using Equation ( 2), X i represents the membership in a configuration, and Y i represents the membership in the outcome condition.High coverage scores indicate that a given pathway represents many of the represented cases.However, this does not mean that pathways with low coverage are unimportant, as QCA is not probabilistic.Despite this, knowing which pathways to a given result are seen more frequently can help guide practitioners to interventions that may be more likely to apply to many cases.

Complex, parsimonious, and intermediate solutions
The truth table pathways analysis results in three different solutions: complex, parsimonious, and intermediate (as described below).These different solutions are based on different assumptions made about the unobserved configurations discussed above in the section entitled 'Case selection'.QCA uses counterfactual analysis to transparently compare the impacts of assumptions regarding unobserved configurations, and to obtain more parsimonious solutions based on these unobserved configurations.However, it is up to the researcher to use her theoretical and substantive knowledge to decide to what degree these unobserved configurations should be included in the analysis.For example, in the hypothetical example given in Table 1 we might not expect to see cases of Sustained Water Services with the absence of both Community Participation and a Municipal Utility, but we probably would suspect that there are unobserved cases with the presence of both of these conditions.
To validate this intuition, published literature from academic journals or practice can be used.Alternatively, more research would be needed to seek out additional cases and better populate the logic space.
As such, there are three possible solutions from each QCA run, depending on how unobserved configurations are used during simplification (ranging from none to all those logically possible).Firstly, the complex solution does not incorporate any counterfactuals and is based entirely on the observed cases.This will often be a highly complicated solution, sometimes with a unique pathway for each observed case.It is not typically used by researchers as it does not take into account any theoretical knowledge about the link between conditions and outcomes.
In contrast, the intermediate solution uses 'easy' counterfactuals, which are researcher-specified theoretical assumptions.For example, a researcher may believe that Thirdly and finally, the parsimonious solution is obtained by using all of the unobserved configurations as potential simplifying assumptions in the truth table analysis.
In this solution, the researcher does not specify which assumptions are reasonable, but rather allows the software to find the mathematically simplest solution.Clearly, the researcher must evaluate each of the assumptions that result from the parsimonious solution algorithm to ensure that they are theoretically plausible.It is quite likely that (as in the example just given) at least some of the assumptions leading to the parsimonious solution would be difficult to justify.As such, the intermediate solution should be reported unless there are strong theoretical reasons to accept the parsimonious solution.
Note that it is also recommended to perform an analysis of which conditions lead to the lack of attainment of an outcome.Because QCA accounts for configurational complexity and asymmetrical relationships (which are discussed in more detail below), this will not necessarily be the negation of the conditions that led to the outcome.An equally important critique coming from qualitative research traditions would emphasize that the calibration scales required for QCA analysis are deeplyand potentially problematicallysimplified representations of reality.As such, there is a risk that the numeric scores provide a sense of false precision.In this sense, QCA may be seen as overly positivistic and reductive.In response to these important critiques, we acknowledge that the use of any particular research method is extremely unlikely to enable perfect project outcomes (as defined by either the development community or as defined by the end users).
However, we do argue that methodological diversity can help us move towards more sustainable WASH infrastructure, by which we mean infrastructure that is used and maintained by communities over time.
WHY AND WHEN TO USE QCA For WASH research, an important attribute of QCA is its ability to handle combinations of qualitative and quantitative data.For example, in their fsQCA analysis of the challenges facing the production and marketing of colloidal silver water filters in Nepal, Bogler & Meierhofer () were able to consider quantitative data, like population density and percentage of people treating water, alongside qualitative data, such as the reasons customers gave for not buying filters and strategies used for new customers.
A key conceptual difference between QCA and more traditional statistical methods is the different assumption regarding symmetry of relationships.Table 4 uses hypothetical data and a highly simplified example to describe why this assumption is important.The uppermost portion of the table shows an example of a perfectly symmetric relationship.
Here, we see that when Community Participation is present, we achieve the outcome of Sustained Water Services.In contrast, when Community Participation is absent, we see abandoned water systems.Given these data, both statistical analysis and QCA find a strong link between Community Participation and Sustained Water Services.However, it would also be possible to find an asymmetric relationship between these variables, as shown in the lower portion of

CONCLUSION
QCA has not been used frequently in studies of water, sanitation and hygiene interventions to date.However, given its ability to account for configurational complexity through the use of Boolean algebra or fuzzy logic, it is a promising method for WASH researchers that strongly complements more commonly used methods.QCA is a useful method to apply when there is a desire to examine the complex interactions between conditions that may influence the success of interventions, and particularly when there are strong reasons for considering both quantitative and qualitative data.In addition, QCA is useful in complex situations where researchers or practitioners are interested in learning if there is more than one way to attain an outcome of interest.Similarly, QCA requires explicit calibration definitions for both conditions and outcomes; this ability to deal with and document nuanced differences is a key strength of the method.In addition, the process of condition calibration is a systematic way for researchers to incorporate unexpected complexities and nuances that emerge during the analysis.As such, QCA is well-suited for examining not only if a particular intervention results in the outcome we expect, but how and why such an intervention does (or does not) work.
Results of QCA studies include analysis of what variables are necessary and/or sufficient to achieve an outcome and pathways demonstrating what possible combinations of variables may lead to an outcome.To enable reproducibility and transparency of analysis, documentation of the various analytic decisions detailed in this paper should be reported for every QCA analysis.To date, the majority of QCA studies have been from academics, but QCA has strong potential to be useful to practitioners as well.
Often, evaluations of WASH projects rely on qualitative methods; QCA offers a complementary approach to practitioners who wish to rigorously evaluate the success of their projects across a limited number of cases in order to gain an understanding of why interventions may have succeeded or failed in different contexts.
In recent years a handful of researchers have begun to apply QCA to WASH research, which we define as research interested in drinking water supply, sanitation and hygiene for developing nations, communities, and households worldwide.While limited in number, the existing studies showcase the wide variety of applications in which QCA can be valuable.To identify the examples referenced here (which necessarily represent a subset of those examples present in the literature), we searched the literature for 'QCA' in combination with either 'WASH,' 'water,' 'sanitation,' or 'hygiene.'We included papers that considered WASH projects as some cases in a larger dataset.These searches were carried out on article databases including Academic Search Complete, Engineering Village, Web of Science, the Environmental Science Collection, SCOPUS, and WorldCat.We also reviewed the first 100 results for each search on the GoogleScholar search engine.A limitation of this approach is that most non-academic publications are not archived in these databases.As such, for each combination of search terms we also reviewed the first 100 results returned from standard Google searches, as well as searching the SuSanA knowledgebase (http://www.susana.org/en/resources/library) for 'QCA'.This approach identified resources such as QCA-based evaluation protocols and toolkits (Annamalai et al. ; OpenIDEO ).This search identified 17 key documents, including four practitioner-published reports, two dissertations, and 11 academic journal articles.The majority of the key articles we identified dealt with water, while a few treated sanitation and hygiene.The cases analyzed in the articles varied widely in scale.For example, several papers analyzed individual households (Spencer ; Kaminsky & Javernick-Will ) or schools (Chatterley et al. , ), others analyzed development projects (Boudet et al. ; Santosh Kumar Delhi et al. ), and another analyzed public private partnerships for urban water supply (House ).Similarly, there is a wide range of research topics in this set of papers.The most common is an emphasis on sustainability (Chatterley et al. , 2014; Kaminsky & Javernick-Will ; Welle et al. ).Interestingly, and as opposed to past trends in the broader sanitation literature (Rosenqvist et al. ), these papers use sustainability to refer to the sustained use of WASH services with reference to social systems rather than targeting environmental sustainability.Other work studies methods of project delivery such as private participation in WASH infrastructure construction (Santosh Kumar Delhi et al. ; House ) or drivers of conflict regarding these projects (Boudet et al. ).Several of the papers used QCA in combination with either qualitative or statistical methods for mixed-methods analysis (House ; Welle et al. ).
vides details of Chatterley's definitions).In this paper, schools with excellent performance on both of these metrics are fully in the set of schools with well-managed sanitation; schools with moderate performance on these metrics are partially in the set of schools with wellmanaged sanitation; schools with poor performance on these metrics are fully out of the set of schools with wellmanaged sanitation.THE QCA PROCESS Defining outcomes and conditions For all three variants of QCA, the first step is to define the outcome(s) of interest to the research question.The outcome of interest is whatever the study intends to measure as an outcome of the intervention; examples in the WASH provide a hypothetical example where the causal conditions are Community Participation and a Municipal Utility.The selection of conditions for any QCA study is iterative.Conditions are logically constructed and should generally be grounded in theory.
Participation and a Municipal Utility.These are called unobserved configurations, regardless of the likelihood of their existence.During QCA analysis, unobserved configurations may be handled in three standard ways; the researcher must determine which of these is most appropriate to the research question and data.The different assumptions in each of these three methods should be expected to result in different answers, which are called the complex, intermediate, and parsimonious solutions.These are discussed in more detail in the Pathway analysis section below.

(
for example) there is a missing condition that explains the difference between the two cases.Alternatively, calibration cutoffs may be re-examined to determine if an important difference between the two cases was obscured in the initial calibration.Researchers intending to use QCA should note that the creation of a contradiction-free truth table is extremely time consuming and requires deep case knowledge.The first step in QCA analysis determines which individual conditions are necessary or sufficient to achieve the outcome.The second step determines which combinations of conditions combine to lead to the achievement (or nonachievement) of an outcome.These two steps are discussed in more detail below.Although these analyses can be performed by hand, software can facilitate analysis.One option is the open source fs/QCA software developed by Charles Ragin, which can be used for csQCA or fsQCA.Other options are Tosmana, a software package designed for mvQCA and csQCA studies, or various and constantly evolving options for STATA and R ( Jordan et al. ; Schneider & Wageman ; Ragin et al. ) relationship (chi-squared p ¼ 0.12) Causal condition: Community Participation absent 10 40 Causal condition: Community Participation present 0 10Note: hypothetical data.
ditions of Community Participation, no Municipal Utility, and the outcome of Sustained Water Services; these cases share a pathway.Two metrics are employed to assess QCA pathway outputs: consistency and coverage.Consistency is a measure of the degree to which cases sharing the same combination of conditions have the same outcome.In other words, consistency is a measure of the extent to which the observed cases align with each other.High consistency means a given pathway almost always leads to a certain outcome, while low consistency means a given pathway only sometimes leads to the outcome of interest.Necessity and consistency use the same equation (Equation (1)) but consistency describes a particular combination of conditions rather than considering individual conditions.As such, to measure consistency using Equation (1), X i represents the membership in a configuration, and Y i represents the membership in the outcome condition.A consistency score of 1 would indicate perfect consistency, where all cases with a given set of causal conditions have membership in the outcome set to a greater degree than membership in the configuration; however, consistency scores above 0.8 are generally considered acceptable.According to Ragin, 'Consistency, like significance, signals whether an empirical connection merits the close attention of the investigator.If a hypothesized subset relation is not consistent, then the researcher's theory or conjecture is not supported.'In contrast, coverage is a measure of how much a particular pathway accounts for the instance of the outcome, giving a measure of the importance of that pathway.Sufficiency and coverage use the same equation (Equation ( three conditions (A, B and C) are likely related to the positive instance of an outcome, but only observes cases where A and B are present, but C is absent (i.e.A*B* ∼ C).If the researcher has strong knowledge that the presence of C should contribute to the outcome under the scenario, then the assumption that A*B*C would lead to the outcome would be an 'easy' counterfactual.It should be noted that these types of assumptions are common, but usually implicit, in traditional comparative case study analysis.A strength of QCA is that these assumptions are clearly documented throughout the analysis process.

Table 2 |
Excerpted fsQCA coding scheme fromChatterley et al. (2014) b : 1: all toilets are almost always clean and quickly cleaned when dirty 0.67: usually more or less clean, with some instances where they remain dirty 0.33: frequently unclean and are usually considered unclean by students 0: rarely clean and students label them as dirty a 'Functional' ¼ waste is easily flushed, the building structure, doors and locks function providing privacy, water is available, and soap is available in or near the toilet.'Repairs timely addressed' ¼ minor critical repairs (needed for use), such as a door lock or clogged toilet, are repaired within 24 hours, major critical repairs, such as a broken pan or door, are repaired within 1 week, minor non-critical repairs, such as a broken tap, are repaired within 1 week, and major non-critical repairs, such as a broken water pump, are repaired within 1 month.b 'Clean' ¼ no visible feces on the floor/walls/seat, no flies, and no foul smell.

Table 1 |
Hypothetical example of cases and variables aIn set notation, the symbol * signifies and, while ∼ signifies not.Note: hypothetical data.

Table 3 |
Truth table example Note: hypothetical data.

Table 4 |
Symmetric and non-symmetric relationships

Table 4 .
Here, we see that all cases with Community Participation achieve the Sustained Water Services outcome. in Sustained Water Services; the p value resulting from a chi squared test is 0.12, which is above typical cutoffs for statistical significance.In contrast, in set-based analysis like QCA, we would describe these as set relationships and gain the insight that while Community Participation does seem to be sufficient for achieving Sustained Water Services, it is not necessary for achieving it.In other words, Community Participation is a valuable strategy, but not the only one.The example in Table4 alsoshows the importance of considering configurational complexity in socially influenced research topics like WASH.While regression methods examine the relative contribution of variables, holding other modeled variables equal, QCA seeks combinations of variables that lead to an outcome and recognizes that there are likely several different combinations of factors that may result in an outcome.This allows us to handle situationswhere uniformity of causal effects cannot be assumed.For example, in the hypothetical example shown in Table4we might add another causal condition such as the presence of a municipal utility (as we did earlier in Table1).This resolves the excerpted hypothetical data in Table4showing that to achieve Sustained Water Services a community requires some combination of Community Participation, a Municipal Utility, or both working together.This hypothetical finding means that Community Participation and the presence of a Municipal Utility are substitutable conditions, or conditions that are interchangeable in terms of achieving the outcome of Sustained Water Service.
However, when Community Participation is absent some cases experienced Sustained Water Services and others showed Unsustained Water Services.Using statistical analysis techniques such as a chi squared test, we would believe that Community Participation is not a statistically significant factor