We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.
To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
This chapter applies localized peace enforcement theory to a subnational analysis of patterns of dispute escalation in Mali. In order to investigate whether the previous chapters’ experimental findings generalize to real-world operations, the chapter presents the results of two analyses of UN peacekeeping efforts to prevent the onset of communal violence in the central Malian region of Mopti. The first study leverages a geographic regression discontinuity design to compare dispute escalation on either side of the Burkina Faso–Mali border. The border splits similar areas into those “treated” with UN peacekeeping patrols (on the Mali side) and “control” areas without peacekeeping (on the Burkina Faso side). The findings indicate that peacekeeping reduces the likelihood of communal violence. The second study delves deeper into the data with an analysis of UN peacekeepers from different countries deployed to the same regions of Mali and uncovers further evidence in line with the predictions of the theory. Rather than comparing UN peacekeeping in countries with against those without a peacekeeping operation, the study compares UN peacekeepers from different contributing countries – Togo and Senegal – deployed to the same area.
This chapter describes the data collection strategy and multimethod research design employed to test the theory in the subsequent chapters of the book. The structure of the empirical analysis mirrors the book’s primary argument: to show how peacekeeping works from the bottom up, from the individual to the community to the country. Given that UN peacekeepers deploy to the most violent areas, the design needed to account for selection bias as well as other confounding variables in order to make causal inference possible. Using data from individual- and subnational/community-level data from Mali as well as cross-national data from the universe of multidimensional PKOs deployed in Africa, the book employs a three-part strategy to test the hypotheses in the next few chapters. First, the book considers the micro-level behavioral implications of the theory using a lab-in-the-field experiment and a survey experiment, both implemented in Mali. Second, it test whether UN peacekeepers’ ability to increase individual willingness to cooperate aggregates upward to prevent communal violence in Mali. Third, the book considers whether these findings extend to other countries.
This chapter focuses on causal inference in healthcare, emphasizing the need to identify causal relationships in data to answer important questions related to efficacy, mortality, productivity, and care delivery models. The authors discuss the limitations of randomized controlled trials due to ethical or pragmatic considerations and introduce quasi-experimental research designs as a scientifically coherent alternative. They divide these designs into two broad categories, independence-based designs and model-based designs, and explain the validity of assumptions necessary for each design. The chapter covers key concepts such as potential outcomes, selection bias, heterogeneous treatment effects bias, average treatment effect, average treatment effect for the treated and untreated, and local average treatment effect. Additionally, it discusses important quasi-experimental designs such as regression discontinuity, difference-in-differences, and synthetic controls. The chapter concludes by highlighting the importance of careful selection and application of these methods to estimate causal effects accurately and open the black box of healthcare.
from
Part II
-
The Practice of Experimentation in Sociology
Davide Barrera, Università degli Studi di Torino, Italy,Klarita Gërxhani, Vrije Universiteit, Amsterdam,Bernhard Kittel, Universität Wien, Austria,Luis Miller, Institute of Public Goods and Policies, Spanish National Research Council,Tobias Wolbring, School of Business, Economics and Society at the Friedrich-Alexander-University Erlangen-Nürnberg
Vignette experiments are vignettes are brief descriptions of social objects including a list of varying characteristics, on the basis of which survey respondents state their evaluations or judgments. The respondents’ evaluations typically concern positive beliefs, normative judgments, or their own intentions or actions. Using a study on the gender pay gap and an analysis of trust problems in the purchase of used cars as examples, we discuss the design characteristics of vignettes. Core issues are the selection of the vignettes that are included out of the universe of possible combinations, the type of dependent variables, such as rating scales or ranking tasks, the presentation style, differentiating text vignettes from a tabular format, and issues related to sampling strategies.
Results from cultural evolutionary theory often suggest that social learning can lead cultural groups to differ markedly in the same environment. Put differently, cultural evolutionary processes can in principle stabilise behavioural differences between groups, which in turn could lead selection pressures to vary across cultural groups. Separating the effects of culture from other confounds, however, is often a daunting and sometimes intractable challenge for the working empiricist. To meet this challenge, we exploit a cultural border dividing Switzerland in ways that are independent of institutional, environmental and genetic variation. Using a regression discontinuity design, we estimate discontinuities at the border in terms of preferences related to fertility and mortality, the two basic components of genetic fitness. We specifically select six referenda related to health and fertility and analyse differences in the proportion of yes votes across municipalities on the two sides of the border. Our results show multiple discontinuities and thus indicate a potential role of culture in shaping stable differences between groups in preferences and choices related to individual health and fertility. These findings further suggest that at least one of the two groups, in order to uphold its cultural values, has supported policies that could impose fitness costs on individuals relative to the alternative policy under consideration.
Exploiting the fact that hypertension is diagnosed when a person’s blood pressure reading exceeds a medically specified threshold (90 mmHg for diastolic blood pressure or 140 mmHg for systolic blood pressure), this study estimates the effect of a first-ever hypertension diagnosis on Chinese adults’ alcohol consumption using a two-dimensional regression discontinuity design. Analyzing data on 10,787 adults from the China Health and Nutrition Survey, our estimation reveals that hypertension diagnoses based on diastolic blood pressure readings exert a number of desirable effects. Hypertensive adults’ drinking frequency and the incidence of excessive drinking among them were reduced by 1.2 times/week and 17.9 percentage points, respectively, about three years after the diagnosis. Meanwhile, their beer and Chinese spirits (Baijiu) intakes were reduced by 518.6 ml/week and 194.8 ml/week, respectively. Interestingly, we also found modest evidence that hypertension diagnoses based on diastolic blood pressure readings increase Chinese adults’ wine intake, suggesting a substitution pattern upon hypertension diagnoses. In contrast, based on systolic blood pressure readings, no significant effects of hypertension diagnoses on alcohol consumption were found.
Faced with rising levels of cross-border migration, many countries have extended local voting rights to non-citizen residents. However, empirical evidence indicates that voter turnout among non-naturalized immigrants is lower when compared to citizens. This raises the question of how to explain this difference. A common answer is that the low turnout rates of non-citizen residents are primarily due to the socio-economic composition of this group and the challenges involved in adapting to a new political system. An alternative but less discussed possibility is that the low turnout concerns the nature of the elections. Hence, we examine whether the turnout of non-citizens is hampered because they are only allowed to partake in local elections. Based on a regression discontinuity design (RDD) using Swedish administrative data, we find that turnout could increase by 10–20 percentage points if the voting rights of non-citizens were extended to the national level.
We provide closed-form solutions for measuring electoral closeness of candidates in proportional representation (PR) systems. In contrast to plurality systems, closeness in PR systems cannot be directly inferred from votes. Our measure captures electoral closeness for both open- and closed-list systems and for both main families of seat allocation mechanisms. This unified measure quantifies the vote surplus (shortfall) for elected (nonelected) candidates. It can serve as an assignment variable in regression discontinuity designs or as a measure of electoral competitiveness. For illustration, we estimate the incumbency advantage for the parliaments in Switzerland, Honduras, and Norway.
In this chapter, we discuss the logic and practice of quasi-experimentation. Specifically, we describe four quasi-experimental designs – one-group pretest–posttest designs, non-equivalent group designs, regression discontinuity designs, and interrupted time-series designs – and their statistical analyses in detail. Both simple quasi-experimental designs and embellishments of these simple designs are presented. Potential threats to internal validity are illustrated along with means of addressing their potentially biasing effects so that these effects can be minimized. In contrast to quasi-experiments, randomized experiments are often thought to be the gold standard when estimating the effects of treatment interventions. However, circumstances frequently arise where quasi-experiments can usefully supplement randomized experiments or when quasi-experiments can fruitfully be used in place of randomized experiments. Researchers need to appreciate the relative strengths and weaknesses of the various quasi-experiments so they can choose among pre-specified designs or craft their own unique quasi-experiments.
Many studies exploit close elections in a regression discontinuity framework to identify partisan effects, that is, the effect of having a given party in office on some outcome. We argue that, when conducted on single-member districts, such design may identify a compound effect: the partisan effect, plus the majority status effect, that is, the effect of being represented by a member of the legislative majority. We provide a simple strategy to disentangle the two, and test it with simulations. Finally, we show the empirical relevance of this issue using real data.
A close reading of the literature on radical right parties (RRPs) suggests that these parties erode trust and solidarity in European democracies when they pit ‘the pure people’ against political and legal institutions, elites, and immigrants. I propose the conjecture that RRPs with seats in the national parliament have better conditions for spreading nativist and populist messages that may erode trust and solidarity between a society’s residents, between ethnic groups, and towards its political and legal institutions. To test this research question, I combine nine waves of European Social Survey data from 17 countries and data on national elections spanning the years 1999 to 2020. Two-way fixed effects models estimate that RRPs representation in the national parliament is associated with a reduction in public support for redistribution of ca. 18% of a standard deviation. Additionally, I demonstrate that this inverse relationship runs parallel to growing welfare chauvinistic beliefs and that it is stronger in countries with weak integration policies. Contra theoretical expectations, the radical rights’ political representation has not produced any change in societal levels of anti-immigration attitudes, institutional trust, or social trust. While the findings persist across a wide range of robustness checks and other model specifications, threats to identification in the form of non-parallel pre-trends and unobserved sources of confounding, means that one should be cautious in interpreting the findings in a causal manner.
We study the impact of compulsory voting in Brazil, where voting is mandatory from age 18 to 70 and voluntary for those aged 16, 17 and 70+. Using a survey sample of 8008 respondents, we document voter confusion about how the age criterion applies. Some people falsely believe that what matters is one's age in an election year rather than on Election Day. Next, we perform a regression discontinuity (RD) analysis of compulsory voting among young voters with register-based data from six Brazilian elections (2008–2018). We find that the effect of compulsory voting is seriously underestimated if we focus solely on the discontinuities prescribed by the law. Our findings carry important implications for studies adopting the RD design where knowledge of the cutoff is expected of the units of interest (like those about compulsory voting) and confirm that compulsory voting is a strong institutional arrangement that promotes greater electoral participation.
Regression discontinuity (RD) designs are increasingly common in political science. They have many advantages, including a known and observable treatment assignment mechanism. The literature has emphasized the need for “falsification tests” and ways to assess the validity of the design. When implementing RD designs, researchers typically rely on two falsification tests, based on empirically testable implications of the identifying assumptions, to argue the design is credible. These tests, one for continuity in the regression function for a pretreatment covariate, and one for continuity in the density of the forcing variable, use a null of no difference in the parameter of interest at the discontinuity. Common practice can, incorrectly, conflate a failure to reject evidence of a flawed design with evidence that the design is credible. The well-known equivalence testing approach addresses these problems, but how to implement equivalence tests in the RD framework is not straightforward. This paper develops two equivalence tests tailored for RD designs that allow researchers to provide statistical evidence that the design is credible. Simulation studies show the superior performance of equivalence-based tests over tests-of-difference, as used in current practice. The tests are applied to the close elections RD data presented in Eggers et al. (2015b).
Do firms with directors holding elected political office benefit from political connections? Restricting the analysis to elections in single-member districts, this chapter uses a regression discontinuity design to identify the causal effect of gaining political ties, comparing outcomes of firms that are directed by candidates who either won or lost close elections to regional legislatures. Having a connection to a winning politician increases a firm’s revenue by 60 percent and profitability by 15 percent over a term in office. The chapter then tests between different mechanisms, finding that connected firms improve their performance by gaining access to bureaucrats, and not by signaling legitimacy to financiers. The value of winning a seat increases in more politically competitive regions, but falls markedly when more businesspeople win office in a convocation. Politically connected firms extract fewer benefits when faced with greater competition from other rent-seekers.
This chapter investigates whether businessperson politicians actually govern differently. I argue that given their preferences and managerial expertise, businesspeople in office may adopt policies favorable to the business community and improve government efficiency. To test these claims, I collect data on over 33,000 Russian mayors and legislators and investigate policy outcomes using detailed municipal budgets and over a million procurement contracts. Using a regression discontinuity design, the results show that businessperson politicians increase expenditures on roads and transport, while leaving health and education spending untouched. Prioritizing economic over social infrastructure brings immediate benefits to firms, while holding back long-term accumulation of human capital. However, businesspeople do not reduce budget deficits, but rather adopt less competitive methods for selecting contractors, particularly in corruption-ripe construction. In all, businessperson politicians do more to make government run for business, rather than like a business.
While youth suffrage is widely debated, the causal effects of being eligible to vote on adolescents' political attitudes are less well known. To gain insights into this question, we leverage data from a real-life quasi-experiment of voting at 16 in the city of Ghent (Belgium). We compare the attitudes of adolescents that were entitled to vote with their peers that just fell below the age cut-off. We also examine the effects of the enfranchisement at 18-years-old. While we find an effect of youth enfranchisement on attention to politics, there is no evidence for an effect of enfranchisement on political engagement overall.
Most of the distributive politics literature focuses on how incumbent politicians allocate development resources in the absence of spending rules, and on the politicization of rules when they do determine distribution. What is less clear is whether politically neutral spending rules lead to neutral spending. Using new data on a long-running federal development fund and elections from Pakistan in a regression discontinuity design, the author presents strong evidence that the ruling party manipulated fund distribution to disproportionately benefit its co-partisans and punish the weakest opposition. Considering various factors, partisan bias is the most plausible explanation. These findings are important not only because the purpose of rules-based funds is to prevent politicized distribution but also because they have implications for development patterns and for using such funds to address questions about legislator effort and patronage patterns within constituencies, which requires assuming that legislators do receive their share of funds in the first place.
Economic activity is unevenly distributed across space, or spiky. Measuring this spikiness is not trivial. A good measure is comparable across space, comparable across sectors, unbiased regarding spatial and sector classification, and should provide a measure of significance. No measure fulfils all these criteria, but some are better than others. Once spikiness is identified the next question is ‘so what?’ Does spatial agglomeration stimulate productivity? Econometric methods to deal with this question and tackle the problem of reverse causality are: difference-in-differences, natural experiments, and regression discontinuity design. These techniques are introduced in this chapter.
Economic activity is unevenly distributed across space, or spiky. Measuring this spikiness is not trivial. A good measure is comparable across space, comparable across sectors, unbiased regarding spatial and sector classification, and should provide a measure of significance. No measure fulfils all these criteria, but some are better than others. Once spikiness is identified the next question is ‘so what?’ Does spatial agglomeration stimulate productivity? Econometric methods to deal with this question and tackle the problem of reverse causality are: difference-in-differences, natural experiments, and regression discontinuity design. These techniques are introduced in this chapter.
In this Element and its accompanying second Element, A Practical Introduction to Regression Discontinuity Designs: Extensions, Matias Cattaneo, Nicolás Idrobo, and Rocıìo Titiunik provide an accessible and practical guide for the analysis and interpretation of regression discontinuity (RD) designs that encourages the use of a common set of practices and facilitates the accumulation of RD-based empirical evidence. In this Element, the authors discuss the foundations of the canonical Sharp RD design, which has the following features: (i) the score is continuously distributed and has only one dimension, (ii) there is only one cutoff, and (iii) compliance with the treatment assignment is perfect. In the second Element, the authors discuss practical and conceptual extensions to this basic RD setup.