Natural experiment
A natural experiment is a study in which individuals (or clusters of individuals) are exposed to the
Natural experiments are employed as
History
One of the best-known early natural experiments was the
In this example, Snow discovered a strong association between the use of the water from the pump, and deaths and illnesses due to cholera. Snow found that the Southwark and Vauxhall Waterworks Company, which supplied water to districts with high attack rates, obtained the water from the Thames downstream from where raw sewage was discharged into the river. By contrast, districts that were supplied water by the Lambeth Waterworks Company, which obtained water upstream from the points of sewage discharge, had low attack rates. Given the near-haphazard patchwork development of the water supply in mid-nineteenth century London, Snow viewed the developments as "an experiment...on the grandest scale."[5] Of course, the exposure to the polluted water was not under the control of any scientist. Therefore, this exposure has been recognized as being a natural experiment.[6][7][8]
Recent examples
Family size
An aim of a study Angrist and Evans (1998)[9] was to estimate the effect of family size on the labor market outcomes of the mother. For at least two reasons, the correlations between family size and various outcomes (e.g., earnings) do not inform us about how family size causally affects labor market outcomes. First, both labor market outcomes and family size may be affected by unobserved "third" variables (e.g., personal preferences). Second, labor market outcomes themselves may affect family size (called "reverse causality"). For example, a woman may defer having a child if she gets a raise at work. The authors observed that two-child families with either two boys or two girls are substantially more likely to have a third child than two-child families with one boy and one girl. The sex of the first two children, then, constitutes a kind of natural experiment: it is as if an experimenter had randomly assigned some families to have two children and others to have three. The authors were then able to credibly estimate the causal effect of having a third child on labor market outcomes. Angrist and Evans found that childbearing had a greater impact on poor and less educated women than on highly educated women although the earnings impact of having a third child tended to disappear by that child's 13th birthday. They also found that having a third child had little impact on husbands' earnings.[9]
Game shows
Within economics, game shows are a frequently studied form of natural experiment. While game shows might seem to be artificial contexts, they can be considered natural experiments due to the fact that the context arises without interference of the scientist. Game shows have been used to study a wide range of different types of economic behavior, such as decision making under risk[10] and cooperative behavior.[11]
Smoking ban
In Helena, Montana a smoking ban was in effect in all public spaces, including bars and restaurants, during the six-month period from June 2002 to December 2002. Helena is geographically isolated and served by only one hospital. The investigators observed that the rate of heart attacks dropped by 40% while the smoking ban was in effect. Opponents of the law prevailed in getting the enforcement of the law suspended after six months, after which the rate of heart attacks went back up.[12] This study was an example of a natural experiment, called a case-crossover experiment, where the exposure is removed for a time and then returned. The study also noted its own weaknesses which potentially suggest that the inability to control variables in natural experiments can impede investigators from drawing firm conclusions.'[12]
Nuclear weapons testing
Vietnam War draft
An important question in economics research is what determines earnings. Angrist (1990) evaluated the effects of military service on lifetime earnings.
Industrial melanism
With the
See also
- Common garden experiment
References
- ^ ISBN 978-0-333-78676-5.
- ^ a b Dunning, Thad (2012). Natural Experiments in the Social Sciences: A Design-Based Approach. Cambridge University Press.
- ISBN 978-0-07-022434-6.
- .
- ^ Snow, J. (1855). On the Mode of Communication of Cholera (2nd ed.). London: Churchill. Excerpted in MacMahon, B. & Pugh, T.F. (1970). Epidemiology. Boston: Little Brown.
- ^ The 1854 cholera outbreak is the example of a natural experiment discussed often by David A. Freedman, e.g. in Statistical Models: Theory and Practice (Cambridge University Press) [1], chapter 1.3 (pp. 6–9).
- ^ MacMahon, B., & Pugh, T.F. (1970). Epidemiology: Principles and Methods. Boston: Little, Brown.
- ^ Snow's studies of the pattern of the disease were convincing enough to persuade the local council to disable the well pump by removing its handle. After the handle of the well-pump was replaced, the incidence of new cases dropped. In stopping the use of water from the well-pump, the authorities conducted, in effect, a second study, an uncontrolled intervention study, a study with an intervention group but no control group.
- ^ JSTOR 116844.
- SSRN 636508.
- SSRN 1592456.
- ^ PMID 15066887.
- JSTOR 2006669.
- ^ "Natural experiments in econometrics" – via www.youtube.com.
- PMID 18941471.