Philip E. Tetlock
This biography of a living person relies too much on references to primary sources. (September 2018) |
Philip E. Tetlock | |
---|---|
decision making | |
Institutions | University of Pennsylvania Annenberg University Professor at the Wharton School and the School of Arts and Sciences (2011–present), University of California, Berkeley Mitchell Endowed Chair at the Haas School of Business (2002–2010) Ohio State University Burtt Endowed Chair in Psychology and Political Science (1996–2001) University of California, Berkeley (1979–1995) |
Philip E. Tetlock (born 1954) is a Canadian-American political science writer, and is currently the Annenberg University Professor at the University of Pennsylvania, where he is cross-appointed at the Wharton School and the School of Arts and Sciences. He was elected a Member of the American Philosophical Society in 2019.
He has written several non-fiction books at the intersection of psychology, political science and organizational behavior, including
Biography
Tetlock was born in 1954 in Toronto, Canada and completed his undergraduate work at the University of British Columbia and doctoral work at Yale University, obtaining his PhD in 1979.
He has served on the faculty of the University of California, Berkeley (1979–1995, assistant professor), the Ohio State University (the Burtt Endowed Chair in Psychology and Political Science, 1996–2001) and again at the University of California Berkeley (the Mitchell Endowed Chair at the Haas School of Business, 2002–2010). Since 2011, he has been the Annenberg University Professor at the University of Pennsylvania.
Tetlock has received awards from scientific societies and foundations, including the
Work
He has published over 200 articles in peer-reviewed journals and has edited or written ten books.[1]
Tetlock's research program over the last four decades has explored five themes:
- the concept of good judgment (with special emphasis on the usefulness of forecasting tournaments in assessing one key component of good judgment: accuracy);
- the impact of accountability on judgment and choice;
- the constraints that sacred values place on the boundaries of the thinkable;
- the difficult-to-define distinction between political versus politicized psychology; and
- the usefulness of hypothetical-society experiments in disentangling fact and value judgments of the impact of competing policy proposals.
The Good Judgment Project
In his early work on good judgment, summarized in
The tournaments solicited roughly 28,000 predictions about the future and found the forecasters were often only slightly more accurate than chance, and usually worse than basic extrapolation algorithms, especially on longer–range forecasts three to five years out. Forecasters with the biggest news media profiles were also especially bad. This work suggests that there is an inverse relationship between fame and accuracy.
As a result of this work, he received the 2008 University of Louisville Grawemeyer Award for Ideas Improving World Order, as well as the 2006 Woodrow Wilson Award for best book published on government, politics, or international affairs and the Robert E. Lane Award for best book in political psychology, both from the American Political Science Association in 2005. The expert political judgment project also compared the accuracy track records of "foxes" and "hedgehogs" (two personality types identified in Isaiah Berlin's 1950 essay "The Hedgehog and the Fox"). "Hedgehogs" performed less well, especially on long-term forecasts within the domain of their expertise.
These findings were reported widely in the media and came to the attention of Intelligence Advanced Research Projects Activity (IARPA) inside the United States intelligence community—a fact that was partly responsible for the 2011 launch of a four-year geopolitical forecasting tournament that engaged tens of thousands of forecasters and drew over one million forecasts across roughly 500 questions of relevance to U.S. national security, broadly defined.
Since 2011, Tetlock and his wife/research partner
Among the more surprising findings from the tournament were:
- the degree to which simple training exercises improved the accuracy of probabilistic judgments as measured by Brier scores;[3][4]
- the degree to which the best forecasters could learn to distinguish many degrees of uncertainty along the zero to 1.0 probability scale (many more distinctions than the traditional 7-point verbal scale used by the National Intelligence Council);[4][9]
- the consistency of the performance of the elite forecasters (superforecasters) across time and categories of questions;[4][5][6]
- the power of a log-odds extremizing aggregation algorithm to out-perform competitors;[7][8] and
- the apparent ability of GJP to generate probability estimates that were "reportedly 30% better than intelligence officers with access to actual classified information."[9]
These and other findings are laid out in particularly accessible form in the Tetlock and Gardner (2015) book on "
There is a tension, if not contradiction, between the positions taken in the Good Judgment Project and those that Tetlock took in his earlier book Expert Political Judgment: How Good Is It? How Can We Know? (2005). The more pessimistic tone of Expert Political Judgment (2005) and optimistic tone of Superforecasting (2015) reflects less a shift in Tetlock's views on the feasibility of forecasting than it does the different sources of data in the two projects. The Superforecasting book focused on shorter-range forecasts, the longest of which, about 12 months, being only as long as the shortest forecasts in the Expert Political Judgment project. Tetlock and Gardner (2015) also suggest that the public accountability of participants in the later IARPA tournament boosted performance. Apparently, "even the most opinionated hedgehogs become more circumspect"[9] when they feel their accuracy will soon be compared to that of ideological rivals.
Tetlock and Mellers
Tetlock is also President and Chief Scientist of Forecasting Research Institute,[12] which organized, among other things "the Existential Risk Persuasion Tournament" that involved 169 experts recording probability judgements on existential risks between June and October 2022. They asked 80 subject matter experts and 89 "superforecasters" to estimate probabilities for various events by 2030, 2050, and 2100 that might involve either a "catastrophe" (leading to the deaths of at least 10 percent of humanity) or "human extinction" (where the human population would drop below 1,000). Overall, their superforecasters gave a median estimate of 9.05 percent for a catastrophe from whatever source by 2100 while the median according to the experts was 20 percent, with 95 percent confidence intervals of [6.13, 10.25] and [15.44, 27.60] percent for superforecasters and experts, respectively.[13]
Accountability and judgment processes
In a 1985 essay, Tetlock proposed that accountability is a key concept for linking the individual levels of analysis to the social-system levels of analysis.[14] Accountability binds people to collectivities by specifying who must answer to whom, for what, and under what ground rules.[14][15] In his earlier work in this area, he showed that some forms of accountability can make humans more thoughtful and constructively self-critical (reducing the likelihood of biases or errors), whereas other forms of accountability can make us more rigid and defensive (mobilizing mental effort to defend previous positions and to criticize critics).[16] In a 2009 essay, Tetlock argues that much is still unknown about how psychologically deep the effects of accountability run—for instance, whether it is or is not possible to check automatic or implicit association-based biases,[17] a topic with legal implications for companies in employment discrimination class actions.[18]
In addition to his work on the bias-attenuating versus bias-amplifying effects of accountability, Tetlock has explored the political dimensions of accountability. When, for instance, do liberals and conservatives diverge in the preferences for "process accountability" that holds people responsible for respecting rules versus "outcome accountability" that holds people accountable for bottom-line results?[19][20] Tetlock uses the phrase "intuitive politician research program" to describe this line of work.[21]
Taboo cognition and sacred values
Tetlock uses a different "functionalist metaphor" to describe his work on how people react to threats to sacred values—and how they take pains to structure situations so as to avoid open or transparent trade-offs involving sacred values.[22][23][24][25] Real-world implications of this claim are explored largely in business-school journals such as the Journal of Consumer Research, California Management Review, and Journal of Consumer Psychology. This research argues that most people recoil from the specter of relativism: the notion that the deepest moral-political values are arbitrary inventions of mere mortals desperately trying to infuse moral meaning into an otherwise meaningless universe.[26][27][28][29] Rather, humans prefer to believe that they have sacred values that provide firm foundations for their moral-political opinions. People can become very punitive "intuitive prosecutors" when they feel sacred values have been seriously violated, going well beyond the range of socially acceptable forms of punishment when given chances to do so covertly.[30]
Political versus politicized psychology
Tetlock has a long-standing interest in the tensions between
Experimental political philosophy
In collaboration with
References
- ^ Tetlock, Phil. "CV" (PDF).
- ISBN 978-0-691-12871-9.
- ^ S2CID 145516680.
- ^ S2CID 3118872.
- ^ PMID 25581088.
- ^ S2CID 42143367.
- ^ .
- ^ .
- ^ a b c Tetlock, P.E.; Gardner, D. (2015). Superforecasting: The Art and Science of Prediction. New York: Crown.
- ^ PMID 21823782.
- ^ Tetlock, P.E. (2009). "Playing tarot on K Street". The National Interest (Sept–Oct): 57–67.
- Wikidata Q122208275
- Wikidata Q122208144
- ^ a b Tetlock, P.E. (1985). "Accountability: The neglected social context of judgment and choice". Research in Organizational Behavior. 7: 297–332.
- ISBN 9780120152254.
- S2CID 18195061.
- .
- ^ Mitchell, P.G.; Tetlock, P.E. (2006). "Anti-discrimination law and the perils of mind reading". The Ohio State University Law Review. 67: 1023–1121.
- .
- S2CID 58924766.
- PMID 12088240.
- ^ Tetlock, P.E.; Peterson, R.; Lerner, J. (2009). "Revising the value pluralism model: Incorporating social content and context postulates". Ontario Symposium on Social and Personality Psychology: Values.
- PMID 10821194.
- .
- S2CID 8532142.
- S2CID 157853775.
- doi:10.1086/662070.
- S2CID 14394449.
- S2CID 6181783.
- S2CID 8228107.
- ^ Tetlock, P.E. (2007). "Psychology and politics: The challenges of integrating levels of analysis in social science". Social Psychology: Handbook of Basic Principles.
- ^ Tetlock, P.E. (1998). "Social psychology and world politics". Handbook of Social Psychology.
- .
- .
- .
- S2CID 9834343.
- PMID 23773046.
- PMID 25844574.
- S2CID 51690723.
- PMID 25036715.
- S2CID 206263185.
- JSTOR 3791569.
- ISBN 9780521431996.
- S2CID 53075954.
- ISBN 978-0-19-532091-6.
- .
- .
- .
- .
External links
- Official website
- Phil Tetlock at Social Psychology Network maintained by Scott Plous