Hostname: page-component-8448b6f56d-dnltx Total loading time: 0 Render date: 2024-04-18T09:12:58.289Z Has data issue: false hasContentIssue false

A Robust Transformation Procedure for Interpreting Political Text

Published online by Cambridge University Press:  17 May 2007

Lanny W. Martin
Affiliation:
Department of Political Science, Rice University, PO Box 1892, MS 24, Houston TX 77251-1892, e-mail: lmartin@rice.edu
Georg Vanberg*
Affiliation:
Department of Political Science, University of North Carolina, Chapel Hill, NC 27599-3265
*
e-mail: gvanberg@unc.edu (corresponding author)

Abstract

In a recent article in the American Political Science Review, Laver, Benoit, and Garry (2003, “Extracting policy positions from political texts using words as data,” 97:311—331) propose a new method for conducting content analysis. Their Wordscores approach, by automating text-coding procedures, represents an advance in content analysis that will potentially have a large long-term impact on research across the discipline. To allow substantive interpretation, the scores produced by the Wordscores procedure require transformation. In this note, we address several shortcomings in the transformation procedure introduced in the original program. We demonstrate that the original transformation distorts the metric on which content scores are placed—hindering the ability of scholars to make meaningful comparisons across texts—and that it is very sensitive to the texts that are scored—opening up the possibility that researchers may generate, inadvertently or not, results that depend on the texts they choose to include in their analyses. We propose a transformation procedure that solves these problems.

Type
Research Article
Copyright
Copyright © The Author 2007. Published by Oxford University Press on behalf of the Society for Political Methodology 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Authors' note: We would like to thank Ken Benoit, Michael Laver, three anonymous referees, and the editor for comments on earlier versions of this article.

References

Budge, Ian, Klingemann, Hans-Dieter, Volkens, Andrea, Bara, Judith, and Tanenbaum, Eric. 2001. Mapping policy preferences: Estimates for parties, electors, and governments 1945-1998. Oxford: Oxford University Press.CrossRefGoogle Scholar
Laver, Michael, Benoit, Kenneth, and Garry, John. 2003. Extracting policy positions from political texts using words as data. American Political Science Review 97: 311–31.CrossRefGoogle Scholar
Laver, Michael, and Ben Hunt, W. 1992. Policy and party competition. New York: Routledge.Google Scholar
Monroe, Burt L., and Maeda, Ko. 2004. Talk's cheap: Text-based estimation of rhetorical ideal-points. Working paper. Michigan State University.Google Scholar