1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 1/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
Chapter 2 The Empirical Approach to Political Science
In chapter 2 of the textbook, we describe the scientific method and argue that it underlies empirical political science research. We note that empiricism is not the only method of obtaining knowledge—there are others that lots of people fervently adhere to—and a case can be made against trying to study politics scientifically. (There are even disagreements about the definition and nature of the scientific method.) Nevertheless, this way of acquiring knowledge is so common that many social scientists take it for granted, as do many average citizens. The problem is that scientific claims are sometimes difficult to distinguish from other kinds of statements. Nor is it always clear whether and how empirical analysis can be applied to propositions stated in theoretical and practical terms. The following questions, problems, and assignments therefore offer opportunities for you to think about the application of the empirical approach. Note that not all of the questions have one “right” answer. Many, in fact, require a lot of careful thought. And it is often necessary to redefine or clarify words or phrases, to look for hidden assumptions, and to consider whether or not statements can be “translated” into scientific terms.
Exercise 2–1. Make a list of the characteristics of scientific knowledge. The list may help organize your thinking for other questions in this chapter.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
https://jigsaw.vitalsource.com/books/9781506306728/epub/OEBPS/s9781483396002.i88.xhtml
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 2/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
Exercise 2–2. The chapter mentions several characteristics of scientific knowledge. It also warns about confusing commonsense and casual observations with verified or potentially verifiable claims. In this exercise you will try to identify and differentiate between normative statements, which are statements that suggest how things should be, and empirical statements, which are statements that can be measured, tested, or verified through observation. For each of the following statements, decide if the statement is normative, empirical, a combination of the two, or if there is not enough information in the statement for you to decide. Write your responses in the space provided after each statement and briefly explain why you think your answer is correct.
a. The Republicans won a majority of seats in the U.S. Senate in the 2014 midterm elections.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
b. Offshore drilling should be banned in Alaska because it is immoral to risk damaging an otherwise pristine natural environment.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
c. Early voting periods should be shortened because they disproportionately favor Democratic candidates for office.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
d. Multiparty systems are better for representation than two-party systems.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 3/23
e. More people voted in the most recent election than in the previous election.
_______________________________________________________________________________________
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 4/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
f. Senior citizens are more likely to vote than college students.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
g. Scotland would be better off today if it had voted for independence in 2014.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
h. Freedom of religion is a fundamental right of all people.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
i. Democratic leaders always have better ideas on social policy than Republican leaders.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 5/23
j. Decriminalizing marijuana distribution and regulating sales can create a substantial source of tax revenue.1
_______________________________________________________________________________________
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 6/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
k. Too many people have been unable to find work.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
l. It doesn’t make any sense to vote because so many ballots are cast in an election that no single vote is going to make a difference in the outcome.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
Exercise 2–3. Below are several paragraphs drawn from an article in which the author discusses a debate over how congressional districts are drawn:
I argue that map makers ought to “pack” districts with as many like-minded partisans as possible. Trying to draw “competitive districts” effectively cracks ideologically congruent votes into separate districts, which has the effect of increasing the absolute number of voters who will be unhappy with the outcome and dissatisfied with their representative.
One common objection to this method of districting [packing] is that it would add to the polarization in Congress by creating overwhelmingly Republican (Democratic) districts that are more likely to elect very conservative (liberal) members.
Some states, like Arizona, have passed laws or referenda specifying that a districting plan ought to maximize the number of competitive districts. This is not particularly surprising because the common wisdom among most voters and certainly among the media is that the House of Representatives does not have enough competitive districts currently, and that an increase in the number of competitive elections or in the amount of turnover in Congress will somehow enhance representation.
From: Thomas L. Brunell, “Rethinking Redistricting: How Drawing Uncompetitive Districts Eliminates Gerrymanders, Enhances Representation, and Improves Attitudes toward Congress,” PS: Political Science and Politics 40 (January 2006): 77–85.
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 7/23
a. Identify two normative statements or claims from the preceding text that can’t be tested empirically as currently expressed.
_______________________________________________________________________________________
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 8/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
b. Write down three statements or claims in the preceding text that are empirical and can be tested.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
Exercise 2–4. Many people make the following claim: “You can’t predict human behavior.” In light of our discussion of the scientific approach to political science, do you find this claim to be valid? (Hint: Try breaking human behavior down into more specific traits or properties. For example, consider if people are naturally aggressive. Then think of ways that this might be empirically investigated.)
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 9/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
Exercise 2–5. Chapter 2 of the textbook highlights criticisms of the empirical study of political science. List the criticisms here.
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
Which of the criticisms do you find most compelling and why?
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
_______________________________________________________________________________________
Helpful Hints
Decoding the Ambiguity of Political Discourse As we stated earlier, political discourse is frequently ambiguous, and you have to think carefully about what words really say. Sometimes a politician’s meaning is clear. Consider President Obama’s Rose Garden speech on a proposed nuclear deal with Iran.2 In his speech, President Obama said, “The Islamic Republic of Iran has been advancing its nuclear program for decades,” which was a straightforward factual statement that could be verified empirically. But he also claimed, “I made clear that we were prepared to resolve this issue diplomatically, but only if Iran came to the table in a serious way.” The word serious makes this statement a judgment, not a factual proposition. Whether something is serious or not is an opinion. In some people’s minds, Iran had been making serious attempts at diplomacy, but others thought differently. Who was right? It is hard to see how the proposition could be scientifically proven true or false.
2 “Statement by the President on the Framework to Prevent Iran from Obtaining a Nuclear Weapon,” April 2, 2015, www.whitehouse.gov/the-press-office/2015/04/02/statement-president-framework-prevent-iran-obtaining-nuclear-weapon.
https://jigsaw.vitalsource.com/books/9781506306728/epub/OEBPS/s9781483396002.i88.xhtml
http://www.whitehouse.gov/the-press-office/2015/04/02/statement-president-framework-prevent-iran-obtaining-nuclear-weapon
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 10/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
Exercise 2–6. Chapter 2 in the textbook focuses on empirical research and using the scientific method. Empiricism is defined as “relying on observation to verify propositions.” In this exercise you will want to consider how you might make observations to verify propositions. For each of the following empirical statements, indicate where you might look or how you might make observations to find information to verify the statement. In the example below, you will see that while you only need to provide one answer, there are many potential verification methods.
Example: A majority of voters oppose the use of the death penalty.
Answer: “I would search for survey results on national news organization Web sites,” or “I would randomly sample students at my university and ask if they support the death penalty,” or “I would call an interest group that focuses on the death penalty and ask about support for the death penalty among voters.”
a. More voters are registered with the Democratic Party than the Republican Party in Pennsylvania.
_______________________________________________________________________________________
b. The British Parliament currently has more than twelve parties represented by members.
_______________________________________________________________________________________
c. Someone working forty hours a week and earning the minimum wage will still be below the federal poverty level for a family of two.
_______________________________________________________________________________________
d. People are not willing to pay higher taxes to address climate change.
_______________________________________________________________________________________
e. Texas has the most stringent voter identification law in the United States.
_______________________________________________________________________________________
f. Ninety percent of deaths attributed to diarrheal diseases like cholera are children five years of age or younger.
_______________________________________________________________________________________
Exercise 2–7. In order to think about the scientific components of empirical research, it is useful to compare research projects that are more scientific with projects that are less scientific. For this exercise you will select two examples of empirical research with publicly available results on the Internet.
The first step is to find two projects to compare. You should look for a project that closely adheres to the scientific method and a project that clearly does not. For example, you might search for a report or opinion poll from a commercial organization like Gallup or Roper, a news organization like the New York Times or NBC News, a research institution like Brookings or Cato, or a government agency like the Government Accounting Office or the Environmental Protection Agency. These sources are more likely to generate research projects that follow the scientific method. You might also consider projects produced by entertainment media companies like ESPN, US Weekly, or TMZ. These organizations are less likely to produce scientific research and should provide a clear contrast with more scientific work.
a. Identify the sources for the two projects you selected and briefly describe each project. Include the URLs where they can be found.
1. _______________________________________________________________________________________
https://jigsaw.vitalsource.com/books/9781506306728/epub/OEBPS/s9781483396002.i88.xhtml
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 11/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
_______________________________________________________________________________________ _______________________________________________________________________________________ 2. _______________________________________________________________________________________ _______________________________________________________________________________________ _______________________________________________________________________________________
b. Compare and contrast the scientific nature of each project. Make sure to describe the scientific components each project made use of, such as random samples, replicability, generalization, etc.
_______________________________________________________________________________________ _______________________________________________________________________________________ _______________________________________________________________________________________ _______________________________________________________________________________________ _______________________________________________________________________________________ _______________________________________________________________________________________
1 Kelley Phillips Erb, “It’s No Toke: Colorado Pulls in Millions in Marijuana Tax Revenue,” Forbes, March 11, 2014, http://www.forbes.com/sites/kellyphillipserb/2014/03/11/its-no-toke-colorado-pulls-in-millions-in-marijuana-tax- revenue/.
http://www.forbes.com/sites/kellyphillipserb/2014/03/11/its-no-toke-colorado-pulls-in-millions-in-marijuana-tax-revenue/
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 12/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
Chapter 3 Beginning the Research Process Identifying a Research Topic, Developing Research Questions, and Reviewing the Literature
Probably everyone would agree that picking and narrowing a topic are the hardest tasks confronting a new researcher. One can, of course, easily identify issues worthy of research, such as the war on terror or the effects of television on democracy. But moving from a desire to “do something on ________” to a specific theme that can be researched with relatively few resources and little time can be quite challenging.
Part of the difficulty lies in having enough information about the subject matter. What is already known about it? How have previous investigators studied it? What important questions remain unanswered? All these considerations motivate the review of the literature.
Chapter 3 of the textbook provides readers with some insights and tips for conducting an effective literature review. It is particularly important that you understand the differences between different kinds of sources, such as scholarly and mass circulation publications.
We assume that everyone knows roughly how to surf the Internet. So these assignments mainly force students to think carefully about what they are looking for and finding. As mentioned in the textbook chapter, you can easily enough use Google or equivalent software to search for terrorism or television or any other subject. But these efforts are usually unsuccessful because they lead to too much irrelevant information. Instead we encourage the application of more specialized databases and library tools.
Exercise 3–1. For this exercise you will begin thinking about how to find a research question for a research paper. One potential source for ideas is a political news Web site. Visit an online political news organization like Politico.com or BBC.com. On the lines following, write six research questions based on political news stories from the organization you selected.
1. Research question: ______________________________________________________________
_______________________________________________________________________________________
2. Research question: _______________________________________________________________
_______________________________________________________________________________________
3. Research question: _______________________________________________________________
_______________________________________________________________________________________
4. Research question: _______________________________________________________________
_______________________________________________________________________________________
5. Research question: _______________________________________________________________
_______________________________________________________________________________________
6. Research question: _______________________________________________________________
_______________________________________________________________________________________
https://jigsaw.vitalsource.com/books/9781506306728/epub/OEBPS/s9781483396002.i110.xhtml
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 13/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
Exercise 3–2. A potential source for research topic ideas is a political science journal. To complete this exercise you will need to find a copy of a political science journal, such as the American Political Science Review. Inside you will find a series of research articles. You should choose three articles that interest you. First, for each of the articles, identify the research question. (Hint: The research question is often found in the title, in an abstract, or in the first paragraph of the article.)
1. ________________________________________________________________________________ 2. _______________________________________________________________________________ 3. _______________________________________________________________________________
Next, think about how you might investigate a similar topic to those found in each article you have chosen. Write down three new research questions below.
1. ________________________________________________________________________________ 2. ________________________________________________________________________________ 3. ________________________________________________________________________________
Exercise 3–3. Literature reviews are an important part of the research process. They provide the context and background so that a research project furthers our understanding of a political phenomenon by, among other things, attempting to resolve conflicting evidence, investigating a topic in different settings and populations, or using different measures of key concepts. Read the following excerpt of an article by David Niven.1
In reviewing the literature on the effects of negative campaign advertising, the author identifies several problems with the state of knowledge about the topic. What are these problems?
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 14/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
A Field Experiment on the Effects of Negative Campaign Mail on Voter Turnout in a Municipal Election
DAVID NIVEN, Ohio State University
This field experiment is used to expose a random sample of voters in a 2003 mayoral race to various pieces of negative direct mail advertising. Exposure to the negative advertising stimulus improved turnout overall about 6 percent over that of the control group. Results show that different topics and amounts of negative advertising had different effects on turnout. The results suggest that alarm bells sounded by some previous research and by public officials may be overheated, because the effects of campaign negativity may not be monolithic, and it would appear political negativity can have a positive effect on turnout.
Is voter turnout subject to the effects of negative advertising? Political science research answers alternatively yes, no, or maybe. This study uses a field experiment in which voters in a mayoral contest were randomly exposed to negative campaign mail to assess the effects of negativity and move toward a better understanding of what has become a thoroughly confusing line of scholarship.
Indeed two of the most prominent studies on campaign advertising offer quite differing views on the effects of negativity. Ansolabehere and Iyengar (1995) conclude that negative ads directly result in lower voter turnout. Far from qualifying their results, Ansolabehere and Iyengar (1995:12) assert the evidence is definitive that negative campaign messages “pose a serious threat to democracy” and are “the single biggest cause” of public disdain for politics (2). By contrast, Green and Gerber (2004: 59) describe the effect of campaign advertising negativity as “slight.” Depending on the circumstances, Green and Gerber find negativity modestly nudging turnout upwards or downwards. Far from labeling their results conclusive, however, Green and Gerber suggest much more work needs to be done to better understand negativity’s effect.
While this study addresses Green and Gerber’s call for continuing research on this question, studying the effects of campaign negativity is of value beyond simply satisfying an academic curiosity. Understanding the effects of negativity obviously has implications for how candidates, parties, and interest groups conduct campaigns. Moreover, various government bodies have expressed interest in some form of negative ad regulation. Legislative proposals have been introduced at the local, state, and national level to limit negative campaigning with measures such as forcing candidates to appear in their ads or subjecting political advertising copy to some form of official scrutiny. Indeed, “I would ban negative ads,” says Senator John McCain (R-Arizona) of the legislation he would create if he could find a constitutional procedure to accomplish the task.1 Thus, to understand negativity and its effects better is to become better armed to participate in a debate which pits the First Amendment against the very popular notion of cleaning up campaigns.
Negativity and its Effects While there is no consensus definition of negative advertising, most researchers start with the notion that negativity involves the invoking of an opponent by a candidate (for example, Djupe and Peterson 2002). That is, a negative ad suggests the opponent should not be elected rather than that the sponsoring candidate should be elected. West (2001) defines a negative campaign ad as advertising that focuses at least 50 percent of its attention on the opponent rather than the sponsor of the ad. Such negativity may be focused on any aspect of the opponent’s record, statements, campaign, or background.
Precise estimates vary, but there is no doubt that negativity occupies a significant place in the modern campaign advertising arsenal. In the 2000 presidential election, for example, content analyses of television commercials from the two parties’ nominees found between half and 70 percent were negative (Benoit et al. 2003; West 2001). Other forms of communication, such as radio ads, were even more negatively oriented (Benoit et al. 2003). Looked at from another tack, researchers have found as few as 20 percent of ads directed purely toward extolling the virtues of the sponsoring candidate (Freedman and Lawton 2004).
Employing a variety of methods, researchers have produced intriguing results in studies of negativity effects. However, those results variously demonstrate the negative, positive, or lack of effect of negative advertising on voter turnout.
Negative Ads Alienate Citizens
Dating back at least to the Watergate era, political scientists have documented the capacity of the American public to become categorically dismissive of political leaders. That is, the untrustworthy behavior of one political figure can transcend the individual and come to represent the political class as a whole (Arterton 1974; Craig 1993; Miller 1974).
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 15/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
Consistent with that notion, researchers have found evidence that negative political advertising negatively affects recipients’ feelings not only toward the target of the attack but also toward its sponsor (Basil, Schooler, and Reeves 1991; Lemert, Wanta, and Lee 1999; Garramone 1984; Merritt 1984; Roese and Sande 1993) and even toward politics more generally (Ansolabehere and Iyengar 1995; Ansolabehere, Iyengar, Simon, and Valentino 1994; Houston and Roskos-Ewoldsen 1998; Houston, Doan, and Roskos-Ewoldsen 1999).
Using various real world races, including senate, gubernatorial, and mayoral campaigns, Ansolabehere and Iyengar (1995) exposed subjects in a laboratory setting to campaign television ads of various tone. Participants in Ansolabehere and Iyengar’s experiments who were shown a negative television ad were almost 5 percent less likely to report they planned on voting in the upcoming election than participants who were shown a positive ad. Those who saw negative ads were also less likely to express confidence in the political system, and less likely to express political efficacy. Ansolabehere and Iyengar conclude that negativity in politics is causing declining voter interest and participation.
According to other experimental studies, the capacity for negative ads to produce diffuse political negativity varies with the precise details of the ads. For example, Budesheim, Houston, and DePaola (1996) found that unsubstantiated negative attacks reduced respondents’ ratings of both the attacker and the target. See also Shapiro and Rieger (1992). Other scholars have suggested that issue related attacks are more apt to be seen as fair game than attacks focused on personal characteristics (Johnson-Cartee and Copeland 1989; Roddy and Garramone 1988).
Nevertheless, there is a significant limitation in experimental laboratory work on this subject that is inherent to the method. For example, Ansolabehere and colleagues show subjects’ campaign ads then inquire about their intention to vote. Various other experimental studies inquire about intentions to vote, or candidate preferences, but none is equipped to measure actual resulting behavior. Of course, there is no shortage of psychological research demonstrating the gaping chasm between knowing someone’s intentions or preferences and knowing their actual resulting behavior; for example, Kaiser and Gutscher (2003). Moreover, political scientists have regularly documented the propensity of Americans to mislead researchers when they are asked about their voting habits; for example, Bernstein, Chadha, and Montjoy (2001). Thus, regardless of the rigor of the researchers or the ingenious nature of their design, the laboratory remains a difficult setting in which to demonstrate the effect of negative advertising on the real world behavior of turning out to vote.
Negative Ads Do Not Alienate Citizens
Meanwhile, other researchers posit that the effects of negativity might not be negative at all. Finkel and Geer (1998), for example, argue that negative ads stimulate turnout because they provide highly relevant information.
Indeed, researchers have attributed positive or stimulating effects to feelings of negativity as an explanation for some notable political phenomena. For example, some scholars conclude that one source of the typical midterm loss, in which the president’s party generally loses House seats in elections without the presidency on the ballot, is that voters who are critical of the president have a higher motivation to participate than voters who are positively inclined toward the president (Kernell 1977).2
Contemporary evidence also suggests that reception of negative advertising may contribute to effective citizenry. Brians and Wattenberg (1996), using survey data, show that citizens who recalled seeing negative political advertising during the 1992 presidential election were more accurate in assessing candidates’ overall issue positions in that election.3 In fact, recalling ads was more closely associated with holding accurate assessments of the candidates than was regularly watching television news or reading a newspaper. West (2001), studying the content of the ad rather than the effects on recipients, similarly supports the notion of the value of negative advertising. West (2001: 69) finds “the most substantive appeals actually came in negative spots.”
Consistent with this line of thinking, several studies have found links between campaign negativity and increased voter turnout (Lau and Pomper 2001; Djupe and Peterson 2002; Kahn and Kenney 1999; Finkel and Geer 1998; Wattenberg and Brians 1999). Based on survey results or aggregate trends, these studies are better able than laboratory experiments to demonstrate actual voter turnout, but are far weaker in demonstrating individual reception of negative ads and thus are less firmly able to demonstrate a causal link between receiving ads and deciding to vote.4
Given the limitations of both laboratory experiments and non-experimental approaches, a strong argument can be made for the need for field experiments to address negativity
1/23/2019 VitalSource: Working with Political Science Research Methods
https://bookshelf.vitalsource.com/#/books/9781506306728/cfi/6/20!/4/2/4/2@0:0 16/23
PRINTED BY: tmomen@gmail.com. Printing is for personal, private use only. No part of this book may be reproduced or transmitted without publisher's prior permission. Violators will be prosecuted.
effects. Field experiments offer internal validity (with random assignment and controlled exposure to the stimulus) and external validity (with diverse participants and a measurement of the actual resulting behavior).
Relatively few field experiments on negative advertising have been reported. Pfau and Kenski (1990) did use field experiments to assess the strategic value of negative campaign messages by exposing randomly chosen voters to independently created direct mail and push poll messages. More recently, Green and Gerber (2004) have employed field experiments to study a vast array of potential campaign influences on voter turnout. Among their studies have been two which included negative political advertising sent by mail.
Green and Gerber (2004) sent negative campaign mail to a sample of voters in a Connecticut mayoral election. Here both reception of the ad and actual voter turnout can be established, and the subjects include a random sample of potential voters. Green and Gerber found the effects of negative ads on turnout in the mayoral race were negative but quite small. In another contest, using the same basic design but different mailings, they found the effect of negative ads on turnout was small but positive. Green and Gerber (2004: 59) tentatively conclude that the effect of negative campaign mail on turnout is best understood as “slight.”
Why do Ansolabehere and Iyengar (1995) find negativity an inherent threat to voter turnout while Green and Gerber (2004) find negativity has little relevance to turnout? Differences in methodology could explain the disparate conclusions. Ansolabehere and Iyengar (1995) used television to convey negative messages while Green and Gerber (2004) used mail. However, nothing in Ansolabehere and Iyengar’s (1995) theoretical approach suggests the effects of negativity require television as the medium of communication. Ansolabehere and Iyengar used a diverse but not random group of participants, while Green and Gerber (2004) used participants randomly drawn from several towns. However, nothing in Ansolabehere and Iyengar’s (1995) protocol suggests they assembled a group of participants particularly attuned to the effects of negative messages. Probably the two most significant differences between the studies are that Ansolabehere and Iyengar’s participants received their campaign communication in a laboratory, rather than in their homes (as was the case for Green and Gerber), and were asked about their intention to vote, rather than observed actually voting (as was the case for Green and Gerber). Both those factors might have contributed to an exaggeration of the negativity effect in Ansolabehere and Iyengar’s study.5 Beyond methodological differences, though, another compelling explanation exists. It is possible that both teams of researchers were measuring a realistic effect. That is, there may not be a monolithic negativity effect, and depending on the content of the ad and the circumstances of the race, negativity may in fact have quite varying effects on turnout.