Abstract
Objectives
Prior research indicates that public assessments of the manner in which the police exercise their authority are a key antecedent of judgments about the legitimacy of the police. In this study, the importance of context in influencing people’s assessment of police wrongdoing is examined.
Methods
A randomized factorial experiment was used to test how respondents perceive and evaluate police–citizens interactions along a range of types of situations and encounters. 1,361 subjects were surveyed on factors hypothesized to be salient influences on how citizens perceive and evaluate citizen interactions with police. Subjects viewed videos of actual police–citizen encounters and were asked for their evaluations of these observed encounters. Contextual primes were used to focus subjects on particular aspects of the context within which the encounter occurs.
Results
Structural equation models revealed that social contextual framing factors, such as the climate of police–community relations and the legality of the stop that led to the encounter, influence citizen appraisals of police behavior with effects comparable in size to and even larger than demographic variables such as education, race, and income.
Conclusions
These results suggest that the understandings and perceptions that people bring to a situation are important determinants of their assessment of police fairness. The police can positively influence citizen interpretations of police actions by striving to create a climate of positive police–community relationships in cities.
Similar content being viewed by others
Notes
Prior studies suggest the value of this type of vignette approach (Seron et al. 2006), but have used written vignettes of uncertain realism. We utilized actual videos of police interactions centered on the core issues in the study to supplement the vignettes and provide salient visual cues and contextual primes to stimulate respondents.
KN has completed several studies to validate its methodology, including both accuracy and nonresponse bias. For example, Krosnick and Chang (2001) compared responses to a single survey on the 2000 presidential election using three different samples and methods: KN, Harris Interactive (HI), and a RDD survey conducted by the Ohio State University Center for Survey Research. They reported that the KN samples had higher completion rates, closer approximation to census estimates, and less skew on basic measures of opinion and voting behavior. They also show higher measurement reliability and “non-differentiation” of responses for Internet-enabled data collection compared to RDD. Skitka and Mullen (2002) and Skitka et al. (2002) show that on questions of civic values and actions, in particular, telephone survey responses were more often influenced by respondents’ motivations to present themselves in a positive light to interviewers compared to internet-enabled surveys. Benchmarking studies show that KN samples yield estimates for several health behaviors—current smoking, diabetes, ulcer, migraine headaches, and stroke—similar to the estimates in the National Health Interview Survey conducted by telephone annually by CDC. The average difference in the results is about 1 percentage point (Baker et al. 2003).
The 15 U.S. cities were Baltimore, Boston, Chicago, Cleveland, Denver, Detroit, Houston, Los Angeles, Miami, New York, Philadelphia, Phoenix, San Diego, Seattle, and Washington, DC. Knowledge Networks completed between 85 (New York) and 98 (Baltimore) interviews in each city.
The survey was fielded on March 27, 2008 to a sample of 2,183 Knowledge Networks panel members. To be included in this analysis, a respondent had to view all three videos (N = 1,361).
These questions were randomly administered before or after the videos were viewed. 676 respondents completed the questionnaire after seeing the videos and 685 respondents completed the questionnaire before seeing the videos. To investigate whether the timing of the administration of the questionnaire impacted our findings, we split the sample and replicated the full sample analyses presented here. When the impact of the four framing effects dummy variables (city climate of police-citizen relations, stop context, officer history, and citizen history) on the “police were wrong/should be punished” outcome variable were estimated, the two split samples produced coefficients of similar direction, magnitude, and statistical significance (p < .05). As such, whether the respondent answered the questionnaire before or after the video did not substantively impact the findings presented in Tables 2, 3, and 4.
OLS regressions were used to analyze the normally-distributed interval-level dependent variables “age” and “conservative” scale. Logistic regression models were used to examine the remaining dichotomous dependent variables: “White” (0 = non-white, 1 = white), “male” (0 = female, 1 = male), “income >$40 K” (0 = household income ≤$40,000 per year, 1 = household income >$40,000 per year), “college+” (0 = less education than a bachelor’s degree, 1 = bachelor’s degree or higher), and “victim” (0 = household member was a prior victim of crime, 1 = household member was not a prior victim of crime).
Table 2 identifies only 6 statistically-significant (p < .05) differences across 168 hypothesis tests (3 videos * 8 contextual dummy variables per video * 7 outcome variables). This is lower than the 8.4 statistically-significant results that would be expected by chance alone for 168 hypothesis tests at a .05 level of statistical significance. We also ran similar OLS and Probit regression models for all observed variables that comprised the latent variables described above; these analyses yielded similar results that supported successful randomization. Further, we created an 81 cell variable representing the different combinations of framing conditions and social contextual issues and ran a series of Chi square tests to examine whether the observed distributions of cell counts were significantly different from the expected distribution of cells counts. We did not find any statistically significant differences between the observed and expected distributions, suggesting successful randomization by this measure.
These videos showed real-life interactions between police officers and citizens. We acquired the three study videos from the internet and edited the footage down to 30 s that captured the key events briefly described in this section.
We also recognized that our main effects models could be structured as hierarchical linear models to analyze multiple observations nested within a single subject. This analysis required restructuring the study dataset into a longitudinal panel design where each respondent views three consecutive videos for a total of 4,083 observations (3 videos * 1,361 respondents). In Stata 12.0, we used the XTSET command to declare that the data were structured in the longitudinal panel format and the XTREG command to execute hierarchical linear models to analyze the data. Video dummy variables and manipulated social context dummy variables were used to measure the main effects of viewing the different police-citizen interaction videos and the randomly-allocated framing effects, respectively. Interactive dummy variables were constructed (video dummies * manipulated social context dummies) and entered into the model to determine whether the observed framing effects were consistent across the three videos. These results were congruent with the main effects findings presented here and are available upon request from the authors.
Since they are not directly measured, latent variables do not have intrinsic variances. For the factor loadings in Table 3, the variances of the latent variables were constrained to equal “1” for ease of interpretation (StataCorp 2011, p. 254). These coefficients can be interpreted as correlations that range from “0” to “1”.
Unfortunately, small numbers of the 1,361 respondents did not answer all of the study questions for each video viewed and for the questionnaire. We handled missing responses through listwise case deletions. As Table 2 presents, the number of respondents included in our analyses ranged from 1,232 (90.5 % of 1,361) to 1,246 (91.5 %). We used t-tests to examine whether there were any statistically-significant differences between included and excluded cases for the covariates used in the SEM analyses presented in Tables 2, 3 and 4. Our simple comparisons did not reveal any statistically-significant differences between the missing cases and the included cases. This suggests that the data were missing at random and, as such, listwise case deletions were an appropriate method to address the very modest missing data problem.
The CFI assesses the fit of a user-specified solution in relation to a more restricted, nested baseline model in which the covariances among all input indicators are fixed to zero or no relationship among variables is posited (Brown 2006, p. 84). The CFI coefficient value ranges from 0 to 1.00 with values greater than 0.90 indicating a reasonably good fit of the hypothesized model (Hu and Bentler 1999). RMSEA takes the error of population approximation and degrees of freedom into account and measures the lack of fit of the hypothesized model to the population covariance matrix. SRMR is estimated in a similar to RMSEA but does not penalize model complexity. As a general rule of thumb, SRMR and RMSEA results of 0.05 or less indicates a close approximate fit of the model (Hu and Bentler 1999).
The sex effects were statistically significant in Videos 2 and 3 and in the expected direction with males expressing more favorable attitudes toward police.
Arguably the effect of Education should be estimated without controlling for income, since presumably part of the effect of Education is mediated through Income. Dropping Income as a control only results in the effect of Education being reduced—with the effect dropping to −0.78 (SE = .028, p < .05). In our sample, levels of Education are very modestly correlated with levels of Income (r = .28). In reduced regression models of the effects of Education and Income on respondent assessment of police behavior, we find that both are statistically significant predictors of the outcome variable in all three videos. Controlling for Income, increasing levels of Education are associated with more negative perceptions of observed police behavior. This suggests that more educated people are more critical appraisers of police behavior independent of how much money they earn. Clearly, future research in this area should seek to better disentangle these complicated effects.
References
Baker L, Wagner TH, Singer S, Bundorf MK (2003) Use of the internet and email for health care information: results from a national survey. JAMA 289:2400–2406
Balcetis E, Lassiter GD (eds) (2010) Social psychology of visual perception. Psychology Press, NY
Bargh J, Chartrand T (2000) Priming and automaticity research. In: Reis HT, Judd CM (eds) Handbook of research methods in social and personality psychology. Cambridge University Press, NY, pp 253–284
Beeghley L (2004) The structure of social stratification in the United States. Pearson, Allyn & Bacon, Boston
Beetham D (1991) The legitimation of power. Humanities Press International, Atlantic Highlands
Bollen KA (1989) Structural equations with latent variables. Wiley, NY
Bollen KA, Long JS (eds) (1993) Testing structural equation models. Sage, Newbury Park
Bottoms A, Tankebe J (2012) Beyond procedural justice: a dialogic approach to legitimacy in criminal justice. J Crim Law Criminol 102:119–170
Box GE, Hunter WG, Hunter JS (2005) Statistics for experimenters: design, innovation, and discovery, 2nd edn. Wiley, NY
Braga AA (2008) Problem-oriented policing and crime prevention, 2nd edn. Lynne Rienner, Boulder
Brandl SG, Frank J, Worden RE, Bynum T (1994) Global and specific attitudes toward the police: disentangling the relationship. Justice Q 11:119–134
Brown TA (2006) Confirmatory factor analysis for applied research. Guilford, NY
Brown B, Benedict W (2002) Perceptions of the police: past findings, methodological issues, conceptual issues, and policy implications. Policing 25:543–580
Brunson RK (2007) Police don’t like black people: African-American young men’s accumulated police experiences. Criminol Pub Pol 6:71–101
Brunson RK, Miller J (2006) Young black men and urban policing in the United States. Brit J Criminol 46:613–640
Brunson RK, Weitzer R (2009) Police relations with black and white youths in different urban neighborhoods. Urb Aff Rev 44:858–885
Carr PJ, Napolitano L, Keating J (2007) We never call the cops and here is why: a qualitative examination of legal cynicism in three Philadelphia neighborhoods. Criminology 45:701–736
Coicaud J-M (2002) Legitimacy and politics: a contribution to the study of the political right and political responsibility. Cambridge University Press, Cambridge
Couper MP (2000) Web surveys: a review of issues and approaches. Pub Opin Q 64:464–494
Cronbach LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334
Dennis JM (2001) Are internet panels creating professional respondents? The benefits of online panels far outweigh the potential for panel effects. Mark Res Summer:34–38
Easton D (1975) A reassessment of the concept of political support. Br J Polit Sci 5:435–457
Erdley CA, D’Agostino P (1988) Cognitive and affective components of automatic priming effects. J Pers Soc Psychol 54:741–747
Fagan J (2002) Law, social science and racial profiling. Just Res Policy 4:104–129
Fagan J, Malkin V (2003) Theorizing community justice through community courts. Fordham Urb Law J 30:857–953
Fisher R (1926) The arrangement of field experiments. J Minist Agric G B 33:503–513
Fiske ST, Taylor SE (1991) Social cognition, 2nd edn. McGraw-Hill, NY
Fyfe JJ (2002) Too many missing cases: holes in our knowledge about police use of force. US Department of Justice, Washington
Gaertner SL, Mann J, Murrell A, Dovidio JF (1989) Reducing intergroup bias: the benefits of recategorization. J Pers Soc Psychol 57:239–249
Gallagher C, Maguire E, Mastrofski S, Reisig M (2001) The public image of the police. International Association of Chiefs of Police, Alexandria
Gardner MP (1983) Advertising effects on attributes recalled and criteria used for brand evaluations. J Consum Res 10:310–318
Gau J (2010) Basic principles and practices of structural equation modeling in criminal justice and criminology research. J Crim Just Educ 21:136–151
Gottfredson GD (1981) Schooling and delinquency. In: Martin SE, Sechrest LB, Redner R (eds) New directions in the rehabilitation of criminal offenders. Report of the panel on research on rehabilitative techniques. National Academy Press, Washington, DC
Gould J, Mastrofski SD (2001) The constitutionality of police searches. Paper presented at the annual meeting of the Midwest Political Science Association, Chicago
Graham S, Lowery B (2007) Unconscious racial stereotypes about adolescent offenders. Law Hum Behav 28:483–504
Hastorf AH, Cantril H (1954) They saw a game: a case study. J Abnormal Psychol 49:129–134
Hawdon J (2008) Legitimacy, trust, social capital, and policing styles: a theoretical statement. Police Q 11:182–201
Herr PM (1989) Priming price: prior knowledge and context effects. J Consum Res 16:67–75
Higgins ET, Rholes WS, Jones CR (1977) Category accessibility and impression formation. J Exp Soc Psychol 13:141–154
Higgins ET, Bargh J, Lombardi W (1985) Nature of priming effects on categorization. J Exp Psychol Learn Memory Cogn 11:59–69
Hohl K, Bradford B, Stanko EA (2010) Influencing trust and confidence in the London Metropolitan Police. Br J Criminol 50:491–513
Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structural analysis. Struct Equat Model 6:1–55
Jackson J, Bradford B (2009) Crime, policing and social order: on the expressive nature of public confidence in policing. Br J Sociol 60:493–521
Jackson J, Bradford B, Hough M, Myhill A, Quinton P, Tyler TR (2012) Why do people comply with the law? Legitimacy and the influence of legal institutions. Br J Criminol 52:1051–1071
Kim J-O, Mueller CW (1978) Introduction to factor analysis. Quantitative applications in the social sciences, paper 13. Sage, Newbury Park, CA
Kline R (2010) Principles and practice of structural equation modeling, 3rd edn. Guilford, NY
Krosnick JA, Chang LC (2001) A comparison of the random digit dialing telephone survey methodology with internet survey methodology as implemented by Knowledge Networks and Harris Interactive. Paper presented at conference of the American Association for Public Opinion Research. http://www.knowledgenetworks.com/ganp
Krueger AB, Malechkova J (2003) Education, poverty and terrorism: is there a causal connection. J Econ Perspect 17:119–144
Loftus EF, Doyle JM, Dysert J (2008) Eyewitness testimony: civil and criminal, 4th edn. Lexis Law Publishing, Charlottesville
Long JS (1983) Confirmatory factor analysis. Quantitative applications in the social sciences, paper 33. Sage, Newbury Park, CA
Mastrofski SD, Snipes J, Supina A (1996) Compliance on demand: the public’s response to specific police requests. J Res Crime Delinq 33:269–305
Mazerolle L, Bennett S, Davis J, Sargeant E, Manning M (2012) Legitimacy in policing. Campbell systematic reviews
Mazerolle L, Antrobus E, Bennett S, Tyler TR (2013) Shaping citizen perceptions of police legitimacy: a randomized field trial of procedural justice. Criminology 51:33–64
McCauley C (2002) Psychological issues in understanding terrorism and the response to terrorism. In: Stout CE, Schwab K (eds) The psychology of terrorism, vol 3., ParegerWestport, CT, pp 33–65
McCluskey JD (2003) Police requests for compliance: coercive and procedurally just tactics. LFB Scholarly Publishing, NY
Meares T, Kahan D (1998) Law and (norms of) order in the inner city. Law Soc Rev 32:805–838
Moore M (1992) Problem-solving and community policing. In: Tonry M, Morris N (eds) Modern policing, crime and justice, vol 15. University of Chicago Press, Chicago, pp 99–158
Moore M (2002) Recognizing value in public policing. Police Executive Research Forum, Washington
Parsons T (1967) Some reflections on the place of force in social process. In: Parsons T (ed) Sociological theory and modern society. The Free Press, NY, pp 264–296
Paternoster R, Brame R, Bachman R, Sherman LW (1997) Do fair procedures matter? Law Soc Rev 17:457–479
Reisig MD (2010) Community and problem-oriented policing. In: Tonry M (ed) Crime and justice, vol 39. University of Chicago Press, Chicago, pp 2–53
Reisig MD, Chandek MS (2001) The effects of expectancy disconfirmation on outcome satisfaction in police–citizen interactions. Policing 21:88–99
Reisig MD, Bratton J, Gertz MG (2007) The construct validity and refinement of process-based policing measures. Crim Just Behav 34:1005–1028
Rosenbaum DP, Schuck A, Costello S, Hawkins DF, Ring M (2005) Attitudes toward the police: the effects of direct and vicarious experience. Police Q 8:343–365
Rossi P, Lipsey M, Freeman H (2004) Evaluation: a systematic approach, 7th edn. Sage, Thousand Oaks
Sarat A (1977) Studying American legal culture. Law Soc Rev 11:427–488
Scheingold S (1974) The politics of rights, lawyers, public policy, and political change. Yale University Press, New Haven
Seron C, Pereira J, Kovath J (2006) Just punishment for police misconduct. Criminology 44:925–960
Shadish W, Cook T, Campbell D (2002) Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin, Boston
Sherman LW (1999) Consent of the governed: police, democracy, and diversity. Paper presented at the conference in honor of Professor Menachem Amir, Institute of Criminology, Hebrew University of Jerusalem, Israel
Skitka LJ, Mullen E (2002) Understanding judgments of fairness in a real-world political context: a test of the value protection model of justice reasoning. Pers Soc Psychol Bull 28:588–597
Skitka LJ, Mullen E, Griffin T, Hutchinson S, Chamberlin B (2002) Dispositions, ideological scripts, or motivated correction? Understanding ideological differences in attributions for social problems. J Pers Soc Psychol 83:470–487
Skogan W (1990) Disorder and decline. The Free Press, NY
Skogan W, Frydl K (2004) Fairness and effectiveness in policing: the evidence. National Research Council, Washington
Skogan W, Hartnett S (1997) Community policing, Chicago style. Oxford University Press, NY
Skogan W, Meares TL (2004) Lawful policing. Ann Am Acad Polit Soc Sci 593:66–83
Skolnick JH, Fyfe JJ (1993) Above the law. The Free Press, NY
StataCorp (2011) Stata Release 12.0. StataCorp, College Station
Sunshine J, Tyler TR (2003) The role of procedural justice and legitimacy in shaping public support for policing. Law Soc Rev 37:555–589
Tankebe J (2009) Public cooperation with the police in Ghana: does procedural fairness matter? Criminology 47:1265–1293
Tankebe J (2013) Viewing things differently: the dimensions of public perceptions of police legitimacy. Criminology 51:103–135
Tyler TR (2003) Procedural justice, legitimacy, and the effective rule of law. In: Tonry M (ed) Crime and justice: a review of research, vol 30. University of Chicago Press, Chicago, pp 431–505
Tyler TR (2004) Enhancing police legitimacy. Ann Am Acad Polit Soc Sci 593:84–99
Tyler TR (2005) Policing in black and white: ethnic group differences in trust and confidence in the police. Police Q 8:322–342
Tyler TR (2006) Why people obey the law, 2nd edn. Princeton University Press, Princeton
Tyler TR, Fagan J (2008) Legitimacy and cooperation: why do people help the police fight crime in their communities? Ohio St J Crim Law 6:231–276
Tyler TR, Huo YJ (2002) Trust in the law: encouraging public cooperation with the police and courts. Russell Sage Foundation, NY
Tyler TR, Mitchell G (1994) Legitimacy and the empowerment of discretionary legal authority. Duke Law J 43:703–802
Tyler TR, Wakslak C (2004) Profiling and the legitimacy of the police: procedural justice, attributions of motive, and the acceptance of social authority. Criminology 42:13–42
Tyler TR, Boeckmann R, Smith HJ, Huo YJ (1997) Social justice in a diverse society. Westview, Boulder
U.S. National Advisory Commission on Civil Disorders (1968) Report of the national advisory commission on civil disorders. U.S. Government Printing Office, Washington, DC
Warren PY (2011) Perceptions of police disrespect during vehicle stops: a race-based analysis. Crime Delinq 57:356–376
Weisburd DL, Eck JE (2004) What can police do to reduce crime, disorder, and fear? Ann Am Acad Polit Soc Sci 593:42–65
Weitzer R, Tuch SA (2006) Race and policing in America: conflict and reform. Cambridge University Press, NY
Wells GL, Olson EA (2003) Eyewitness testimony. Ann Rev Psychol 54:277–295
Wolfinger R, Rosenstone SJ (1980) Who votes? Yale University Press, New Haven, CT
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Braga, A.A., Winship, C., Tyler, T.R. et al. The Salience of Social Contextual Factors in Appraisals of Police Interactions with Citizens: A Randomized Factorial Experiment. J Quant Criminol 30, 599–627 (2014). https://doi.org/10.1007/s10940-014-9216-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10940-014-9216-7