Skip to main content
Log in

The Salience of Social Contextual Factors in Appraisals of Police Interactions with Citizens: A Randomized Factorial Experiment

  • Original Paper
  • Published:
Journal of Quantitative Criminology Aims and scope Submit manuscript

Abstract

Objectives

Prior research indicates that public assessments of the manner in which the police exercise their authority are a key antecedent of judgments about the legitimacy of the police. In this study, the importance of context in influencing people’s assessment of police wrongdoing is examined.

Methods

A randomized factorial experiment was used to test how respondents perceive and evaluate police–citizens interactions along a range of types of situations and encounters. 1,361 subjects were surveyed on factors hypothesized to be salient influences on how citizens perceive and evaluate citizen interactions with police. Subjects viewed videos of actual police–citizen encounters and were asked for their evaluations of these observed encounters. Contextual primes were used to focus subjects on particular aspects of the context within which the encounter occurs.

Results

Structural equation models revealed that social contextual framing factors, such as the climate of police–community relations and the legality of the stop that led to the encounter, influence citizen appraisals of police behavior with effects comparable in size to and even larger than demographic variables such as education, race, and income.

Conclusions

These results suggest that the understandings and perceptions that people bring to a situation are important determinants of their assessment of police fairness. The police can positively influence citizen interpretations of police actions by striving to create a climate of positive police–community relationships in cities.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. Prior studies suggest the value of this type of vignette approach (Seron et al. 2006), but have used written vignettes of uncertain realism. We utilized actual videos of police interactions centered on the core issues in the study to supplement the vignettes and provide salient visual cues and contextual primes to stimulate respondents.

  2. KN has completed several studies to validate its methodology, including both accuracy and nonresponse bias. For example, Krosnick and Chang (2001) compared responses to a single survey on the 2000 presidential election using three different samples and methods: KN, Harris Interactive (HI), and a RDD survey conducted by the Ohio State University Center for Survey Research. They reported that the KN samples had higher completion rates, closer approximation to census estimates, and less skew on basic measures of opinion and voting behavior. They also show higher measurement reliability and “non-differentiation” of responses for Internet-enabled data collection compared to RDD. Skitka and Mullen (2002) and Skitka et al. (2002) show that on questions of civic values and actions, in particular, telephone survey responses were more often influenced by respondents’ motivations to present themselves in a positive light to interviewers compared to internet-enabled surveys. Benchmarking studies show that KN samples yield estimates for several health behaviors—current smoking, diabetes, ulcer, migraine headaches, and stroke—similar to the estimates in the National Health Interview Survey conducted by telephone annually by CDC. The average difference in the results is about 1 percentage point (Baker et al. 2003).

  3. The 15 U.S. cities were Baltimore, Boston, Chicago, Cleveland, Denver, Detroit, Houston, Los Angeles, Miami, New York, Philadelphia, Phoenix, San Diego, Seattle, and Washington, DC. Knowledge Networks completed between 85 (New York) and 98 (Baltimore) interviews in each city.

  4. The survey was fielded on March 27, 2008 to a sample of 2,183 Knowledge Networks panel members. To be included in this analysis, a respondent had to view all three videos (N = 1,361).

  5. These questions were randomly administered before or after the videos were viewed. 676 respondents completed the questionnaire after seeing the videos and 685 respondents completed the questionnaire before seeing the videos. To investigate whether the timing of the administration of the questionnaire impacted our findings, we split the sample and replicated the full sample analyses presented here. When the impact of the four framing effects dummy variables (city climate of police-citizen relations, stop context, officer history, and citizen history) on the “police were wrong/should be punished” outcome variable were estimated, the two split samples produced coefficients of similar direction, magnitude, and statistical significance (p < .05). As such, whether the respondent answered the questionnaire before or after the video did not substantively impact the findings presented in Tables 2, 3, and 4.

  6. OLS regressions were used to analyze the normally-distributed interval-level dependent variables “age” and “conservative” scale. Logistic regression models were used to examine the remaining dichotomous dependent variables: “White” (0 = non-white, 1 = white), “male” (0 = female, 1 = male), “income >$40 K” (0 = household income ≤$40,000 per year, 1 = household income >$40,000 per year), “college+” (0 = less education than a bachelor’s degree, 1 = bachelor’s degree or higher), and “victim” (0 = household member was a prior victim of crime, 1 = household member was not a prior victim of crime).

  7. Table 2 identifies only 6 statistically-significant (p < .05) differences across 168 hypothesis tests (3 videos * 8 contextual dummy variables per video * 7 outcome variables). This is lower than the 8.4 statistically-significant results that would be expected by chance alone for 168 hypothesis tests at a .05 level of statistical significance. We also ran similar OLS and Probit regression models for all observed variables that comprised the latent variables described above; these analyses yielded similar results that supported successful randomization. Further, we created an 81 cell variable representing the different combinations of framing conditions and social contextual issues and ran a series of Chi square tests to examine whether the observed distributions of cell counts were significantly different from the expected distribution of cells counts. We did not find any statistically significant differences between the observed and expected distributions, suggesting successful randomization by this measure.

  8. These videos showed real-life interactions between police officers and citizens. We acquired the three study videos from the internet and edited the footage down to 30 s that captured the key events briefly described in this section.

  9. We also recognized that our main effects models could be structured as hierarchical linear models to analyze multiple observations nested within a single subject. This analysis required restructuring the study dataset into a longitudinal panel design where each respondent views three consecutive videos for a total of 4,083 observations (3 videos * 1,361 respondents). In Stata 12.0, we used the XTSET command to declare that the data were structured in the longitudinal panel format and the XTREG command to execute hierarchical linear models to analyze the data. Video dummy variables and manipulated social context dummy variables were used to measure the main effects of viewing the different police-citizen interaction videos and the randomly-allocated framing effects, respectively. Interactive dummy variables were constructed (video dummies * manipulated social context dummies) and entered into the model to determine whether the observed framing effects were consistent across the three videos. These results were congruent with the main effects findings presented here and are available upon request from the authors.

  10. Since they are not directly measured, latent variables do not have intrinsic variances. For the factor loadings in Table 3, the variances of the latent variables were constrained to equal “1” for ease of interpretation (StataCorp 2011, p. 254). These coefficients can be interpreted as correlations that range from “0” to “1”.

  11. Unfortunately, small numbers of the 1,361 respondents did not answer all of the study questions for each video viewed and for the questionnaire. We handled missing responses through listwise case deletions. As Table 2 presents, the number of respondents included in our analyses ranged from 1,232 (90.5 % of 1,361) to 1,246 (91.5 %). We used t-tests to examine whether there were any statistically-significant differences between included and excluded cases for the covariates used in the SEM analyses presented in Tables 2, 3 and 4. Our simple comparisons did not reveal any statistically-significant differences between the missing cases and the included cases. This suggests that the data were missing at random and, as such, listwise case deletions were an appropriate method to address the very modest missing data problem.

  12. The CFI assesses the fit of a user-specified solution in relation to a more restricted, nested baseline model in which the covariances among all input indicators are fixed to zero or no relationship among variables is posited (Brown 2006, p. 84). The CFI coefficient value ranges from 0 to 1.00 with values greater than 0.90 indicating a reasonably good fit of the hypothesized model (Hu and Bentler 1999). RMSEA takes the error of population approximation and degrees of freedom into account and measures the lack of fit of the hypothesized model to the population covariance matrix. SRMR is estimated in a similar to RMSEA but does not penalize model complexity. As a general rule of thumb, SRMR and RMSEA results of 0.05 or less indicates a close approximate fit of the model (Hu and Bentler 1999).

  13. The sex effects were statistically significant in Videos 2 and 3 and in the expected direction with males expressing more favorable attitudes toward police.

  14. Arguably the effect of Education should be estimated without controlling for income, since presumably part of the effect of Education is mediated through Income. Dropping Income as a control only results in the effect of Education being reduced—with the effect dropping to −0.78 (SE = .028, p < .05). In our sample, levels of Education are very modestly correlated with levels of Income (r = .28). In reduced regression models of the effects of Education and Income on respondent assessment of police behavior, we find that both are statistically significant predictors of the outcome variable in all three videos. Controlling for Income, increasing levels of Education are associated with more negative perceptions of observed police behavior. This suggests that more educated people are more critical appraisers of police behavior independent of how much money they earn. Clearly, future research in this area should seek to better disentangle these complicated effects.

References

  • Baker L, Wagner TH, Singer S, Bundorf MK (2003) Use of the internet and email for health care information: results from a national survey. JAMA 289:2400–2406

    Article  Google Scholar 

  • Balcetis E, Lassiter GD (eds) (2010) Social psychology of visual perception. Psychology Press, NY

    Google Scholar 

  • Bargh J, Chartrand T (2000) Priming and automaticity research. In: Reis HT, Judd CM (eds) Handbook of research methods in social and personality psychology. Cambridge University Press, NY, pp 253–284

    Google Scholar 

  • Beeghley L (2004) The structure of social stratification in the United States. Pearson, Allyn & Bacon, Boston

    Google Scholar 

  • Beetham D (1991) The legitimation of power. Humanities Press International, Atlantic Highlands

    Google Scholar 

  • Bollen KA (1989) Structural equations with latent variables. Wiley, NY

    Book  Google Scholar 

  • Bollen KA, Long JS (eds) (1993) Testing structural equation models. Sage, Newbury Park

    Google Scholar 

  • Bottoms A, Tankebe J (2012) Beyond procedural justice: a dialogic approach to legitimacy in criminal justice. J Crim Law Criminol 102:119–170

    Google Scholar 

  • Box GE, Hunter WG, Hunter JS (2005) Statistics for experimenters: design, innovation, and discovery, 2nd edn. Wiley, NY

    Google Scholar 

  • Braga AA (2008) Problem-oriented policing and crime prevention, 2nd edn. Lynne Rienner, Boulder

    Google Scholar 

  • Brandl SG, Frank J, Worden RE, Bynum T (1994) Global and specific attitudes toward the police: disentangling the relationship. Justice Q 11:119–134

    Article  Google Scholar 

  • Brown TA (2006) Confirmatory factor analysis for applied research. Guilford, NY

    Google Scholar 

  • Brown B, Benedict W (2002) Perceptions of the police: past findings, methodological issues, conceptual issues, and policy implications. Policing 25:543–580

    Article  Google Scholar 

  • Brunson RK (2007) Police don’t like black people: African-American young men’s accumulated police experiences. Criminol Pub Pol 6:71–101

    Article  Google Scholar 

  • Brunson RK, Miller J (2006) Young black men and urban policing in the United States. Brit J Criminol 46:613–640

    Article  Google Scholar 

  • Brunson RK, Weitzer R (2009) Police relations with black and white youths in different urban neighborhoods. Urb Aff Rev 44:858–885

    Article  Google Scholar 

  • Carr PJ, Napolitano L, Keating J (2007) We never call the cops and here is why: a qualitative examination of legal cynicism in three Philadelphia neighborhoods. Criminology 45:701–736

    Article  Google Scholar 

  • Coicaud J-M (2002) Legitimacy and politics: a contribution to the study of the political right and political responsibility. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Couper MP (2000) Web surveys: a review of issues and approaches. Pub Opin Q 64:464–494

    Article  Google Scholar 

  • Cronbach LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334

    Article  Google Scholar 

  • Dennis JM (2001) Are internet panels creating professional respondents? The benefits of online panels far outweigh the potential for panel effects. Mark Res Summer:34–38

    Google Scholar 

  • Easton D (1975) A reassessment of the concept of political support. Br J Polit Sci 5:435–457

    Article  Google Scholar 

  • Erdley CA, D’Agostino P (1988) Cognitive and affective components of automatic priming effects. J Pers Soc Psychol 54:741–747

    Article  Google Scholar 

  • Fagan J (2002) Law, social science and racial profiling. Just Res Policy 4:104–129

    Google Scholar 

  • Fagan J, Malkin V (2003) Theorizing community justice through community courts. Fordham Urb Law J 30:857–953

    Google Scholar 

  • Fisher R (1926) The arrangement of field experiments. J Minist Agric G B 33:503–513

    Google Scholar 

  • Fiske ST, Taylor SE (1991) Social cognition, 2nd edn. McGraw-Hill, NY

    Google Scholar 

  • Fyfe JJ (2002) Too many missing cases: holes in our knowledge about police use of force. US Department of Justice, Washington

    Google Scholar 

  • Gaertner SL, Mann J, Murrell A, Dovidio JF (1989) Reducing intergroup bias: the benefits of recategorization. J Pers Soc Psychol 57:239–249

    Article  Google Scholar 

  • Gallagher C, Maguire E, Mastrofski S, Reisig M (2001) The public image of the police. International Association of Chiefs of Police, Alexandria

    Google Scholar 

  • Gardner MP (1983) Advertising effects on attributes recalled and criteria used for brand evaluations. J Consum Res 10:310–318

    Article  Google Scholar 

  • Gau J (2010) Basic principles and practices of structural equation modeling in criminal justice and criminology research. J Crim Just Educ 21:136–151

    Article  Google Scholar 

  • Gottfredson GD (1981) Schooling and delinquency. In: Martin SE, Sechrest LB, Redner R (eds) New directions in the rehabilitation of criminal offenders. Report of the panel on research on rehabilitative techniques. National Academy Press, Washington, DC

  • Gould J, Mastrofski SD (2001) The constitutionality of police searches. Paper presented at the annual meeting of the Midwest Political Science Association, Chicago

  • Graham S, Lowery B (2007) Unconscious racial stereotypes about adolescent offenders. Law Hum Behav 28:483–504

    Article  Google Scholar 

  • Hastorf AH, Cantril H (1954) They saw a game: a case study. J Abnormal Psychol 49:129–134

    Article  Google Scholar 

  • Hawdon J (2008) Legitimacy, trust, social capital, and policing styles: a theoretical statement. Police Q 11:182–201

    Article  Google Scholar 

  • Herr PM (1989) Priming price: prior knowledge and context effects. J Consum Res 16:67–75

    Article  Google Scholar 

  • Higgins ET, Rholes WS, Jones CR (1977) Category accessibility and impression formation. J Exp Soc Psychol 13:141–154

    Article  Google Scholar 

  • Higgins ET, Bargh J, Lombardi W (1985) Nature of priming effects on categorization. J Exp Psychol Learn Memory Cogn 11:59–69

    Article  Google Scholar 

  • Hohl K, Bradford B, Stanko EA (2010) Influencing trust and confidence in the London Metropolitan Police. Br J Criminol 50:491–513

    Article  Google Scholar 

  • Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structural analysis. Struct Equat Model 6:1–55

    Article  Google Scholar 

  • Jackson J, Bradford B (2009) Crime, policing and social order: on the expressive nature of public confidence in policing. Br J Sociol 60:493–521

    Article  Google Scholar 

  • Jackson J, Bradford B, Hough M, Myhill A, Quinton P, Tyler TR (2012) Why do people comply with the law? Legitimacy and the influence of legal institutions. Br J Criminol 52:1051–1071

    Article  Google Scholar 

  • Kim J-O, Mueller CW (1978) Introduction to factor analysis. Quantitative applications in the social sciences, paper 13. Sage, Newbury Park, CA

  • Kline R (2010) Principles and practice of structural equation modeling, 3rd edn. Guilford, NY

    Google Scholar 

  • Krosnick JA, Chang LC (2001) A comparison of the random digit dialing telephone survey methodology with internet survey methodology as implemented by Knowledge Networks and Harris Interactive. Paper presented at conference of the American Association for Public Opinion Research. http://www.knowledgenetworks.com/ganp

  • Krueger AB, Malechkova J (2003) Education, poverty and terrorism: is there a causal connection. J Econ Perspect 17:119–144

    Article  Google Scholar 

  • Loftus EF, Doyle JM, Dysert J (2008) Eyewitness testimony: civil and criminal, 4th edn. Lexis Law Publishing, Charlottesville

    Google Scholar 

  • Long JS (1983) Confirmatory factor analysis. Quantitative applications in the social sciences, paper 33. Sage, Newbury Park, CA

  • Mastrofski SD, Snipes J, Supina A (1996) Compliance on demand: the public’s response to specific police requests. J Res Crime Delinq 33:269–305

    Article  Google Scholar 

  • Mazerolle L, Bennett S, Davis J, Sargeant E, Manning M (2012) Legitimacy in policing. Campbell systematic reviews

  • Mazerolle L, Antrobus E, Bennett S, Tyler TR (2013) Shaping citizen perceptions of police legitimacy: a randomized field trial of procedural justice. Criminology 51:33–64

    Article  Google Scholar 

  • McCauley C (2002) Psychological issues in understanding terrorism and the response to terrorism. In: Stout CE, Schwab K (eds) The psychology of terrorism, vol 3., ParegerWestport, CT, pp 33–65

    Google Scholar 

  • McCluskey JD (2003) Police requests for compliance: coercive and procedurally just tactics. LFB Scholarly Publishing, NY

    Google Scholar 

  • Meares T, Kahan D (1998) Law and (norms of) order in the inner city. Law Soc Rev 32:805–838

    Article  Google Scholar 

  • Moore M (1992) Problem-solving and community policing. In: Tonry M, Morris N (eds) Modern policing, crime and justice, vol 15. University of Chicago Press, Chicago, pp 99–158

    Google Scholar 

  • Moore M (2002) Recognizing value in public policing. Police Executive Research Forum, Washington

    Google Scholar 

  • Parsons T (1967) Some reflections on the place of force in social process. In: Parsons T (ed) Sociological theory and modern society. The Free Press, NY, pp 264–296

    Google Scholar 

  • Paternoster R, Brame R, Bachman R, Sherman LW (1997) Do fair procedures matter? Law Soc Rev 17:457–479

    Article  Google Scholar 

  • Reisig MD (2010) Community and problem-oriented policing. In: Tonry M (ed) Crime and justice, vol 39. University of Chicago Press, Chicago, pp 2–53

    Google Scholar 

  • Reisig MD, Chandek MS (2001) The effects of expectancy disconfirmation on outcome satisfaction in police–citizen interactions. Policing 21:88–99

    Article  Google Scholar 

  • Reisig MD, Bratton J, Gertz MG (2007) The construct validity and refinement of process-based policing measures. Crim Just Behav 34:1005–1028

    Article  Google Scholar 

  • Rosenbaum DP, Schuck A, Costello S, Hawkins DF, Ring M (2005) Attitudes toward the police: the effects of direct and vicarious experience. Police Q 8:343–365

    Article  Google Scholar 

  • Rossi P, Lipsey M, Freeman H (2004) Evaluation: a systematic approach, 7th edn. Sage, Thousand Oaks

    Google Scholar 

  • Sarat A (1977) Studying American legal culture. Law Soc Rev 11:427–488

    Article  Google Scholar 

  • Scheingold S (1974) The politics of rights, lawyers, public policy, and political change. Yale University Press, New Haven

    Google Scholar 

  • Seron C, Pereira J, Kovath J (2006) Just punishment for police misconduct. Criminology 44:925–960

    Article  Google Scholar 

  • Shadish W, Cook T, Campbell D (2002) Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin, Boston

    Google Scholar 

  • Sherman LW (1999) Consent of the governed: police, democracy, and diversity. Paper presented at the conference in honor of Professor Menachem Amir, Institute of Criminology, Hebrew University of Jerusalem, Israel

  • Skitka LJ, Mullen E (2002) Understanding judgments of fairness in a real-world political context: a test of the value protection model of justice reasoning. Pers Soc Psychol Bull 28:588–597

    Article  Google Scholar 

  • Skitka LJ, Mullen E, Griffin T, Hutchinson S, Chamberlin B (2002) Dispositions, ideological scripts, or motivated correction? Understanding ideological differences in attributions for social problems. J Pers Soc Psychol 83:470–487

    Article  Google Scholar 

  • Skogan W (1990) Disorder and decline. The Free Press, NY

    Google Scholar 

  • Skogan W, Frydl K (2004) Fairness and effectiveness in policing: the evidence. National Research Council, Washington

    Google Scholar 

  • Skogan W, Hartnett S (1997) Community policing, Chicago style. Oxford University Press, NY

    Google Scholar 

  • Skogan W, Meares TL (2004) Lawful policing. Ann Am Acad Polit Soc Sci 593:66–83

    Article  Google Scholar 

  • Skolnick JH, Fyfe JJ (1993) Above the law. The Free Press, NY

    Google Scholar 

  • StataCorp (2011) Stata Release 12.0. StataCorp, College Station

    Google Scholar 

  • Sunshine J, Tyler TR (2003) The role of procedural justice and legitimacy in shaping public support for policing. Law Soc Rev 37:555–589

    Article  Google Scholar 

  • Tankebe J (2009) Public cooperation with the police in Ghana: does procedural fairness matter? Criminology 47:1265–1293

    Article  Google Scholar 

  • Tankebe J (2013) Viewing things differently: the dimensions of public perceptions of police legitimacy. Criminology 51:103–135

    Article  Google Scholar 

  • Tyler TR (2003) Procedural justice, legitimacy, and the effective rule of law. In: Tonry M (ed) Crime and justice: a review of research, vol 30. University of Chicago Press, Chicago, pp 431–505

    Google Scholar 

  • Tyler TR (2004) Enhancing police legitimacy. Ann Am Acad Polit Soc Sci 593:84–99

    Article  Google Scholar 

  • Tyler TR (2005) Policing in black and white: ethnic group differences in trust and confidence in the police. Police Q 8:322–342

    Article  Google Scholar 

  • Tyler TR (2006) Why people obey the law, 2nd edn. Princeton University Press, Princeton

    Google Scholar 

  • Tyler TR, Fagan J (2008) Legitimacy and cooperation: why do people help the police fight crime in their communities? Ohio St J Crim Law 6:231–276

    Google Scholar 

  • Tyler TR, Huo YJ (2002) Trust in the law: encouraging public cooperation with the police and courts. Russell Sage Foundation, NY

    Google Scholar 

  • Tyler TR, Mitchell G (1994) Legitimacy and the empowerment of discretionary legal authority. Duke Law J 43:703–802

    Article  Google Scholar 

  • Tyler TR, Wakslak C (2004) Profiling and the legitimacy of the police: procedural justice, attributions of motive, and the acceptance of social authority. Criminology 42:13–42

    Article  Google Scholar 

  • Tyler TR, Boeckmann R, Smith HJ, Huo YJ (1997) Social justice in a diverse society. Westview, Boulder

    Google Scholar 

  • U.S. National Advisory Commission on Civil Disorders (1968) Report of the national advisory commission on civil disorders. U.S. Government Printing Office, Washington, DC

  • Warren PY (2011) Perceptions of police disrespect during vehicle stops: a race-based analysis. Crime Delinq 57:356–376

    Article  Google Scholar 

  • Weisburd DL, Eck JE (2004) What can police do to reduce crime, disorder, and fear? Ann Am Acad Polit Soc Sci 593:42–65

    Article  Google Scholar 

  • Weitzer R, Tuch SA (2006) Race and policing in America: conflict and reform. Cambridge University Press, NY

    Book  Google Scholar 

  • Wells GL, Olson EA (2003) Eyewitness testimony. Ann Rev Psychol 54:277–295

    Article  Google Scholar 

  • Wolfinger R, Rosenstone SJ (1980) Who votes? Yale University Press, New Haven, CT

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anthony A. Braga.

Appendix

Appendix

See Tables 5 and 6.

Table 5 OLS and logistic regressions to test randomization of framing effects for selected respondent characteristics, N = 1,361
Table 6 Factor loadings for endogenous variables comprising latent variables in SEMs

Rights and permissions

Reprints and permissions

About this article

Cite this article

Braga, A.A., Winship, C., Tyler, T.R. et al. The Salience of Social Contextual Factors in Appraisals of Police Interactions with Citizens: A Randomized Factorial Experiment. J Quant Criminol 30, 599–627 (2014). https://doi.org/10.1007/s10940-014-9216-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10940-014-9216-7

Keywords

Navigation