In response to community demands, case settlements, and state laws concerning racial profiling, police departments across the nation are collecting data on traffic stops. While the data collection is rapidly moving forward, there are few if any agreed upon methods for analyzing the data. Much of the attention has been on benchmarks for the race distribution of stops and searches. Little empirical work has advanced our understanding of the influence of race in the post-stop activities of police. The present study proposes a propensity score technique to determine the extent to which race bias affects citation rates, search rates, and the duration of the stop. Adjusting for confounding variables using the propensity score offers an alternative to multivariate regression that is more interpretable, less prone to errors in model assumptions, and ultimately easier to present to stakeholders in policing practices. An analysis of traffic stop data from the City of Oakland, California demonstrates the process, presentation, and interpretation of the results that the methodology produces. Ultimately, the study addresses the extent to which race plays a role in officers’ use of discretion.
Similar content being viewed by others
Notes
The groups may still differ on an unobserved factor, but at a minimum we know that the groups are similar on these factors.
References
Alpert, G. P., Smith, M. R., and Dunham, R. G. (2003). Toward a better benchmark: Assessing the utility of not-at-fault traffic crash data in racial profiling research. Confronting Racial Profiling in the 21st Century: Implications for Racial Justice, Boston.
Attorney General of the State of New York (1999). The New York City Police Department’s ‘Stop & Frisk’ Practices: A Report to the People of the State of New York From The Office Of The Attorney General, Civil Rights Bureau.
Berk R. A., Newton P. J., (1985). Does arrest really deter wife battery? An effort to replicate the findings of the Minneapolis spouse abuse experiment. Am. Sociol. Rev. 50(2):253–262
Breiman L., Friedman J. H., Olshen R. A., Stone C. J., (1984). Classification and Regression Trees. Wadsworth International Group, Belmont CA
Cordner, G., Williams, B., and Velasco, A. (2002). Vehicle stops in San Diego. City of San Diego. Available at http://www.sannet.gov/police/pdf/stoprpt.pdf
Decker, S., and Rojek, J. (2002). Saint Louis metropolitan police department traffic stop patterns. Report submitted to the St. Louis Police Department, January.
Engel R. S., Calnon J. M. (2004). Examining the influence of drivers’ characteristics during traffic stops with police: Results from a national survey. Justice Q. 21(1):49–90
Farrell, A., McDevitt, D. J., Bailey, L., Andresen, C., and Pierce, E. (2004). Massachusetts Racial and Gender Pmiling Study, Final Report. Center for Criminal Justice Policy Research, Northeastern University.
Fisher R. (1935). The Design of Experiments. Oliver and Boyd, Edinburgh
Friedman J. H. (2001). Greedy function approximation: A gradient boosting machine. Ann. Stat. 29(5):1189–1232
The Gallup Organization (1999). Racial profiling is seen as widespread, particularly among young black men. December 9, 1999. Retrieved from http://polls.gallup.com
Gould J. B., and Mastrofski, S. D. (2004). Suspect searches: Assessing police behavior under the U.S. constitution. Criminol. Public Policy 3(3): 316–362
Grogger, J., and Ridgeway, G. (2006, to appear). Testing for racial profiling in traffic stops from behind a veil of darkness. Journal of the American Statistical Association.
Harcourt, B. (2004). Unconstitutional police searches and collective responsibility. Criminol. Public Policy 3(3): 363–378.
Harris D. A. (2002). Profiles In Injustice: Why Racial Profiling Cannot Work. The New Press, New York
Hastie T., Tibshirani R., Friedman J. (2001). The Elements of Statistical Learning. Springer-Verlag, New York
Hirano K., Imbens G. (2001). Estimation of causal effects using propensity score weighting: An application to data on right heart catheterization. Health Serv. Outcomes Res. Methodol. 2:259–278
Hirano K., Imbens G., Ridder G. (2003). Efficient estimation of average treatment effects using the estimated propensity score. Econometrica 71(4):1161–1189
Hosmer D. W., Lemeshow S. (2000). Applied Logistic Regression. Wiley, Boston
Imbens, G. (2003). Nonparametric estimation of average treatment effects under exogeneity: A review. Technical Working Paper 294, National Bureau of Economic Research.
Kelling G. L. (1992). Toward new images of policing: Herman Goldstein’s problem-oriented policing. Law Soc. Inq. 17(3):545
Kelling, G. L. (1999). “Broken Windows” and police discretion. National Institute of Justice. NCJ 178259. Available at http://www.ncjrs.org/pdffiles1/nij/178259.pdf
Knowles J., Persico N., Todd P. (2001). Racial Bias in Motor Vehicle Searches: Theory and Evidence. J. Polit. Econ. 109(1):203–229
Lamberth, J. (1994). Revised Statistical Analysis of the Incidence of Police Stops and Arrests of Black Drivers/Travelers on the New Jersey Turnpike Between Exits or Interchanges 1 and 3 from the Years 1988 through 1991. Lamberth Consulting.
Lamberth, J. (1996). Expert report for Wilkins v. Maryland state police, Civil Action No. CCB-93483.
Lange, J. E., Blackman, K. O., and Johnson, M. B. (2001). Speed violation survey of the New Jersey turnpike: Final report. Office of the Attorney General of New Jersey
Mastrofski S. D. (2004). Controlling Street-level police discretion. Ann. Am. Acad. Polit. Soc. Sci. 593(1):100–118
McCaffrey D. F., Ridgeway G., Mortal A. R. (2004). Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychol. Methods 9(4):403–425
McConnell, E. H., and Scheidegger, A.R. (2001). Race and speeding citations: Comparing speeding citations issued by air traffic officers with those issued by ground traffic officers, Presentation at the annual meeting of the Academy of Criminal Justice Sciences, Washington, D.C., April 4–8.
McCullagh, P., and Nelder, J. A. (1989). Generalized Linear Models, 2nd ed., Chapman & Hall, Cambridge.
Merriam-Webster Dictionary of Law (1996) Merriam-Webster, Inc.
R Development Core Team (2005). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.Rproject.org
Ridgeway G. (1999). The state of boosting. Comput. Sci. Stat. 31:172–181
Ridgeway, G. (2005). GBM 1.5 package manual. http://cran.r-project.org/doc/packages/gbm.pdf
Rosenbaum P. (1987). Model-based direct adjustment. J. Am. Stat. Assoc. 82:387–394
Rosenbaum P. (2002). Observational Studies. Springer-Verlag, New York
Rosenbaum P. R., Rubin D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika 70:41–55
Rubin D. B. (1974). Estimating causal effects of treatments in randomized and non-randomized studies. J. Educ. Psychol. 66:688–701
Rubin D. B. (1978). Bayesian inference for causal effects: The role of randomization. Ann. Stat. 7:34–58
Rubin D. B. (1986). Which ifs have causal statements? J. Am. Stat. Assoc. 81(396):961–962
Rubin D.B. (2005). Causal inference using potential outcomes: Design, modeling, decisions. J. Am. Stat. Assoc. 100(469):322–331
Smedley B. D., Smith A. Y., Nelson A. R. (2003). Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care. National Academic Press, Washington, DC.
Smith M. R., Petrocelli M. (2001). Racial profiling? A multivariate analysis of police traffic stop data. Police Q. 4(1):4–27
Steward, D. (2004). Racial profiling: Texas traffic stops and searches. Texas Criminal Justice Reform Coalition. Available at http://www.criminaljusticecoalition.org
Tita, G., Jack Riley, K., Ridgeway, G., Grammich, C., Abrahamse, A. F., and Greenwood, P. (2003). Reducing Gun Violence in East Los Angeles: Results from an Intervention, RAND MR-1764-NIJ, RAND, Santa Monica, CA.
Washington State Police and Criminal Justice Training Commission (2001). Report to the legislature on routine traffic stop data. Available at http://www.wsp.wa.gov/reports/demogra2.doc
Wooldridge J. (2002). Econometric Analysis of Cross Section and Panel Data. MIT Press, Cambridge
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ridgeway, G. Assessing the Effect of Race Bias in Post-traffic Stop Outcomes Using Propensity Scores. J Quant Criminol 22, 1–29 (2006). https://doi.org/10.1007/s10940-005-9000-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10940-005-9000-9