Skip to main content

Advertisement

Log in

Telling a Similar Story Twice? NCVS/UCR Convergence in Serious Violent Crime Rates in Rural, Suburban, and Urban Places (1973–2010)

  • Original Paper
  • Published:
Journal of Quantitative Criminology Aims and scope Submit manuscript

Abstract

Objectives

This study examines UCR and NCVS serious violence crime trends in urban, suburban, and rural areas, and assesses the extent to which discrepancies in the two data series are due to victim reporting or police crime-recording practices. Particular attention is paid to the dynamics of the rural data series.

Methods

NCVS data for 1973–2010 are used to estimate subnational rates of serious violence and comparable rates for crimes that victims said were reported to police, and these estimates are compared to subnational UCR data. Time-series cointegration analysis is used to assess convergence in the NCVS and UCR series along with descriptive comparative analyses.

Results

The degree of convergence in UCR and NCVS trends was found to vary across areas; however this was not due to differences in rates of reporting to police. Suburban and urban UCR and NCVS trends converged with and without adjustment for police reporting. Little evidence of NCVS/UCR series convergence was found in rural areas even after victim reporting was taken into account.

Conclusion

The recording and production of crime data by the police appears to contribute to subnational differences in the convergence between the UCR and NCVS series. The findings suggest rural crime trend analysis should not be based solely on UCR data. To illustrate the difference between conclusions based on UCR and NCVS rural violence trends, we find that poverty rates have a large, significant association with rural violence as measured in the NCVS, but are unrelated to UCR rates.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. The President’s Commission on Law Enforcement and the Administration of Justice identified several limitations of police-generated crime statistics and concluded that there is “much information about crime that either cannot be obtained from the agencies of law enforcement or that can only be obtained imperfectly” (Winslow 1968: 94).

  2. Lynch and Jarvis (2008: 80) also state that “it is difficult to determine if this overrepresentation has substantial effects on conclusions based on these data.”

  3. Interested readers should consult Shadish et al. (2002) for a detailed exposition of convergent validity.

  4. We used NCS and NCVS data available through ICPSR (data sets 7635, 8608, 8864, 4699, 22,560, 24,741, 25,461, and 28,543) at icpsr.umich.edu/NACJD/NCVS. Because of several changes in sample design and methodology in 2006, early reports from BJS suggested that the 2006 NCVS data contained some anomalies in the form of higher than expected rates, particularly in rural areas. Subsequent research found that the anomalies appear to be related to the introduction of new sample and the use of first-time interviewers in the new, predominantly rural sample areas and the transition to a fully computerized interviewing system (see US Department of Justice 2011, pp. 5–7). Because comparability in rates over time and across subnational locations is paramount to our analyses we exclude data from the 2006 NCVS in our trends and interpolate the 2006 rates using the average rates for 2005 and 2007. However, we also replicated our analyses using the original 2006 data rather than the interpolated 2006 information. The results of those supplementary analyses are the same as those presented here. Also, in 3 years of the data (1977–1979) the MSA variable is unavailable. After further investigation with BJS, it was confirmed that this information cannot be recovered. Rather than exclude those 3 years from the NCVS series trends, we rely on the estimates of crime across areas that are available in printed reports (US Department of Justice 1994). To make these estimates comparable to our direct estimates (which include "series" incidents of serious violence counted as one incident) we up-weight these estimates by 1.068, which is the average of the ratio of the rates with series included and excluded in the surrounding 3 year periods.

  5. In the figures we use 3-year moving averages to better depict the long-term trends, however in the convergence tests discussed below, annual rates are used.

  6. The standard errors for the annual NCVS-PRV urban rates are a function of sample size and relative rarity of the event. To give the reader a sense of the magnitude of the standard errors in the NCVS data, in 1994 the 95 % confidence interval for the NCVS-PRV annual urban rate was 15.2 ± 1.8 and in 2007, it was 5.3 ± 1.1. In rural places where sample sizes and rates are lower, the 1994 NCVS-PRV rate and confidence interval was 6.8 ± 1.2, and in 2007 it was 3.3 ± 1.1.

  7. The ADF tests considered intercept and trend components or combinations thereof. Optimal lag lengths are selected by the Schwarz information criterion (SIC) (see Enders 2010: 215–219).

  8. The appropriate lags for cointegration tests are selected based on the Akaike’s final prediction error criterion, AIC, and the Hannan and Quinn information criterion (HQIC) in STATA 11. Detailed mathematical expositions of the Johansen (1991) methodology have been provided elsewhere (see Charemza and Deadman 1992).

  9. The VECM models were estimated in STATA 11. The VECM results are not displayed due to space constraints, but are available upon request from the authors.

  10. The question of whether the correlation between the NCVS-PRV and UCR rates is becoming stronger over time essentially is comparable to asking if a cointegrated time-series contains structural breaks (see Gregory and Hansen 1996). Formal inferential tests of structural breaks are available in time-series econometrics; however, methodological research routinely finds that structural break tests suffer from validity problems in samples of less than 50 observations (Antoshin et al. 2008), meaning the results of tests conducted on smaller samples tend to be unstable. For instance, Bai and Perron’s (2006) simulation analysis detected sizeable coefficient variation in structural break estimates from smaller samples. Thus, more observations (years) are required in order to draw valid model-based assumptions about structural shifts in the correspondence between the two data series. Moving window correlations are an alternative, and useful descriptive tool that provides some insight into the changing association between a pair of time-series (see O’Brien 2003).

  11. These same three location questions are not available throughout the earlier years of the NCS. However, information about whether the victimization occurred in the same city or county is available. Our reassessments of the incident location using these two items detected a very similar tendency for rural and suburban crime victims to be less likely than urban victims to report that the victimization occurred in the same city or county in which they live. Therefore, it is unlikely that additional location data regarding where NCS-based incidents occurred would change our conclusions about the role of this factor on series correspondence across these areas.

  12. The years of analysis were restricted because the sampling information necessary for properly estimating the standard errors in such models is not available in earlier years of the public NCVS data.

  13. This is indicated by the fact that the annual sampling weights are roughly equal in each year across type place.

  14. See Groves and Cork (2008) for a discussion of NCVS sampling issues over time.

  15. NCVS sampling weights take into account potential nonresponse by age, race, and sex in each sampled area. However the standard error estimation routines used here mirror those in use by BJS (e.g., Truman 2011: 13) and are based on weighted numbers of cases across the three types of areas. Thus, they may slightly underestimate standard errors in the rural areas during the 1997–2005 period.

References

  • Ansari S, He N (2012) Convergence revisited. A multi-definition, multi-method analysis of the UCR and NCVS crime series (1973–2008). Justice Q 42:1–31

    Google Scholar 

  • Antoshin S, Berg A, Souto M (2008). Testing for structural breaks in small samples. Paper prepared for the International Monetary Fund

  • Bai J, Perron P (2006). Multiple structural change models: a simulation analysis. Econ Theory Pract Front Anal Appl Res 38:212–237

    Article  Google Scholar 

  • Baller RD, Messner SF, Anselin L, Deane G (2002) The interchangeability of homicide data sources. A spatial analytical perspective. Homicide Stud 6:211–226

    Article  Google Scholar 

  • Baumer EP, Lauritsen JL (2010) Reporting crime to the police, 1973–2005: a multivariate analysis of long term trends in the National Crime Survey (NCS) and National Crime Victimization Survey (NCVS). Criminology 48:131–185

    Article  Google Scholar 

  • Bernard TJ (1999) Juvenile crime and the transformation of juvenile justice: is there a juvenile crime wave? Justice Q 16:337–356

    Article  Google Scholar 

  • Biderman AD, Lynch JP (1991) Understanding crime incidence statistics: why the UCR diverges from the NCS. Research in Criminology Series. Springer, New York

    Book  Google Scholar 

  • Blumstein A, Cohen J, Rosenfeld R (1991) Trend and deviation in crime rates: a comparison of UCR and NCS data for burglary and robbery. Criminology 29:237–263

    Article  Google Scholar 

  • Burch A (2012) Sheriffs’ Offices, 2007—statistical tables. US Department of Justice, Washington

    Google Scholar 

  • Charemza WW, Deadman DF (1992) New directions in econometric practice: general to specific modelling, cointegration and vector autoregression. Elgar Press

  • Crank JP (1990) The influence of environmental and organizational factors on police style in urban and rural environments. J Res Crime Delinq 27:166–189

    Article  Google Scholar 

  • Crank JP, Wells LE (1991) The effects of size and urbanism on structure among Illinois police departments. Justice Q 8:169–185

    Article  Google Scholar 

  • Elder G, Conger R (2000) Children of the land. Adversity and success in Rural America. University of Chicago Press, Chicago

    Google Scholar 

  • Enders W (2010) Applied econometric time-series, 3rd edn. Wiley, New York

    Google Scholar 

  • Engle R, Granger CWJ (1987) Co-integration and error correction: representation, estimation and testing. Econometrica 55:251–276

    Article  Google Scholar 

  • Falcone DN, Edward Wells L, Weisheit RA (2002) The small town police department. Policing 25:371–384

    Article  Google Scholar 

  • Gregory AW, Hansen BE (1996) Residual based tests for cointegration in models with regime shifts. J Econom 70:99–126

    Article  Google Scholar 

  • Groves RM, Cork DL (eds) (2008) Surveying victims: options for conducting the National Crime Victimization Survey. National Academies Press, Washington

    Google Scholar 

  • Jencks C (1991) Behind the numbers: is violent crime increasing? Am Prospect 4(Winter):98–109

    Google Scholar 

  • Jensen GF, Karpos M (1993) Managing rape: exploratory research on the behavior of rape statistics. Criminology 31:368–385

    Article  Google Scholar 

  • Johansen S (1991) Estimation and hypothesis testing of cointegration vectors in Gaussian vector autoregressive models. Econometrica 59:1551–1580

    Article  Google Scholar 

  • Kindermann C, Lynch JP, Cantor D (1997) Effects of the redesign on victimization estimates. US Department of Justice, Washington

    Google Scholar 

  • Laub J (1981) Ecological considerations in victim reporting to the police. J Crim Justice 9:419–430

    Article  Google Scholar 

  • Lauritsen J, Schaum R (2005) Crime and victimization in the three largest metropolitan areas, 1980–1998. US Department of Justice, Bureau of Justice Statistics, Washington. NCJ 208075

  • Loftin C, McDowall D (2003) Regional culture and patterns of homicide. Homicide Stud 7:353–367

    Article  Google Scholar 

  • Lynch JP (2002) Trends in juvenile violent offending: an analysis of victim survey data. US Department of Justice, Office of Juvenile Justice and Delinquency Prevention, Washington

    Google Scholar 

  • Lynch JP, Addington LA (2007) Understanding crime statistics: revisiting the divergence of the NCVS and UCR. Cambridge University Press, Cambridge

    Google Scholar 

  • Lynch JP, Cantor D (1996) Models for adjusting the NCS trend to account for design differences between the NCS and NCVS. Memorandum to the American Statistical Association Committee on Law and Justice Statistics

  • Lynch JP, Jarvis JP (2008) Missing data and imputation in the Uniform Crime Reports and the effects on national estimates. J Contemp Crim Justice 24:69–85

    Article  Google Scholar 

  • Maltz M (2007) Missing UCR data and divergence of the NCVS and UCR trends. In: Lynch JP, Addington LA (eds) Understanding crime statistics: revisiting the divergence of the NCVS and UCR. Cambridge Press, Cambridge

    Google Scholar 

  • Maltz MD, Targonski J (2002) A note on the use of county-level UCR data. J Quant Criminol 18:297–317

    Article  Google Scholar 

  • McDowall D, Loftin C (1992) Comparing the UCR and NCS over time. Criminology 30:125–132

    Article  Google Scholar 

  • McDowall D, Loftin C (2007) What is convergence and what do we know about it? In: Lynch JP, Addington LA (eds) Understanding crime statistics: revisiting the divergence of the NCVS and UCR. Cambridge Press, Cambridge

    Google Scholar 

  • National Institute of Justice (2004) Law enforcement technology—are small and rural agencies equipped and trained? Research for Practice. US Department of Justice, Office of Justice Programs, Washington

  • National Institute of Justice (2010) Report on the National Small and Rural Agency Summit. August. US Department of Justice, Office of Justice Programs

  • O’Brien RM (1996) Police productivity and crime rates: 1983–1992. Criminology 34:187–207

    Google Scholar 

  • O’Brien RM (2003) UCR violent crime rates, 1958–2000: recorded and offender-generated trends. Soc Sci Res 32:499–518

    Article  Google Scholar 

  • Payne BK, Berg B, Sun I (2005) Policing in small town America. Dogs, drunks, disorder and dysfunction. J Crim Justice 33:31–41

    Article  Google Scholar 

  • Planty M (2014) Using NCVS for subnational estimates of victimization: a BJS update. Justice Resarch and Statistics Association Training and Technical Assistance Webinar Series. http://www.jrsainfo.org/webinars/presentations/NCVS_final.pdf

  • Pridemore WA (2005) A cautionary note on using county-level crime and homicide data. Homicide Stud 9:256–268

    Article  Google Scholar 

  • Rand MR, Rennison CM (2002) True crime stories? Accounting for differences in our national crime indicators. Chance 15:47–51

    Article  Google Scholar 

  • Rand MR, Lynch JP, Cantor D (1977) Criminal victimization, 1973–1995. US Department of Justice, Washington

    Google Scholar 

  • Reaves B (2010) Local police departments, 2007. US Department of Justice, Washington

    Google Scholar 

  • Reiss A (1976) Problems in the documentation of crime. In: Guenther AL (ed) Criminal behavior and social systems. Rand McNally, Chicago

    Google Scholar 

  • Rosenfeld R (2007) Explaining the divergence between UCR and NCVS aggravated assault trends. In: Lynch JP, Addington LA (eds) Understanding crime statistics: revisiting the divergence of the NCVS and UCR. Cambridge Press, Cambridge

    Google Scholar 

  • Shadish WR, Cook TD, Campbell DT (2002) Experimental and quasi-experimental designs for generalized causal inference. Houghton-Mifflin Press, Boston

    Google Scholar 

  • Sims VH (1988) Small town and rural police. Charles C. Thomas, Springfield

    Google Scholar 

  • Smith BL (1980) Criminal victimization in rural areas. In: Price BR, Baunauch PJ (eds) Criminal justice research: new methods and findings. Sage research progress series in criminology, vol 16. Sage, Thousand Oaks

    Google Scholar 

  • Truman J (2011) Criminal victimization, 2010. US Department of Justice, Washington

    Google Scholar 

  • US Department of Justice (1994) Criminal victimization in the United States: 1973–1992 trends. Washington, DC. NCJ 147006

  • US Department of Justice (2011) Office of Justice Programs, Bureau of Justice Statistics. National Crime Victimization Survey 2010 Codebook. ICPSR21303-v1. Inter-University Consortium for Political and Social Reseach, Ann Arbor [distributor]

  • Vollard B, Hamed J (2012) Why the police have an effect on violent crime after all: evidence from the British Crime Survey. J Law Econ 55(901):924

    Google Scholar 

  • Weisheit RA, Donnermeyer JF (2000) Change and continuity in crime in rural America. In: LaFree G (ed) The nature of crime: continuity and change, criminal justice 2000, vol 1. US Department of Justice, Office of Justice Programs, National Institute of Justice, Washington, pp 309–357

    Google Scholar 

  • Weisheit RA, Edward Wells L (1996) Rural crime and justice. Implications for theory and Research. Crime Delinq 42:379–397

    Article  Google Scholar 

  • Weisheit R, Edward Wells L, Falcone DN (1994) Community policing in small town and rural America. Crime Delinq 40:549–567

    Article  Google Scholar 

  • Wiersema B, Loftin C, McDowall D (2000) A comparison of supplementary homicide reports and national vital statistics system homicide estimates for U.S. counties. Homicide Stud 4:317–340

    Article  Google Scholar 

  • Winslow RW (1968) Crime in a free society: selections from the President’s Commission on Law Enforcement and the Administration of Justice. Dickeson, Belmont

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark T. Berg.

Appendices

Appendix 1

The Potential Role of Non-Discretionary NCVS-UCR Procedural Differences

UCR rates are based on where the crime incident occurred, while NCVS rates are classified according to where the respondent lives. This dissimilarity in the meaning of the location variables between the systems can be consequential if, for example, rural residents are more likely to suffer serious violence while visiting other types of locations, especially if this pattern has changed over time.

The NCVS asks victims whether the incident occurred in the same city or town in which they reside, and if the answer is no, they are then asked whether it occurred in the same county in which they reside. All victims are also asked whether the incident occurred at home; within one mile of the home; 1–5 miles; 5–50 miles or more than 50 miles. Using this information, we classified victimizations that occurred in the same city or county, or at home or within one mile as having occurred in the ‘same type of area’ in which the respondent resides. For the period 1993–2010, we found that 92 % of urban residents, 82 % of suburbanites, and 84 % of rural residents experienced their victimizations in the ‘same type of area’ in which they lived. Importantly, we observed no trend in these crime-specific proportions over the 1993–2010 time frame and so inconsistencies in changes in crime rates between the systems are unlikely to be affected by changes in where incidents occur relative to the type of place in which the victim lives.Footnote 11

An Exploration of Subnational Differences in Crime Composition

Other issues that may affect the differences in our findings across rural and non-rural places are the possibility of varying crime compositions across areas, and differences in reporting and police recording of incidents that may be associated with crime composition. As noted above, the likelihood that victims will notify the police is partly a function of the characteristics of the victimization incident and discretion in police recording of incidents may vary according to the characteristics of crime events as well. If the types of incidents that involve the most discretion occur more frequently in rural relative to urban places, then this pattern may help account for discrepancies between rural NCVS and UCR estimates. For instance, if rural victims experience proportionately fewer incidents of stranger (versus nonstranger) violence, and victim reporting to police and police report-taking are more likely for stranger incidents, this may help account for the differences in our findings across places. Likewise, a similar pattern might emerge if rural places experience fewer robberies and if this crime is subject to less discretion but more likely to be reported to the police.

To assess the issue of how compositional differences in crime types might affect UCR-NCVS convergence over time, we first examined the 1973–2010 trends in crime composition across the three types of areas. The NCVS data show that the composition of crime types (i.e., rape, robbery, and aggravated assault) is remarkably stable across all three types of areas over time (see Table 6). In each of the areas, the modal type of serious violence is aggravated assault and the degree to which such incidents compose the violence rate varies by less than three percentage points over time periods within each area. Robberies compose a greater proportion of violent crimes for urban residents than elsewhere, but here too the percentage of violent crimes that are robberies in urban, suburban, and rural areas varies little over time. The stability of crime composition over time within each of the areas suggests that differences in the UCR-NCVS rural findings are not due to unique changes in types of crime over time in rural areas.

Table 6 Crime composition by type of crime, area, and time period: NCVS

Second, because rural crime victims experience lower rates of stranger violence than victims elsewhere, we also examined how the proportion of stranger incidents over time varied across areas (see also Table 6). Generally speaking, the NCVS rural data do show lower proportions of stranger violence than elsewhere. In all three places, the proportion of serious violence committed by strangers declined over time because stranger violence rates declined faster than non-stranger rates. However, the decline in the percent of violence committed by strangers was proportionately greater in rural areas and this pattern is not what would be expected to prompt an apparent increase in consistency between the UCR and NCVS rural rates in the later part of the series. Instead, we would have expected decreasing consistency over time as incidents in rural areas became increasingly less stranger-dominated.

Third, we estimated a series of additional Johansen’s models comparing the rural UCR rates to rural NCVS rates of serious stranger violence and non-stranger violence. We estimate these additional models because the disaggregated NCVS trends may uncover nuances obscured by a focus on total rates of violence. More importantly, this analysis could help to determine whether the lack of cointegration in rural places is due to a discretionary processes associated with the victim-offender relationship. Estimates from Johansen’s cointegration tests on the correspondence between the NCVS non-stranger rates and UCR rates yield no evidence of cointegration (r = 0, \(\lambda\) Trace  = 11.89; 5 % critical value = 15.41) and the same conclusion emerges from the estimates of the stranger violence models (r = 0, \(\lambda\) Trace  = 9.52; 5 % critical value = 15.41). Thus, the results of the multivariate models in combination with the descriptive trends suggest that variation in crime type—or compositional differences—does not appear to account for the divergence between the series in rural places. Much of the descriptive and time-series evidence presented thus far suggests that discretionary processes relating to informal networks in rural places may not be the main culprit behind the NCVS/UCR divergence in rural places. However, it is important to note that since the UCR trends cannot be disaggregated according to the victim-offender relationship the scope of this comparison is necessarily limited.

As a final check on the potential influences of crime composition on our findings, we estimated survey weighted multivariate logistic regression models of victim reporting to police and police report taking for the years 1994–2010 (see Table 7).Footnote 12 The key predictor variable of interest was rural location, controlling for year of incident, type of crime (i.e., rape, robbery, and aggravated assault), stranger versus non-stranger incident, and location of the incident (i.e., more than one mile away from home versus one mile or less). These analyses found that victim reporting to the police was not significantly different in rural versus other areas during this period; that police report-taking was significantly less likely in rural areas; and that these patterns were independent of the influences of year, crime type, victim–offender relationship, and location of the incident. The results also suggest that both reporting to the police and police report-taking for serious violence increased some during this period.

Table 7 Logistic regressions of reporting to the police and police report-taking: pooled NCVS 1994–2010

Appendix 2

Consideration of Potential NCVS Contributions to Divergence

We also considered whether some of the observed divergence in the UCR and NCVS-PRV rates may be due to aspects of the NCVS system that could vary by subnational location (see Biderman and Lynch 1991). For example, if there is more measurement error in the NCVS data in rural places than in other areas, this may also contribute to divergence in the data trends. Potential differences in measurement errors include variations in sampling errors and nonresponse errors. The possibility that rural, urban, and suburban residents may interpret the NCVS serious violence questions differently is unlikely given the similarity in the effects of the redesign on the three groups of respondents and comparable levels of police reporting.

The issue of differences in sampling errors may be a concern because the standard errors of the NCVS and NCVS-PRV rates will be a function of both the rate in which victimization occurs, as well as the sample size on which the rate is based. If the serious violent victimization rates and sample sizes are much smaller in rural areas than elsewhere, the underlying trend may be harder to detect, particularly because NCVS sample sizes declined some over time. To investigate the potential impact of this issue we examined population proportions across the years and three types of areas, as well as sample sizes and weights. During the earlier years of the series (from approximately 1973 to 1985) the rural population was equal to or slightly larger in size than the urban population, and the suburban population constituted the largest proportion of the US population. Thereafter however, the proportion of the US population living in rural areas began to decline, from about 31 % in 1985 to 16 % in 2010. The proportion of the US population living in urban areas declined some in the 1970s, but overall was similar in 2010 (32 %) to what it was in 1973 (31 %). The proportion of the US population living in suburban areas gradually increased over time from 38 % in 1973 to 52 % in 2010.

Accompanying these changes in population proportions in each area were declines in NCVS sample size. For example, in 1973 there were about 72,000 households in the sample (resulting in about 220,000 personal interviews) while in 2010 there were about 41,000 households in the sample (resulting in about 167,000 personal interviews). Examination of non-weighted cases and the sampling weights across time and place reveals that survey nonresponse was unrelated to type of place.Footnote 13 It also suggests that the overall declines in sample size occurred rather equally in urban, rural, and suburban places except during the period 1997–2005. During this period sample sizes in rural areas declined disproportionately in an effort to reduce survey costs, and corresponding sample weights were adjusted upward to make up for the disproportionate decrease in cases.Footnote 14 Though we are unable to detect any bias during this period in the rural NCVS trends, this does suggest that some caution is warranted when interpreting differences in the annual levels of the UCR and NCVS-PRV rates for this period.Footnote 15 The cointegration analyses of the trends in these rates are not affected by this issue.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Berg, M.T., Lauritsen, J.L. Telling a Similar Story Twice? NCVS/UCR Convergence in Serious Violent Crime Rates in Rural, Suburban, and Urban Places (1973–2010). J Quant Criminol 32, 61–87 (2016). https://doi.org/10.1007/s10940-015-9254-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10940-015-9254-9

Keywords

Navigation