Population Research and Policy Review

, Volume 34, Issue 4, pp 461–480 | Cite as

Conflicts in the Use of the ACS by Federal Agencies Between Statutory Requirements and Survey Methodology

Article

Abstract

The American Community Survey (ACS) has been fully implemented since 2005. The Census Bureau has released four 5-year datasets, the most geographically detailed dataset. Yet, government agencies still grapple with how to use the multiple datasets and estimates. The Census Bureau publishes guidelines for their use, emphasizing the need to balance timeliness and precision in choosing an estimate and encouraging the use of the margin of error. This study examines how three federal agencies use the ACS to implement programs to understand whether the published guidelines address the issues of importance to government agencies. These programs all use income data from the ACS, but for different ends: eligibility criteria, evaluation of federal guideline implementation, and allocation of funds among urban areas. After reviewing agency publications, studying changes in policy, and conducting personal interviews with officials, we find that the agencies consider not only precision and timeliness when choosing an estimate, but also statutory requirements, computational limitations, and geographic needs. Federal agencies are cognizant that these estimates are subject to error, but find that the margin of error adds complexity that does not necessarily result in better implementation of programs. The ACS offers users multiple dataset choices, with varying degrees of reliability, to estimate population characteristics. Current Census Bureau guidelines for the ACS do not meet the needs of many government agencies, as federal statutes are not designed with the current survey methodology in mind.

Keywords

American Community Survey Margin of error Federal policy SNAP Urbanized area formula program Housing choice voucher program 

References

  1. Alexander, C. H. (2002). Still rolling: Leslie Kish’s rolling samples and the American Community Survey. Survey Methodology, 28(1), 10.Google Scholar
  2. Alexander, C.H. (2003). The quality of estimates from the American Community Survey for small population groups. In 2003 Joint statistical meetings—section on survey research methods, (pp. 363-371). Alexandria, VA: The American Statistical Association. Retreived July 15, 2013 from https://www.amstat.org/sections/srms/Proceedings/y2003/Files/JSM2003-000180.pdf.
  3. Alexander, C. H., & Wetrogan, S. (2000). Integrating the American Community Survey and the intercensal demographic estimates program. In Proceedings of the Survey Research Methods Section, ASA (pp. 295–300). Alexandria, VA: American Statistical Association. Retrieved May 27, 2012 from http://www.amstat.org/sections/srms/proceedings/.
  4. Ashenfelter, K. T. (2010). Data reliability indicator based on the coefficient of variation: Results from the second round of testing. Statistical Research Division Study Series (Survey Methodology #2010–04). U.S. Census Bureau. Retrieved December 17, 2013 from https://www.census.gov/srd/papers/pdf/ssm2010-04.pdf.
  5. Bench, K. (2004). Census 2000 sample data and ACS 3-year averages quality measures comparison documentation. Washington, DC: US Census Bureau.Google Scholar
  6. Blodgett, J. (2009). American Community Survey vs. Decennial Census: Are we better off now than we were a decade ago? world wide webpage. Columbia, MO: Missouri Census Data Center. Retrieved June 7, 2012 from http://mcdc.missouri.edu/data/acs/acsVScensus.shtml.
  7. Blumerman, L. M., & Vidal, P. M. (2009). Uses of population and income statistics in federal funds distributionWith a focus on census bureau data (No. #2009-1). Washington, DC: US Census Bureau. Retrieved July 9, 2014 from http://www.census.gov/prod/pubs/govsrr2009-1.pdf.
  8. Citro, C. F., & Kalton, G. (2007). Using the American community survey: Benefits and challenges. Washington, DC: National Academies.Google Scholar
  9. Cork, D. L. (2013). Benefits, burdens, and prospects of the American community survey: summary of a workshop. Washington DC: National Academy of Sciences.Google Scholar
  10. Cunnyngham, K. E., Castner, L. A., & Schrim, A. L. (2007). Reaching those in need: State food stamp participation rates in 2005. Washington, DC: Food and Nutrition Service, USDA. Retrieved October 25, 2013 from http://www.fns.usda.gov/ora/MENU/Published/snap/FILES/Participation/Reaching2005.pdf.
  11. Donnelly, F. P. (2013). The American community survey: Practical considerations for researchers. Reference Services Review, 41(2), 280–297.CrossRefGoogle Scholar
  12. Eslami, E., Leftin, J., & Strayer, M. (2012). Supplemental Nutrition Assistance Program participation rates: Fiscal year 2010 (No. HFHPEHU2012). Washington, DC: USDA Food and Nutrition Service.Google Scholar
  13. Food Stamp Program: High Performance Bonuses. (2003, Dec. 17). Federal Register, 68(242), 70193–70200.Google Scholar
  14. Food Stamp Program: High performance bonuses (final rule). (2005, Feb. 7). Federal Register, 72(24), 6313–6323.Google Scholar
  15. Freedman, D., Pisani, R., & Purves, R. (1998). Statistics (3rd ed.). New York: WW Norton & Co.Google Scholar
  16. FTA. (2005). FTA transit program changes, authorization funding levels and implementation of the safe, accountable, flexible, efficient transportation equity act: A legacy for users. Federal Register, 70(229), 71950–72022.Google Scholar
  17. Gage, L. (2006). Comparison of census 2000 and American community survey 1999–2001 estimates: San Francisco and Tulare Counties, California. Population Research and Policy Review, 25(3), 243–256.CrossRefGoogle Scholar
  18. Government Accountability Office (GAO). (2009). Formula Grants: Funding for the largest federal assistance programs is based on Census-related data and other factors (report to congressional requesters No. GAO-10-263). Washington DC.Google Scholar
  19. Government Accountability Office (GAO). (2012). Housing choice vouchers: Options exist to increase program efficiencies (report to congressional requesters No. GAO-12-300). Washington DC.Google Scholar
  20. Griffin, D. H., & Waite, P. J. (2006). American community survey overview and the role of external evaluations. Population Research and Policy Review, 25(3), 201–223.CrossRefGoogle Scholar
  21. Herman, E. (2008). The American community survey: An introduction to the basics. Government Information Quarterly, 25, 504–519.CrossRefGoogle Scholar
  22. Hodges, K. (2014). Improving the accuracy of block group data from the American community survey. Presented at the ACS data users conference. Washington, DC: Population Reference Bureau.Google Scholar
  23. Hough, G. C., & Swanson, D. A. (2006). An evaluation of the American community survey: Results from the Oregon test site. Population Research and Policy Review, 25(3), 257–273.CrossRefGoogle Scholar
  24. Joyce, P. M., Malec, D., Little, R. A., & Gilary, A. (2012). Statistical modeling methodology for the voting rights act section 203 language assistance determinations (Research Report Series, Statistics No. 2012-02). Washington, DC: US Census Bureau.Google Scholar
  25. King, K., & Starsinic, M. (2010). Investigation of data release rules for medians and zero estimates for the American Community Survey. In Proceedings of the survey research methods section, ASA (pp. 1396–1409). Alexandria, VA: American Statistical Association. Retrieved May 27, 2012 from http://www.amstat.org/sections/srms/proceedings/.
  26. Kuchak, J., Eggers, F. J., Thompson, D., Iachan, R., Saavedra, P., & Patel, J. (2002). The American community survey: Challenges and opportunities for HUD (No. C-OPC-21762). Department of Housing and Urban Development. Retrieved from http://www.huduser.org/Publications/pdf/ACS_FINAL_REPORT.pdf.
  27. Lowenthal, T. A. (2006). American community survey: Evaluating accuracy. Annie E. Casey Foundation. Retrieved May 29, 2012 from http://www.aecf.org/upload/publicationfiles/da3622h1266.pdf.
  28. MacDonald, H. (2006). The American community survey. Journal of the American Planning Association, 72(4), 491–503.CrossRefGoogle Scholar
  29. Mather, M., Rivers, K. L., & Jacobsen, L. A. (2005). The American community survey. Population Bulletin, 60(3), 24.Google Scholar
  30. McLaughlin, D. K., Melz, H. M., Lichter, D. T., & Gardner, E. L. (2000). The quality of rural population estimates from the American community survey. Journal of Economic and Social Measurement, 26, 193–230.Google Scholar
  31. Meltzer, E. (2011). Survey: Median incomes drop across Boulder County. Daily Camera. Retreived September 4, 2013 from LexisNexis Academic.Google Scholar
  32. National Research Council. (2003). Statistical issues in allocating funds by formula: Panel on formula allocations. In T. A. Louis, T. B. Jabine, & M. A. Gerstein (Eds.), Committee on National Statistics, Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press.Google Scholar
  33. Notice of FTA transit program changes, authorized funding levels and implementation of the moving ahead for progress in the 21st century act (MAP–21) and FTA fiscal year 2013 apportionments, allocations, program information and interim guidance. (2012). Federal Register, 77(200), 63670–63706.Google Scholar
  34. Office of Analysis, Nutrition and Evaluation. (2006). Estimating the number of people in poverty for the program access index: The American community survey vs. the current population survey (No. 080206a). Washington, DC: Food and Nutrition Service, USDA. Retrieved October 25, 2013 from http://www.fns.usda.gov/snap/rules/Memo/2006/080206a.pdf.
  35. Office of Research, Nutrition and Analysis. (2007). Calculating the food stamp program access index: A step-by-step guide. Washington, DC: Food and Nutrition Service, USDA.Google Scholar
  36. Proposed information collection; comment request; the American community survey content review results. (2014). Federal Register, 79(211), 64743–64745.Google Scholar
  37. Quadel Consulting Corporation. (2001). Housing choice voucher guidebook. Washington, DC: US Department of Housing and Urban Development. Retrieved October 25, 2013 from http://portal.hud.gov/hudportal/HUD?src=/program_offices/public_indian_housing/programs/hcv/forms/guidebook.
  38. Rapino, M. A., McKenzie, B., & Fields, A. K. (2013). Extended place of work allocation procedures and results for the 2006–2010 5-year ACS-based census transportation planning products (CTPP) (working paper No. 2013-26) (p. 10). Washington, DC: US Census Bureau.Google Scholar
  39. Reamer, A. D. (2010). Counting for dollars: The role of the decennial census in the geographic distribution of federal funds (p. 24). Washington, DC: The Brookings Institution.Google Scholar
  40. Salvo, J. (2014). Using small-area data from the ACS: Issues, challenges, solutions. Presented at the Population Association of America Annual meeting. Boston, MA: Population Reference Bureau.Google Scholar
  41. Salvo, J. J., & Lobo, A. P. (2006). Moving from a decennial census to a continuous measurement survey: Factors affecting nonresponse at the neighborhood level. Population Research and Policy Review, 25(3), 225–241.CrossRefGoogle Scholar
  42. Salvo, J. J., & Lobo, A. P. (2010). The federal statistical system: The local government perspective. Annals of the American Academy of Political and Social Science, 631, 75–88. doi:10.1177/0002716210374414.CrossRefGoogle Scholar
  43. Salvo, J. J., Lobo, A. P., & Love, S. P. (2002). Evaluating continuous measurement: Data quality in the Bronx test site of the American community survey. Journal of Economic and Social Measurement, 28, 263–277.Google Scholar
  44. Scardamalia, R. (2006). The American community survey: General commentary on the findings from external evaluations. Population Research and Policy Review, 25(3), 293–303.CrossRefGoogle Scholar
  45. Smith, A. S. (1998). The American community survey and intercensal population estimates: Where are the crossroads? (Population Division Technical Working Paper No. 31). US Census Bureau. Retrieved May 29, 2012 from http://www.census.gov/population/www/documentation/twps0031/twps0031.html.
  46. Sun, M., & Wong, D. W. S. (2010). Incorporating data quality information in mapping American community survey data. Cartography and Geographic Information Science, 37(4), 285–300. doi:10.1559/152304010793454363.CrossRefGoogle Scholar
  47. Treat, J. B., & Griffin, D. H. (2012). 2012 American community survey research and evaluation report. Memorandum Series #ACS12_RER-19. Memorandum. Retrieved October 25, 2013 from http://www.census.gov/acs/www/Downloads/library/2012/2012_Griffin_02.pdf.
  48. Urban area criteria for the 2010 census. (2011). Federal Register, 76(164), 53030–53043.Google Scholar
  49. US Census Bureau. (2002). Measuring America: The decennial censuses from 1790 to 2000. Report #POL/02-MA(RV). Washington DC: US Government Printing Office. Retrieved July 8, 2014 from https://www.census.gov/history/pdf/measuringamerica.pdf.
  50. US Census Bureau. (2008). A compass for understanding and using American community survey data: What federal agencies need to know. Washington DC: US Government Printing Office. Retrieved October 21, 2013 from http://www.census.gov/acs/www/guidance_for_data_users/handbooks/.
  51. US Census Bureau. (2009). ACS design and methodology report. Washington, DC: US Census Bureau.Google Scholar
  52. US Census Bureau. (2012). American community survey accuracy of the data (2011). Retrieved July 23, 2013 from http://www.census.gov/acs/www/Downloads/data_documentation/Accuracy/ACS_Accuracy_of_Data_2011.pdf.
  53. US Census Bureau. (2013a). When to use 1-year, 3-year, or 5-year estimates—Guidance for data users—American community survey. U.S. Census Bureau. Retrieved October 21, 2013, from http://www.census.gov/acs/www/guidance_for_data_users/estimates/.
  54. US Census Bureau. (2013b). Sample size—Data. Retrieved July 23, 2013 from http://www.census.gov/acs/www/methodology/sample_size_data/.
  55. US Census Bureau. (2013c). American community survey program review final report. Retreived Novemeber 7, 2014 from http://www.census.gov/acs/www/Downloads/operations_admin/2012_program_review/ACS_Program_Review_Report.pdf.
  56. US Department of Housing and Urban Development (HUD). (2011). FY 2012 HUD Income Limits Briefing Material. Retrieved September 9, 2013 from http://www.huduser.org/portal/datasets/il/il12/IncomeLimitsBriefingMaterial_FY12_v2.pdf.
  57. US Department of Housing and Urban Development (HUD). (2013). FY2014 HUD income limits briefing material. Retrieved February 24, 2014 from http://www.huduser.org/portal/datasets/il/il14/IncomeLimitsBriefingMaterial_FY14.pdf.
  58. Van Auken, P. M., Hammer, R. B., Voss, P. R., & Veroff, D. L. (2006). The American community survey in counties with “seasonal” populations. Population Research and Policy Review, 25(3), 275–292.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2014

Authors and Affiliations

  1. 1.Landscape Architecture | Regional and Community PlanningKansas State UniversityManhattanUSA
  2. 2.Applied EconomicsOregon State UniversityCorvallisUSA

Personalised recommendations