Generating Useful Test Data for Complex Linked Employer-Employee Datasets

  • Matthias Dorner
  • Jörg Drechsler
  • Peter Jacobebbinghaus
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7556)

Abstract

When data access for external researchers is difficult or time consuming it can be beneficial if test datasets that mimic the structure of the original data are disseminated in advance. With these test data researchers can develop their analysis code or can decide whether the data are suitable for their planned research before they go through the lengthly process of getting access at the research data center. The aim of these data is not to provide any meaningful results. Instead it is important to maintain the structure of the data as closely as possible including skip patterns, logical constraints between the variables, and longitudinal relationships so that any code that is developed using these test data will also run on the original data without further modifications. Achieving this goal can be challenging for complex datasets such as linked employer-employee datasets (LEED) where the links between the establishments and the employees also need to be maintained. Using the LEED of the Institute for Employment Research we illustrate how useful test data can be developed for such complex datasets. Our approach mainly relies on traditional statistical disclosure control (SDC) techniques such as data swapping and noise addition for data protection. Since statistical inferences need not be preserved, high swapping rates can be applied to sufficiently protect the data. At the same time it is straightforward to maintain the structure of the data by adding some constraints on the swapping procedure.

Keywords

linked employer-employee data test data dummy data swapping noise addition 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Dalenius, T., Reiss, S.P.: Data-swapping: A technique for disclosure control. Journal of Statistical Planning and Inference 6, 73–85 (1982)MathSciNetMATHCrossRefGoogle Scholar
  2. 2.
    Drechsler, J., Reiter, J.P.: Sampling with Synthesis: A New Approach for Releasing Public Use Census Microdata. Journal of the American Statistical Association 105, 1347–1357 (2010)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Fischer, G., Janik, F., Müller, D., Schmucker, A.: The IAB Establishment Panel – things users should know. Schmollers Jahrbuch - Journal of Applied Social Science Studies 129, 133–148 (2009)Google Scholar
  4. 4.
    Jacobebinghaus, P., Müller, D., Orban, A.: How to use data swapping to create useful dummy data for panel datasets. Tech. rep., FDZ-Methodenreport, No. 3 (2010)Google Scholar
  5. 5.
    Jacobebinghaus, P., Seth, S.: Linked-Employer-Employee-Daten des IAB: LIAB-Querschnittmodell 2, 1993-2008. Tech. rep., FDZ-Datenreport, No. 5 (2010)Google Scholar
  6. 6.
    Kölling, A.: The IAB-Establishment Panel. Journal of Applied Social Science Studies 120, 291–300 (2000)Google Scholar
  7. 7.
    Winkler, W.E.: Examples of Easy-to-implement, Widely Used Methods of Masking for which Analytic Properties are not Justified. Tech. rep., Statistical Research Division, U.S. Bureau of the Census, Washington, DC (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Matthias Dorner
    • 1
  • Jörg Drechsler
    • 1
  • Peter Jacobebbinghaus
    • 1
  1. 1.Institute for Employment ResearchNurembergGermany

Personalised recommendations