An Information Theoretic Approach to Ecological Inference in Presence of Spatial Dependence

  • Rosa Bernardini-Papalia
Part of the Advances in Spatial Science book series (ADVSPATIAL)


This chapter introduces an Information Theory (IT)-based method for modeling economic aggregates and for obtaining estimates for small area (sub-group) or subpopulations when no sample units or limited data are available. The proposed approach offers a tractable framework for modeling the underlying variation in small area indicators, in particular when data set contains outliers and in presence of collinearity among regressors since the maximum entropy estimates are robust with respect to the outliers and also less sensitive to a high condition number of the design matrix. A basic ecological inference problem which allows for spatial heterogeneity and dependence is presented with the aim of estimating small area/sub-group indicators by combining all available information at both macro and micro data level.


Spatial Autocorrelation Spatial Dependence Support Point Local Labour Market Spatial Weight Matrix 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Anselin L (1988) Spatial econometrics: methods and models. Kluwer, BostonGoogle Scholar
  2. Bernardini-Papalia R (2008) A composite generalized cross entropy formulation in small samples estimation. Econ Rev 27(4–6):596–609CrossRefGoogle Scholar
  3. Bernardini-Papalia R (2010a) Incorporating spatial structures in ecological inference: an information theoretic approach. Entropy 12(10):2171–2185CrossRefGoogle Scholar
  4. Bernardini-Papalia R (2010b) Data disaggregation procedures within a maximum entropy framework. J Appl Stat 37(11):1947–1959CrossRefGoogle Scholar
  5. Cho WKT (2001) Latent groups and cross-level inferences. Elect Stud 20:243–263CrossRefGoogle Scholar
  6. Golan A (2008) Information and entropy econometrics: a review and synthesis. Foundations and trends® in econometrics, vol 2, No 1–2. Now Publishers, Hanover, pp 1–145Google Scholar
  7. Golan A, Gzyl H (2006) Ill conditioned linear estimation problems: an information theoretic approach with priors. Working paperGoogle Scholar
  8. Golan A, Judge G, Robinson S (1994) Recovering information from incomplete or partial multisectoral economic data. Rev Econ Stat 76(3):541–549CrossRefGoogle Scholar
  9. Golan A, Judge G, Miller D (1996) Maximum entropy econometrics: robust estimation with limited data. Wiley, New YorkGoogle Scholar
  10. Johnston R, Pattie C (2000) Ecological inference and entropy-maximizing: an alternative estimation procedure for split-ticket voting. Pol Anal 8:333–345CrossRefGoogle Scholar
  11. Judge G, Miller D, Cho WKT (2004) An information theoretic approach to ecological inference. In: King G, Rosen O, Tanner MA (eds) Ecological inference: new methodological strategies. Cambridge University Press, Cambridge, pp 162–187CrossRefGoogle Scholar
  12. King G (1997) A solution to the ecological inference problem: reconstructing individual behavior from aggregate data. Princeton University Press, PrincetonGoogle Scholar
  13. King G, Rosen O, Tanner MA (2004) Ecological inference: new methodological strategies. Cambridge University Press, Cambridge, pp 1–422CrossRefGoogle Scholar
  14. Kullback J (1959) Information theory and statistics. Wiley, New YorkGoogle Scholar
  15. Levine RD (1980) An information theoretical approach to inversion problems. J Phys A 13:91–108CrossRefGoogle Scholar
  16. Peeters L, Chasco C (2006) Ecological inference and spatial heterogeneity: an entropy-based distributionally weighted regression approach. Pap Reg Sci 85(2):257–276CrossRefGoogle Scholar
  17. Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27:379–423Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  1. 1.Department of Statistical SciencesUniversity of Bologna, ItalyBolognaItaly

Personalised recommendations