How Comparable are the Gallup World Poll Life Satisfaction Data?

Abstract

This paper explores the degree to which the new data on life satisfaction from the Gallup World Poll are comparable to those used in previous empirical studies, predominantly those from the World Values Survey. Differences might arise due to the timing and anchoring of questions in the Gallup data. The paper identifies a set of large outlier countries, and estimates suggest that the two datasets tend to generate rather different results, questioning the degree to which they measure the same concept.

This is a preview of subscription content, log in to check access.

Fig. 1

Notes

  1. 1.

    The only other surveys that provide cross-country data are the International Social Survey Programme, which unfortunately includes only a small number of countries, all covered by the WVS, and the European, Latin American, African and Asian Barometers, that have so far been used in very few studies on specific regions.

  2. 2.

    For a broader discussion of issues related to comparing different surveys and survey designs, see Veenhoven (2006, ch. 7) for an optimist view and Ormerod and Johns (2007) for a corresponding negative view.

  3. 3.

    The data employed in Bjørnskov et al. (2008c), available twice a year for most years since 1973 for the EU-15 and distributed from one to four, serve to illustrate the stability of the scores over time. Even though the difference between the least happy and the happiest European country is almost one point on the four-point scale, the intra-country variance over time is only .007.

  4. 4.

    The difficulty in translating the concept arises out of at least two problems. First, the Russian and French translations of ‘happy’ both mean happy and lucky, implying that the word can have multiple meanings that make the scores less comparable across countries. Second, the word may carry more or less weight. Even while Denmark has the world’s happiest population in most surveys, the Danish translation ‘lykkelig’ is a stronger concept than the parallel notion of ‘happy’ in English and would arguably require more to achieve.

  5. 5.

    Bjørnskov (2003), relying on WVS data, finds that not only do the Latin American countries score higher on life satisfaction than one would expect, but failing to control for this effect biases coefficients on income inequality, and potentially other institutional factors, upwards.

  6. 6.

    An additional simple test is to replace GDP per capita with the level of private consumption, as indicated by Fischer’s (2008) recent critique of Easterlin’s work. However, the logarithm to private consumption fairs worse than GDP when using the GWP data (not shown). Yet, given the vast differences in taxes across the world, which the data do not take into account, it remains an open question which is the most relevant measure of income in happiness studies.

  7. 7.

    One of the referees of this journal suggested that the GWP data might not measure life satisfaction at all, but instead capture individuals’ attempts at objectively classifying their lives on a ‘good life’ dimension. While the present analysis cannot be used to draw such conclusions, it certainly remains a likely possibility.

References

  1. Angelini, V., Cavapozzi, D., Corazzini, L., & Paccagnella, O. (2008). Do Danes and Italians rate life satisfaction in the same way? Using vignettes to correct for individual-specific scale biases. Mimeo, University of Padua.

  2. Bjørnskov, C. (2003). The happy few. Cross-country evidence on social capital and life satisfaction. Kyklos, 56, 3–16. doi:10.1111/1467-6435.00207.

    Article  Google Scholar 

  3. Bjørnskov, C. (2008). The growth-inequality association: Government ideology matters. Journal of Development Economics, 87, 300–308. doi:10.1016/j.jdeveco.2007.04.002.

    Article  Google Scholar 

  4. Bjørnskov, C., Dreher, A., & Fischer, J. A. V. (2008a). Cross-country determinants of life satisfaction: Exploring different determinants across groups in society. Social Choice and Welfare, 30, 119–173. doi:10.1007/s00355-007-0225-4.

    Article  Google Scholar 

  5. Bjørnskov, C., Dreher, A., & Fischer, J. A. V. (2008b). Formal institutions and subjective wellbeing: Revisiting the cross-country evidence. KOF Working Paper no. 192, ETH Zürich.

  6. Bjørnskov, C., Datta Gupta, N., & Pedersen, P. J. (2008c). Analyzing trends in subjective well-being in 15 European countries, 1973–2002. Journal of Happiness Studies, 9, 317–330. doi:10.1007/s10902-007-9055-4.

    Article  Google Scholar 

  7. Cantril, H. (1945). Do different polls get the same results? Public Opinion Quarterly, 9, 61–69. doi:10.1086/265721.

    Article  Google Scholar 

  8. Cantril, H. (1965). The pattern of human concerns. New Brunswick, NJ: Rutgers University Press.

    Google Scholar 

  9. Cingranelli and Richards database. (2004). Available at the CIRI Human Rights Data Project homepage at http://ciri.binghamton.edu/.

  10. Connelly, G. M. (1945). Now let’s look at the real problem: Validity. Public Opinion Quarterly, 9, 51–60. doi:10.1086/265720.

    Article  Google Scholar 

  11. Cummins, R. (2003). Normative life satisfaction: Measurement issues and a homeostatic model. Social Indicators Research, 64, 225–240. doi:10.1023/A:1024712527648.

    Article  Google Scholar 

  12. Diener, E., Diener, M., & Diener, C. (1995). Factors predicting the subjective well-being of nations. Journal of Personality and Social Psychology, 89, 851–864. doi:10.1037/0022-3514.69.5.851.

    Article  Google Scholar 

  13. Diener, E., & Seligman, M. E. P. (2004). Beyond money. Towards an economy of well-being. Psychological Science in the Public Interest, 5, 1–31. doi:10.1111/j.0963-7214.2004.00501001.x.

    Article  Google Scholar 

  14. Di Tella, R., MacCulloch, R. J., Clark, A., & Oswald, A. (2003). The macroeconomics of happiness. The Review of Economics and Statistics, 85, 809–827. doi:10.1162/003465303772815745.

    Article  Google Scholar 

  15. Easterlin, R. (1973). Does money buy us happiness? The Public Interest, 3, 3–10.

    Google Scholar 

  16. Easterlin, R. (1995). Will raising the incomes of all increase the happiness of all? Journal of Economic Behavior & Organization, 27, 35–47. doi:10.1016/0167-2681(95)00003-B.

    Article  Google Scholar 

  17. Fischer, C. (2008). What wealth-happiness paradox? A short note on the American case. Journal of Happiness Studies, 9, 219–226. doi:10.1007/s10902-007-9047-4.

    Article  Google Scholar 

  18. Fischer, J. A. V., & Kirchgässner, G. (2008). Are happy people more satisfied with their lives? The impact of national culture on the difference between life satisfaction and happiness. Mimeo, University of St. Gallen.

  19. Freedom House. (2007). Freedom in the world 2007. The annual survey of political rights and civil liberties. Lanham, MD: Rowman and Littlefield.

    Google Scholar 

  20. Frey, B. (2008). Happiness: A revolution in economics. Cambridge, MA: MIT Press.

    Google Scholar 

  21. Hagerty, M. R., & Veenhoven, R. (2003). Wealth and happiness revisited—growing national income does go with greater happiness. Social Indicators Research, 64, 1–27. doi:10.1023/A:1024790530822.

    Article  Google Scholar 

  22. Heady, B. (2006). Happiness: Revising set point theory and dynamic equilibrium theory to account for longterm change. DIW Discussion Paper no. 607, Berlin.

  23. Helliwell, J. F., & Huang, W. (2006). How’s your government? International evidence linking good government and well-being. NBER working paper 11988.

  24. Helliwell, J. F., & Putnam, R. (2004). The social context of well-being. Philosophical Transactions of the Royal Society, 359, 1435–1446. doi:10.1098/rstb.2004.1522.

    Article  Google Scholar 

  25. Henisz, W. J. (2002). The institutional environment for infrastructure investment. Industrial and Corporate Change, 11, 355–389.

    Article  Google Scholar 

  26. Heritage Foundation. (2007). 2007 Index of economic freedom. Washington, DC: Heritage Foundation.

    Google Scholar 

  27. Irwin, F. W. (1944). The realism of expectations. Psychological Review, 51, 120–126. doi:10.1037/h0061743.

    Article  Google Scholar 

  28. Kaufmann, D., Kraay, A., & Mastruzzi, M. (2006). Governance Matters V: Aggregate and individual governance indicators for 1996–2005. World Bank Policy Research Working Paper 4012.

  29. Kristensen, N., & Johansson, E. (2008). New evidence on cross-country differences in job satisfaction using anchoring vignettes. Labour Economics, 15, 96–117. doi:10.1016/j.labeco.2006.11.001.

    Article  Google Scholar 

  30. Larsen, J. T., & McKibban, A. R. (2008). Is happiness having what you want, wanting what you have, or both? Psychological Science, 19, 371–377.

    Article  Google Scholar 

  31. Lim, H.-E. (2008). The use of different happiness rating scales: Bias and comparison problem? Social Indicators Research, 87, 259–267.

    Article  Google Scholar 

  32. Lucas, R. E., Clark, A. E., Georgellis, Y., & Diener, E. (2004). Unemployment alters the set point for life satisfaction. Psychological Science, 15, 8–13.

    Article  Google Scholar 

  33. Ormerod, P., & Johns, H. (2007). Against happiness. Prospect Magazine, 133, April.

  34. Ott, J. (2008). Government effectiveness and happiness in 131 nations in 2006. Mimeo, Erasmus University Rotterdam.

  35. Ovaska, T., & Takashima, R. (2006). Economic policy and the level of self-perceived well-being: An international comparison. Journal of Socio-Economics, 35, 308–325.

    Article  Google Scholar 

  36. Pavot, W., & Diener, E. (1993). Review of the satisfaction with life scale. Psychological Assessment, 5, 164–172.

    Article  Google Scholar 

  37. Radcliff, B. (2001). Politics, markets, and life satisfaction: The political economy of human happiness. American Political Science Review, 95, 939–952.

    Google Scholar 

  38. RSF. (2007). Worldwide press freedom index. Press release, October 17, Reporters Without Borders, Paris.

  39. Schwarze, J., & Härpfer, M. (2007). Are people inequality averse, and do they prefer redistribution by the state? Evidence from German longitudinal data on life satisfaction. Journal of Socio-Economics, 36, 233–249.

    Article  Google Scholar 

  40. Stevenson, B., & Wolfers, J. (2008). Economic growth and subjective well-being: Reassessing the Easterlin paradox. Working paper, University of Pennsylvania.

  41. Stutzer, A. (2004). The role of income aspirations in individual happiness. Journal of Economic Behavior and Organization, 54, 89–109.

    Article  Google Scholar 

  42. Summers, A., Heston, R., & Aten, B. (2006). Penn world tables mark 6.2. CICUP, University of Pennsylvania.

  43. Transparency International. (2007). Transparency international corruption perceptions index 2007. Press release (October), Berlin, Transparency International.

  44. UNU. (2008). World income inequality database v2.0. Helsinki: United Nations University-World Institute for Development Economics Research.

    Google Scholar 

  45. Veenhoven, R. (2006). Average happiness in 95 nations 1995–2005. World Database of Happiness, Rank Report 2006-1d. Available at http://worlddatabaseofhappiness.eur.nl.

  46. Veenhoven, R., & Ehrhardt, J. (1995). The cross-cultural pattern of happiness. Test of predictions implied in three theories of happiness. Social Indicators Research, 34, 33–68.

    Article  Google Scholar 

  47. WDH. (2008). World database of happiness. Available at http://worlddatabaseofhappiness.eur.nl.

  48. World Values Survey. (2008). World values survey database. Available at http://worldvaluessurvey.org.

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Christian Bjørnskov.

Appendix

Appendix

Table A1 Data sources and studies
Table A2 Descriptive statistics
Table A3 Data definitions
Table A4 Testing prior hypotheses of determinants of national average satisfaction—using WDH data

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Bjørnskov, C. How Comparable are the Gallup World Poll Life Satisfaction Data?. J Happiness Stud 11, 41–60 (2010). https://doi.org/10.1007/s10902-008-9121-6

Download citation

Keywords

  • Life satisfaction
  • Data comparability
  • Validity