Skip to main content
Log in

The psychosocial correlates of quality of life in the dialysis population: a systematic review and meta-regression analysis

  • Published:
Quality of Life Research Aims and scope Submit manuscript

Abstract

Purpose

The psychosocial correlates of quality-of-life (QoL) research in end-stage renal disease (ESRD) are important in identifying risk and protective factors that may account for the QoL variability. Thus, the present study provides a meta-analysis of these research results.

Methods

Published studies reporting associations between any psychosocial factors and QoL were retrieved from Medline, Embase, and PsycINFO. Mean effect sizes were calculated for the associations across psychosocial constructs (affect, stress, cognitive appraisal, social support, personality attributes, and coping process). Multiple hierarchical meta-regressions were applied to moderator analyses.

Results

Eighty-one studies covering a combined sample of 13,240 participants were identified resulting in 377 effect sizes of the association between psychosocial factors and QoL. The overall effect size of the association was medium (0.38). Stress, affect, and cognitive appraisal had the largest effect sizes. Location of study, dialysis type, gender, age and QoL domains measured (general well-being, subjective QoL, and health-related QoL) were significant substantive moderators for the associations.

Conclusions

The present study shows that there is a moderate association between psychosocial variables and QoL in patients with ESRD, consistent across different QoL domains. The psychosocial constructs that have the strongest association with QoL are stress, affect, and cognitive appraisal.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Abbreviations

ESr:

Effect size

ESRD:

End-stage renal disease

QoL:

Quality of life

HRQoL:

Health-related quality of life

CAPD:

Continuous ambulatory peritoneal dialysis

PD:

Peritoneal dialysis

PRISMA:

Preferred reporting items for systematic reviews and meta-analyses

References

  1. Rebollo, P., & Ortega, F. (2002). New trends on health related quality of life assessment in end-stage renal disease patients. International Urology and Nephrology, 33, 195–202.

    Article  PubMed  Google Scholar 

  2. Liem, Y. S., Bosch, J. L., Arends, L. R., Heijenbrok-Kal, M. H., & Hunink, M. G. M. (2007). Quality of life assessed with the medical outcomes study short form 36-item health survey of patients on renal replacement therapy: A systematic review and meta-analysis. Value Health, 10, 390–397.

    Article  PubMed  Google Scholar 

  3. Cagney, K. A., Wu, A. W., Fink, N. E., Jenckes, M. W., Meyer, K. B., Bass, E. B., et al. (2000). Formal literature review of quality-of-life instruments used in end-stage renal disease. American Journal of Kidney Diseases, 36, 327–336.

    Article  PubMed  CAS  Google Scholar 

  4. Unruh, M. L., Weisbord, S. D., & Kimmel, P. L. (2005). Health-related quality of life in nephrology research and clinical practice. Seminars in Dialysis, 18, 82–90.

    Article  PubMed  Google Scholar 

  5. Finkelstein, F. O., Wuerth, D., & Finkelstein, S. H. (2009). Health related quality of life and the ckd patient: Challenges for the nephrology community. Kidney International, 76, 946–952.

    Article  PubMed  Google Scholar 

  6. Kimmel, P. L., & Patel, S. S. (2006). Quality of life in patients with chronic kidney disease: Focus on end-stage renal disease treated with hemodialysis. Seminars in Nephrology, 26, 68–79.

    Article  PubMed  Google Scholar 

  7. Unruh, M. L., Hess, R., Unruh, M. L., & Hess, R. (2007). Assessment of health-related quality of life among patients with chronic kidney disease. Advanced Chronic Kidney Disease, 14, 345–352.

    Article  Google Scholar 

  8. Mujais, S. K., Story, K., Brouillette, J., Takano, T., Soroka, S., Franek, C., et al. (2009). Health-related quality of life in ckd patients: Correlates and evolution over time. Clinical Journal of the American Society of Nephrology, 4, 1293–1301.

    Article  PubMed  Google Scholar 

  9. Vazquez, I., Valderrabano, F., Fort, J., Jofre, R., Lopez-Gomez, J. M., Moreno, F., et al. (2005). Psychosocial factors and health-related quality of life in hemodialysis patients. Quality of Life Research, 14, 179–190.

    Article  PubMed  Google Scholar 

  10. Merkus, M. P., Jager, K. J., Dekker, F. W., Boeschoten, E. W., Stevens, P., & Krediet, R. T. (1997). Quality of life in patients on chronic dialysis: Self-assessment 3 months after the start of treatment. The necosad study group. American Journal of Kidney Diseases, 29, 584–592.

    Article  PubMed  CAS  Google Scholar 

  11. Carmichael, P., Popoola, J., John, I., Stevens, P., & Carmichael, A. (2000). Assessment of quality of life in a single centre dialysis population using the kdqol-sftm questionnaire. Quality of Life Research, 9, 195–205.

    Article  PubMed  CAS  Google Scholar 

  12. Spiegel, B. M., Melmed, G., Robbins, S., Esrailian, E., Spiegel, B. M. R., Melmed, G., et al. (2008). Biomarkers and health-related quality of life in end-stage renal disease: A systematic review. Clinical Journal of the American Society of Nephrology, 3, 1759–1768.

    Article  PubMed  Google Scholar 

  13. Leaf, D. E., & Goldfarb, D. S. (2009). Interpretation and review of health-related quality of life data in ckd patients receiving treatment for anemia. Kidney International, 75, 15–24.

    Article  PubMed  Google Scholar 

  14. Ross, S. D., Fahrbach, K., Frame, D., Scheye, R., Connelly, J. E., & Glaspy, J. (2003). The effect of anemia treatment on selected health-related quality-of-life domains: A systematic review. Clinical Therapy, 25, 1786–1805.

    Article  Google Scholar 

  15. Clement, F. M., Klarenbach, S., Tonelli, M., Johnson, J. A., & Manns, B. J. (2009). The impact of selecting a high hemoglobin target level on health-related quality of life for patients with chronic kidney disease: A systematic review and meta-analysis. Archives of Internal Medicine, 169, 1104–1112.

    Article  PubMed  CAS  Google Scholar 

  16. Tovbin, D., Gidron, Y., Jean, T., Granovsky, R., & Schnieder, A. (2003). Relative importance and interrelations between psychosocial factors and individualized quality of life of hemodialysis patients. Quality of Life Research, 12, 709–717.

    Article  PubMed  Google Scholar 

  17. Kao, T.-W., Lai, M.-S., Tsai, T.-J., Jan, C.-F., Chie, W.-C., & Chen, W.-Y. (2009). Economic, social, and psychological factors associated with health-related quality of life of chronic hemodialysis patients in northern taiwan: A multicenter study. Artificial Organs, 33, 61–68.

    Article  PubMed  Google Scholar 

  18. Kimmel, P. L., Emont, S. L., Newmann, J. M., Danko, H., & Moss, A. H. (2003). Esrd patient quality of life: Symptoms, spiritual beliefs, psychosocial factors, and ethnicity. American Journal of Kidney Disease, 42, 713–721.

    Article  Google Scholar 

  19. Patel, S. S., Shah, V. S., Peterson, R. A., & Kimmel, P. L. (2002). Psychosocial variables, quality of life, and religious beliefs in esrd patients treated with hemodialysis. American Journal of Kidney Disease, 40, 1013–1022.

    Article  Google Scholar 

  20. Wolcott, D. L., Nissenson, A. R., & Landsverk, J. (1988). Quality of life in chronic dialysis patients: Factors unrelated to dialysis modality. General Hospital Psychiatry, 10, 267–277.

    Article  PubMed  CAS  Google Scholar 

  21. Cameron, J. I., Whiteside, C., Katz, J., & Devins, G. M. (2000). Differences in quality of life across renal replacement therapies: A meta-analytic comparison. American Journal of Kidney Disease, 35, 629–637.

    Article  CAS  Google Scholar 

  22. Edgell, E. T., Coons, S. J., Carter, W. B., Kallich, J. D., Mapes, D., Damush, T. M., et al. (1996). A review of health-related quality-of-life measures used in end-stage renal disease. Clinical Therapy, 18, 887–938.

    Article  CAS  Google Scholar 

  23. Parsons, D. S., & Harris, D. C. (1997). A review of quality of life in chronic renal failure. Pharmacoeconomics, 12, 140–160.

    Article  PubMed  CAS  Google Scholar 

  24. Gladis, M. M., Gosch, E. A., Dishuk, N. M., & Crits-Christoph, P. (1999). Quality of life: Expanding the scope of clinical significance. Journal of Consulting and Clinical Psychology, 67, 320–331.

    Article  PubMed  CAS  Google Scholar 

  25. Cummins, R. A. (2005). Moving from the quality of life concept to a theory. Journal of Intellectual Disability Research, 49, 699–706.

    Article  PubMed  CAS  Google Scholar 

  26. Eack, S. M., & Newhill, C. E. (2007). Psychiatric symptoms and quality of life in schizophrenia: A meta-analysis. Schizophrenia Bulletin, 33, 1225–1237.

    Article  PubMed  Google Scholar 

  27. Lehman, A. F. (2006). Instruments for measuring quality of life in mental disorders. I: Up to 1996; quality of life in mental disorders (2nd ed., pp. 71–83). New York: Wiley.

    Google Scholar 

  28. Cummins, R. A. (2000). Objective and subjective quality of life: An interactive model. Social Indicators Research, 52, 55–72.

    Article  Google Scholar 

  29. Bruce, M. (2002). Psychosocial risk factors for depressive disorders in late life. Biological Psychiatry, 52, 175–184.

    Article  Google Scholar 

  30. Kelsey, J. L., Whittemore, A. S., Evans, A. S., & Thompson, W. D. (1996). Methods in observational epidemiology. New York: Oxford University Press.

    Google Scholar 

  31. Zwicker, J. G., & Harris, S. R. (2008). Quality of life of formerly preterm and very low birth weight infants from preschool age to adulthood: A systematic review. Pediatrics, 121, e366–e376.

    Article  Google Scholar 

  32. Rabindranath, K. S., Daly, C., Butler, J. A., Roderick, P. J., Wallace S., & MacLeod, A. M. (2005). Psychosocial interventions for depression in dialysis patients. The Cochrane Database of Systematic Reviews 2005; Issue 3: Art. No.: CD004542. DOI:004510.100214651858.CD100214004542.pub100214651852.

  33. Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Group, T. P. (2009). Preferred reporting items for systematic reviews and meta-analyses: The prisma statement. PLoS Medicine/Public Library of Science 2009; 6:e1000097.

    Google Scholar 

  34. Fishbane, S., & Masani, N. (2005). Anemia in chronic kidney disease. In B. J. G. Pereira, M. H. Sayegh, & P. Blake (Eds.). Chronic kidney disease, dialysis, transplantation: A companion to brenner and rector’s the kidney (pp. 122–135). Philadelphia: Elsevier Saunders.

  35. Lipsey, M. W., & Wilson, D. (2000). Practical meta-analysis. London: Sage.

    Google Scholar 

  36. Downs, S. H., & Black, N. (1998). The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. Journal of Epidemiology and Community Health, 52, 377–384.

    Article  CAS  Google Scholar 

  37. Hayden, J. A., Côté, P., & Bombardier, C. (2006). Evaluation of the quality of prognosis studies in systematic reviews. Annals of Internal Medicine,144, 427.

    Google Scholar 

  38. McGraw, K. O., & Wong, S. P. (1996) “Forming inferences about some intraclass correlations coefficients”: Correction. Psychological Methods, 1, 390.

  39. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.

    Article  CAS  Google Scholar 

  40. McEwen, B. S. (2007). Physiology and neurobiology of stress and adaptation: Central role of the brain. Physiological Reviews, 87, 873–904.

    Article  Google Scholar 

  41. Stanton, A. L., Revenson, T. A., & Tennen, H. (2007). Health psychology: Psychological adjustment to chronic disease. Annual Review of Psychology, 58, 565–592.

    Article  Google Scholar 

  42. Chida, Y., Hamer, M., Steptoe, A., Chida, Y., Hamer, M., & Steptoe, A. (2008). A bidirectional relationship between psychosocial factors and atopic disorders: A systematic review and meta-analysis. Psychosomatic Medicine, 70, 102–116.

    Article  Google Scholar 

  43. McEwen, B. S. (1998). Protective and damaging effects of stress mediators. New England Journal of Medicine, 338, 171–179.

    Article  CAS  Google Scholar 

  44. Stanton, A. L., & Revenson, T. A. (2007). Adjustment to chronic disease: Progress and promise in research. In H. S. Friedman (Ed.). Foundations of health psychology (pp. 203–233). New York, NY: Oxford University Press.

  45. Hamer, M., Chida, Y., Molloy, G. J., Hamer, M., Chida, Y., & Molloy, G. J. (2009). Psychological distress and cancer mortality. Journal of Psychosomatic Research, 66, 255–258.

    Article  Google Scholar 

  46. Chida, Y., & Hamer, M. (2008). An association of adverse psychosocial factors with diabetes mellitus: A meta-analytic review of longitudinal cohort studies. Diabetologia, 51, 2168–2178.

    Article  CAS  Google Scholar 

  47. Wilson, D. (2002). A spreadsheet for calculating standardized mean difference type effect sizes: Es_calculator.Xls, 2002. Retrieved January 2009.

  48. Rosenthal, R., & Rubin, D. B. (2003). R-sub(equivalent): A simple effect size indicator. Psychological Methods, 8, 492–496.

    Article  Google Scholar 

  49. Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2005). Comprehensive meta-analysis. Englewood, NJ: Biostat.

    Google Scholar 

  50. Rosenthal, R. (1991). Meta-analytic procedures for social research (rev. Ed.). Newbury Park, CA: Sage Publications.

  51. Lyubomirsky, S., Sheldon, K. M., & Schkade, D. (2005). Pursuing happiness: The architecture of sustainable change. Review of General Psychology Special Issue: Positive Psychology, 9, 111–131.

    Google Scholar 

  52. Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2009). Introduction to meta-analysis. Oxford: Wiley.

    Book  Google Scholar 

  53. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando: Academic Press.

    Google Scholar 

  54. Cohen, J. (1988). Statistical power analysis for the behavioral sciences, ed 2. Hillsdale, NJ: L. Erlbaum Associates.

    Google Scholar 

  55. Shadish, W. R., & Haddock, C. K. (2009). Combining estimates of effect size. In: H. M. Cooper, L. V. Hedges, & J. C. Valentine (Eds.). The handbook of research synthesis and meta-analysis (pp. 257–278). New York: Russell Sage Foundation.

  56. Huedo-Medina, T. B., Sánchez-Meca, J., Marin-Martinez, F., & Botella, J. (2006). Assessing heterogeneity in meta-analysis: Q statistic or i2 index? Psychological Methods, 11, 193–206.

    Article  Google Scholar 

  57. Higgins, J. P. T., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21, 1539–1558.

    Article  Google Scholar 

  58. Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a bank correlation test for publication bias. Biometrics, 50, 1088–1101.

    Article  CAS  Google Scholar 

  59. Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638–641.

    Article  Google Scholar 

  60. Wilson, D. (2009). Spss, stata, and sas macros for performing meta-analytic analyses: Spss_macros.Zip, 2002. Retrieved Januray 2009.

  61. SPSS for Windows, (2008). Spss for windows 17. Chicago: SPSS Inc.

  62. Cafri, G., Kromrey, J. D., & Brannick, M. T. (2009). A sas macro for statistical power calculations in meta-analysis. Behavior Research Methods, 41, 35–46.

    Article  Google Scholar 

  63. Sas software. (2002). Cary, NC: SAS Institute Inc.

  64. Steel, Z., Chey, T., Silove, D., Marnane, C., Bryant, R. A., & van Ommeren, M. (2009). Association of torture and other potentially traumatic events with mental health outcomes among populations exposed to mass conflict and displacement: A systematic review and meta-analysis. Jama, 302, 537–549.

    Article  CAS  Google Scholar 

  65. Davern, M. T., Cummins, R. A., & Stokes, M. A. (2007). Subjective wellbeing as an affective-cognitive construct. Journal of Happiness Studies, 8, 429–449.

    Article  Google Scholar 

  66. Smith, K. W., Avis, N. E., & Assmann, S. F. (1999). Distinguishing between quality of life and health status in quality of life research: A meta-analysis. Quality of Life Research, 8, 447–459.

    Article  PubMed  CAS  Google Scholar 

  67. Lew, S. Q., & Piraino, B. (2005). Quality of life and psychological issues in peritoneal dialysis patients. Seminars in Dialysis, 18, 119–123.

    Article  PubMed  Google Scholar 

  68. Cummins, R. A., & Nistico, H. (2002). Maintaining life satisfaction: The role of positive cognitive bias. Journal of Happiness Studies, 3, 37–69.

    Article  Google Scholar 

  69. Kimmel, P. L., Peterson, R. A., Weihs, K. L., Simmens, S. J., Boyle, D. H., Cruz, I., et al. (1995). Aspects of quality of life in hemodialysis patients. Journal of the American Society of Nephrology, 6, 1418–1426.

    PubMed  CAS  Google Scholar 

  70. Stansfeld, S., & Rasul, F. (2007). Psychosocial factors, depression and illness. In A. Steptoe (Ed.). Depression and physical illness (pp. 19–50). London: Cambridge University Press.

  71. Hyde, J. S., Mezulis, A. H., & Abramson, L. Y. (2008). The abcs of depression: Integrating affective, biological, and cognitive models to explain the emergence of the gender difference in depression. Psychological Review, 115, 291–313.

    Article  PubMed  Google Scholar 

  72. Matud, M. P. (2004). Gender differences in stress and coping styles. Personality and Individual Differences, 37, 1401–1415.

    Article  Google Scholar 

  73. Ptacek, J. T., Smith, R. E., & Dodge, K. L. (1994). Gender differences in coping with stress: When stressor and appraisals do not differ. Personality and Social Psychology Bulletin, 20, 421–430.

    Article  Google Scholar 

  74. Mapes, D. L., Bragg-Gresham, J. L., Bommer, J., Fukuhara, S., McKevitt, P., Wikstrom, B., et al. (2004). Health-related quality of life in the dialysis outcomes and practice patterns study (dopps). American Journal of Kidney Disease, 44, 54–60.

    Article  Google Scholar 

  75. Fukuhara, S., Lopes, A. A., Bragg-Gresham, J. L., Kurokawa, K., Mapes, D. L., Akizawa, T., et al. (2003). Worldwide dialysis outcomes and practice patterns S: Health-related quality of life among dialysis patients on three continents: The dialysis outcomes and practice patterns study. Kidney International, 64, 1903–1910.

    Article  PubMed  Google Scholar 

  76. Hays, R. D., Kallich, J. D., Mapes, D. L., Coons, S. J., & Carter, W. B. (1994). Development of the kidney disease quality of life (kdqol) instrument. Quality of Life Research, 3, 329–338.

    Article  PubMed  CAS  Google Scholar 

  77. Saban, K. L., Stroupe, K. T., Bryant, F. B., Reda, D. J., Browning, M. M., Hynes, D. M., et al. (2008). Comparison of health-related quality of life measures for chronic renal failure: Quality of well-being scale, short-form-6d, and the kidney disease quality of life instrument. Quality of Life Research, 17, 1103–1115.

    Article  PubMed  Google Scholar 

  78. Addington-Hall, J., & Kalra, L. (2001). Who should measure quality of life? British Medical Journal, 322, 1417–1420.

    Article  PubMed  CAS  Google Scholar 

  79. Hickey, A. M., O’Boyle, C. A., McGee, H. M., & Joyce, C. R. B. (1999). The schedule for the evaluation of individual quality of life. In C. R. B. Joyce (Ed.). Individual quality of life: Approaches to conceptualisation and assessment (pp 119–133). Amsterdam, Netherlands: Harwood Academic Publishers.

  80. Kalantar-Zadeh, K., & Unruh, M. (2005). Health related quality of life in patients with chronic kidney disease. International Urology and Nephrology, 37, 367–378.

    Article  PubMed  Google Scholar 

  81. O’Boyle, C. A., McGee, H. M., Hickey, A., Joyce, C. R. B., Browne, J., O’Malley, K., et al. (1993). The schedule for the evaluation of individual quality of life (seiqol): A direct weighting procedure for quality of life domains (seiqol-dw) administration manual. Dublin: Department of Psychology, Royal College of Surgeons in Ireland.

    Google Scholar 

  82. Marks, R., Allegrante, J. P., & Lorig, K. (2005). A review and synthesis of research evidence for self-efficacy-enhancing interventions for reducing chronic disability: Implications for health education practice (part i). Health Promotion Practice, 6, 37–43.

    Article  PubMed  Google Scholar 

  83. Marks, R., Allegrante, J. P., & Lorig, K. (2005). A review and synthesis of research evidence for self-efficacy-enhancing interventions for reducing chronic disability: Implications for health education practice (part ii). Health Promotion Practice, 6, 148–156.

    Article  PubMed  Google Scholar 

  84. Tsay, S.-L. (2003). Self-efficacy training for patients with end-stage renal disease. Journal of Advanced Nursing, 43, 370–375.

    Article  PubMed  Google Scholar 

  85. Tsay, S.-L., & Hung, L.-O. (2004). Empowerment of patients with end-stage renal disease—a randomized controlled trial. International Journal of Nursing Studies, 41, 59–65.

    Article  PubMed  Google Scholar 

  86. Tsay, S.-L., & Lee, Y. C. (2005). Effects of an adaptation training programme for patients with end-stage renal disease. Journal of Advanced Nursing, 50, 39–46.

    Article  PubMed  Google Scholar 

  87. Cohen, S., Gottlieb, B. H., & Underwood, L. G. (2000). Social relationships and health. In S. Cohen, L. G. Underwood, & B. H. Gottlieb (Eds.). Social support measurement and intervention: A guide for health and social scientists (pp. 3–25). NY, USA: Oxford University Press.

  88. Mucsi, I. (2008). Health-related quality of life in chronic kidney disease patients. Primary psychiatry, 15, 46–51.

    Google Scholar 

  89. Folkman, S., & Moskowitz, J. T. (2004). Coping: Pitfalls and promise. Annual Review of Psychology, 55, 745–774.

    Google Scholar 

  90. Cohen, S. D., Sharma, T., Acquaviva, K., Peterson, R. A., Patel, S. S., & Kimmel, P. L. (2007). Social support and chronic kidney disease: An update. Advanced Chronic Kidney Disease, 14, 335–344.

    Article  Google Scholar 

  91. Patel, S. S., Peterson, R. A., & Kimmel, P. L. (2005). The impact of social support on end-stage renal disease. Seminars in Dialysis, 18, 98–102.

    Article  PubMed  Google Scholar 

  92. Folkman, S. (2009). Commentary on the special section “theory-based approaches to stress and coping”: Questions, answers, issues, and next steps in stress and coping research. European Psychologist, 14, 72–77.

    Article  Google Scholar 

  93. Liu, R. T., & Alloy, L. B. (2010). Stress generation in depression: A systematic review of the empirical literature and recommendations for future study. Clinical Psychology Review, 30, 582–593.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

We are grateful for the authors of the included studies who provided additional data for this meta-analysis and the extensive support from the Renal Unit, Liverpool Hospital in completing this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ramony Chan.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 68 kb)

Supplementary material 2 (DOCX 28 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chan, R., Brooks, R., Steel, Z. et al. The psychosocial correlates of quality of life in the dialysis population: a systematic review and meta-regression analysis. Qual Life Res 21, 563–580 (2012). https://doi.org/10.1007/s11136-011-9973-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11136-011-9973-9

Keywords

Navigation