Abstract
Background
The long-term efficacy of Highly Active Antiretroviral Therapies (HAART) has enlightened the crucial role of health-related quality of life (HRQL) among HIV-infected patients. However, any analysis of such extensive longitudinal data necessitates a suitable handling of dropout which may correlate with patients–health status.
Methods
We analysed the HRQL evolution over 5 years for 1,000 patients initiating a protease inhibitor (PI)-containing therapy, using MOS SF-36 physical (PCS) and mental (MCS) scores. In parallel with a classical separate random effects model, we used a joint parameter-dependent selection model to account for non-ignorable dropout.
Results
HRQL evolved according to a two-phase pattern, characterized by an initial improvement during the year following HAART initiation and a relative stabilization thereafter. Immunodepression and self-reported side effects were found to be negative predictors of both PCS and MCS scores. Hepatitis C virus coinfection and AIDS clinical stage were found to affect physical HRQL. Results were not significantly altered when accounting for dropout.
Conclusion
Such results, obtained on a large sample of HIV-infected patients with extensive follow-up, underline the need for a regular monitoring of patients–immunological status and for a better management of their experience with hepatitis C and HAART.
Similar content being viewed by others
Notes
Note that there is no principal effect for the “Number of self-reported symptoms of lipodystrophy–in Table 3, as lipodystrophy symptoms were absent at M0. The coefficient of the first slope is used in this case for the interpretation.
References
Palella, F. J., Jr., Delaney, K. M., Moorman, A. C., Loveless, M. O., Fuhrer, J., Satten, G. A., et al. (1998). Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. HIV Outpatient Study Investigators. New England Journal of Medicine, 338, 853–60.
Little, R., & Rubin, D. (2002). Statistical analysis with missing data.
Laird, N. M. (1988). Missing data in longitudinal studies. Statistics in Medicine, 7, 305–15.
Vonesh, E. F., Greene, T., & Schluchter, M. D. (2006). Shared parameter models for the joint analysis of longitudinal data and event times. Statistics in Medicine, 15, 143–63.
Hogan, J. W., Lin, X., & Herman, B. (2004). Mixtures of varying coefficient models for longitudinal data with discrete or continuous nonignorable dropout. Biometrics, 60, 854–64.
Lin, D. Y., & Ying, Z. (2003). Semiparametric regression analysis of longitudinal data with informative drop-outs. Biostatistics, 4, 385–98.
Hu, C., & Sale, M. E. (2003). A joint model for nonlinear longitudinal data with informative dropout. Journal of Pharmacokinetics and Pharmacodynamics, 30, 83–03.
Guo, X., & Carlin, B. P. (2004). Separate and joint modeling of longitudinal and event time data using standard computer packages. The American Statistician, 58, 1–.
Carrieri, P., Spire, B., Duran, S., Katlama, C., Peyramond, D., Francois, C., et al. (2003). Health-related quality of life after 1 year of highly active antiretroviral therapy. Journal of Acquired Immune Deficiency Syndromes, 32, 38–7.
Carrieri, M. P., Leport, C., Protopopescu, C., Cassuto, J. P., Bouvet, E., Peyramond, D., et al. (2006), Factors associated with nonadherence to highly active antiretroviral therapy: A 5-year follow-up analysis with correction for the bias induced by missing data in the treatment maintenance phase. Journal of Acquired Immune Deficiency Syndromes, 41, 477–85.
Ware, J. E., Jr., & Sherbourne, C. D. (1992). The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Medical Care, 30, 473–83.
McHorney, C. A., Ware, J. E., Jr., & Raczek, A. E. (1993). The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Medical Care, 31, 247–63.
McHorney, C. A., Ware, J. E., Jr., Lu, J. F., & Sherbourne, C. D. (1994). The MOS 36-item Short-Form Health Survey (SF-36): III Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Medical Care, 32, 40–6.
Ware, J. E., Jr., Keller, S. D., Gandek, B., Brazier, J. E., & Sullivan, M. (1995). Evaluating translations of health status questionnaires. Methods from the IQOLA project. International Quality of Life Assessment. International Journal of Technology Assessment in Health Care, 11, 525–51.
Leplege, A., Mesbah, M., & Marquis, P. (1995). [Preliminary analysis of the psychometric properties of the French version of an international questionnaire measuring the quality of life: The MOS SF-36 (version 1.1)]. Revue d Epidemiologie et de Sante Publique, 43, 371–79.
Prentice, R. L., & Gloeckler, L. A. (1978). Regression analysis of grouped survival data with application to breast cancer data. Biometrics, 34, 57–7.
Henderson, R., Diggle, P., & Dobson, A. (2000). Joint modelling of longitudinal measurements and event time data. Biostatistics, 1, 465–80.
SAS/STAT 9.1 (2004). User’s Guide. Cary, NC, SAS Institute Inc: SAS Publishing.
Furher, R., & Rouillon, F. (1989). La version française de l’échelle CES-D. Description and translation of the auto-evaluation (in French). Psychiatrie et Psychobiologie, 4, 163–66.
Bissell, D., Paton, A., & Ritson, B. (1982). ABC of alcohol. Help: Referral. British Medical Journal (Clinical Research Ed), 284, 495–97.
Nieuwkerk, P. T., Gisolf, E. H., Colebunders, R., Wu, A. W., Danner, S. A., & Sprangers, M. A. (2000). Quality of life in asymptomatic- and symptomatic HIV infected patients in a trial of ritonavir/saquinavir therapy. The Prometheus Study Group. Acquired Immune Deficiency Syndromes, 14, 181–87.
Cohen, C., Revicki, D. A., Nabulsi, A., Sarocco, P. W., & Jiang, P. (1998). A randomized trial of the effect of ritonavir in maintaining quality of life in advanced HIV disease. Advanced HIV Disease Ritonavir Study Group. Acquired Immune Deficiency Syndromes, 12, 1495–502.
Carr, A., Chuah, J., Hudson, J., French, M., Hoy, J., Law, M., et al. (2000). A randomised, open-label comparison of three highly active antiretroviral therapy regimens including two nucleoside analogues and indinavir for previously untreated HIV-1 infection: The OzCombo1 study. Acquired Immune Deficiency Syndromes, 14, 1171–180.
Nieuwkerk, P. T., Gisolf, E. H., Reijers, M. H., Lange, J. M., Danner, S. A., & Sprangers, M. A. (2001). Long-term quality of life outcomes in three antiretroviral treatment strategies for HIV-1 infection. Acquired Immune Deficiency Syndromes, 15, 1985–991.
Burgoyne, R. W., Rourke, S. B., Behrens, D. M., & Salit, I. E. (2004). Long-term quality-of-life outcomes among adults living with HIV in the HAART era: The interplay of changes in clinical factors and symptom profile. Acquired Immune Deficiency Syndromes Behavior, 8, 151–63.
Burgoyne, R., & Renwick, R. (2004). Social support and quality of life over time among adults living with HIV in the HAART era. Social Science and Medicine, 58, 1353–366.
Eriksson, L. E., Bratt, G. A., Sandstrom, E., & Nordstrom, G. (2005). The two-year impact of first generation protease inhibitor based antiretroviral therapy (PI-ART) on health-related quality of life. Health Quality of Life Outcomes, 3, 32.
Campsmith, M. L., Nakashima, A. K., & Davidson, A. J. (2003). Self-reported health-related quality of life in persons with HIV infection: Results from a multi-site interview project. Health Quality of Life Outcomes, 1, 12.
Jia, H., Uphold, C. R., Wu, S., Chen, G. J., & Duncan, P. W. (2005). Predictors of changes in health-related quality of life among men with HIV infection in the HAART era. Acquired Immune Deficiency Syndromes Patient Care STDS Patient Care STDS, 19, 395–05.
Hogg, R. S., Yip, B., Chan, K. J., Wood, E., Craib, K. J., O’shaughnessy, M. V., & Montaner, J. S. (2001). Rates of disease progression by baseline CD4 cell count and viral load after initiating triple-drug therapy. JAMA, 286, 2568–577.
Bonfanti, P., Valsecchi, L., Parazzini, F., Carradori, S., Pusterla, L., Fortuna, P., et al. (2000). Incidence of adverse reactions in HIV patients treated with protease inhibitors: a cohort study Coordinamento Italiano Studio Allergia e Infezione da HIV (CISAI) Group. Journal of Acquired Immune Deficiency Syndromes, 23, 236–45.
Fellay, J., Boubaker, K., Ledergerber, B., Bernasconi, E., Furrer, H., Battegay, M., et al. (2001). Prevalence of adverse events associated with potent antiretroviral treatment: Swiss HIV Cohort Study. Lancet, 358, 1322–327.
Ammassari, A., Murri, R., Pezzotti, P., Trotta, M. P., Ravasio, L., De Longis, P., et al. (2001). Self-reported symptoms and medication side effects influence adherence to highly active antiretroviral therapy in persons with HIV infection. Journal of Acquired Immune Deficiency Syndromes, 28, 445–49.
Duran, S., Spire, B., Raffi, F., Walter, V., Bouhour, D., Journot, V., et al. (2001). Self-reported symptoms after initiation of a protease inhibitor in HIV-infected patients and their impact on adherence to HAART. HIV Clinical Trials, 2, 38–5.
Bury, M. (1991). The sociology of chronic illness: A review of research and prospects. Sociology of Health and Illness, 13, 451–68.
Foster, G. R., Goldin, R. D., & Thomas, H. C. (1998). Chronic hepatitis C virus infection causes a significant reduction in quality of life in the absence of cirrhosis. Hepatology, 27, 209–12.
Rodger, A. J., Jolley, D., Thompson, S. C., Lanigan, A., & Crofts, N. (1999). The impact of diagnosis of hepatitis C virus on quality of life. Hepatology, 30, 1299–301.
Preau, M., Leport, C., Salmon-Ceron, D., Carrieri, P., Portier, H., Chene, G., et al. (2004). Health-related quality of life and patient–provider relationships in HIV-infected patients during the first three years after starting PI-containing antiretroviral treatment. Acquired Immune Deficiency Syndromes Care, 16, 649–61.
Cederfjall, C., Langius-Eklof, A., Lidman, K., & Wredling, R. (2001). Gender differences in perceived health-related quality of life among patients with HIV infection. Acquired Immune Deficiency Syndromes Patient Care STDS, 15, 31–9.
Mrus, J. M., Williams, P. L., Tsevat, J., Cohn, S. E., & Wu, A. W. (2005). Gender differences in health-related quality of life in patients with HIV/AIDS. Quality of Life Research, 14, 479–91.
Nicholas, P. K., Kirksey, K. M., Corless, I. B., & Kemppainen, J. (2005). Lipodystrophy and quality of life in HIV: Symptom management issues. Applied Nursing Research, 18, 55–8.
Collins, E., Wagner, C., & Walmsley, S. (2000). Psychosocial impact of the lipodystrophy syndrome in HIV infection. Acquired Immune Deficiency Syndromes Read, 10, 546–50.
Préau, M., Bouhnik, A., Spire, B., Leport, C., Saves, M., Pïcard, O., et al. (2006). Health related quality of life and lipodystrophy syndrome among HIV-infected patients. Encephale, 32, 713–19.
Hsiung, P. C., Fang, C. T., Chang, Y. Y., Chen, M. Y., Wang, J. D. (2005). Comparison of WHOQOLbREF and SF-36 in patients with HIV infection. Quality of Life Research, 14, 141–50.
Monnete, G., Shao, Q., & Kwan, E. (2002). A first look at multilevel models. In S.C.S. Institute for Social Research. York University: Institute for Social Research. Statistical Consulting Service, York University.
Allison, P. D. (1995). Survival analysis using the SAS system: A practical guide. The SAS Institute, Cary, NC.
Allison, P. D. (1982). Discrete-time methods for the analysis of event histories. Sociological Methodology, 15, 61–8.
Jenkins, S. P. (1995). Easy estimation methods for discrete-time duration models. Oxford Bulletin of Economics and Statistics, 57, 129–38.
Jenkins, S. P. (1997). Estimation of discrete time (grouped duration data) proportional hazards models: pgmhaz. Stata Technical Bulletin Reprints, STB 17, 1–2.
Jenkins, S. P. (2005). Survival analysis. In Institute for Social and Economic Research, University of Essex.
Zewotir, T., & Galpin, J. S. (2005). Influence diagnostics for linear mixed models. Journal of Data Science, 3, 153–77.
Acknowledgements
The authors would like to thank all patients, nurses and physicians in clinical sites. The APROCO-COPILOTE Study Group is composed of the following:
Steering Committee: Principal Investigators: C. Leport, F. Raffi; Methodology: G. Chêne, R. Salamon; Social Sciences: J-P. Moatti, J. Pierret , B. Spire; Virology: F. Brun-Vézinet, H. Fleury, B. Masquelier; Pharmacology: G. Peytavin, R. Garraffo.
Scientific Committee: Members of Steering Committee and other members: D. Costagliola, P. Dellamonica, C. Katlama, L. Meyer, M. Morin, D. Salmon, A. Sobel; Project coordination: F. Collin; Events Validation Committee: L. Cuzin, M. Dupon, X. Duval, V. Le Moing, B. Marchou, T. May, P. Morlat, C. Rabaud, A. Waldner-Combernoux; Clinical Research Group : V. Le Moing, C. Lewden.
Clinical centers: Amiens (Pr Schmit), Angers (Dr Chennebault), Belfort (Dr Faller), Besançon (Dr Estavoyer, Pr Laurent, Pr Vuitton), Bordeaux (Pr Beylot, Pr Lacut, Pr Le Bras, Pr Ragnaud), Bourg-en-Bresse (Dr Granier), Brest (Pr Garré), Caen (Pr Bazin), Compiègne (Dr Veyssier), Corbeil-Essonne (Dr Devidas), Créteil (Pr Sobel), Dijon (Pr Portier), Garches (Pr Perronne), Lagny (Dr Lagarde), Libourne (Dr Ceccaldi), Lyon (Pr Peyramond), Meaux (Dr Allard), Montpellier (Pr Reynes), Nancy (Pr Canton), Nantes (Pr Raffi), Nice (Pr Cassuto, Pr Dellamonica), Orléans (Dr Arsac), Paris (Pr Bricaire, Pr Caulin, Pr Frottier, Pr Herson, Pr Imbert, Dr Malkin, Pr Rozenbaum, Pr Sicard, Pr Vachon, Pr Vildé), Poitiers (Pr Becq-Giraudon), Reims (Pr Rémy), Rennes (Pr Cartier), Saint-Etienne (Pr Lucht), Saint-Mandé (Pr Roué), Strasbourg (Pr Lang), Toulon (Dr Jaureguiberry), Toulouse (Pr Massip), Tours (Pr Choutet).
Data monitoring and statistical analysis: C. Alfaro, F. Alkaied, C. Barennes, S. Boucherit, AD. Bouhnik, C. Brunet-François, MP. Carrieri, JL. Ecobichon, V. El Fouikar, V. Journot, R. Lassalle, JP. Legrand, M. François, E. Pereira, M. Préau, V. Villes, C. Protopopescu, H. Zouari, F. Marcellin.
Promotion: Agence Nationale de Recherches sur le Sida (ANRS, Coordinating Action n°7.) Other support: Collège des Universitaires de Maladies Infectieuses et Tropicales (CMIT ex APPIT), Sidaction Ensemble contre le Sida and associated pharmaceutical companies: Abbott, Boehringer-Ingelheim, Bristol-Myers Squibb, Glaxo- SmithKline, Merck Sharp et Dohme, Roche.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
The linear random effects model
Let y ij be the transformed score (MCS or PCS) measured for patient i at time s j , i = 1,...,N,j = 1,...,7. We used a piecewise linear random effects model with a change in the slope at M12, written as:
Here x 1i (t) and x 2i (t) are vectors including fixed and time-varying explanatory variables, and (t j -12)+ = t j - 12 if t j ≥ 12, and 0 otherwise. U 0i is the subject-specific intercept, U 1i and U 2i are the random slopes, modelling the true individual level trajectories after they have been adjusted for the overall mean trajectory and the other fixed effects, such that (U 0i , U 1i , U 2i )′ ˜ N(0, G and ε ij ˜ N(0, σ2) are mutually independent measurement errors. The first term α0 + x 1i ′(t j )′ 0 + U 0i includes principal effects of the factors, the second term α1 + x 2i ′(t j )′ 1 + U 1i represents the changes in the short term evolution (M0–M12), and the third term α2 + x 2i ′(t j )′ 2 + U 2i represents the changes in the long-term evolution (M12–M60).
We used the random effects covariance matrix G to perform a likelihood ratio test for choosing the number of random effects in the model. We tested whether we needed a model with q = 3 random effects (i.e. two random slopes: U 1i , U 2i ) or whether a simpler model, with only two random effects, would be more adequate. We fitted both models with the same set of fixed effects and recorded the deviance (− Log Likelihood) for each of them. The distribution of the difference in deviances is a mixture of a χ2 with q degrees of freedom and a χ2 with q− degrees of freedom [45].
For the MCS (resp. PCS) transformed score we found an increase in the deviance of 16.2 (resp. 23.6) for q = 3 degrees of freedom, so the test rejected the specification with two random effects in both cases. Nevertheless, the estimated G matrix for the model with three random effects was almost singular, which suggested that the variability in the last slope was very small after considering heterogeneity which was accounted for by the fixed factors. Moreover, the estimated parameters and their P-values were very similar for the two models, so we finally decided to include only two random effects in the longitudinal model, which allowed a faster estimation of the joint model.
The time-to-dropout model
Patients had scheduled follow-up visits at fixed times (M0, M12, M28, M36, M44, M52, M60). The proposed model allowed the investigation of the relationship between times-to-dropout and a set of possibly time-dependent explanatory variables. When dropout time is discrete with tied events without underlying ordering, this model is equivalent to a logistic model (“discrete-time logit model– for a data set with patient-time as the unit of analysis, which is the same data set used for the mixed longitudinal analysis [46]. For each of these observations the response variable w is dichotomous, corresponding to 1 = “dropout–and 0 = “still in the study–in that time interval. Dropouts due to death or withdrawal from the study, as well as all observations corresponding to patients followed until the end of the study (M60) were censored. A censored observation can be modelled by having a record of all zeros until the end of the follow-up.
The time scale of the study follow-up is partitioned into six disjoint intervals, say [t h , t h+1), H = 1,...,6. Let T i be the discrete time-to-dropout variable of the patient i. Then the hazard of dropout in the interval [t h , t h+1) for the patient i given covariates z i is the conditional probability that its dropout is at time t h+1, given that it was still in the study at the beginning of the interval:
Using elementary properties of conditional probabilities, it can be shown that Suppose that [) is the observed interval of dropout of the ith subject, and δ i = 1 if and 0 otherwise. Let h(i) be such that . The likelihood for the discrete time data is given by where w ij = 1 if j = h(i) + 1 and 0 otherwise. Prentice and Gloeckler [16] have shown that where λ0h is the logarithm of the integral of the baseline hazard on the relevant interval [t h , t h+1). This can be written equivalently, Given this complementary log–log transformation, the parameter γ is interpreted as the effect of covariates in z i on the hazard rate of dropout, assuming the hazard rate to be constant on each interval of the study.
As noted by Vonesh et al. [4], one advantage when using such a model is that it allows the inclusion of time-dependent covariates, defined at the start of each interval [t h , t h+1. In this way, the inclusion of time-dependent covariates is not affected by the fact that an actual measurement may not be available for them at the time-of-dropout. Moreover, the specification of the time-to-dropout model gives a closed-form expression for the marginal and joint likelihood, allowing us to use existing standard software like the SAS procedure NLMIXED to estimate both the separate and joint model (see also Guo and Carlin [8]).
The log-likelihood function for the sample of individuals used in this study can then be given by This takes the form of a “sequential binary response–model with data in the “vertical–form with the ith subject contributing h(i) observations. Allison [47
47] and Jenkins [48–50] have shown that, for such suitably organized data, the log-likelihood function is the same as the log-likelihood for a generalized linear model of the binomial family with complementary log–log link function.
The joint model
In the joint approach, the linear random effects model and the time-to-dropout model are estimated simultaneously (see Guo and Carlin [8]). The discrete-time proportional hazard model is now written as follows: where U 0 and U 1 are the random effects that appear in the linear random effects model. In this way, the HRQL model and the time-to-dropout model are connected through the stochastic dependence on unobserved factors represented by these random variables. The parameters γ0 and γ1 in the time-to-dropout model measure the association between the two submodels induced through these two common latent variables. In the absence of association between the two models, the parameters γ0 and γ1 are not statistically significant and there is no gain from the joint analysis.
As in Guo and Carlin [8], the binary explanatory variables were coded with 1 for the active modality and − for the reference modality.
The SAS codes used to estimate the separate and joint models for the MCS transformed score are given below.
Determination of factors–contribution to the untransformed HRQL scores changes between M0 and M12
In order to have an idea of the contribution of each factor on the HRQL scores changes between M0 and M12 on their original scale (varying between 0 and 100), we adopted the following approach. For each factor, the corresponding univariate two–phase random effects model on transformed HRQL scores was translated back onto the original scale using the inverse transformation of -ln (100-score). Then, the factor’s contribution to the HRQL scores evolution during the first year of HAART was calculated as the difference between the score values estimated by the back translated model at M12 and M0. The same approach was used to determine the intercepts–contribution, from the two-phase random effects model without covariates.
Random slopes and variance components parametrization for the mixed model:
-
proc mixed data = mydata covtest method=ml; class patient; model lnmcs = obstime1 obstime2 sexe_r naif_tr naif_tr_1 naif_tr_2 part_pr confort confort_1 confort_2 homo toxico cd4t_200 nbs30 nbs30_1 nbs30_2 nbtm_1 nbtm_2 / influence(iter = 5 effect = patient est) s cl; random obstime1 intercept / subject = patient type = fa0( 2 ); ods output covparms = cp; ods output solutionf = solf; ods output Influence = inf; run;
Here obstime1 and obstime2 are the two time variables defined in the “Statistical methods–section (i.e. (t j , 12) and (t j − 12)+ respectively). The legend for the rest of the covariates is given at the end of this Appendix. Multivariate influence analysis was performed using the INFLUENCE option of the MODEL statement, in order to test the stability of the linear mixed model to perturbations of the data. According to the likelihood distance and Cook’s D measure [51], two patients identified as influential observations were dropped from the basis for each HRQL score.
As in Guo and Carlin [8], we used the FA0(q) structure (No Diagonal Factor Analytic) for the G matrix in the RANDOM statement of SAS PROC MIXED, where q is the number of random effects. This parametrization is equivalent to specifying a Cholesky root for the G matrix, to constrain it to be non-negative definite. The lower triangular Choleski root of G is a lower triangular matrix C, with non-negative diagonal elements that is a ‘square root’ of G in the sense that CC–G.
The time-to-dropout model
-
proc logistic data = mydata; model w(event=––= time1–time6 homo toxico ue_bis cd4t_200 naif_tr confort sexe_r ageinc logem alc / noint link = cloglog technique = newton; run;
Here w is the dropout indicator variable, and time1 to time6 are the indicator variables for the six intervals between the visits. The legend for the rest of the covariates is given at the end of this Appendix.
The NOINT option was specified to prevent the redundancy in the estimation of the coefficients of time1–time6 indicator variables. The Newton–Raphson algorithm with Gauss–Hermite quadrature was used for the maximum-likelihood estimation of the parameters.
The joint model
The following statements were used to estimate the joint model with two random effects (u0 and u1, corresponding to the intercept and the first slope), and the same list of predictors used in separate analyses. This is a modified version of the model XI in Guo and Carlin [8] (see also their SAS code supplied at http://www.biostat.umn.edu/~brad/software.html).
The estimate of the longitudinal and dropout separate models were combined in a table named SeparateEstimates. This data set was used to provide starting values for the joint model, cf. PARAMETERS statement.
Unlike Guo and Carlin’s [8] program, we used a discrete-time model, rather than a continuous one. This way, the computation of the log likelihood contribution of the dropout data is not made when the last observation of a subject is reached, but instead for each observation in the vertical dataset of follow-up visits.
Variance and covariance of the random effects were obtained by the delta method, using ESTIMATE statement. Approximate 95% prediction intervals could then be obtained by assuming asymptotic normality.
Rights and permissions
About this article
Cite this article
Protopopescu, C., Marcellin, F., Spire, B. et al. Health-related quality of life in HIV-1-infected patients on HAART: a five-years longitudinal analysis accounting for dropout in the APROCO-COPILOTE cohort (ANRS CO-8). Qual Life Res 16, 577–591 (2007). https://doi.org/10.1007/s11136-006-9151-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-006-9151-7