Avoid common mistakes on your manuscript.
We are pleased that the interest in response shift continues to remain strong and we appreciate the In-Sync Group’s intentions to assess the field. Clearly, there is a growing consensus among researchers that response-shift phenomena are central to any understanding of quality of life (QOL). However, as this series of papers clearly states, much of the uncertainty about how to align and reconcile different definitions and methods remains unclear [1,2,3,4]. Twenty-five years after the initial work on response shift [5], it feels less than satisfactory to leave these as unresolved. As the In-Sync group argues, for progress to be made in the study of change in QOL, it will be necessary to specify and test falsifiable hypotheses about the nature of response shift.
In 2004, we set out to bring clarity to theory and measurement by strictly defining response shift in terms of changes in appraisal [6, 7]. The In-Sync papers each suggest ways to articulate and interpret key questions in QOL research and in healthcare decision-making in terms of response shift. We believe that applying the definition of response shift formalized by our appraisal model provides a way to specify hypotheses about divergences and convergences among the many different conceptual and methodological approaches that are discussed in these papers.
In the appraisal paradigm, QOL can only be understood by encompassing each individual’s unique point of view. Response shift represents a change in individual perspective—distinct from change in level of QOL but nonetheless meaningful. This perspective has led to a substantial body of work, including a psychological theory [6, 7] whose constructs have been examined in over two dozen peer-reviewed papers on multiple patient populations; a series of measures honed with data on over 6000 patients [8,9,10]; a measurement theory [10, 11] that accounts for the contextual nature of appraisal change; and a path for intervention [12].
It is important to clarify a misconception that was evident in the In-Sync work. Rather than being an alternative theory of how response shift can occur, appraisal is fundamental to defining and operationalizing recalibration, reprioritization, and reconceptualization response shifts. That is, you cannot have re-conceptualization without having conceptualization. Accordingly, response shift is an emergent phenomenon that can only be inferred when discrepant changes in QOL scores are explained by changes in appraisal. Such discrepant changes have most often been defined statistically as residuals but may also be based on comparison of individuals’ changes in self-reported QOL scores with clinician or proxy ratings of change, estimates based on observable performance, comparison to population-based norms, and even the then-test. However, residuals or other discrepancy scores are not in and of themselves measures of response shift. It is only when changes in appraisal explain these discrepancies that response shift can be inferred.
In order to advance work in this area, testable hypotheses about response shift must have clear theory. The appraisal model offers testable pathways to explain the unexpected impact of changes in health states and other life events. Influences of demographic, clinical and psychosocial antecedents listed in Vanier et al.’s [2] table of related domains are also expected to be mediated by appraisal.
The Sebille et al. [1] paper contrasts a number of statistical methods aimed at estimating or detecting response-shift effects from QOL data alone with those that directly measure psychological change. It is confusing that Sebille et al. have relegated the direct measurement of appraisal to being a “design method” rather than recognizing its centrality to any understanding of response shift. It should be noted that statistical approaches to detect response shift essentially infer cognitive processes of recalibration, reconceptualization, or reprioritization. As such, these statistical methods can best be validated against appraisal measures.
Both the Vanier et al. and Sawatzky et al. papers promote a perspective that response shift is a form of bias in measurement [2, 3]. This position is difficult to reconcile with an understanding of response shift as meaningful change. In the context of healthcare decision-making, providers discussing patient-reported QOL do not have a privileged perspective to correct patients’ “bias.” Rather, patients often legitimately see their QOL differently than providers, family members, or other caregivers do. Indeed, all observers have their own subjective perspectives. Articulating these perspectives with appraisal measurement can be useful for addressing cultural and racial tensions that influence outcomes in medicine.
At this point, response-shift theory has to go beyond reshuffling the deck. The In-Sync group has continued an ongoing dialogue about the importance of work that is grounded in testable theory. However measured, there needs to be a consensus that response shift is not bias. Rather it is about meaningful changes in individual perspectives that occur in reaction to changing health. The appraisal model directly takes hold of those fundamental cognitive processes. That is why we emphasize its centrality for this area of research. As we invited in our 2019 paper [13] in this journal, we strongly encourage work in the field that builds upon, improves upon, or substantively refutes work on appraisal. Work that further addresses appraisal or provides a more compelling and empirically grounded alternative to current appraisal theory is needed to advance and unify our field.
Data availability
Not applicable.
References
Sébille, V., Lix, L. M., Ayilara, O. F., Sajobi, T. T., Janssens, A. C. J., Sawatzky, R., et al. (2021). Critical examination of current response shift methods and proposal for advancing new methods. Quality of Life Research. https://doi.org/10.1007/s11136-020-02755-4
Vanier, A., Oort, F. J., McClimans, L., Ow, N., Gulek, B. G., Böhnke, J. R., et al. (2021). Response shift in patient-reported outcomes: Definition, theory, and a revised model. Quality of Life Research. https://doi.org/10.1007/s11136-021-02846-w
Sawatzky, R., Kwon, J.-Y., Barclay, R., Chauhan, C., Frank, L., van den Hout, W. B., et al. (2021). Implications of response shift for micro-, meso-, and macro-level healthcare decision-making using results of patient-reported outcome measures. Quality of Life Research. https://doi.org/10.1007/s11136-021-02766-9
Sprangers, M. A., Sajobi, T., Vanier, A., Mayo, N. E., Sawatzky, R., Lix, L. M., et al. (2021). Response shift in results of patient-reported outcome measures: A commentary to the response shift—In Sync Working Group initiative. Quality of Life Research. https://doi.org/10.1007/s11136-020-02747-4
Schwartz, C. E., & Sprangers, M. A. G. (2000). Adaptation to changing health: Response shift in quality-of-life research. American Psychological Association.
Rapkin, B. D., & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2(1), 14.
Schwartz, C. E., & Rapkin, B. D. (2004). Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal. Health and Quality of Life Outcomes, 2, 16.
Rapkin, B. D., Garcia, I., Michael, W., Zhang, J., & Schwartz, C. E. (2017). Distinguishing appraisal and personality influences on quality of life in chronic illness: Introducing the quality-of-life appraisal profile version 2. Quality of Life Research, 26, 2815–2829. https://doi.org/10.1007/s11136-017-1600-y
Rapkin, B. D., Garcia, I., Michael, W., Zhang, J., & Schwartz, C. E. (2017). Development of a practical outcome measure to account for individual differences in quality-of-life appraisal: The brief appraisal inventory. Quality of Life Research. https://doi.org/10.1007/s11136-017-1722-2
Schwartz, C. E., Stark, R. B., & Rapkin, B. D. (2021). Creating idiometric short-form measures of cognitive appraisal: Balancing theory and pragmatics. Journal of Patient-Reported Outcomes. https://doi.org/10.1186/s41687-021-00317-x
Schwartz, C. E., Stark, R. B., & Rapkin, B. D. (2020). Capturing patient experience: Does quality-of-life appraisal entail a new class of measurement? Journal of Patient-Reported Outcomes, 4(1), 1–11.
Nevadunsky, N. S., Gordon, S., Spoozak, L., Van Arsdale, A., Hou, Y., Klobocista, M., et al. (2014). The role and timing of palliative medicine consultation for women with gynecologic malignancies: Association with end of life interventions and direct hospital costs. Gynecologic Oncology, 132(1), 3–7.
Rapkin, B. D., & Schwartz, C. E. (2019). Advancing quality-of-life research by deepening our understanding of response shift: A unifying theory of appraisal. Quality of Life Research, 28(10), 2623–2630.
Acknowledgements
Not applicable.
Funding
This work was not funded by any external agency.
Author information
Authors and Affiliations
Contributions
BDR and CES wrote and edited the paper, and both authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that they have no potential conflicts of interest and report no disclosures.
Research involving human rights
This article does not contain any studies with human participants performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Rapkin, B.D., Schwartz, C.E. What should progress in response-shift research look like?. Qual Life Res 30, 3359–3361 (2021). https://doi.org/10.1007/s11136-021-02962-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-021-02962-7