Usefulness of translatability assessment: results from a retrospective study

Abstract

Purpose

The purpose of the study is to evaluate the extent to which a retrospectively conducted translatability assessment (TA) could identify the items previously singled out during the validation study as having poor content validity or poor measurement performance. This study was performed with the intent of supporting evidence of the usefulness of TA early in the PRO development process. The Weight module of the Youth Quality-of-Life Instrument (YQOL-W) was used for this appraisal of translatability.

Methods

Two linguists, blinded to the design and results of content validation and psychometric analyses, conducted a TA on the 32-item version of the YQOL-W taken into cross-sectional validation for item reduction. TA results were categorized into (1) issues relating to target culture (cross-cultural issues) and (2) issues relating to the structure of the original questionnaire (structural issues). Items for possible revision or deletion were identified. We compared the results of the TA with the content validity and psychometric results and decisions to eliminate items after cross-sectional validation.

Results

Content validation identified seven of the 32 items to be dropped, and psychometric analyses including the 25 remaining items highlighted an additional four to be eliminated, yielding a final instrument with 21 items. Out of these 11 dropped items, TA had identified nine as problematic (82 %) and the developer was advised to drop five of them (45.4 %). In addition, TA results highlighted the need to change the original formulation of eight items for semantic reasons and identified two instances where alternative wording should be used for translation purposes without any change to the original formulation.

Conclusion

Our study showed that translatability assessment confirmed problematic issues in items previously identified as having poor content validity or poor measurement performance. In general, a translatability assessment offers the possibility for the identification of alternative formulations for translation purposes, modifications of original formulations to optimize subsequent translations efforts, and the early detection and discussion of irrelevant or inappropriate items.

This is a preview of subscription content, access via your institution.

References

  1. 1.

    Bullinger, M., Power, M. J., Aaronson, N. K., Cella, D. F., & Anderson, R. T. (1996). Creating and evaluating cross-cultural instruments. In B. Spilker (Ed.), Quality of life and pharmacoeconomics in clinical trials (2nd ed., pp. 659–668). Philadelphia: Lippincott-Raven Publishers.

    Google Scholar 

  2. 2.

    Chassany, O., Sagnier, P., Marquis, P., Fullerton, S., Aaronson, N. K., & for the European Regulatory Issues on Quality of Life Assessment (ERIQA) Group. (2001). Patient-reported outcomes: The example of health-related quality of life—A European guidance document for the improved integration of Health-Related Quality of Life assessment in the drug approval process. DIA Journal, 36, 209–238.

    Google Scholar 

  3. 3.

    Food and Drug Administration. (2009). Patient-reported outcome measures: Use in medical product development to support labeling claims. Federal Register, 74(35), 65132–65133.

    Google Scholar 

  4. 4.

    Acquadro, C., Conway, K., Hareendran, A., & Aaronson, N. K. (2008). Literature review of methods to translate health-related quality of life (HRQL) questionnaires for use in multinational clinical trials. Value Health, 11, 509–521.

    PubMed  Article  Google Scholar 

  5. 5.

    Conway, K. (2012). Translatability Assessment. In C. Acquadro, K. Conway, C. Giroudet, & I. Mear (Eds.), Linguistic validation manual for health outcome assessments (pp. 127–132). Lyon: MAPI Institute.

    Google Scholar 

  6. 6.

    Piault, E., Evans, C. J., Espindle, D., Kopp, Z., Brubaker, L., & Abrams, P. (2008). Development and validation of the Overactive Bladder Satisfaction (OAB-S) Questionnaire. Neurourology and Urodynamics, 27(3), 179–190.

    PubMed  Article  Google Scholar 

  7. 7.

    Kim, J., Keininger, D. L., Becker, S., & Crawley, J. A. (2005). Simultaneous development of the pediatric GERD caregiver impact questionnaire (PGCIQ) in American English and American Spanish. Health and Quality of Life Outcomes, 14(3), 5.

    Article  Google Scholar 

  8. 8.

    Spertus, J., Green, P., Conway, K., & Uzun, V. (1998). Creating a new disease-specific health status measure for congestive heart failure: A prototype for instrument development in the current era. Quality of Life Newsletter, 20, 9–10.

    Google Scholar 

  9. 9.

    Bell, C., McLeod, L. D., Nelson, L. M., Fehnel, S. E., Zografos, L. J., & Bowers, B. (2011). Development and psychometric evaluation of a new patient-reported outcome instrument measuring the functional impact of insomnia. Quality of Life Research, 20(9), 1457–1468.

    PubMed  Article  Google Scholar 

  10. 10.

    Conway, K., Patrick, D. L., Gauchon, T., & Acquadro, C. (2010). Enhancing cross-cultural appropriateness for newly developed patient-reported outcome (PRO) instruments: The use of translatability assessment. Patient-Reported Outcomes Newsletter, 44, 9–12.

    Google Scholar 

  11. 11.

    Skalicky, A. M., Edwards, T. C., Flores, Y. N., Hobby, A. D., Morales, L. S., & Patrick, D. L. (2010). Perceptions of multicultural youth about weight and body size. International Society for Quality of Life Research. http://www.isoqol.org/UserFiles/file/2009_conference_program.pdf. Accessed February 7, 2013.

  12. 12.

    Morales, L. S., Edwards, T. C., Flores, Y., Barr, L., & Patrick, D. L. (2011). Measurement properties of a multicultural weight-specific quality-of-life instrument for children and adolescents. Quality of Life Research, 20(2), 215–224.

    PubMed Central  PubMed  Article  Google Scholar 

  13. 13.

    Hong, F. C., Pecotich, A., & Shultz, C. J. (2002). Brand name translation: Language constraints, product attributes, and consumer perceptions in east and Southeast Asia. Journal of International Marketing, 10(2), 29–45.

    Article  Google Scholar 

  14. 14.

    Brand Institute (2013). Name Development. Linguistic screening. http://www.brandinstitute.com/services_ND_linguistic.asp. Accessed February 7, 2013.

  15. 15.

    Sony History (2013). Establishing Tokyo Tsushin Kogyo. http://www.sony.net/SonyInfo/CorporateInfo/History/history.html. Accessed February 7, 2013.

  16. 16.

    Morita, A., Reingold, E. M., & Shimomura, M. (1986). Made in Japan: Akio Morita and Sony. New York: Signet Books.

    Google Scholar 

  17. 17.

    Wild, D., Grove, A., Martin, M., Eremenco, S., McElroy, S., Verjee-Lorenz, A., et al. (2005). Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: Report of the ISPOR task force for translation and cultural adaptation. Value Health, 8(2), 94–104.

    PubMed  Article  Google Scholar 

Download references

Acknowledgments

We thank Maud Beswick for her contribution to the translatability assessment of the Youth Quality-of-Life Instrument-Weight module. We thank Annarita Felici for her help in defining the TA cross-cultural categories.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Catherine Acquadro.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Conway, K., Acquadro, C. & Patrick, D.L. Usefulness of translatability assessment: results from a retrospective study. Qual Life Res 23, 1199–1210 (2014). https://doi.org/10.1007/s11136-013-0572-9

Download citation

Keywords

  • Patient-reported outcomes
  • Instrument
  • Development
  • Translatability assessment
  • Cross-cultural research