Abstract
Purpose
The current study aimed to evaluate the feasibility of RetinoQuest in clinical practice, from survivors and healthcare professionals’ (HCPs) point of view.
Methods
RetinoQuest is a touch screen computer program to monitor health-related quality of life (HRQoL) of retinoblastoma survivors via patient-reported outcome measures (PROMs) targeting children (4–10 years) as evaluated by their parents (proxy measures), adolescents (11–18 years), and adults. Feasibility was evaluated by the actual time taken to complete the PROMs, acceptability of the time as perceived by the users, the content of PROMs in RetinoQuest, and overall satisfaction with RetinoQuest.
Results
Ninety-six survivors participated: 41 parents of children, 38 adolescents, and 17 adults. Mean time to complete the evaluation form was 7.8 min (median 6.7, range 2.4–24.5), and 90% of the users stated that the time needed to complete PROMs in RetinoQuest was acceptable. The majority of users reported that it was important to answer the questions (88% of the parents, 66% of the adolescents, and 76% of the adult survivors) and that all important issues were covered, e.g., no missing questions (78, 84, and 76%, respectively). Satisfaction rate was high, 7.8 according to parents, 8.1 according to adolescents, and 7.7 for adults.
Conclusions
RetinoQuest is a feasible e-health application to monitor HRQoL in retinoblastoma survivors in clinical practice.
Implications for cancer survivors
This tool allows for open and structured communication which can lead to early detection of psychosocial impacts on quality of life and referral of the retinoblastoma survivors.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Retinoblastoma (Rb) is a malignant intraocular pediatric cancer. It occurs in the first years of childhood, usually between the ages of 0 and 5 years. The incidence is 1:17,000 newborns (10–12 new patients in the Netherlands each year) [1], which represents approximately 3% of all pediatric malignancies.
In spite of good survival chances, the psychosocial effects of Rb vary according to the severity of the disease and the treatment, late sequelae and coping mechanisms of the patient and parents [2]. Many survivors experience distress regarding their cosmetic appearance and the fear of blindness. Other concerns relate to recurrence of the disease, passing Rb to offspring, second primary tumors, restrictions in education and professional career, mobility, self-care, and relationships [3,4,5,6,7,8]. Furthermore, the parents’ ability to cope with the stress associated with diagnosis, treatment, and heredity impacts the psychosocial functioning and development of their affected child [2, 7, 9,10,11,12].
Van Dijk et al. showed that 30% of Rb survivors develop behavioral problems [8]. Adult survivors have 20% more psychological problems like anxiety or depression than a healthy reference group [3]. The study by Van Dijk et al. also noted that a history with Rb influenced the health-related quality of life (HRQoL) and daily living negatively in 50% of Rb survivors [3].
Though psychosocial problems are thus common among Rb survivors, they are infrequently discussed during the annual follow-up visits at the outpatient clinic. Adequate psychosocial care should include an initial survey of the psychosocial background and early detection of psychosocial problems. If necessary, survivors should be referred to one of the specialized psychosocial disciplines. In the past 10 years, interest in using patient-reported outcome measures (PROMs) to screen for psychosocial problems and the need for supportive care in routine clinical practice has increased [13,14,15,16,17,18,19]. Several studies have shown that using PROMs in clinical practice facilitates open communication [20, 21] regarding HRQoL between doctors and patients and offers the possibility of early detection of psychological problems [22, 23]. In the Netherlands, we already use validated questionnaires for cancer survivors such as OncoQuest, QLIC-ON PROfile, and KLIK [14, 15, 24]. However, these questionnaires do not highlight Rb-specific distress such as cosmetic appearance and the fear of blindness. Furthermore, OncoQuest is a HRQoL-monitoring computer-assisted system for adult cancer survivors, whereas our population consists of both adults and children. Thus, currently existing validated questionnaires are not fully applicable to monitor HRQoL of Rb survivors. Therefore, we decided to develop Rb-specific questionnaire which consists of a combination of OncoQuest software with questions from Strengths and Difficulties Questionnaire (SDQ) and General Health Questionnaire (GHQ) [25,26,27,28]. RetinoQuest is a touch screen computer program to monitor HRQoL of retinoblastoma survivors via three age-specific PROMs (Table 1). The objective of the present study was to evaluate the feasibility of RetinoQuest in clinical practice, from the survivors’ and health care professionals’ (HCPs’) point of view.
Methods and results
Ethical consideration
All procedures performed involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards (for further details, see online supplementary methods).
The current evaluation study was performed in agreement with recommendations of Dutch ethics committee with waiver of informed consent. Prior to the current study, survivors and their parents have been informed per letter regarding the use of RetinoQuest in the outpatient clinic to support ophthalmologic consultation. They were also informed that its use will be evaluated through an evaluation form. Apart from this, when filling out RetinoQuest, survivors and their parents are asked to give a consent to data analysis for scientific purposes by answering (yes/no) the following question in the software application: “The information obtained is also important for scientific research at our department. Your information will be processed anonymously and treated confidentially. Please indicate below if you give permission to use this information for research purposes.”
RetinoQuest
RetinoQuest consists of the currently available validated questionnaires for oncological survivors in combination with Rb-specific questions. Dutch versions of SDQ 4-10 (parent proxy measure), SDQ 10-16, and GHQ-28 were used for the assessment of HRQoL [25,26,27,28]. The software program is written using Delphi2007 [14]. To meet the requirements of the visually impaired, the text is displayed in Verdana with a 24 to 28-point font size, in bright colors in boxes, and displayed on a 17-inch touch screen (Fig. 1). The data is processed in real time and is presented on the HCPs’ computer screen (Fig. 2) (for further details, see online supplementary methods).
Procedures and analysis
For a period of 1 year, all eligible survivors and their parents, who visited the outpatient clinic, and two ophthalmologists were interviewed regarding the use of and the satisfaction with RetinoQuest at the end of each visit. Participants were assisted by a trained staff member or a researcher and were asked to complete an eight-item survey on feasibility of and satisfaction with RetinoQuest. The variables were measured via 10-point Likert scale. Time needed to complete RetinoQuest was logged by the computer program. Data was extracted from RetinoQuest, and frequencies and percentage frequencies were calculated for each variable. These frequencies are summarized in frequency table (Table 2). Ophthalmologists were asked to answer the question “Was the well-being profile discussed?” after each visit. In case of a negative answer, they were requested for an explanation, and in case of a positive answer, they were asked for the result of the discussion (e.g., advice or referral). Both ophthalmologists evaluated the use of RetinoQuest at the end of the study period through structured interviews (for further details, see online supplementary methods).
RetinoQuest evaluation by participants
All 96 eligible survivors were enrolled in current study: 41 parents of child survivors, 38 adolescent survivors, and 17 adult survivors. The results are summarized in Table 2. Mean satisfaction rate was 7.8 (scale 1–10, median 8.0, range 1–10) among parent participants, 8.2 (scale 1–10, median 8.0, range 6–10) for adolescent participants, and 7.8 (scale 1–10, median 7.5, range 6–10) for adult participants. Mean overall satisfaction rate was 8.0 (median 7.8, range 1–10), and 78% of participants agreed with the statement “I would like to complete RetinoQuest at the outpatient clinic before the consultation.” Participants needed a mean time of 7.8 min (median 6.7, range 2.4–24.5) to complete the survey, and 90% of all participants stated that completing the survey takes limited time.
Ninety-eight percent of parent participants, 89% of adolescent participants, and 82% adult participants strongly agreed that the system is easy to use.
Eighty-eight percent of parent participants, 66% of adolescent participants, and 76% of adult participants strongly agreed that it is important to complete the questionnaire. Eighty-nine percent of parent participants, 66% of adolescent participants, and 36% percent strongly or somewhat disagreed that there were redundant questions. Four questions for the adolescent participants seemed redundant; all were derived from the SDQ questionnaire. The questions concerned the topics lying/cheating, fighting, helpfulness, and admiration by peers. Three adult participants suggested that they missed questions involving happiness/positive aspects of living with Rb, the past, and hereditary impact. Adult participants also indicated that there were too many questions about depression and suicide. Three parent participants indicated that they missed a question regarding the impact of Rb on the siblings of their affected child. Eighty-four percent of adolescent participants noted (strongly agreed) that no questions were missing. The majority of adolescent participants (74%) reported that the questions were clear.
Seventy-one percent of adult participants reported that the screen visibility was good. Three adult participants could not read the screen due to blindness/severe visual impairment. In these cases, the staff member assisted the participant by reading the text aloud.
RetinoQuest evaluation by healthcare professionals
PROMs were discussed with 80% of the parent participants, 76% of the adolescent participants, and 76% of the adult participants during the consultations (Table 3). Main reasons for not discussing the PROMs were technical/logistic problems (11%) or due to a lack of a reason for discussion (profile normal/no questions in 10%). If discussed further, it resulted in clarification of the ongoing issues, answering of the questions, and if necessary advice (7%) or referral to psychologist (2%).
Discussion
The current study investigated the feasibility of RetinoQuest in clinical practice. Earlier studies have shown that computer-assisted data collection on HRQoL data is feasible in daily clinical practice [4, 5, 12,13,14,15,16,17, 19, 22, 29]. In line with the findings of de Bree et al. [14], we showed that RetinoQuest is a feasible e-health application to monitor HRQoL in Rb survivors in clinical practice. Ninety percent of the participants (n = 96) stated that the system was fast and easy to use. Furthermore, the system was rated with an overall satisfaction rate of 8.0 (scale 1–10).
The use of PROMs in pediatrics is scarce [16, 22, 24], while children with a chronic disease are at a greater risk of quality-of-life problems than a healthy reference group [3, 30]. Since RetinoQuest is developed for survivors of different age groups, the system uses three different validated questionnaires depending on the age group: the SDQ parent 4-10, SDQ 11-18, and the GHQ-28 [25,26,27,28]. Therefore, participants were divided into three evaluation groups: parent participants, adolescent participants, and adult participants. The parents of the children between 4 and 10 years were most often satisfied with the system. Meanwhile, adolescents rated the questionnaire the highest. The majority of this group (28 out of 38 respondents) stated that the questions were clear. The majority of the adolescent participants (63%) stated there were no redundant questions. A large group of the adult participants (41%) were dissatisfied with questions about severe depression, suicide, and death. Because GHQ-28 is a validated questionnaire, we chose not to omit or change items of this questionnaire. Currently, we inform the survivors and their parents about the fact that RetinoQuest includes a wide variety of questions (also regarding depression) due to the large heterogeneity in the survivor group.
Special attention was given to the visibility of RetinoQuest because many retinoblastoma survivors are visually impaired [31]. Questions were presented on a large screen in clear, large characters with bright colors. The majority (88%) of participants were able to read the questions adequately. Four blind adult participants were unable to read the screen and were assisted by a trained staff member who read out the questions. These findings indicate that computer-assisted data collection on HRQoL data should be tailored to the target group.
RetinoQuest facilitated the medical team in starting and having a structured conversation about the psychosocial condition and HRQoL of a patient, in addition to the medical follow-up. Although this study had a cross-sectional design, our clinical experience is that RetinoQuest also helps to provide clear insight in how specific problems improve or deteriorate over time. Podmore et al. [32] found that if clinicians rely on patients to initiate a discussion about psychosocial issues, patients’ problems may go unaddressed. Many patients do not spontaneously confess to doctors that they are suffering from psychosocial difficulties during consultation [17, 33].
From the structured interviews with the two HCPs at the end of the study, it was clear that RetinoQuest supports HCPs to communicate relevant psychosocial issues with survivors and their families. The interviews also revealed that HCPs appreciate the use of RetinoQuest in clinical practice. The discussion with survivors about their well-being profile is efficient and usually does not prolong the consultation time, which is in line with the study from Engelen et al. [23]. However, when problems are detected, it does take extra time to adequately support the patient, and it was emphasized that special psychological care should be available when necessary. The ophthalmologists’ observations confirmed that the PROMs included in RetinoQuest are satisfactory for clinical use, except for the questions about depression and suicide. Furthermore, they had the impression that the well-being profile matches the psychosocial situation of patient. The main flaw in the use of RetinoQuest was that the HCPs did not always have access to the well-being profile due to technical or logistical issues.
In the present study, the ophthalmologists used RetinoQuest in 80% of the visits to discuss the quality-of-life issues with the Rb survivors. Other authors found [14, 22, 29] that survivors and HCPs are willing to discuss the results of PROMs in clinical practice and that the possibility of data collection is depending on the technical and logistical capabilities of the organization.
An essential factor for implementing systems as RetinoQuest in clinical practice is having dedicated manpower (e.g., staff members) responsible for this task in supporting survivors to use the system in the hospital. Web-based data collection has shown to be logistically feasible [24]. This would allow visually impaired survivors to administer the tests to their own vision aid at home, thereby ensuring that no survivors are missed in hospital. Furthermore, it would give the HCPs the opportunity to screen the results in advance. We are currently working on a web-based version of RetinoQuest, so survivors can complete the questionnaire at home before the clinical visit.
One of the limitations of the current study is that the added value of the use of RetinoQuest during consultation was only evaluated from the HCPs’ point of view. Future studies should also focus on the question if survivors feel that the program adds value to their consultation with the HCP. Furthermore, it should also be investigated if RetinoQuest increases referrals for supportive care or counseling at clinical psychology.
Conclusions
This study reveals that RetinoQuest is a feasible e-health application to monitor HRQoL in retinoblastoma survivors in clinical practice. Survivors as well as ophthalmologists are satisfied with the system as a tool to improve communication on quality of life and psychosocial difficulties. However, the use of the system is dependent on a good logistic organization.
References
Moll AC, Kuik DJ, Bouter LM, Den Otter W, Bezemer PD, Koten JW, et al. Incidence and survival of retinoblastoma in The Netherlands: a register based study 1862-1995. Br J Ophthalmol. 1997;81(7):559–62.
Weintraub N, Rot I, Shoshani N, Pe’er J, Weintraub M. Participation in daily activities and quality of life in survivors of retinoblastoma. Pediatr Blood Cancer. 2011, 56;(4):590–4. https://doi.org/10.1002/pbc.22790.
van Dijk J, Oostrom KJ, Huisman J, Moll AC, Cohen-Kettenis PT, Ringens PJ, et al. Restrictions in daily life after retinoblastoma from the perspective of the survivors. Pediatr Blood Cancer. 2010;54(1):110–5. https://doi.org/10.1002/pbc.22230.
Batra A, Kumari M, Paul R, Patekar M, Dhawan D, Bakhshi S. Quality of life assessment in retinoblastoma: a cross-sectional study of 122 survivors from India. Pediatr Blood Cancer. 2016;63(2):313–7. https://doi.org/10.1002/pbc.25781.
Ford JS, Chou JF, Sklar CA, Oeffinger KC, Novetsky Friedman D, McCabe M, et al. Psychosocial outcomes in adult survivors of retinoblastoma. J Clin Oncol. 2015;33(31):3608–14. https://doi.org/10.1200/JCO.2014.60.5733.
van Dijk J, Grootenhuis MA, Imhof SM, Cohen-Kettenis PT, Moll AC, Huisman J. Coping strategies of retinoblastoma survivors in relation to behavioural problems. Psychooncology. 2009;18(12):1281–9. https://doi.org/10.1002/pon.1507.
van Dijk J, Huisman J, Moll AC, Schouten-van Meeteren AY, Bezemer PD, Ringens PJ, et al. Health-related quality of life of child and adolescent retinoblastoma survivors in the Netherlands. Health Qual Life Outcomes. 2007;5:65. https://doi.org/10.1186/1477-7525-5-65.
van Dijk J, Oostrom KJ, Imhof SM, Moll AC, Schouten-van Meeteren AY, Bezemer PD, et al. Behavioural functioning of retinoblastoma survivors. Psychooncology. 2009;18(1):87–95. https://doi.org/10.1002/pon.1381.
Hamama-Raz Y, Rot I, Buchbinder E. The coping experience of parents of a child with retinoblastoma-malignant eye cancer. J Psychosoc Oncol. 2012;30(1):21–40. https://doi.org/10.1080/07347332.2011.633977.
van Dijk J, Imhof SM, Moll AC, Ringens PJ, Cohen-Kettenis PT, Rijmen F, et al. Quality of life of adult retinoblastoma survivors in the Netherlands. Health Qual Life Outcomes. 2007;5:30. https://doi.org/10.1186/1477-7525-5-30.
Sheppard L, Eiser C, Kingston J. Mothers’ perceptions of children’ s quality of life following early diagnosis and treatment for retinoblastoma (Rb). Child Care Heal Dev. 2005;31(2):137–42. https://doi.org/10.1111/j.1365-2214.2005.00498.x.
Batra A, Kain R, Kumari M, Paul R, Dhawan D, Bakhshi S. Parents’ perspective of quality of life of retinoblastoma survivors. Pediatr Blood Cancer. 2016;63(7):1287–9. https://doi.org/10.1002/pbc.25982.
Clark K, Bardwell WA, Arsenault T, DeTeresa R, Loscalzo M. Implementing touch-screen technology to enhance recognition of distress. Psychooncology. 2009;18(8):822–30. https://doi.org/10.1002/pon.1509.
de Bree R, Verdonck-de Leeuw IM, Keizer AL, Houffelaar A, Leemans CR. Touch screen computer-assisted health-related quality of life and distress data collection in head and neck cancer patients. Clin Otolaryngol. 2008;33(2):138–42. https://doi.org/10.1111/j.1749-4486.2008.01676.x.
Engelen V, Haverman L, Koopman H, Schouten-van Meeteren N, Meijer-van den Bergh E, Vrijmoet-Wiersma J, et al. Development and implementation of a patient reported outcome intervention (QLIC-ON PROfile) in clinical paediatric oncology practice. Patient Educ Couns. 2010;81(2):235–44. https://doi.org/10.1016/j.pec.2010.02.003.
Engelen V, Koopman HM, Detmar SB, Raat H, van de Wetering MD, Brons P, et al. Health-related quality of life after completion of successful treatment for childhood cancer. Pediatr Blood Cancer. 2011;56(4):646–53. https://doi.org/10.1002/pbc.22795.
Giesinger J, Kemmler G, Meraner V, Gamper EM, Oberguggenberger A, Sperner-Unterweger B, et al. Towards the implementation of quality of life monitoring in daily clinical routine: methodological issues and clinical implication. Breast Care (Basel). 2009;4(3):148–54. https://doi.org/10.1159/000224158.
Luckett T, Butow PN, King MT. Improving patient outcomes through the routine use of patient-reported data in cancer clinics: future directions. Psychooncology. 2009;18(11):1129–38. https://doi.org/10.1002/pon.1545.
Verdonck-de Leeuw IM, de Bree R, Keizer AL, Houffelaar T, Cuijpers P, van der Linden MH, et al. Computerized prospective screening for high levels of emotional distress in head and neck cancer patients and referral rate to psychosocial care. Oral Oncol. 2009;45(10):e129–e33. https://doi.org/10.1016/j.oraloncology.2009.01.012.
Detmar SB, Muller MJ, Schornagel JH, Wever LD, Aaronson NK. Health-related quality-of-life assessments and patient-physician communication: a randomized controlled trial. JAMA. 2002;288(23):3027–34.
Engelen V, van Zwieten M, Koopman H, Detmar S, Caron H, Brons P, et al. The influence of patient reported outcomes on the discussion of psychosocial issues in children with cancer. Pediatr Blood Cancer. 2012;59(1):161–6. https://doi.org/10.1002/pbc.24089.
de Wit M, Delemarre-van de Waal HA, Bokma JA, Haasnoot K, Houdijk MC, Gemke RJ, et al. Monitoring and discussing health-related quality of life in adolescents with type 1 diabetes improve psychosocial well-being: a randomized controlled trial. Diabetes Care. 2008;31(8):1521–6. https://doi.org/10.2337/dc08-0394.
Engelen V, Detmar S, Koopman H, Maurice-Stam H, Caron H, Hoogerbrugge P, et al. Reporting health-related quality of life scores to physicians during routine follow-up visits of pediatric oncology patients: is it effective? Pediatr Blood Cancer. 2012;58(5):766–74. https://doi.org/10.1002/pbc.23158.
Haverman L, Engelen V, van Rossum MA, Heymans HS, Grootenhuis MA. Monitoring health-related quality of life in paediatric practice: development of an innovative web-based application. BMC Pediatr. 2011;11:3. https://doi.org/10.1186/1471-2431-11-3.
Goodman R. The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry. 1997;38(5):581–6.
van Widenfelt BM, Goedhart AW, Treffers PD, Goodman R. Dutch version of the Strengths and Difficulties Questionnaire (SDQ). Eur Child Adolesc Psychiatry. 2003;12(6):281–9. https://doi.org/10.1007/s00787-003-0341-3.
youthinmind. The Strengths and Difficulties Questionnaire (SDQ). 2012. www.sdqinfo.com. Accessed 2016 Apr 10.
Koeter MWJ, Ormel J, General Health Questionnaire. Nederlandse bewerking: Handleiding. Lisse: Swets, Test Services; 1991.
Erharter A, Giesinger J, Kemmler G, Schauer-Maurer G, Stockhammer G, Muigg A, et al. Implementation of computer-based quality-of-life monitoring in brain tumor outpatients in routine clinical practice. J Pain Symptom Manag. 2010;39(2):219–29. https://doi.org/10.1016/j.jpainsymman.2009.06.015.
Grootenhuis MA, Koopman HM, Verrips EG, Vogels AG, Last BF. Health-related quality of life problems of children aged 8-11 years with a chronic disease. Dev Neurorehabil. 2007;10(1):27–33.
Imhof SM, Moll AC, Schouten-van Meeteren AY. Intraocular retinoblastoma: new therapeutic options. Ned Tijdschr Geneeskd. 2001;145(45):2165–70.
Podmore EJ, Bingham LC, Roberts KM, Selby PJ, Wright P, Velikova G. Routine assessment of social difficulties in cancer patients: are we opening Pandora’s box? Support Care Cancer. 2009;17(11):1425–32. https://doi.org/10.1007/s00520-009-0690-7.
Greenhalgh J, Long A, Flynn R. The use of patient reported outcome measures in routine clinical practice: lack of impact or lack of theory? Soc Sci Med. 2005;60:833–43. https://doi.org/10.1016/j.socscimed.2004.06.022.
Acknowledgements
This study was financially supported by Fonds NutsOhra, the Netherlands. We are grateful to G. La Rivière and T. Boer-Baaij for the delivered support for RetinoQuest.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declared that they have no conflict of interest.
Ethical consideration
The study protocol was approved by the Medical Ethics Committee (METC) of VUMC (METC-nr 2011/191), and all procedures performed involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed consent
All participants read the information folder about this study and gave an initial informed consent via the computer program with which they filled in the survey, before starting the questionnaire. These consents are only available on the software that is securely stored in VU University Medical Center.
Electronic supplementary material
ESM 1
(DOCX 25 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
McNeill, N.A., Kors, W.A., Bosscha, M.I. et al. Feasibility of RetinoQuest: e-health application to facilitate and improve additional care for retinoblastoma survivors. J Cancer Surviv 11, 683–690 (2017). https://doi.org/10.1007/s11764-017-0642-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11764-017-0642-z