Abstract
Purpose
This study assessed adherence to, feasibility of, and barriers and facilitators of implementation of an app developed to monitor and follow-up with pain in children with cancer at home.
Methods
Children (8–18 years) receiving cancer treatment (all diagnoses) or their parents (of children aged 0–7 years) used the KLIK Pain Monitor app for 3 weeks. Pain was assessed twice daily using an 11-point numeric rating scale (NRS-11) (ranging from 0 to 10). Healthcare professionals (HCP’s) from the hospital’s Pediatric Pain Service were instructed to follow-up with clinically significant pain scores (≥ 4) within 120 min (scores 4–6) or 30 min (scores 7–10). Adherence, feasibility, and implementation outcomes were assessed using questionnaires, app log data, and interviews.
Results
Twenty-seven children (M age = 7.3 years, 51.8% male) and six HCP’s participated. Sixty-three percent (N = 17) of families used the app on a daily basis during three weeks, and 18.5% (N = 5) reported pain scores twice daily during that time (family adherence). Twelve out of 27 children (44.4%) reported a clinically significant pain score at least once. In 70% (14/20) of clinically significant pain scores, HCP’s followed-up with families within the set timeframe (HCP adherence). Outcomes reveal feasibility for the majority of app functions (i.e., positive evaluation by ≥ 70% families/HCP’s), and non-feasible aspects could be resolved. Identified barriers and facilitators were used to improve future implementation efforts.
Conclusion
Use of the KLIK Pain Monitor app seems feasible. Future research will determine its effectiveness in reducing pain in children with cancer at home.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
Pain is a common and disconcerting symptom during all stages of childhood cancer with prevalence rates varying between 40 and 78% [1,2,3,4,5]. Changes in therapeutic regimens cause children to spend less time in the hospital and more time at home [6,7,8,9,10], making families increasingly responsible for the management of pain [6, 9]. Studies on pain management at home reveal parental misconceptions (e.g., pain is unavoidable during cancer) [1] and concerns regarding analgesic use (e.g., pain medication is addictive) [11]. A previous study in children (1–18 years old) receiving outpatient chemotherapy revealed that in one third of clinically significant pain incidents (score ≥ 4 on scale of 0–10 [12, 13]) occurring in the home setting, no analgesic medication was used [5]. It seems that despite the availability of effective pain interventions (either pharmacologic [14, 15] or nonpharmacologic [16,17,18,19] in nature) for children with cancer, parents tend to undertreat pain [3]. As pain has been related to poor quality of life, suffering and morbidity [20], combined with the notion that suffering from persistent pain during the treatment of cancer can extend into survivorship [21], it is imperative to address this problem.
Interventions for the home setting are warranted. Some efforts have already been made to address this using mHealth, such as the Pain Squad + smartphone app [22], the tablet-based Pain Buddy program [23], and the Color me Healthy app [24], which were all developed to improve pain management in children with cancer. The KLIK Pain Monitor app, named after the existing KLIK PROM (patient-reported outcome measures) portal [25], was developed to reduce pain in children aged 0–18 years old at home during cancer treatment with the aim to (1) monitor pain in the home setting, enabling healthcare professionals (HCP’s) to follow-up with families and offer help more quickly, and (2) provide families with psycho-educational information about pain. A future goal is to integrate data from the app into the KLIK PROM portal, which has already been implemented at the hospital. The distinction between the KLIK Pain Monitor app and most previously developed mHealth-initiatives lies in its target user (i.e., all children with cancer versus 6/8–18 year olds). By creating an app that bridges the gap between the hospital and home setting, we aim to improve pain management and decrease pain in children with cancer.
Stakeholder (i.e., end user) involvement is a prerequisite for the development of purposeful mHealth interventions fit for effective use in practice [26]. This study therefore aims to assess user adherence to, feasibility of, and barriers/facilitators of implementation based on family and HCP experiences with the app. Outcomes will be used to improve the app and processes involved.
Methods
The KLIK Pain Monitor app
The KLIK Pain Monitor app for Apple and Android was commissioned by the Princess Máxima Center for Pediatric Oncology and the software was developed according to secure and controlled processes (ISO72001/NEN75010 approved Information Security Management System) by an external web design company (Biomedia). To ensure user privacy, the app uses two-factor authentication (2FA) login, and a Data Protection Impact Assessment (DPIA) was carried out and approved by the hospital’s Data Protection Officer. Currently, there are three versions of the app: a parent version (for kids aged 0–7 years old), a child version (for kids aged 8–18 years old, for which language was adapted and approved by the Dutch children’s cancer association) and a HCP version. Screenshots of the translated parent/child and HCP version of the app can be found in Figs. 1, 2 and 3. The parent/child version of the app featured psycho-educational information about pain, medication and nonpharmacologic interventions suitable to the home setting. This information was composed by a medical psychologist, pediatric oncologist specialized in palliative care, and a representative of the center’s Pain Service, based on the WHO Guidelines on the Pharmacological Treatment of Persisting Pain in Children with Medical Illnesses [27], the Dutch Pediatrics Association Guideline on the treatment of pain [28], and a clinical practice guideline on the pharmacological and psychological management of pain in children with cancer [17].
The family version of the app allowed children (aged 8–18) or parents (children aged 0–7) to report pain intensity at the time on an 11-point numeric rating scale (NRS-11) ranging from 0 (no pain) to 10 (worst pain imaginable). When a score ranging between 0 and 3 was reported, families were redirected to interventions suitable to the home setting on the psycho-educational information page of the app. When a clinically significant pain score was reported (≥ 4), a notification was forwarded to the family (stating the time in which they would be contacted, and instructions to contact the hospital themselves in acute situations requiring immediate follow-up), as well as the calling list of the HCP version of the app. They were instructed to call the family within a set time frame (i.e., within 2 h for pain scores 4–6 and within 30 min for scores 7–10). In the HCP calling list, the reported pain intensity score, remaining time for follow-up (based on set time frame), a patient identification number (PID), date of birth, and a phone number provided by the family for the purposes of this study were visible. The attending HCP would use the PID (and date of birth as cross check) to find the patient in the hospital’s electronic patient dossier to read up on essential medical background information, before calling the family. During follow-up, HCP’s were instructed to use a standardized questionnaire and decision tree for pain management based on the center’s Pediatric Pain Service standard of care.
Procedure and participants
This study included children aged 0–18 years old (all diagnoses) receiving chemotherapy at the Princess Máxima Center for Pediatric Oncology in Utrecht, The Netherlands. In this national center, all care for children with cancer is centralized. Participants needed to have a sufficient understanding of the Dutch language to participate. Finally, as the app was developed to decrease pain in children in the home setting, children needed to be home at the time of the study (i.e., not hospitalized). Participating HCP’s consisted of members of the hospital’s Pediatric Pain Service (N = 4 nurses specialized in pediatric pain treatment), and two pediatric oncologists. Approval for the study was obtained from the Internal Review Board of the hospital.
Families of eligible children received both oral and written information about the study. If a family agreed to participate, an informed consent form was signed. The coordinating researcher offered support with downloading the app, after which families received their login information via email. For children aged 0–7 years old, a parent was asked to use the app and report pain scores based on their evaluation of the child’s pain (i.e. parent proxy-reporting) [29, 30]. Children aged 8–18 years old were assumed capable to scoring self-reports of pain intensity using the NRS-11 scale [31]. However, not all children in this age group owned a smartphone or were capable of using the app independently. Thus, parents were allowed to help (i.e., using their phone and offering support with pain reporting). Still, the focus for this age group was self-reported pain (child’s self-assessment of the pain). Families were clearly instructed that whoever used the app (child/parent) during the study, should also complete the evaluative questionnaire and interview at the end of the study. Thus, if a parent assisted in using the app, they also assisted in completing the evaluative questionnaire and were present during the interview.
Families were asked to use the KLIK Pain Monitor for three consecutive weeks and report pain at least twice daily (morning and evening), and whenever deemed necessary (ad hoc). Daily reminders were sent in the morning and evening, for which families were able to set the exact times. The minimum requirement of two pain assessments per day created the opportunity to test all functionalities of the app.
Adherence was assessed using log data from the app. All app-users (families and HCP’s) completed a feasibility questionnaire after completion of the study. To identify barriers of, and facilitators to future implementation, app-users were interviewed (semi-structured) about their experiences with the app.
Measures
This study used a mixed-method design, consisting of quantitative (standardized questionnaires and log data from the app) as well as qualitative (semi-structured interviews) methods.
Background and medical characteristics
The child’s age, sex, and medical characteristics (diagnosis, time since diagnosis, stage/risk levels, and treatment modalities (surgery, chemotherapy, radiation, transplant)) were obtained from the medical chart. Medical characteristics were used to complete the Intensity of Treatment Rating (ITR-3) [32]. Intensity levels were as follows: level 1 (least intensity), 2 (moderately intensive), 3 (very intensive), and 4 (most intensive). The ITR-3 was completed individually by two pediatric oncologists (WT and EM), after which scores were discussed and consensus was reached on the intensity level of treatment of each patient.
Adherence
Adherence reflected the extent to which families and HCP’s were able to use the app as intended [33]. For families, this meant reporting pain scores at least twice daily for 3 weeks. If patients were admitted to the hospital during this period, families were asked to stop using the app temporarily and resume once they returned home. For HCP’s, adherence related to responding to clinically significant pain scores within the defined time range: 120 min for scores 4–6, and 30 min for scores 7–10. Adherence to the app was assessed using log data obtained through the app server.
Feasibility
Feasibility was assessed using a questionnaire (separate version for families and HCP’s) with statements regarding app functions. The questionnaire was adapted from Hochstenbach et al. (2016) [34] and two versions were composed: for families and for HCP’s. The questionnaires focused on learnability (N = 4 items), usability (N = 6 items), and desirability (N = 4 (families), N = 7 (HCP’s)) of the app. Learnability reflected the time and effort required for families and HCP’s to learn how to use the application as intended (e.g., “It was easy to learn how to use the app”). Usability reflected the extent to which families and HCP’s could use the app with effectiveness, efficiency and satisfaction (e.g., “The information provided by the app on pain (treatment) was easy to understand”). Desirability reflected the extent to which the application was pleasant and engaging to use [34] (e.g., “I liked that HCP’s called me when I reported high pain scores”). The questionnaire contained an additional item to assess whether users would recommend the app to others. App-users rated their agreement with these statements on a 5-point Likert scale (1 = strongly disagree, 2 = disagree, 3 = undecided, 4 = agree, 5 = strongly agree). Higher scores indicated better learnability, usability, and desirability. Internal consistency was evaluated. Cronbach’s alphas for the family version were 0.54 (learnability scale), 0.40 (usability scale), and 0.79 (desirability scale). For the HCP version, these were 0.84 (learnability scale), 0.60 (usability scale), and 0.80 (desirability scale).
Barriers and facilitators of implementation
Interviews were carried out with all app-users (families and HCP’s). Whoever used the app (parent or child) was interviewed. A semi-structured interview guide was composed and focused on three main themes: use and general satisfaction with the app, technical functioning of the app, and supportiveness of the app regarding pain management.
Analytic strategy
Adherence
In order to determine adherence to the KLIK Pain Monitor app, descriptives were used to assess the percentage of patients that reported scores twice daily in the home setting for 3 weeks (i.e., 21 days) (family adherence), and the percentage of incidences in which healthcare professionals called within the set time range when clinical scores were reported by families (HCP adherence). The threshold was reached if at least 70% of families/HCP’s adhered to app use as intended. If adherence was below that cut-off point, the process involved was re-evaluated and measures were taken to make improvements.
Feasibility
We assessed responses on the feasibility questionnaire for families and HCP’s separately. A statement (each relating to specific app functions) was found feasible if it was rated with a 4 (agree) or higher by at least 70% of families/HCP’s. Conversely, if a statement was rated with a 2 (disagree) or lower by at least 30% of families/HCP’s, the corresponding app-function was closely re-evaluated and measures were taken to make improvements.
Barriers and facilitators of implementation
Transcripts of the interviews were made and all interviews were audio recorded. Transcripts were then thoroughly read and thematic analysis was performed by the interviewer (JS) to identify recurring topics and meaningful themes within the data [35, 36]. The following main themes emerged: technical functioning, user friendliness, content and functionalities, and impact on pain care. Subsequently, the transcripts were analyzed by two researchers (JS and SS) independently to identify barriers and facilitators for future implementation. These were categorized into either one of the main themes. Afterwards, the researchers discussed their findings during several meetings and consensus was reached on which barriers and facilitators were mentioned. To identify relevance of specific topics, a list was composed with all identified barriers and facilitators, and how often they were mentioned. If a barrier or facilitator was mentioned by at least 30% of families/HCP’s, it was marked “relevant” by the researchers. For relevant facilitators, efforts were made to reinforce their impact on successful future implementation; for relevant barriers, measures were taken to prevent their impact on successful future implementation.
Results
Forty-one families of children with cancer were invited to participate in the study. Of those, 28 families agreed to participate and signed informed consent (response rate: 68%). No families were ineligible for participation due to a lack of devices. The most common motivation for non-participation was the absence of pain at the time of intended inclusion. One family dropped out after signing informed consent but before they started using the app due to bad timing with regard to the child’s treatment (feeling overwhelmed). The characteristics of the remaining 27 children are summarized in Table 1, as well as HCP characteristics.
Of the participating children, eight children (29.7%) used the app themselves and two children (7.4%) used the app with the help of a parent. For the remaining children, the app was used by a parent (mothers: N = 12, 44.4%; fathers: N = 2, 7.4%, both parents: N = 3, 11.1%).
Adherence
Families
Log data from the app shows that 63% (N = 17) of families used the app at home on a daily basis during the three study weeks, and 37% (N = 10) used the app for a shorter period (minimum number of days = 7). Of all families, 18.5% (N = 5) used the app at home for three weeks and reported pain scores twice daily during that time (family adherence).
Of the total of 976 reported NRS-11 pain scores, twenty clinically significant pain scores were reported by 12 families. Thus, 44.4% (12/27) of families reported a clinically significant pain score at least once. Of the clinically significant reported pain scores, 50% (N = 10) occurred during the nights/evenings/weekends, and 50% (N = 10) on working days between 8 a.m.–5 p.m.
HCP’s
In 70% (14/20) of clinically significant incidences, HCP’s called families within the set timeframe (HCP adherence).
Feasibility
Families
The majority of statements (9/15) were rated with a 4 (agree) or higher by at least 70% of families and were found feasible (Fig. 1). One statement (“I received daily reminders at the times I chose”) was rated with a 2 (disagree) or lower by at least 30% of families, and was found not feasible. The remaining statements did not reach the cut-off for feasibility nor non-feasibility due to neutral responses (score 3).
HCP’s
The majority of statements (14/18) were rated with a 4 (agree) or higher by at least 70% of HCP’s (Fig. 2) and were found feasible. One statement (“Pop-ups (reminders, notifications) sent by the app were noticeable”) was rated with a 2 (disagree) or lower by at least 30% of HCP’s, and was found not feasible. The remaining statements did not reach the cut-off for feasibility nor non-feasibility due to neutral responses (score 3).
Feasibility (usability, learnability, desirability) rated by families. Note. N = 27 families. Responses rated on five-point Likert-scale divided into categories of disagree (scores 1, 2), neutral (score 3) and agree (scores 4, 5). N = 11 for item with * ( only families called by HCP during study included); N = 26 for item with ** (one missing)
Feasibility (usability, learnability, desirability) rated by HCP’s. Note. N = 6 HCP's. Responses rated on five-point Likert-scale divided into categories of disagree (scores 1, 2), neutral (score 3) and agree (scores 4, 5). N = 5 for items with * ( only HCP who called by families during study included)
The feasibility questionnaire included one added item assessing whether users would recommend the app to others. Of the families, 81.5% said that they would recommend the app to other children/parents, and 66.7% of HCP’s said that they would recommend the app to other HCP’s.
Barriers and facilitators of implementation
Families
Results of the interviews can be found in Fig. 4. Based on the interviews with families, six relevant facilitators and three relevant barriers were identified (i.e., mentioned by at least 30% of families). The facilitators related to technical functioning (“It worked perfectly: customer friendly, intuitively, simple. I didn’t experience any problems”), impact on pain care (“We don’t want to call the hospital all the time. With the app, you get the sense that pain is being monitored and they call us when we report high pain scores. That is very comforting. It gives you the sense that you’re being taken care of”), and user friendliness of the app (“It was really easy and clear how to use the app”). The identified barriers related to technical problems with daily reminders (“I didn’t always receive the daily reminders. At one point, I didn’t receive them for two days”), content and functionalities (“The only thing that was missing, was an overview of previously reported scores. That way, you get a sense of patterns of pain”), and user friendliness (“It wasn’t immediately clear to us that the app was only meant for use at home and not during hospitalization”).
HCP’s
Based on the interviews with HCP’s, three relevant facilitators and five relevant barriers have been identified (i.e., mentioned by at least 30% of HCP’s). Facilitators mainly related to impact on pain care (“I think that the app will increase our knowledge on how often kids are in pain at home. And it enables us to provide them with care much quicker”). The identified barriers related to user friendliness of the app (“If we start using the app there will be extra shifts, extra workload”).
Discussion
This study aimed to assess adherence to, feasibility of, and barriers and facilitators of implementation of a newly developed app to reduce pain in children with cancer at home, by providing HCP’s and families with a tool for real-time feedback and educational information about pain (management).
Family adherence (i.e., reporting pain scores twice daily for three weeks) was 18.5%. Log data from the app reveals that families did not receive daily reminders for pain reporting during one-third of the study period. This was the only adjustment made to the app over the course of the study. A consecutive study will closely monitor the effects of the specific adaptations made to the app and processes involved as a result of this feasibility study. During the month the technical bug was active, zero family adhered to our request of reporting pain twice daily for 3 weeks. After the bug had been resolved, family adherence increased to 38.4%, indicating that the bug affected family adherence. However, 38.4% is still low compared to another study with a similar app and patient population (children with cancer aged 8–18 years old), in which adherence to pain assessment was 62% [37]. Another possible explanation for low family adherence in the current study might be a relatively low prevalence of pain in the study sample. Of the total of 976 reported pain scores, 20 scores were clinically significant (2%). This is in shrill contrast with the 78% pain prevalence found in children with cancer in a previous study [5]. Thus, adherence and prevalence will be closely monitored in consecutive studies.
For HCP’s, adherence (i.e., follow-up with families within the set timeframe) was 70%, reaching the pre-defined threshold for adherence. However, as feasibility questionnaires as well as interviews reveal that HCP’s did not always notice the notifications sent when a clinically significant score was reported, we believe profit can still be made. Thus, the notifications have been assigned a more distinctive sound and the effect on HCP adherence will be assessed in consecutive studies.
The cut-off for feasibility (learnability, usability, desirability) was reached for the majority of app functionalities and non-feasible functions have been addressed (i.e., technical bug daily reminders, non- distinctive sound of HCP notifications). Generally, families (81.5%) and HCP’s (66.7%) said they would recommend the app to others.
Barriers and facilitators mentioned in the interviews have been taken into account as well. Some families said the app should have an overview of previously reported scores. This was not one of the original aims of the app, but it has been added to the list of possible future functionalities. Also, since it was not clear to all families that the app was only meant for use at home, a flyer with clear instructions was developed to hand out to families in consecutive studies and future implementation. Facilitators mentioned by families related to improved care for patients and user friendliness of the app.
Barriers identified in HCP interviews mainly related to time consumption and increased workload. The list of questions used by HCP’s as a guideline for follow-up with patients (based on the hospital’s Pediatric Pain Service standard of care) was rated ‘too extensive’ and has since then been reviewed by the Pediatric Pain Service. HCP’s indicated that the login process was not yet integrated into their workflow and could be easily forgotten. This is something we cannot resolve immediately, and we think that this is a matter of time to get used to. With regard to the 2-FAlogin process (“time consuming”), as this is a privacy requirement we were unable to make alterations. Facilitators mainly related to improved care for patients, and user friendliness of the app. Thus, although HCP’s are generally positive about use of the app and its potential benefits for patient care, their worries relating to workload need to be addressed. Worries related to workload might also account for the fact that one-third of HCP’s indicated that they would not recommend the app to other HCP’s. In view of the fact that only a small number (N = 20, 2%) of reported scores required follow-up, it is possible that external factors have also influenced HCP’s attitudes towards working with the app. As the Princess Máxima Center is a relatively new hospital in which HCP’s are still getting used to new workflows and division of tasks, it is possible that HCP’s experience a resistance to (additional) change [38]. This will be addressed in consecutive studies.
These outcomes are in line with a previous study assessing barriers and facilitators of implementation of an online tool monitoring electronic patient-reported outcomes (KLIK) [25]. Similar to the current study, barriers mainly related to organizational context (i.e., time), whereas facilitators related to the intervention (i.e., simplicity of use) and outcome expectations (i.e., more efficient detection of problems). Addressing organizational aspects such as capacity, financial resources, and time is an essential prerequisite for the successful implementation of innovations [39], and will be taken into account in future efforts.
The current study has some limitations. Firstly, a technical bug caused the daily reminders for pain reporting not to be sent to families for a majority of the study period, affecting family adherence. However, it should be noted that the daily reminders were merely instituted to guarantee sufficient pain scores to test all functionalities of the app. As the final goal of the app is to provide families with a tool to report pain when necessary (not at set times), the daily reminders will be optional. Secondly, this study reflects the experiences of a small sample of children and parents, whose perspectives might not be representative for all children with cancer receiving treatment in the home setting. However, with regard to patient characteristics (age, gender, diagnosis, intensity of treatment), this group reflects a realistic cross section of the patient population. Thirdly, as the app is currently only available in Dutch, non-Dutch speaking families could not participate. Translation of the app to different languages is an important goal for the future. Fourthly, only families with access to a smartphone and access to the Internet were able to participate in this study. However, as The Netherlands is one of the leading European countries with regard to households with internet access (98%) and smartphones (87%) [40], we do not believe this has impacted the outcomes. And fifthly, not all sub scales of the feasibility questionnaires for families and HCP’s showed good internal consistency. However, as we wanted to analyze individual items to assess specific functionalities of the app, rather than calculate mean scores for sub scales, we see the questionnaire as a valid tool for this purpose.
We can conclude that patients, parents, and HCP’s are generally positive about the KLIK Pain Monitor and use of the app seems feasible for implementation at the Princess Máxima Center for Pediatric Oncology. This study is an important preliminary step in the implementation process, as tailoring interventions based on evaluation with stakeholders (patients, parents, HCP’s) will ultimately benefit effective use in practice [26]. As feasibility has been established, the next step is to assess effectiveness of the app in reducing pain in children at home, in a randomized controlled trial (RCT). If found effective, the KLIK Pain Monitor app will be implemented and function as a bridge between the hospital and home setting, improving pain management at home and decreasing pain in children with cancer.
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
Code availability
SPSS version 25.0 was used for all analyses.
References
Ljungman G et al (2000) Pain variations during cancer treatment in children: a descriptive survey. Pediatr Hematol Oncol 17(3):211–221
Tutelman PR et al (2018) Pain in children with cancer: prevalence, characteristics, and parent management. Clin J Pain 34(3):198–206
Fortier MA et al (2014) Pain management at home in children with cancer: a daily diary study. Pediatr Blood Cancer 61(6):1029–1033
Bult MK et al (2019) Health-related quality of life of adolescents with cancer during the first year of treatment. J Adolesc Young Adult Oncol 8(5):616–622
Simon JDHP, Van Loon FRAA, Van Amstel J, Elmont GS, Zwaan CM, Fiocco M, Schepers SA, Tissing WJE, Michiels EMC (2020) Pain at home during childhood cancer treatment: Severity, prevalence, analgesic use, and interference with daily life. Pediatr Blood Cancer 67(12):e28699. https://doi.org/10.1002/pbc.28699
James K et al (2002) The care of my child with cancer: parents’ perceptions of caregiving demands. J Pediatr Oncol Nurs 19(6):218–228
Pearce S, Kelly D, Stevens W (2001) “More than just money” – widening the understanding of the costs involved in cancer care. J Adv Nurs 33(3):371–379
Henderschot E et al (2005) Outpatient chemotherapy administration: decreasing wait times for patients and families. J Pediatr Oncol Nurs 22(1):31–37
Fortier MA, Sender L, Kain ZN (2011) Management of Pediatric oncology pain in the home setting: the next frontier. J Pediatr Hematol Oncol 33(4):249–250
Jacob E (1999) Making the transition from hospital to home: caring for the newly diagnosed child with cancer. Home Care Provid 4(2):67–73
Fortier MA et al (2012) Attitudes regarding analgesic use and pain expression in parents of children with cancer. J Pediatr Hematol Oncol 34(4):257–262
Breivik H et al (2008) Assessment of pain. Br J Anaesth 101(1):17–24
Hangaard MH, Malling B, Mogensen CB (2018) High inter-observer agreement of observer-perceived pain assessment in the emergency department. BMC Emerg Med 18(1):8
Monteiro Caran EM et al (2005) Clinical aspects and treatment of pain in children and adolescents with cancer. Pediatr Blood Cancer 45(7):925–932
Habashy C et al (2018) Methadone for pain management in children with cancer. Pediatr Drugs 20:409–416
Eccleston C et al (2002) Systematic review of randomised controlled trials of psychological therapy for chronic pain in children and adolescents, with a subset meta-analysis of pain relief. Pain 99(1–2):157–165
Loeffen E et al (2020) Reducing pain and distress related to needle procedures in children with cancer: a clinical practice guideline. Eur J Cancer 131:53–67
Jibb LA et al (2015) Psychological and physical interventions for the management of cancer-related pain in pediatric and young adult patients: an integrative review. Oncol Nurs Forum 42(6):E339–E357
Palermo TM et al (2010) Randomized controlled trials of psychological therapies for management of chronic pain in children and adolescents: an updated meta-analytic review. Pain 148(3):387–397
Sung L (2015) Priorities for quality care in pediatric oncology supportive care. Journal of Oncology Practice 11(3):187–189
Alberts NM, Gagnon MM, Stinson JN (2018) Chronic pain in survivors of childhood cancer: a developmental model of pain across the cancer trajectory. Pain 159(10):1916–1927
Jibb L, et al (2020) Pain Squad + smartphone app to support real-time pain treatment for adolescents with cancer: protocol for a randomised controlled trial. BMJ Open 10(3): p. e037251
Fortier MA et al (2016) Pain buddy: A novel use of m-health in the management of children’s cancer pain. Comput Biol Med 76:202–214
Linder LA, Newman AR, Stegenga K, Chiu YS, Wawrzynski SE, Kramer H, Weir C, Narus S, Altizer R (2021) Feasibility and acceptability of a game-based symptom-reporting app for children with cancer: perspectives of children and parents. Support Care Cancer 29(1):301–310
Schepers SA et al (2017) Real-world implementation of electronic patient-reported outcomes in outpatient pediatric cancer care. Psychooncology 26(7):951–959
Ledel Solem IK, et al (2020) A user-centered approach to an evidence-based electronic health pain management intervention for people with chronic pain: design and development of EPIO. J Med Internet Res 22(1): p. e15889
WHO (2012) Guidelines on the Pharmacological Treatment of Persisting Pain in Children with Medical Illnesses. World Health Organization, Geneva
van Lingen RA (2009) Evidence-based richtlijn richtlijn voor pijnmeting pijnmeting en behandeling pijnbehandeling van pijn bij kinderen. In: Boekblok Pijn info. Pijn info. Bohn Stafleu van Loghum, Houten. https://doi.org/10.1007/978-90-313-7316-1_109
Hagglund G et al (2020) Self-versus proxy-reported pain in children with cerebral palsy: a population-based registry study of 3783 children. J Prim Care Community Health 11:2150132720911523
Martin S et al (2015) Development and validation of the English Pain Interference Index and Pain Interference Index-parent report. Pain Med 16(2):367–373
Birnie KA et al (2019) Recommendations for selection of self-report pain intensity measures in children and adolescents: a systematic review and quality assessment of measurement properties. Pain 160(1):5–17
Kazak AE et al (2012) A revision of the intensity of treatment rating scale: classifying the intensity of pediatric cancer treatment. Pediatr Blood Cancer 59(1):96–99
Donkin L, et al (2011) A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res 13(3): p. e52.
Hochstenbach LM et al (2016) Feasibility of a mobile and web-based intervention to support self-management in outpatients with cancer pain. Eur J Oncol Nurs 23:97–105
Tenniglo LJA et al (2017) Patients’ and parents’ views regarding supportive care in childhood cancer. Support Care Cancer 25(10):3151–3160
Harding J (2018) Qualitative data analysis: from start to finish. Sage
Tutelman, P.R., et al., The implementation effectiveness of a freely available pediatric cancer pain assessment app: a pilot implementation study. JMIR Cancer, 2018. 4(2): p. e10280.
Pardo del Val, M. and C. Martínez Fuentes, Resistance to change: a literature review and empirical study. Management Decision, 2003. 41(2): p. 148–155.
Fleuren MA et al (2014) Towards a measurement instrument for determinants of innovations. Int J Qual Health Care 26(5):501–510
ICT-gebruik van huishouders en personen (2019) Centraal Bureau voor de Statistiek (CBS). The Netherlands
Acknowledgements
We would like to thank all patients, parents, and participating healthcare professionals.
Funding
This work was supported by ZonMw under Grant Agreement No 844001505.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection, and analysis were performed by Julia D.H.P. Simon and Sasja A. Schepers. The first draft of the manuscript was written by Julia D.H.P. Simon and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval
This study was approved by the appropriate institutional research ethics committee (METC Utrecht [medical ethics review committee, Utrecht], registration number 20/680) and was performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments.
Consent to participate and for publication
Informed consent was obtained from all individual participants included in the study. The authors affirm that all participants consented to the publication of their data.
Conflicts of interest
The authors declare that there is no conflict of interest to disclose.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Simon, J.D.H.P., Schepers, S.A., Grootenhuis, M.A. et al. Reducing pain in children with cancer at home: a feasibility study of the KLIK pain monitor app. Support Care Cancer 29, 7617–7626 (2021). https://doi.org/10.1007/s00520-021-06357-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00520-021-06357-9