Abstract
Purpose of Review
The aim of this study was to present the current state of research on mobile health apps for sexual and reproductive health (SRH) education. Apps were analysed based on contents (by using the World Health Organization’s SRH framework), features, intended audiences and quality of evidence (by applying the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach). Taking German sexuality education apps as an example, the rapid development in the field of SRH apps over the last 3 years has been revealed by comparing the quality of apps available in 2019 with apps from 2022.
Recent Findings
SRH apps allow health information to be disseminated quickly, at low thresholds and in a practical and cost-effective manner. Moreover, they allow for anonymous usage independently of time and place. In the absence of network coverage, offline use is also possible. Previous research focused on individual SRH aspects (e.g. human immunodeficiency virus (HIV), contraception). However, some studies were designed to cover a broader range of SRH topics, but identified only a few relevant apps.
Summary
To improve SRH, it would be helpful if the apps would be of high-quality design and be made up of relevant content. Furthermore, they should be tailored to the target group and have been tested in real-life settings. A total of 50 SRH apps with sufficiently high-quality ratings were included. The apps cover a variety of SRH topics, but they often lack field-based evaluation. The effectiveness of SRH apps has not yet been sufficiently studied in a scientific manner. Only 9 apps were deemed to be adequate for a moderate GRADE level. Despite this grading, the study nevertheless shows that there are several apps that could potentially promote SRH.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
To facilitate interactions between physicians and patients, the use of a health app such as Babyscripts might be helpful. Besides providing pregnancy information the Babyscripts app also allows pregnant persons to communicate with their doctors. Furthermore, the application is linked to remote monitoring devices. If any deviating parameters are detected, the app assists by alerting nurses and patients [1•, 2, 3].
Sexual minorities can also benefit from health apps that are tailored to meet their needs [4]. One example is the myPEEPS app. With interactive components such as gamifications (e.g. quizzes), scenarios as well as role plays, it aims to provide same-sex attracted young males with helpful knowledge and skills to reduce their sexual risk behaviour and the risk of them contracting a sexual transmitted infection (STI) [5,6,7,8].
This study focuses on health apps as a specific type of mobile health (mHealth) interventions. mHealth interventions, i.e. interventions delivered via mobile devices, can successfully improve people’s health [9]. Compared to conventional interventions, people benefit from mHealth by being enabled to quickly access information at low thresholds and independently of time and place as well as at low cost [9,10,11,12,13,14]. mHealth interventions can also meet the need for anonymity, which is especially crucial when it comes to sexuality [4, 14, 15].
Health apps can be used to disseminate health information effectively, practically and cost-effectively via mobile phones or tablets [10,11,12,13, 16]. Another advantage of native apps in comparison to other mHealth interventions is the possible offline use in the absence of network coverage [4]. In addition to common text message interventions [9], a variety of interactive features can be implemented in apps to positively influence people’s health.
This article is based on the current World Health Organization (WHO) definition of sexual health [17]. Therefore, apps that focus on aspects such as sexual well-being are being additionally considered to more conventional topics of sexual health like prevention of human immunodeficiency virus (HIV) or sexual risk behaviours. Sexual and reproductive health [18, 19] are closely intertwined [20]. Hence, this study also covers apps that focus mainly on reproductive aspects. For analysing sexual and reproductive health (SRH) aspects, a WHO-framework that distinguishes eight domains of SRH and four socio-structural aspects is used [20].
To promote SRH, apps can provide fundamental knowledge through playful elements (e.g. quizzes) [21,22,23]. Self-assessment and tracking options for symptoms, the menstrual cycle or fertility biomarkers (e.g. basal body temperature, cervical fluid) are other important features of SRH apps [22, 24, 25]. Users can often get their questions answered through the app (FAQs, chatbots, interactive components) [21, 26]. Furthermore, an important element of some apps is the references to offline help services or in-app contact options to experts [21, 24].
Aim of the Review
Current app research often focuses on individual SRH aspects (e.g. HIV, pregnancy prevention) [24, 27, 28]. Other studies already include a wider range of SRH topics but only identify a few relevant apps [29, 30, 31•]. The aim of this study was to present the most researched SRH apps and evaluate their characteristics and outcomes. To identify the apps and the evidence available about them, two types of publications were used: literature reviews (i.e. papers summarising research on mHealth solutions) and app reviews (i.e. papers presenting apps available on common app platforms). Taking German sex education apps as an example, the rapid development in the field of SRH apps is shown.
Methods
The study was conducted in two steps: (1) a systematic literature search to identify SRH apps known in the scientific community followed by (2) an analysis of the selected SRH apps in terms of contents, features, intended audiences and quality of evidence.
Literature Search
The following databases were searched: Pubmed, Embase, PsycInfo, PSYNDEX, PsycArticle, CINAHL, Web of Science, Cochrane Reviews and Cochrane Trials. For this purpose, studies were searched that contained an SRH component (e.g. sexual health, sexual well-being, reproductive health, reproductive well-being) and an app component (e.g. app, application, mobile phone) in title or abstract. The study presents systematic reviews and meta-analysis limited to publications of the last 5 years due to the rapid change in availability of apps [10, 21, 32, 33]. Studies were included if they (a) focused on or addressed SRH components, (b) included smartphone or tablet apps and (c) were written in English or German. On the other side, studies were excluded if they (a) focused on other health-related topics (e.g. mental health) or (b) included other mHealth interventions (e.g. SMS interventions) without mentioning apps or (c) interventions via other apps (e.g. Social Media Platforms). After duplicates removed, 315 studies were screened by title and abstract (for details on study identification, see Appendix 1). By screening all reference lists of included studies, 8 additional studies were identified. Finally, 25 systematic reviews were included in the analysis. In some of the included literature reviews, study protocols of randomised controlled trials (RCT) or articles with ongoing RCTs were mentioned [7, 34,35,36]. In these cases, an additional search for published studies on particular apps was conducted [37,38,39,40,41,42,43,44,45,46].
App Analysis
Apps that achieved at least acceptable quality ratings or were recommended by the study authors were included (for details, see Appendix 2). Apps were analysed with focus on contents, features, intended audiences and quality of evidence. In order to compare findings across studies, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Approach proposed by the GRADE Working Group was used to assess whether the quality of evidence for each app was (a) high, (b) moderate, (c) low or (d) very low [47].
Results
Literature Search
In the analysis, 25 systematic review studies were included. Two types of studies stood out: literature reviews [1•, 5, 24, 27,28,29,30, 31•, 48•, 49, 50••, 51••, 52,53,54, 55••, 56, 57] and app reviews (i.e. evaluations of apps available in common app stores) [1•, 5, 23,24,25,26, 28, 32, 33, 58, 59]. Twelve studies covered digital and mobile health interventions in general [27,28,29,30, 31•, 51••, 52,53,54, 55••, 56, 57], and 13 focused specifically on health apps [1•, 5, 23,24,25,26, 32, 33, 48•, 49, 50••, 58, 59]. Most studies focused on SRH with only a few [50••, 56, 57] examining general health interventions.
Studied SRH Topics
Sexual health areas were covered by 15 studies: (a) comprehensive education and information [23, 28,29,30, 31•, 33, 52, 54, 59], (b) gender-based violence prevention, support and care [29, 31•, 52, 53, 55••], (c) prevention and control of HIV and other STIs [5, 27, 29, 30, 31•, 51••, 52, 55••] and (d) sexual function and psychosexual counselling [24, 28, 51••, 54]. Areas that have a reproductive character: (e) antenatal, intrapartum and postnatal care [1•, 26, 29, 53, 55••], (f) contraception counselling and provision [5, 29, 31•, 32, 48•, 49, 52], (g) fertility care [25, 26, 29, 30, 31•, 32, 33, 48•, 49, 52, 55••, 58] and safe abortion care [29, 30, 31•, 55••] were also covered by 15 studies. In the field of reproductive health, a large proportion of the studies dealt with fertility care (especially menstrual monitoring). Social-structural factors were rarely an explicit topic of the studies. Three studies considered cultural and social norms around sexuality [5, 29, 51••], five studies gender and socioeconomic inequalities [29, 30, 31•, 52, 55••] and two studies human rights [29, 30].
Studied Populations
The vast majority of studies focused on (a) women [25, 32, 33, 48•, 49, 52, 58] or more specifically, pregnancy and the postpartum period [26, 29]. Other studies concentrated on (b) children [23, 29], adolescents and young people [23, 29, 30, 31•, 50••, 59], (c) men [28] or men who have sex with men (MSM) [5] and (d) healthcare workers and/or patients [1•, 27]. There were also studies conducted on (e) adults [24, 54] and (f) people that were deemed healthy [56] as well as (g) people in general [51••, 53, 55••, 57].
Identification of SRH Apps
No apps were included if studies (a) addressed digital interventions, but did not contain apps [30, 54] or (b) did not name individual apps [28, 33]. Furthermore, if (c) study authors did not recommend any app [58] or (d) no quality assessment was conducted in the study [24] apps were also not included (see Appendix 2 for information on the studies and the selection criteria for the apps included in the analysis).
SRH Apps
In terms of contents, technical aspects (features), intended audiences as well as quality of evidence 50 apps were analysed (see Table 1 for details and short summaries of relevant findings on each app).
Contents of SRH Apps
Nine apps focused on (a) comprehensive education and information, 3 on (b) gender-based violence prevention, support and care, 9 on (c) prevention and control of HIV and other STIs and only one on (d) sexual function and psychosexual counselling. Covered by 12 apps was (e) antenatal, intrapartum and postnatal care. There were 9 apps on the topic (f) contraception counselling and provision and 20 on (g) fertility care (including tracking-apps). No app focussing on (h) safe abortion care could be found. Four apps addressed cultural and social norms around sexuality, among these one was noted to be transformative on gender relations [55••]. The remaining social-structural factors may have been approached indirectly (e.g. gender inequalities can be addressed in gender-based violence prevention apps), but they were not the main app contents or explicit research subjects. Figure 1 shows the distribution of contents according to GRADE levels and intended audience groups.
Features of SRH Apps
Many apps (n = 31) offer different data collection options for users e.g. self-tracking menstruation, managing symptoms by taking notes or in some cases collecting data through other devices via Bluetooth [2, 3, 60]. Educational information was also provided in many (n = 19) apps. Reminders or push notifications were a feature which 16 apps contained. A few apps featured audio (n = 5) or video (n = 4) content and used gamification (n = 4) or interactive components (n = 4). Some also enabled communication with experts via app (n = 9), provided an FAQ section (n = 6), supported decision-making (n = 6) or had a community section for social support (e.g. forum, n = 4). Sharing data between client and healthcare workers was possible in 3 apps. Only 2 apps mentioned offline care services.
Intended Audiences of SRH Apps
The included apps addressed four target groups: (a) women, (b) children, adolescents and young adults, (c) healthcare workers and/or patients and (d) men. They are presented in Table 1, which is structured accordingly to these four groups. For each audience group, one app is described in more detail as an example.
For women, 25 apps, including 7 with a focus on pregnant and postpartum persons, were identified. Plan A Birth Control is a tablet app available in English. It informs women about possible contraception options and their effectiveness while they are waiting for a face-to-face consultation with a physican. Tested in a real-life setting, the app was shown to save time without compromising the overall quality of the counselling [61].
For children, adolescents and young adults 16 apps were identified. One of them is the app My Sex Doctor [59]. The smartphone app is available in English as well. It is an app that was designed with the aim to provide comprehensive sex education for adolescents covering a variety of SRH topics. Contents are presented in a Q&A format and include short text explanations on various subjects. There is also a dictionary-function that helps clarifying meanings of SRH-related terms. Adolescents can further check for symptoms that may indicate STIs. There are two versions of the app available (one being suitable for adolescents aged 12 to 16 and one for those that are older). Kalke et al. (2018) rated the app with an overall score of 29 out of possible 38 [59].
Ten apps were designed for healthcare workers and/or patients. Those are mostly apps that assist in data collection and decision-making processes of healthcare workers and support the interaction between professionals and their patients via in-app education or data sharing. OpenSRP supports local health workers through a smartphone app. It offers them educational information, enables data collection, supports decision-making and prompts appointment reminders as well as warn signals. Communication and coordination between different healthcare workers are also possible. Regarding the requirements considered relevant by Haddad et al. (2019), OpenSRP fullfilled the most of the requirements in contrast to the other examined solutions [1•].
The 3 apps aimed at men specialised on MSM. One App is the smartphone app HealthMindr available in English. The app contained tools which help with self-assessment [5]. It recommends prevention strategies to the users and assists them in ordering condoms and HIV self-tests [5]. The app also reminds people about prevention services, condom use, HIV testing and screening [5]. Sullivan et al. (2017) found HealthMindr acceptable for MSM and considered its usability to be above average [62].
Evaluation of SRH Apps
Figure 2 shows a selection of SRH apps for different GRADE levels. Following the GRADE approach, almost half of the apps (n = 23) were rated as very low regarding quality of evidence. This mostly (n = 19) included apps that were rated in app reviews according to their quality, without any information on further research [1•, 23, 26, 32, 59]. Some articles described the development of apps without testing them with the target group or with an insufficient number of participants [63,64,65]. A usability approach was mentioned in one study [66].
Studies for 18 apps were rated low. Those studies were no RCTs or had some severe limitations [2, 3, 36, 46, 61, 62, 67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86]. These included studies on feasibility (n = 9), acceptability (n = 8), efficacy (n = 6), usability (n = 5), development (n = 4) and quality (validity) study (n = 1).
Studies on 9 apps fell in the category moderate: AKUD [87], ClearBlue [60], myPEEPS [6,7,8, 37,38,39,40,41], myPlan [88], Plan A Birth Control [61], PlayForward: Elm City Stories [34, 42,43,44], Pulse [89], Tumaini [35, 45] and WeChat [90]. These included studies on efficacy (n = 9), feasibility (n = 4), acceptability (n = 3), development (n = 2) and usability (n = 1).
Following the GRADE approach, no app obtained a high quality of evidence rating. This would require several high-quality studies indicating no further research is needed to be sure about the estimated effect.
Case Study: Availability and Development of SRH Apps in Germany
In order to keep track of the current apps, it is essential to monitor the apps availability at regular intervals. Building on a previous work from 2019 [23] in 2022, an update for the German app stores was conducted. Developments in the field of sexual education apps for children and adolescents are presented in order to illustrate the dynamics of the app market. Three years after the original study (December 2022), the app stores (Apple App Store, Google Play) were searched again with the same inclusion and exclusion criteria. The most relevant search terms were used. Those are as follows: Sexual education (Sexuelle Bildung), Educating (Aufklärung), Sex education (Sexualerziehung). To enable comparability with the original study, the same raters also rated the new apps using the Mobile Anwendungen Rating Skala (MARS-G) [91] — the German Version of the Mobile Application Rating Scale (MARS) [92]. To allow a comparison, Table 2 presents the new as well as the original ratings.
Four sexual education apps were additionally identified. One of the apps is designed for children (Das bin ich!) and three of the apps are designed for adolescents (KNOWBODY, Sexuell Gesund, Klar und Einfach). Two of the apps from 2019 were no longer available in the app stores. Four of the 8 sexual education apps achieved an overall (total) rating of good (4) or better. On average, at least acceptable (3) scores were achieved in the individual sections of the MARS-G. From 2019 to 2022, the overall quality of apps increased (M2019 = 3.5 (StartChla and AMORELIE included), M2022 available = 3.8).
Discussion
This article presents the current state of research on SRH apps. In the following section, the contents, typical features, intended audiences and the quality of evidence of SRH apps are discussed. Challenges in investigating SRH apps are addressed as well.
Contents of SRH Apps
Among the apps identified in the study, there were many focusing on comprehensive education and fertility care, which includes menstrual tracking apps. However, most apps with these contents achieved very low GRADE ratings. Nine apps on prevention and control of HIV and other STIs (mostly for MSM, adolescents and young adults) with at least a low quality of evidence were identified. Another eight apps on contraception counselling and provision and eight on fertility care (usually for women and healthcare workers) also achieved a low or, in some cases, a moderate GRADE level. There were five apps (mostly aimed at healthcare workers) that supported antenatal, intrapartum and postnatal care with at least a low GRADE level. Three apps included contents on gender-based violence prevention, support and care and only a single app aimed at promoting sexual function and psychosexual counselling. All of these were rated with a low GRADE level or higher. Even though some apps might include abortion as a topic no SRH-app could be identified that focused on abortion care. As an SRH issue with a high mortality, health apps dealing with said topic could be a potential aid when it comes to the decision-making process or to reducing the stigma still attached to abortion [93, 94].
Social-structural factors were rarely the primary aim of the apps although they are highly relevant for the way we deal with SRH [20]. Even if they are taken into account for example through the selection of the intedend audiences (e.g. MSM), there is still a need for research that explicitly investigates the possibility of shaping context factors using app-based technology in order to promote SRH [20]. Three low or moderate quality apps addressed cultural and social norms around sexuality, and one was noted to be transformative on gender relations [55••]. Other social-structural factors may have been addressed indirectly. For instance, gender inequalities can be addressed in gender-based violence prevention apps. However, they were neither the main contents of the apps nor mentioned explicitly in the studies.
Features of SRH Apps
More than half of the apps (62%) enabled data collection, mostly the possibility to self-track menstruation or to manage symptoms. Providing educational information was also a fundemental part of 38% of the apps. Reminders or push notifications were used in 32% of the apps. Audio or video content, as well as gamification or interactive components, was mentioned less frequently overall. Other aspects like the possibility of communicating with experts or having typical questions answered in-app were only available in some of the apps. The same applies to the support of decision-making processes, peer discussions in forums and data sharing and the linkage to offline care services. However, the small percentages of those features can be explained by the high number of menstrual tracking apps. Depending on the target group, various features were used differently.
Intended Audiences of SRH Apps
Four audience groups were addressed by the apps. The vast majority of which, particularly menstrual tracking apps, were aiming at women including pregnant and postpartum persons. There were also a lot of apps for children, adolescents and young adults containing various educational insights. Those apps mostly provided information using audio or video content, gamification or other interactive components. Some apps were designed to support interactions between healthcare workers and patients and a few apps aimed at MSM for HIV prevention and management. Those SRH apps typically enabled data collection for users, which in turn can support keeping track of current health statuses as well as in-app communication with experts. A few apps also allowed sharing data between clients and professionals. There were no apps for men in general, which does not come as a surprise given that only one article targeted them [28]. This can be explained by numerous fertility care studies, which often tend to focus on women. However, men might benefit from digital health interventions when it comes to their own SRH and may be involved in preconception care as well [95, 96] and therefore a more balanced proportion in research would be desirable. The same applies for LGBTQIA + groups, who could benefit from well-designed and relevant health apps [4], as besides apps for MSM, no further apps were mentioned.
Evaluation of SRH Apps
Various studies note that the app market is developing rapidly and the availability of health apps is constantly changing [7, 13, 23, 24]. Keeping track of currently available and relevant apps is almost impossible, especially when it comes to a field as broad as SRH. Authors of app reviews are trying to overcome this issue by systemising the current market [1•, 5, 23,24,25,26, 28, 32, 33, 58, 59]. However, they often lack the tools to recommend high-quality and relevant apps for practice [5, 24, 25, 58]. In addition, studies in which quality assessment scales are used [23, 26, 58] or those with articles that date back to 2014 [1•, 66] covered apps that may no longer be available or only in modified versions. In order to keep an overview of the current apps, it is therefore essential to view the apps at regular intervals and with the shortest possible delay in the publication process. When it comes to German sexual education apps, in the last 3 years, a positive development in the availability and quality has been observed. Two out of 6 apps could no longer be downloaded. Apps in other languages and with other SRH-focuses should also be regularly reviewed and evaluated. For practical purposes, databases that contain currently relevant apps should be made more apparent in order to facilitate better awareness of the wider audience regarding the apps available. Otherwise, it can be difficult for intended users to identify adequate apps [97].
Besides the overwhelming number, the efficacy of SRH apps has not yet been sufficiently studied in a scientific manner. Figure 2 shows a selection of apps sorted by GRADE level. Individual apps were deemed to be rated with at least a moderate GRADE level in the present study. The apps aimed at women are AKUD, ClearBlue, myPlan, Plan A Birth Control and Pulse. Those targeting adolescents and young adults are myPEEPS, PlayForward, Pulse and Tumaini and those for MSM are myPeeps and WeChat. Apps for women showed the potential to improve SRH by decreasing menstrual pain (AKUD), increasing of the conceiving likelihood (ClearBlue), increases in knowledge and skills due to intimate partner violence (myPlan) as well as knowledge gain on contraception options (Plan A Birth Control). Adolescents and young adults benefitted from apps by improving their health knowledge (Playforward, Pulse, Tumaini), attitudes (PlayForward, Tumaini) and self-efficacy (Tumaini) as well as by decreasing their reported sexual risk behaviour (Pulse). Apps for MSM reduced sexual risk behaviour (mePEEPS, WeChat) and enhanced self-testing behaviour (WeChat).
Apps from app reviews usually showed very low quality of evidence, as in the framework of the GRADE approach, those studies are not considered sufficient enough. It is possible that among the apps for which no pilot or RCT study was found, there are some that may have a positive impact on SRH. Some of the apps showed content expert ratings indicating that they are of good quality and therefore have the potential to improve people’s SRH [1•, 23, 32, 59]. Thus, apps such as iMamma could support people during their pregnancy, My Sex Doctor could provide helpful information for adolescents and OpenSRP could support healthcare workers in their decision-making processes when no well-tested alternative is available.
In order to have a positive impact on SRH, it would be useful if apps would not only be of high-quality design and have relevant content, but they should also be tailored to the intended target group [4]. Especially younger audiences can be skeptical about app use [98]. In addition, it is useful to embed the apps in educational or healthcare settings so that users are not left on their own when using them. A good start is the possibility to communicate with experts via the app, as provided in some apps. However, a better approach would be to integrate the app in a real-life environment such as school lessons. A good example was provided by Sridhar et al. (2015), who examined an educational app (Plan a Birth Control) in the intended setting (waiting room) [61]. The authors found that the app can be used to prepare women for meeting with a doctor, saving time and increasing the overall quality of the consultation [61].
Limitations
Comparability between studies is limited. Often study-specific scales and categories are developed to assess quality, function or content of the apps [1•, 24, 25, 32, 33, 59]. In single studies, scientifically sound scales for quality ratings were used, which, however, are not tailored to SRH or the intended audience group [23, 26, 58]. One study explicitly focused on developing a framework for assessing general health apps for adolescents that could be helpful in studies for this specific target group [50••]. Harmonisation would be helpful in order to be able to compare studies and adequately reflect the current state of scientific knowledge. Thus, the selection of apps in this study can only be comprehensive to a limited extent. It is possible that among the apps, for which no pilot or RCT study was found, there are some that can impact SRH positively. This is especially true for articles that did not conduct any quality rating [5, 24, 25]. This may result in relevant apps not being included in the study. Additionally, to promote SRH, different outcomes have been measured across different studies, making it difficult to draw firm conclusions about the effectiveness of apps overall. Hamornisation here would be helpful as well. In order to address this issue in a concise manner, study aims and findings for each app are noted in Table 1.
For five apps, new articles were searched manually via the app name as well as the names of the authors of the original studies. Additional papers could be identified in every case indicating that there are more current studies for some of the other apps as well. These are not included in the present article, as it would have exceeded the scope of this study. Due to geographical location and language capabilities, it was not possible to verify for all apps whether they were still available or whether they exceeded the contents and functions reported in the studies. It is possible that some of the analysed apps are no longer available due to the fast changing market of health apps [10, 21, 32, 33].
For app assessment, the GRADE approach proposed by the GRADE Working Group was followed to distinguish whether the Quality of Evidence was (a) high, (b) moderate, (c) low or (d) very low [47]. Ratings were only conducted by a single scientist (MM) and not double checked to enhance the validity. Expert opinion is not a category of quality of evidence due to GRADE [47]. Nevertheless, apps that have been rated with relevant scales by experts were included, even if the intended audience itself was not involved (see Appendix 2 for more details on the selection of apps).
Conclusions
In this study, SRH apps that are known among the scientific community were examined. Many apps cover a variety of SRH topics, but they often lack high-quality assessment. In order to improve SRH, it would be helpful if apps were of high-quality design, contained relevant evidence-based content, would be tailored to the intended audience and tested in real-life settings [4, 16, 92, 99]. But this does not necessarily mean that less researched apps cannot positively influence health. Even some apps with a very low level of evidence showed relevant contents and promising features to support people in managing their SRH.
Finally, a common issue in the field of SRH interventions emerged again in the present study [100, 101]. Outcomes that are used for effectiveness measurements are not necessarily all factors that lead to good SRH according to our present understanding. Negative factors such as limiting risk behaviour and preventing diseases as well as knowledge gain are still the primary focus. However, there were also studies which set a good example by noting other outcomes. Among these are enhanced feelings of confidence and resilience [88], well-informed SRH decisions [88] and the ability to initiate SRH discussions [72]. In addition to traditional outcomes, there should be a greater emphasis on examining positive-psychological and competence-oriented variables.
Data Availability
The authors confirm that the data supporting the findings of this study are available within the article and its supplementary materials.
Abbreviations
- GRADE:
-
The Grading of Recommendations Assessment, Development and Evaluation
- HIV:
-
Human immunodeficiency virus
- MARS, MARS-G:
-
The Mobile Application Rating Scale, Mobile Anwendungen Rating Skala
- mHealth:
-
Mobile health
- MSM:
-
Men who have sex with men
- RCT:
-
Randomised controlled trials
- SRH:
-
Sexual and reproductive health
- STI:
-
Sexual transmitted infection
- WHO:
-
The World Health Organization
References
Papers of particular interest, published recently, have been highlighted as: • Of importance •• Of major importance
• Haddad SM, Souza RT, Cecatti JG. Mobile technology in health (mHealth) and antenatal care-searching for apps and available solutions: a systematic review. Int J Med Inform. 2019;127:1–8. https://doi.org/10.1016/j.ijmedinf.2019.04.008. The literature and app review provide an overview on 9 apps and assessed their classification as follows: (1) client education and change in behaviour, (2) probes and diagnoses, (3) records and management of vital events, (4) data collection and reports, (5) electronic health charts, (6) electronic decision-making support, (7) interprofessional communication, (8) work schedule and task list of the professional, (9) education and professional training, (10) human resource management, (11) supply chain management, (12) incentives and financial transactions (Labrique).
Marko KI, Krapf JM, Meltzer AC, Oh J, Ganju N, Martinez AG, et al. Testing the feasibility of remote patient monitoring in prenatal care using a mobile app and connected devices: a prospective observational trial. JMIR Res Protoc. 2016;5:e200. https://doi.org/10.2196/resprot.6167.
Lanssens D, Vandenberk T, Smeets CJ, de Cannière H, Molenberghs G, van Moerbeke A, et al. Remote monitoring of hypertension diseases in pregnancy: a pilot study. JMIR Mhealth Uhealth. 2017;5:e25. https://doi.org/10.2196/mhealth.6552.
Byron P. ‘Apps are cool but generally pretty pointless’: LGBTIQ+ young people’s mental health app ambivalence. Media Int Aust. 2019;171:51–65. https://doi.org/10.1177/1329878X19844034.
Queiroz AA, Nunes FL, Mendes IAC, de Godoy S, Velez Lapão L, Dias S. mHealth strategies related to HIV postexposure prophylaxis knowledge and access: systematic literature review, technology prospecting of patent databases, and systematic search on app stores. JMIR Mhealth Uhealth. 2021;9:e23912. https://doi.org/10.2196/23912.
Hidalgo MA, Kuhns LM, Hotton AL, Johnson AK, Mustanski B, Garofalo R. The MyPEEPS randomized controlled trial: a pilot of preliminary efficacy, feasibility, and acceptability of a group-level, HIV risk reduction intervention for young men who have sex with men. Arch Sex Behav. 2015;44:475–85. https://doi.org/10.1007/s10508-014-0347-6.
Kuhns LM, Garofalo R, Hidalgo M, Hirshfield S, Pearson C, Bruce J, et al. A randomized controlled efficacy trial of an mHealth HIV prevention intervention for sexual minority young men: MyPEEPS mobile study protocol. BMC Public Health. 2020;20:65. https://doi.org/10.1186/s12889-020-8180-4.
Cho H, Powell D, Pichon A, Thai J, Bruce J, Kuhns LM, et al. A mobile health intervention for HIV prevention among racially and ethnically diverse young men: usability evaluation. JMIR Mhealth Uhealth. 2018;6:e11450. https://doi.org/10.2196/11450.
Marcolino MS, Oliveira JAQ, D’Agostino M, Ribeiro AL, Alkmim MBM, Novillo-Ortiz D. The impact of mHealth interventions: systematic review of systematic reviews. JMIR Mhealth Uhealth. 2018;6:e23. https://doi.org/10.2196/mhealth.8873.
Chen E, Mangone ER. A systematic review of apps using mobile criteria for adolescent pregnancy prevention (mCAPP). JMIR Mhealth Uhealth. 2016;4:e122. https://doi.org/10.2196/mhealth.6611.
Eleuteri S, Rossi R, Tripodi F, Fabrizi A, Simonelli C. Sexual health in your hands: how the smartphone apps can improve your sexual wellbeing? Sexologies. 2018;27:e57–60. https://doi.org/10.1016/j.sexol.2018.04.004.
Krishna S, Boren SA, Balas EA. Healthcare via cell phones: a systematic review. Telemedicine and e-Health. 2009;15:231–40.
Muessig KE, Pike EC, Legrand S, Hightow-Weidman LB. Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: a review. J Med Internet Res. 2013;15:e1. https://doi.org/10.2196/jmir.2301.
Hightow-Weidman LB, Muessig KE, Bauermeister J, Zhang C, Legrand S. Youth, technology, and HIV: recent advances and future directions. Curr HIV/AIDS Rep. 2015;12:500–15. https://doi.org/10.1007/s11904-015-0280-x.
Matthiesen S, Dekker A. Jugendsexualität [Adolescent sexuality]. In: Lange A, Reiter H, Schutter S, Steiner C, editors. Handbuch Kindheits- und Jugendsoziologie [Handbook sociology of childhood and youth]. Wiesbaden: Springer Reference Sozialwissenschaften; 2018. p. 379–392. https://doi.org/10.1007/978-3-658-04207-3_28.
Albrecht U-V, editor. Chancen und Risiken von Gesundheits-Apps (CHARISMHA) [Chances and risks of mobile health apps (CHARISMHA)]: Medizinische Hochschule Hannover; 2016.
World Health Organization (WHO). Defining sexual health: report of a technical consultation on sexual health. Geneva; 2006.
United Nations Population Fund. Sexual & reproductive health 11.02.2023. https://www.unfpa.org/sexual-reproductive-health#readmore-expand. Accessed 11 Feb 2023.
World Health Organization (WHO). Reproductive health 02.11.2021. https://www.who.int/westernpacific/health-topics/reproductive-health. Accessed 2 Nov 2021.
World Health Organization (WHO). Sexual health and its linkages to reproductive health: an operational approach. Geneva; 2017.
Döring N. „Switched On“: UNESCO-Konferenz 2020 zur sexuellen Bildung im digitalen Raum. Z Sex-Forsch. 2020;33:178–80. https://doi.org/10.1055/a-1213-9618.
Gesselman AN, Druet A, Vitzthum VJ. Mobile sex-tech apps: how use differs across global areas of high and low gender equality. PLoS One. 2020;15:e0238501. https://doi.org/10.1371/journal.pone.0238501.
Muehlmann M, Lienert A, Muehlan H, Stach M, Terhorst Y, Messner E-M. Digitale Sexualaufklärung: Verfügbarkeit und Evaluation mobiler deutschsprachiger Apps zur Förderung der sexuellen Gesundheit. [Digital sex education: availability and quality of German apps for sexual health promotion]. Z Sex Forsch. 2021;34:197–207. https://doi.org/10.1055/a-1669-7626.
Jurin T, Šoštarić M, Jokić-Begić N, Lauri KA. mSexHealth: an overview of mobile sexual health applications. J Sex Marital Ther. 2023;49:129–40. https://doi.org/10.1080/0092623X.2022.2079576.
Starič KD, Trajkovik V, Belani H, Vitagliano A, Bukovec P. Smart phone applications for self-monitoring of the menstrual cycle: a review and content analysis. Clin Exp Obstet Gynecol. 2019;46:731–5. https://doi.org/10.12891/ceog4830.2019.
Brunelli L, de Vita C, Cenedese F, Cinello M, Paris M, Samogizio F, et al. Gaps and future challenges of Italian apps for pregnancy and postnatal care: systematic search on app stores. J MED INTERNET RES. 2021;23:e29151. https://doi.org/10.2196/29151.
Berendes S, Gubijev A, McCarthy OL, Palmer MJ, Wilson E, Free C. Sexual health interventions delivered to participants by mobile technology: a systematic review and meta-analysis of randomised controlled trials. Sex Transm Infect. 2021;97:190–200. https://doi.org/10.1136/sextrans-2020-054853.
García-Cruz E, Romero-Otero J, Fode M, Alcaraz A. The digital environment in men’s sexual disorders: a systematic review. Actas Urológicas Españolas (English Edition). 2018;42:365–74. https://doi.org/10.1016/j.acuroe.2018.05.002.
Ames H, Glenton C, Lewin S, Tamrat T, Akama E, Leon N. Clients’ perceptions and experiences of targeted digital communication accessible via mobile devices for reproductive, maternal, newborn, child, and adolescent health: a qualitative evidence synthesis. Cochrane Database Syst Rev. 2019;10:013447. https://doi.org/10.1002/14651858.CD013447.
Feroz AS, Ali NA, Khoja A, Asad A, Saleem S. Using mobile phones to improve young people sexual and reproductive health in low and middle-income countries: a systematic review to identify barriers, facilitators, and range of mHealth solutions. Reprod Health. 2021;18:9. https://doi.org/10.1186/s12978-020-01059-7.
• Huang K-Y, Kumar M, Cheng S, Urcuyo AE, Macharia P. Applying technology to promote sexual and reproductive health and prevent gender based violence for adolescents in low and middle-income countries: digital health strategies synthesis from an umbrella review. BMC Health Serv Res. 2022;22:1373. https://doi.org/10.1186/s12913-022-08673-0. The umbrella review focuses on SRH promotion and gender-based violence prevention for adolescents. It contains a variety of reviews giving a broad overview on the subject.
Freis A, Freundl-Schütt T, Wallwiener L-M, Baur S, Strowitzki T, Freundl G, Frank-Herrmann P. Plausibility of menstrual cycle apps claiming to support conception. Front Public Health. 2018;6:98. https://doi.org/10.3389/fpubh.2018.00098.
Eschler J, Menking A, Fox S, Backonja U. Defining menstrual literacy with the aim of evaluating mobile menstrual tracking applications. Comput Inform Nurs. 2019;37:638–46. https://doi.org/10.1097/CIN.0000000000000559.
Fiellin LE, Kyriakides TC, Hieftje KD, Pendergrass TM, Duncan LR, Dziura JD, et al. The design and implementation of a randomized controlled trial of a risk reduction and human immunodeficiency virus prevention videogame intervention in minority adolescents: PlayForward: Elm City Stories. Clin Trials. 2016;13:400–8. https://doi.org/10.1177/1740774516637871.
Winskell K, Sabben G, Ondeng’e K, Odero I, Akelo V, Mudhune V. A Smartphone game to prevent HIV among young Kenyans: household dynamics of gameplay in a feasibility study. Health Educ J. 2019;78:595–606. https://doi.org/10.1177/0017896919832344.
Bakibinga P, Kamande E, Omuya M, Ziraba AK, Kyobutungi C. The role of a decision-support smartphone application in enhancing community health volunteers’ effectiveness to improve maternal and newborn outcomes in Nairobi, Kenya: quasi-experimental research protocol. BMJ Open. 2017;7:e014896. https://doi.org/10.1136/bmjopen-2016-014896.
Ignacio M, Garofalo R, Pearson C, Kuhns LM, Bruce J, Scott Batey D, et al. Pilot feasibility trial of the MyPEEPS mobile app to reduce sexual risk among young men in 4 cities. JAMIA Open. 2019;2:272–9. https://doi.org/10.1093/jamiaopen/ooz008.
Gannon B, Davis R, Kuhns LM, Rodriguez RG, Garofalo R, Schnall R. A mobile sexual health app on empowerment, education, and prevention for young adult men (MyPEEPS Mobile): acceptability and usability evaluation. JMIR Form Res. 2020;4:e17901. https://doi.org/10.2196/17901.
Cordoba E, Idnay B, Garofalo R, Kuhns LM, Pearson C, Bruce J, et al. Examining the Information Systems Success (ISS) of a mobile sexual health app (MyPEEPS Mobile) from the perspective of very young men who have sex with men (YMSM). Int J Med Inform. 2021;153:104529. https://doi.org/10.1016/j.ijmedinf.2021.104529.
Anderson A, Karczmar A, Kuhns LM, Garofalo R, Radix A, Bruce J, et al. A qualitative study to inform adaptation of MyPEEPS mobile for transmasculine youth. J Health Care Poor Underserved. 2022;33:301–16. https://doi.org/10.1353/hpu.2022.0022.
Schnall R, Kuhns LM, Pearson C, Batey DS, Bruce J, Hidalgo MA, et al. Efficacy of MyPEEPS mobile, an HIV prevention intervention using mobile technology, on reducing sexual risk among same-sex attracted adolescent males: a randomized clinical trial. JAMA Netw Open. 2022;5:e2231853. https://doi.org/10.1001/jamanetworkopen.2022.31853.
Montanaro E, Fiellin LE, Fakhouri T, Kyriakides TC, Duncan LR. Using videogame apps to assess gains in adolescents’ substance use knowledge: new opportunities for evaluating intervention exposure and content mastery. J MED INTERNET RES. 2015;17:e245. https://doi.org/10.2196/jmir.4377.
Hieftje K, Fiellin LE, Pendergrass T, Duncan LR. Development of an HIV prevention videogame: lessons learned: lessons learned. IJSG 2016. https://doi.org/10.17083/ijsg.v3i2.110.
Fiellin LE, Hieftje KD, Pendergrass TM, Kyriakides TC, Duncan LR, Dziura JD, et al. Video game intervention for sexual risk reduction in minority adolescents: randomized controlled trial. J MED INTERNET RES. 2017;19:e314. https://doi.org/10.2196/jmir.8148.
Winskell K, Sabben G, Akelo V, Ondeng’e K, Obong’o C, Stephenson R, et al. A smartphone game-based intervention (Tumaini) to prevent HIV among young Africans: pilot randomized controlled trial. JMIR Mhealth Uhealth. 2018;6:e10482. https://doi.org/10.2196/10482.
Bakibinga P, Kamande E, Kisia L, Omuya M, Matanda DJ, Kyobutungi C. Challenges and prospects for implementation of community health volunteers’ digital health solutions in Kenya: a qualitative study. BMC Health Serv Res. 2020;20:888. https://doi.org/10.1186/s12913-020-05711-7.
The GRADE Working Group. GRADE handbook 01.12.2022. https://gdt.gradepro.org/app/handbook/handbook.html. Accessed 20 Feb 2023.
• Earle S, Marston HR, Hadley R, Banks D. Use of menstruation and fertility app trackers: a scoping review of the evidence. BMJ Sex Reprod Health. 2021;47:90–101. https://doi.org/10.1136/bmjsrh-2019-200488. This literature review identifies three main themes for tracking-apps: (1) fertility and reproductive health tracking, (2) pregnancy planning and (3) pregnancy prevention. Authors point out that there is a lack of engagement in the development, evaluation, usage and regulation of fertility and menstruation apps. Furthermore, a lack of evidence-based research as well as involvement of health professionals and users was also determined.
Ford EA, Peters AE, Roman SD, McLaughlin EA, Beckett EL, Sutherland JM. A scoping review of the information provided by fertility smartphone applications. Hum Fertil (Camb). 2022;25:625–39. https://doi.org/10.1080/14647273.2021.1871784.
•• Jeminiwa RN, Hohmann NS, Fox BI. Developing a theoretical framework for evaluating the quality of mHealth apps for adolescent users: a systematic review. J Pediatr Pharmacol Ther. 2019;24:254–69. https://doi.org/10.5863/1551-6776-24.4.254. The study provides the opportunity to assess digital health applications within the population of adolescents with regard to (a) Technical Quality, (b) Engagement, (c) Support System, (d) Autonomy and (e) Safety, Privacy and Trust.
•• Abdulai A-F, Howard AF, Currie LM. Stigmatizing and de-stigmatizing properties of web apps for sexual health-related conditions: a scoping review. Int J Sex Health. 2022;34:144–59. https://doi.org/10.1080/19317611.2021.1949655. The review shows the potential of mitigating sexual health-related stigma in apps through sharing experiences, receiving emotional support and providing anonymous virtual connections. Authors also highlighted unintentionally worsened stigma by some of the strategies used.
Chandler R, Guillaume D, Parker A, Wells J, Hernandez ND. Developing culturally tailored mHealth tools to address sexual and reproductive health outcomes among Black and Latina women: a systematic review. Health Promot Pract. 2022;23:619–30. https://doi.org/10.1177/15248399211002831.
El Morr C, Layal M. Effectiveness of ICT-based intimate partner violence interventions: a systematic review. BMC Public Health. 2020;20:1372. https://doi.org/10.1186/s12889-020-09408-8.
Karim H, Choobineh H, Kheradbin N, Ravandi MH, Naserpor A, Safdari R. Mobile health applications for improving the sexual health outcomes among adults with chronic diseases: a systematic review. Digit Health. 2020. https://doi.org/10.1177/2055207620906956.
•• Kirkwood EK, Clymer C, Imbulana K, Mozumder S, Dibley MJ, Alam NA. The role of mHealth interventions in changing gender relations: systematic review of qualitative findings. JMIR Hum Factors. 2022;9:e32330. https://doi.org/10.2196/32330. The review focuses on the impact mHealth interventions have on gender relations. The authors discuss positive impacts as well as adverse effects. They also note the need to design interventions that factor in their impact on power dynamics and gender relations.
Stark AL, Geukes C, Dockweiler C. Digital health promotion and prevention in settings: scoping review. J Med Internet Res. 2022;24:e21063. https://doi.org/10.2196/21063.
Yang Q, van Stee SK. The comparative effectiveness of mobile phone interventions in improving health outcomes: meta-analytic review. JMIR Mhealth Uhealth. 2019;7:e11244. https://doi.org/10.2196/11244.
Fowler LR, Gillard C, Morain SR. Readability and accessibility of terms of service and privacy policies for menstruation-tracking smartphone applications. Health Promot Pract. 2020;21:679–83. https://doi.org/10.1177/1524839919899924.
Kalke KM, Ginossar T, Shah SFA, West AJ. Sex ed to go: a content analysis of comprehensive sexual education apps. Health Educ Behav. 2018;45:581–90. https://doi.org/10.1177/1090198117749259.
Johnson S, Stanford JB, Warren G, Bond S, Bench-Capon S, Zinaman MJ. Increased likelihood of pregnancy using an app-connected ovulation test system: a randomized controlled trial. J Womens Health (Larchmt). 2020;29:84–90. https://doi.org/10.1089/jwh.2019.7850.
Sridhar A, Chen A, Forbes ER, Glik D. Mobile application for information on reversible contraception: a randomized controlled trial. Am J Obstet Gynecol. 2015;212(774):e1-7. https://doi.org/10.1016/j.ajog.2015.01.011.
Sullivan PS, Driggers R, Stekler JD, Siegler A, Goldenberg T, McDougal SJ, et al. Usability and acceptability of a mobile comprehensive HIV prevention app for men who have sex with men: a pilot study. JMIR Mhealth Uhealth. 2017;5:e26. https://doi.org/10.2196/mhealth.7199.
Vanya M, Jakó M, Füle G, Fidrich M, Surányi A, Bitó T, Bártfai G. Use of infertility handling among women of reproductive age 2016:181:497–501https://doi.org/10.1007/978-3-319-49655-9_61
Bretschneider RA. A goal- and context-driven approach in mobile period tracking applications. In: Antona M, Stephanidis C, editors. Universal access in human-computer interaction. Access to learning, health and well-being. Cham: Springer International Publishing; 2015. p. 279–287. https://doi.org/10.1007/978-3-319-20684-4_27.
Shopov M, Kakanakova I, Kakanakov N, Mateev B. An mHealth application for female fertility assistance:1–5. https://doi.org/10.23919/SpliTech.2019.8783086.
Dunsmuir DT, Payne BA, Cloete G, Petersen CL, Görges M, Lim J, et al. Development of mHealth applications for pre-eclampsia triage. IEEE J Biomed Health Inform. 2014;18:1857–64. https://doi.org/10.1109/JBHI.2014.2301156.
Nielsen AM, de Costa A, Gemzell-Danielsson K, Marrone G, Boman J, Salazar M, Diwan V. The MOSEXY trial: mobile phone intervention for sexual health in youth-a pragmatic randomised controlled trial to evaluate the effect of a smartphone application on sexual health in youth in Stockholm. Sweden Sex Transm Infect. 2021;97:141–6. https://doi.org/10.1136/sextrans-2019-054027.
Stroux L, Martinez B, Coyote Ixen E, King N, Hall-Clifford R, Rohloff P, Clifford GD. An mHealth monitoring system for traditional birth attendant-led antenatal risk assessment in rural Guatemala. J Med Eng Technol. 2016;40:356–71. https://doi.org/10.1080/03091902.2016.1223196.
Benski AC, Stancanelli G, Scaringella S, Herinainasolo JL, Jinoro J, Vassilakos P, et al. Usability and feasibility of a mobile health system to provide comprehensive antenatal care in low-income countries: PANDA mHealth pilot study in Madagascar. J Telemed Telecare. 2017;23:536–43. https://doi.org/10.1177/1357633X16653540.
Flickinger TE, DeBolt C, Xie A, Kosmacki A, Grabowski M, Waldman AL, et al. Addressing stigma through a virtual community for people living with HIV: a mixed methods study of the positivelinks mobile health intervention. AIDS Behav. 2018;22:3395–406. https://doi.org/10.1007/s10461-018-2174-6.
Velloza J, Ngure K, Kiptinness C, Quame-Amaglo J, Thuo N, Dew K, et al 2019 A clinic-based tablet application to support safer conception among HIV serodiscordant couples in Kenya: feasibility and acceptability study. mHealth 5:4. https://doi.org/10.21037/mhealth.2019.01.04.
Bacchus LJ, Bullock L, Sharps P, Burnett C, Schminkey DL, Buller AM, Campbell J. Infusing technology into perinatal home visitation in the United States for women experiencing intimate partner violence: exploring the interpretive flexibility of an mHealth intervention. J Med Internet Res. 2016;18:e302. https://doi.org/10.2196/jmir.6251.
Shelus V, Ashcroft N, Burgess S, Giuffrida M, Jennings V. Preventing pregnancy in Kenya through distribution and use of the CycleBeads mobile application. Int Perspect Sex Reprod Health. 2017;43:131–41. https://doi.org/10.1363/43e4617.
Haile LT, Fultz HM, Simmons RG, Shelus V Market-testing a smartphone application for family planning: assessing potential of the CycleBeads app in seven countries through digital monitoring. mHealth 2018 4:27. https://doi.org/10.21037/mhealth.2018.06.07.
Li D, Heyer L, Jennings VH, Smith CA, Dunson DB. Personalised estimation of a woman’s most fertile days. Eur J Contracept Reprod Health Care. 2016;21:323–8. https://doi.org/10.1080/13625187.2016.1196485.
Jennings V, Haile LT, Simmons RG, Spieler J, Shattuck D. Perfect- and typical-use effectiveness of the Dot fertility app over 13 cycles: results from a prospective contraceptive effectiveness trial. Eur J Contracept Reprod Health Care. 2019;24:148–53. https://doi.org/10.1080/13625187.2019.1581164.
Sohda S, Suzuki K, Igari I. Relationship between the menstrual cycle and timing of ovulation revealed by new protocols: analysis of data from a self-tracking health app. J MED INTERNET RES. 2017;19:e391. https://doi.org/10.2196/jmir.7468.
Forbes G, Newton S, Cantalapiedra Calvete C, Birch J, Dodds J, Steed L, et al. MEMPHIS: a smartphone app using psychological approaches for women with chronic pelvic pain presenting to gynaecology clinics: a randomised feasibility trial. BMJ Open. 2020;10:e030164. https://doi.org/10.1136/bmjopen-2019-030164.
Berglund Scherwitzl E, Lindén Hirschberg A, Scherwitzl R. Identification and prediction of the fertile window using NaturalCycles. Eur J Contracept Reprod Health Care. 2015;20:403–8. https://doi.org/10.3109/13625187.2014.988210.
Berglund Scherwitzl E, Gemzell Danielsson K, Sellberg JA, Scherwitzl R. Fertility awareness-based mobile application for contraception. Eur J Contracept Reprod Health Care. 2016;21:234–41. https://doi.org/10.3109/13625187.2016.1154143.
Berglund Scherwitzl E, Lundberg O, Kopp Kallner H, Gemzell Danielsson K, Trussell J, Scherwitzl R. Perfect-use and typical-use Pearl Index of a contraceptive mobile app. Contraception. 2017;96:420–5. https://doi.org/10.1016/j.contraception.2017.08.014.
Bull J, Rowland S, Lundberg O, Berglund-Scherwitzl E, Gemzell-Danielsson K, Trussell J, Scherwitzl R. Typical use effectiveness of Natural Cycles: postmarket surveillance study investigating the impact of previous contraceptive choice on the risk of unintended pregnancy. BMJ Open. 2019;9:e026474. https://doi.org/10.1136/bmjopen-2018-026474.
Faust L, Bradley D, Landau E, Noddin K, Farland LV, Baron A, Wolfberg A. Findings from a mobile application-based cohort are consistent with established knowledge of the menstrual cycle, fertile window, and conception. Fertil Steril. 2019;112:450-457.e3. https://doi.org/10.1016/j.fertnstert.2019.05.008.
Entsieh AA, Emmelin M, Pettersson KO. Learning the ABCs of pregnancy and newborn care through mobile technology. Glob Health Action. 2015;8:29340. https://doi.org/10.3402/gha.v8.29340.
Gkatzidou V, Hone K, Sutcliffe L, Gibbs J, Sadiq ST, Szczepura A, et al. User interface design for mobile-based sexual health interventions for young people: design recommendations from a qualitative study on an online Chlamydia clinical care pathway. BMC Med Inform Decis Mak. 2015;15:72. https://doi.org/10.1186/s12911-015-0197-8.
Mesheriakova VV, Tebb KP. Effect of an iPad-based intervention to improve sexual health knowledge and intentions for contraceptive use among adolescent females at school-based health centers. Clin Pediatr (Phila). 2017;56:1227–34. https://doi.org/10.1177/0009922816681135.
Blödt S, Pach D, von Eisenhart-Rothe S, Lotz F, Roll S, Icke K, Witt CM. Effectiveness of app-based self-acupressure for women with menstrual pain compared to usual care: a randomized pragmatic trial. Am J Obstet Gynecol. 2018;218:227.e1-227.e9. https://doi.org/10.1016/j.ajog.2017.11.570.
Decker MR, Wood SN, Hameeduddin Z, Kennedy SR, Perrin N, Tallam C, et al. Safety decision-making and planning mobile app for intimate partner violence prevention and response: randomised controlled trial in Kenya. BMJ Glob Health. 2020. https://doi.org/10.1136/bmjgh-2019-002091.
Manlove J, Cook E, Whitfield B, Johnson M, Martínez-García G, Garrido M. Short-term impacts of pulse: an app-based teen pregnancy prevention program for Black and Latinx women. J Adolesc Health. 2020;66:224–32. https://doi.org/10.1016/j.jadohealth.2019.08.017.
Zhu X, Zhang W, Operario D, Zhao Y, Shi A, Zhang Z, et al. Effects of a mobile health intervention to promote HIV self-testing with MSM in China: a randomized controlled trial. AIDS Behav. 2019;23:3129–39. https://doi.org/10.1007/s10461-019-02452-5.
Messner E-M, Terhorst Y, Barke A, Baumeister H, Stoyanov S, Hides L, et al. The German version of the Mobile App Rating Scale (MARS-G): development and validation study. JMIR Mhealth Uhealth. 2020;8:e14479. https://doi.org/10.2196/14479.
Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile App Rating Scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3:e27. https://doi.org/10.2196/mhealth.3422.
Sorhaindo A, Mitchell K, Fletcher A, Jessiman P, Keogh P, Bonell C. Young women’s lived experience of participating in a positive youth development programme. Health Educ. 2016;116:356–71. https://doi.org/10.1108/HE-01-2015-0002.
Hinson L, Bhatti AM, Sebany M, Bell SO, Steinhaus M, Twose C, Izugbara C. How, when and where? A systematic review on abortion decision making in legally restricted settings in sub-Saharan Africa, Latin America, and the Caribbean. BMC Womens Health. 2022;22:415. https://doi.org/10.1186/s12905-022-01962-0.
Rabiei Z, Shariati M, Mogharabian N, Tahmasebi R, Ghiasi A, Motaghi Z. A review of guidelines, recommendations, and framework of men’s preconception care. Reprod Dev Med. 2022;6:254–9. https://doi.org/10.1097/RD9.0000000000000030.
Shand T, Marcell AV. Engaging men in sexual and reproductive health. In: McQueen DV, editor. Oxford research encyclopedia of global public health. New York: Oxford University Press; 2016. https://doi.org/10.1093/acrefore/9780190632366.013.215.
Singh A, Gibbs J, Estcourt C, Sonnenberg P, Blandford A. Are HIV smartphone apps and online interventions fit for purpose? In: Kostkova P, editor. DH ‘17: International Conference on Digital Health; London United Kingdom. New York, NY: ACM; 2017. p. 6–15. https://doi.org/10.1145/3079452.3079469.
McKee A, Albury K, Burgess J, Light B, Osman K, Walsh A. Locked down apps versus the social media ecology: why do young people and educators disagree on the best delivery platform for digital sexual health entertainment education? New Media Soc. 2018;20:4571–89. https://doi.org/10.1177/1461444818778255.
Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth. 2016;4:e72. https://doi.org/10.2196/mhealth.5849.
Widman L, Evans R, Javidi H, Choukas-Bradley S. Assessment of parent-based interventions for adolescent sexual health: a systematic review and meta-analysis. JAMA Pediatr. 2019;173:866–77. https://doi.org/10.1001/jamapediatrics.2019.2324.
Widman L, Nesi J, Kamke K, Choukas-Bradley S, Stewart JL. Technology-based interventions to reduce sexually transmitted infections and unintended pregnancy among youth. J Adolesc Health. 2018;62:651–60. https://doi.org/10.1016/J.JADOHEALTH.2018.02.007.
Hough A, Bryce M. Exaggerating contraceptive efficacy: the implications of the Advertising Standards Authority action against Natural Cycles. BMJ Sex Reprod Health. 2019;45:71–2. https://doi.org/10.1136/bmjsrh-2018-200209.
Shemtob L, Littlewood R. Case in point: Natural Cycles Facebook advertisement withdrawn. BMJ Sex Reprod Health. 2018;44:316–7. https://doi.org/10.1136/bmjsrh-2018-200225.
Acknowledgements
The authors thank A. Lienert for conducting the second evaluation of the German sexual education apps as well as J. Ramelow and S. Gebreyesus for enhancing the readability of the article.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Human and Animal Rights Statement
This article does not contain any studies with human or animal subjects performed by any of the authors.
Informed Consent
This article does not include individual participants. Therefore, no informed consent is needed.
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Muehlmann, M., Tomczyk, S. Mobile Apps for Sexual and Reproductive Health Education: a Systematic Review and Quality Assessment. Curr Sex Health Rep 15, 77–99 (2023). https://doi.org/10.1007/s11930-023-00359-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11930-023-00359-w