Background: The use of mobile health (mHealth) apps is increasing rapidly worldwide. More and more institutions and organizations develop regulations and guidelines to enable an evidence-based and safe use. In Germany, mHealth apps fulfilling predefined criteria (Digitale Gesundheitsanwendungen [DiGA]) can be prescribed and are reimbursable by the German statutory health insurance scheme. Due to the increasing distribution of DiGA, problems and barriers should receive special attention.
Objective: This study aims to identify the relevant problems and barriers related to the use of mHealth apps fulfilling the criteria of DiGA.
Methods: This scoping review will follow published methodological frameworks and the PRISMA-Scr (Preferred Reporting Items for Systematic Reviews and Meta-analyses Extension for Scoping Reviews) criteria. Electronic databases (MEDLINE, EMBASE, PsycINFO, and JMIR), reference lists of relevant articles, and grey literature sources will be searched. Two reviewers will assess the eligibility of the articles by a two-stage (title and abstract as well as full text) screening process. Only problems and barriers related to mHealth apps fulfilling the criteria of DiGA are included for this research. The identified studies will be categorized and analyzed with MAXQDA.
Results: This scoping review gives an overview of the available evidence and identifies research gaps regarding problems and barriers related to DiGA. The results are planned to be submitted to an indexed, peer-reviewed journal in the first quarter of 2022.
Conclusions: This is the first review to identify the problems and barriers related to the use of mHealth apps fulfilling the German definition of DiGA. Nevertheless, the findings can be applied to other contexts and health care systems as well.
International Registered Report Identifier (IRRID): DERR1-10.2196/32702
The use of mobile health (mHealth) apps becomes more and more ubiquitous. Health care systems worldwide establish different regulatory frameworks to integrate them into care. mHealth apps are used for many different purposes. For example, app-based vital signs monitoring can serve for (primary) prevention , medical adherence apps can lead to more regular medication intake [ ], and other apps support coping with chronic diseases such as diabetes [ - ] or mental health problems [ , ].
According to the World Health Organization, digital health solutions can contribute to higher standards of health and better access to health care services. The use of digital health allows people worldwide to promote and protect their health and well-being . While opportunities and possibilities are considered certain, the problems and barriers related to the use of mHealth apps often remain unaddressed.
Realizing the potential benefits of digitalization, the national Parliament of the Federal Republic of Germany (Deutscher Bundestag) introduced “the Act to Improve Healthcare Provision through Digitalization and Innovation (Digital Healthcare Act – DVG)” in 2019 . One of the main innovations is the possibility to prescribe predefined mHealth apps, called Digitale Gesundheitsanwendungen (DiGA). These prescribed apps are reimbursable for 73 million people insured under the German statutory health insurance scheme.
Focusing on the following requirements, this text applies the term “Digital Health Application” (DHA) to describe mHealth apps that meet the criteria for DiGA.
In Germany, mHealth apps must fulfill a predefined list of criteria to be regarded as a DiGA . These criteria are as follows: (1) medical device of a risk class lower or equal to IIa; (2) the main function of the app is based on digital technology; (3) the DHA is not only a medium to collect data from a device or to control a device. The app must have a proper main digital function achieving a medical purpose; (4) recognition, monitoring, treatment or alleviation of diseases, or the recognition, treatment or alleviation or compensation of injuries are supported by the DiGA; (5) the purpose of the app is not for primary prevention; and (6) the app is used either by the patient or by the health care provider together with the patient. Therefore, apps only used by health care providers are not assessed as DiGA. DiGA can be considered as “digital assistants” in the hands of patients.
Currently, there are 28 certified DHAs listed in the German DiGA registry, covering a range of indications including mental illnesses such as depression, anxiety disorder, or addiction, as well as physical illnesses such as arthrosis, multiple sclerosis, and diabetes mellitus.
The German DiGA concept is unique, though other countries are considering launching a similar concept. In particular, France has announced to adopt the German system. Therefore, the German system might serve as a blueprint for other countries regarding the integration of DHA in their health care systems.
Reviews on the evidence of problems and barriers related to the use of DHA are sparse. While O’Connor et al  identified and synthesized the qualitative literature on barriers and facilitators to engagement and recruitment to digital health interventions [ ], Kao and Liebovitz [ ] present the current state, barriers, and future directions of consumer mHealth apps. Besides the broad reviews mentioned before, there is a qualitative study by Stiles-Shields et al [ ] investigating the barriers to the use of apps for depression. Finally, Meyerowitz-Katz [ ] investigated the rates of attrition and dropout in app-based interventions for chronic disease. In their review and meta-analysis, they rather focused on dropout rates in apps for chronic disease than reasons for dropping out.
Ahmad et al  planned a scoping review to capture current problems and opportunities in the adoption of mobile apps among older adults. Contrary to this scoping review, our review does not exclude younger users.
The only review focusing specifically on DiGA is part of the German Advisory Council on the Assessment of Developments in the Health Care System report . It focusses on evidence but not on barriers or problems in the context of DiGA.
Considering this research gap, the planned scoping review aims to analyze the following research question: “which problems and barriers related to the use of mHealth apps comparable to the German DiGA concept are addressed in studies?”
The scoping review is part of a wider research project (continuous quality assurance of DHA [QuaSiApps]) funded by the Federal Joint Committee (G-BA) .
The scoping review will be conducted according to the framework with the 5 (mandatory) stages described by Arksey and O’Malley  in 2005 and further developed by Levac et al [ ] in 2010. These stages are as follows: (1) identifying the research question, (2) identifying relevant studies, (3) study selection, (4) charting the data and collating, and (5) summarizing and reporting the results. Following these stages will guarantee a systematic and coherent proceeding. The subsequent preparation of the manuscript will follow the PRISMA-Scr (Preferred Reporting Items for Systematic Reviews and Meta-analyses Extension for Scoping Reviews) by Tricco et al [ ]. The protocol was not registered.
Stage I: Identifying the Research Question
The research question, “Which problems and barriers related to the use of mHealth apps comparable to the German DiGA concept are addressed in studies?” was posed. This scoping review will provide a structured overview for further research and inform stakeholders. Furthermore, it serves as one module of our research project, QuaSiApps.
Stage II: Identifying Relevant Studies
The search strategy is predefined according to the Joanna Briggs Institute Manual for Evidence Synthesis . After an initial explorative research and subsequent team discussion, terms and keywords were determined and used to conduct the main search across the included databases (EMBASE, MEDLINE, PsycINFO, and JMIR). Afterward, the reference lists of included studies will be screened, and referenced articles assessed according to the predefined inclusion and exclusion criteria. If they are appropriate, they will be included in the scoping review.
The search was performed following Methodology, Issues, Participants (MIP)  scheme including methodology (all methodologies), issues (problems and barriers related to the use of DHA), and participants (focus on patients and health care providers).
Electronic databases EMBASE, MEDLINE, and PsycINFO were searched on June 8, 2021. The used search terms were combined in the following manner: (”difficulty“ OR ”obstacle“ OR ”problem“ OR ”issue“ OR ”challenge“ OR ”barrier“) AND (”web application“ OR ”mobile application“ OR ”mHealth“ OR ”virtual care“ OR ”healthcare app“ OR ”health care app“ OR ”mobile health“ OR ”health app“) OR (”smartphone“ OR ”mobile phone“ OR ”android“ OR ”iphone“ OR ”browser“ AND ”health“) AND (”healthcare“ OR ”health care“).
The respective search terms were restricted to the occurrence in abstract, title, or keyword but expanded by indexing terms (Medical Subject Headings [MeSH] and Emtree). The complete search strategy can be found in- . Due to the thematic focus of JMIR, we added a structured search using the search function as well as relevant themes.
Searching the two databases EMBASE and MEDLINE and carrying out structured research in JMIR provide points of view of many different disciplines, which was deemed necessary in order to depict the multidisciplinary field of mHealth apps. In addition, PsycINFO was searched because a large proportion of certified DiGA in Germany stems from the field of mental illnesses.
Language was restricted to English, German, and French. The research was limited to articles published between January 1, 2015, and June 8, 2021. Further explanation for time restriction is given in the discussion of this protocol.
Apart from the online database research, gray literature sources such as the Federal Institute for Drugs and Medical Devices reports, guidelines, working papers, and industry reports will be searched via institutional websites and Google search engine ().
Stage III: Study Selection and Eligibility Criteria
In the first step, the identified citations were uploaded in the literature management program Endnote X9 (Clarivate Analytics), and duplicates were removed. In the second step, 2 reviewers (GG and CS) will decide whether an article is eligible for full-text screening by independently assessing the title and abstract. In a third step, the full-text screening of the included articles and assessment against the exclusion criteria will be conducted by the same 2 reviewers. In this third step, the reasons for excluding studies will also be captured.
Disagreement between the 2 reviewers during the screening process will be resolved through discussion. If necessary, a third person (SN) will resolve emerging conflicts. In case of missing data, the reviewers will contact the authors of the included papers.
To handle the vast magnitude of mHealth apps and to balance between breadth and feasibility, we defined exclusion criteria, which we adjusted in the initial search process. Our final inclusion and exclusion criteria are listed in.
Inclusion and exclusion criteria.
- Articles mentioning problems and barriers related to the use of mobile health apps
- A problem term mentioned in the abstract or title was related to the use of mobile health apps
- Publication with focus on mobile health apps
- Examined mobile health apps fulfill the requirements set for Digital Health Application (Digitale Gesundheitsanwendungen)
- Article published in 2015 or afterward
- Language: English, German, or French
- Not valid to answer the research question
- The problem term mentioned in the abstract or title was not related to mobile health apps
- Publication does not focus on mobile health apps.
- Examined mobile health apps fulfill one or more of the following criteria:
- Not used by the patient
- No relation to illness, injury, or handicap
- Primary prevention
- The medical purpose is not achieved through the main digital functions
- Research protocol or conference abstract
- Article published before 2015
- Language other than English, German, or French
Stage IV: Charting the Data
The remaining publications will be included in the scoping review. Relevant information and data such as authors, year, country, study type underlying diseases, and especially problems and barriers related to DHA will be extracted ().
|Author||Year||Study type||Country||Underlying disease||Problems|
Stage V: Collating, Summarizing, and Reporting Results
Following the recommendations by Levac et al , the fifth stage is divided in the following three distinct steps: (1) analyzing research findings (including descriptive numerical summary analysis and qualitative thematic analysis); (2) evaluating the research findings and extracting an outcome that is in accordance with the research question (the results are reported in a narrative way); and (3) interpreting and discussing the findings with regard to further research questions, practice, and policy.
Besides the narrative reporting, tables and figures will ensure a structured overview about the key findings. The PRISMA-Scr  serves to guarantee a systematic reporting of the results.
A coherent search strategy to identify articles focusing on problems and barriers related to the use of DHA and DiGA was developed. The results of our investigation will be presented and published in a systematic scoping review. Therefore, the process of publication selection will be presented using flowcharts, and the extracted data of our research will be systematized in tables and described in a narrative summary.
Data synthesis will not follow the existing themes. Problems and barriers related to the use of DiGA will be grouped in categories defined by the authors. If a problem does not fit to a defined group of problems, a new group will be created. Subsequently, the results and parent categories of problems aim to answer the research question, “Which problems and barriers related to the use of mHealth apps comparable to the German DiGA concept are addressed in studies?”
There is a multitude of mHealth apps in nearly every domain of medicine. The opportunities and possibilities of mHealth apps are often discussed, whereas the research on related problems and barriers remain scarce. This scoping review will fulfill two reasons for conducting scoping reviews according to Arksey and O’Malley . First, it summarizes and disseminates research findings to policy makers, practitioners, and consumers. Second, it allows researchers and other stakeholder to identify research gaps in the existing literature.
Our scoping review has some limitations, which cannot be prevented due to resource limitation. The research is restricted to articles published after the year 2015. Evidence gained before the time restriction is only captured if it is incorporated in newer publications. Two facts made the year 2015 a reasonable starting point for the scoping review. On the one hand, previous reviews show that older investigations in the context of mHealth cover mainly text messaging interventions . This was found, for example, for the effectiveness of mHealth interventions focused on health care workers to improve pregnancy outcomes in low- and middle-income countries [ ] or the use of mHealth in antenatal and postpartum care and vaccination administration [ ]. Text messaging apps do not provide the criteria to be considered as a DiGA. On the other hand, in 2015, Stoyanov et al [ ] published the Mobile App Rating Scale (MARS). The MARS is the first tool to assess app quality, which is in direct conjunction with DHA problems.
Further limitations arise from the rather new and rapid advancing technology of mHealth, which also hamper a systematic search. Moreover, the terminology in the field of mHealth apps is not consistent. Even in the most known publications (eg, Mobile “App” Rating Scale  and Mobile “Application” Rating Scale [ ]), there is no consistency in terminology. While some institutions such as the German Federal Institute for Drugs and Medical Devices use the term “(Digital Health-) Application,” a consensus paper recommends the use of “app” instead of “application” [ ]. When constructing our search strategy, different terms were pilot tested, and results were compared. In addition, the inclusion of related terms ensures a broad coverage of the topic.
Nevertheless, there still is uncertainty whether all relevant search terms might be covered. This uncertainty also applies to the selection of databases. Medline, Embase, and PsychINFO, the most important databases for classical medical and psychological therapies and devices, are covered. However, these might not cover all relevant journals in the rapidly evolving field of mHealth, and we addressed these limitations by conducting a structured search through JMIR.
A further limitation is made due to the context of the scoping review. The scoping review is one module of the larger research project, QuaSiApps, which aims to develop a generic quality assurance system. Therefore, we could not restrict the research to specific diseases. In order to guarantee research specific to our study and exclude lifestyle, wellness, and fitness apps, we restricted our search to health care.
Exclusion criteria ensured that publications were only included if problems related to mHealth apps were mentioned in the title or the abstract. Other publications describing mHealth apps could include problems or barriers as a secondary aspect. Nevertheless, publications with problems as a central subject are covered.
This scoping review will be the first that provides an overview about potential problems and barriers related to the use of DHA according to the German definition of DiGA. The research findings of this and a further scoping review about the quality of DHA will serve as a first module for the development of a continuous quality assurance concept . In the next step, we will use the research findings to develop a discussion guide to conduct focus groups with users and potential users of DHA.
This research is part of a wider research project (continuous quality assurance of DHA [QuaSiApps]) funded by the German Federal Joint Committee (G-BA) (funding code: 01VSF20007 – QuaSiApps). We acknowledge support by the Open Access Publication Fund of the University of Duisburg-Essen.
Conflicts of Interest
Search strategy; Medline via Embase.DOCX File , 18 KB
Search strategy; Medline via Ovid.DOCX File , 18 KB
Search strategy; PsycINFO via Ovid.DOCX File , 18 KB
Sources of gray literature.DOCX File , 15 KB
- Giebel GD, Gissel C. Accuracy of mHealth Devices for Atrial Fibrillation Screening: Systematic Review. JMIR Mhealth Uhealth 2019 Jun 16;7(6):e13641 [FREE Full text] [CrossRef] [Medline]
- Ahmed I, Ahmad NS, Ali S, Ali S, George A, Saleem Danish H, et al. Medication Adherence Apps: Review and Content Analysis. JMIR Mhealth Uhealth 2018 Mar 16;6(3):e62 [FREE Full text] [CrossRef] [Medline]
- Wu Y, Yao X, Vespasiani G, Nicolucci A, Dong Y, Kwong J, et al. Mobile App-Based Interventions to Support Diabetes Self-Management: A Systematic Review of Randomized Controlled Trials to Identify Functions Associated with Glycemic Efficacy. JMIR Mhealth Uhealth 2017 Mar 14;5(3):e35 [FREE Full text] [CrossRef] [Medline]
- Hou C, Xu Q, Diao S, Hewitt J, Li J, Carter B. Mobile phone applications and self-management of diabetes: A systematic review with meta-analysis, meta-regression of 21 randomized trials and GRADE. Diabetes Obes Metab 2018 Aug;20(8):2009-2013. [CrossRef] [Medline]
- Wu X, Guo X, Zhang Z. The Efficacy of Mobile Phone Apps for Lifestyle Modification in Diabetes: Systematic Review and Meta-Analysis. JMIR Mhealth Uhealth 2019 Jan 15;7(1):e12297 [FREE Full text] [CrossRef] [Medline]
- Batra S, Baker RA, Wang T, Forma F, DiBiasi F, Peters-Strickland T. Digital health technology for use in patients with serious mental illness: a systematic review of the literature. Med Devices (Auckl) 2017;10:237-251 [FREE Full text] [CrossRef] [Medline]
- Linardon J, Cuijpers P, Carlbring P, Messer M, Fuller-Tyszkiewicz M. The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials. World Psychiatry 2019 Oct;18(3):325-336 [FREE Full text] [CrossRef] [Medline]
- Digital health. World Health Organization. URL: https://www.who.int/health-topics/digital-health#tab=tab_1 [accessed 2021-11-19]
- Digital Healthcare Act (DVG). Federal Ministry of Health. URL: https://www.bundesgesundheitsministerium.de/digital-healthcare-act.html [accessed 2021-08-13]
- The Fast-Track Process for Digital Health Applications (DiGA) according to Section 139e SGB V: A Guide for Manufacturers, Service Providers and Users. Federal Institute for Drugs and Medical Devices. 2020. URL: https://www.bfarm.de/SharedDocs/Downloads/EN/MedicalDevices/DiGA_Guide.pdf?__blob=publicationFile&v=2 [accessed 2021-08-13]
- O'Connor S, Hanlon P, O'Donnell CA, Garcia S, Glanville J, Mair FS. Understanding factors affecting patient and public engagement and recruitment to digital health interventions: a systematic review of qualitative studies. BMC Med Inform Decis Mak 2016 Sep 15;16(1):120 [FREE Full text] [CrossRef] [Medline]
- Kao C, Liebovitz DM. Consumer Mobile Health Apps: Current State, Barriers, and Future Directions. PM R 2017 May;9(5S):S106-S115. [CrossRef] [Medline]
- Stiles-Shields C, Montague E, Lattie EG, Kwasny MJ, Mohr DC. What might get in the way: Barriers to the use of apps for depression. Digit Health 2017;3:2055207617713827 [FREE Full text] [CrossRef] [Medline]
- Meyerowitz-Katz G, Ravi S, Arnolda L, Feng X, Maberly G, Astell-Burt T. Rates of Attrition and Dropout in App-Based Interventions for Chronic Disease: Systematic Review and Meta-Analysis. J Med Internet Res 2020 Sep 29;22(9):e20283 [FREE Full text] [CrossRef] [Medline]
- Ahmad NA, Mat Ludin AF, Shahar S, Mohd Noah SA, Mohd Tohit N. Willingness, perceived barriers and motivators in adopting mobile applications for health-related interventions among older adults: a scoping review protocol. BMJ Open 2020 Mar 16;10(3):e033870 [FREE Full text] [CrossRef] [Medline]
- Ziele und Rahmenbedingungen eines dynamisch lernenden Gesundheitssystems. Gutachten 2021. URL: https://www.svr-gesundheit.de/fileadmin/Gutachten/Gutachten_2021/SVR_Gutachten_2021.pdf [accessed 2021-08-13]
- QuaSiApps- Fortlaufende Qualitätssicherung von in der GKV-Regelversorgung eingesetzten Gesundheits-Apps. Gemeinsamer Bundesausschus Innovationsausschus. URL: https://innovationsfonds.g-ba.de/projekte/versorgungsforschung/quasiapps-fortlaufende-qualitaetssicherung-von-in-der-gkv-regelversorgung-eingesetzten-gesundheits-apps.387 [accessed 2021-08-13]
- Arksey H, O'Malley L. Scoping studies: towards a methodological framework. International Journal of Social Research Methodology 2005 Feb;8(1):19-32. [CrossRef]
- Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci 2010 Sep 20;5:69 [FREE Full text] [CrossRef] [Medline]
- Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med 2018 Oct 02;169(7):467-473 [FREE Full text] [CrossRef] [Medline]
- Aromataris E. Welcome to the JBI Manual for Evidence Synthesis. JBI Manual for Evidence Synthesis. URL: https://synthesismanual.jbi.global [accessed 2021-08-13]
- Strech D, Synofzik M, Marckmann G. Systematic reviews of empirical bioethics. J Med Ethics 2008 Jun;34(6):472-477. [CrossRef] [Medline]
- Haddad SM, Souza RT, Cecatti JG. Mobile technology in health (mHealth) and antenatal care-Searching for apps and available solutions: A systematic review. Int J Med Inform 2019 Jul;127:1-8. [CrossRef] [Medline]
- Amoakoh-Coleman M, Borgstein AB, Sondaal SF, Grobbee DE, Miltenburg AS, Verwijs M, et al. Effectiveness of mHealth Interventions Targeting Health Care Workers to Improve Pregnancy Outcomes in Low- and Middle-Income Countries: A Systematic Review. J Med Internet Res 2016 Aug 19;18(8):e226 [FREE Full text] [CrossRef] [Medline]
- Watterson JL, Walsh J, Madeka I. Using mHealth to Improve Usage of Antenatal Care, Postnatal Care, and Immunization: A Systematic Review of the Literature. Biomed Res Int 2015;2015:153402-153409 [FREE Full text] [CrossRef] [Medline]
- Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015 Mar 11;3(1):e27 [FREE Full text] [CrossRef] [Medline]
- Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth 2016 Jun 10;4(2):e72 [FREE Full text] [CrossRef] [Medline]
- Lewis TL, Boissaud-Cooke MA, Aungst TD, Eysenbach G. Consensus on use of the term "App" versus "Application" for reporting of mHealth research. J Med Internet Res 2014 Jul 17;16(7):e174; discussion e174 [FREE Full text] [CrossRef] [Medline]
- Fortlaufende Qualitätssicherung von in der GKV-Regelversorgung eingesetzten Gesundheits-Apps. QuaSiApps. URL: https://www.uni-due.de/quasiapps/startseite.php [accessed 2022-03-17]
|DHA: Digital Health Application|
|DiGA: Digitale Gesundheitsanwendungen|
|MeSH: Medical Subject Headings|
|mHealth: mobile health|
|MIP: Methodology, Issues, Participants|
|PRISMA-Scr: Preferred Reporting Items for Systematic Reviews and Meta-analyses Extension for Scoping Reviews|
|QuaSiApps: continuous quality assurance of DHA|
Edited by T Leung; submitted 06.08.21; peer-reviewed by T Ntalindwa, AF Mat Ludin; comments to author 25.09.21; revised version received 19.11.21; accepted 19.01.22; published 21.04.22Copyright
©Godwin Denk Giebel, Christian Speckemeier, Carina Abels, Kirstin Börchers, Jürgen Wasem, Nikola Blase, Silke Neusser. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 21.04.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.