Protocol
- Juan Martínez-Miranda1*, PhD ;
- Martha Janet Meza Magallanes2*, MSc ;
- Cándido Silva-Peña3*, MSc ;
- Martha Xitlali Mercado Rivas4*, PhD ;
- María del Rocío Figueroa-Varela3*, PhD ;
- Magda Lidiana Sánchez Aranda3*, MSc
1Unidad de Transferencia Tecnológica Tepic, Centro de Investigación Científica y de Educación Superior de Ensenada, Tepic, Mexico
2Centro de Atención Primaria en Adicciones, Servicios de Salud de Nayarit, Tepic, Mexico
3Unidad Académica de Ciencias Sociales, Universidad Autónoma de Nayarit, Tepic, Mexico
4Unidad Académica de Medicina, Universidad Autónoma de Nayarit, Tepic, Mexico
*all authors contributed equally
Corresponding Author:
Juan Martínez-Miranda, PhD
Unidad de Transferencia Tecnológica Tepic
Centro de Investigación Científica y de Educación Superior de Ensenada
Andador 10, Ciudad del Conocimiento
Tepic, 63173
Mexico
Phone: 52 3111295939 ext 28602
Email: jmiranda@cicese.mx
Abstract
Background: According to the World Health Organization, approximately 15% of the global population is affected by mental health or substance use disorders. These conditions contribute significantly to the global disease burden, which has worsened because of the direct and indirect effects of COVID-19. In Mexico, a quarter of the population between the ages of 18 and 65 years who reside in urban areas present a mental health condition. The presence of a mental or substance abuse disorder is behind a significant percentage of suicidal behaviors in Mexico, where only 1 in 5 of those who have these disorders receive any treatment.
Objective: This study aims to develop, deploy, and evaluate a computational platform to support the early detection and intervention of mental and substance use disorders in secondary and high schools as well as primary care units. The platform also aims to facilitate monitoring, treatment, and epidemiological surveillance ultimately helping specialized health units at the secondary level of care.
Methods: The development and evaluation of the proposed computational platform will run during 3 stages. In stage 1, the identification of the functional and user requirements and the implementation of the modules to support the screening, follow-up, treatment, and epidemiological surveillance will be performed. In stage 2, the initial deployment of the screening module will be carried out in a set of secondary and high schools, as well as the deployment of the modules to support the follow-up, treatment, and epidemiological surveillance processes in primary and secondary care health units. In parallel, during stage 2, patient applications to support early interventions and continuous monitoring will also be developed. Finally, during stage 3, the deployment of the complete platform will be performed jointly with a quantitative and qualitative evaluation.
Results: The screening process has started, and 6 schools have been currently enrolled. As of February 2023, a total of 1501 students have undergone screening, and the referral of those students presenting a risk in mental health or substance use to primary care units has also started. The development, deployment, and evaluation of all the modules of the proposed platform are expected to be completed by late 2024.
Conclusions: The expected results of this study are to impact a better integration between the different levels of health care, from early detection to follow-up and epidemiological surveillance of mental and substance use disorders contributing to reducing the gap in the attention to these problems in the community.
International Registered Report Identifier (IRRID): DERR1-10.2196/44607
doi:10.2196/44607
Keywords
Introduction
Background
According to the World Health Organization (WHO), health is not merely the absence of a disease, but it is a state of complete physical, mental, and social well-being [Mental health action plan 2013-2020. World Health Organization. 2013. URL: https://apps.who.int/iris/bitstream/handle/10665/89966/9789241506021_eng.pdf [accessed 2023-04-04] 1]. Nevertheless, it is estimated that the number of individuals who have a mental disorder worldwide is approximately 792 million, representing 10.7% of the world population. This percentage is increased to 15% when individuals presenting conditions associated with substance abuse are considered [Ritchie H, Roser M. Mental health. Our World In Data. 2018. URL: https://ourworldindata.org/mental-health [accessed 2023-04-04] 2]. The consequences of mental and substance use disorders are highly negative; in 2010, these disorders constituted 10.4% of the global burden of disease and were the leading cause of years lived with disability among all disease groups [Trautmann S, Rehm J, Wittchen HU. The economic costs of mental disorders: Do our societies react appropriately to the burden of mental disorders? EMBO Rep. Sep 2016;17(9):1245-1249. [FREE Full text] [CrossRef] [Medline]3]. Moreover, these problems have been exacerbated because of the direct and indirect effects of COVID-19 as already evidenced in recent studies [Czeisler ME, Lane RI, Wiley JF, Czeisler CA, Howard ME, Rajaratnam SMW. Follow-up shurvey of US adult reports of mental Health, substance use, and suicidal ideation during the COVID-19 pandemic, September 2020. JAMA Netw Open. Feb 01, 2021;4(2):e2037665. [FREE Full text] [CrossRef] [Medline]4-Czeisler ME, Wiley JF, Facer-Childs ER, Robbins R, Weaver MD, Barger LK, et al. Mental health, substance use, and suicidal ideation during a prolonged COVID-19-related lockdown in a region with low SARS-CoV-2 prevalence. J Psychiatr Res. Aug 2021;140:533-544. [FREE Full text] [CrossRef] [Medline]8]. Mental and substance use disorders also produce high mortality rates. For example, major depression (the most prevalent mental disorder in the world population) is the main cause of the 800,000 suicides committed every year [Depression and other common mental disorders: global health estimates. World Health Organization. 2017. URL: https://apps.who.int/iris/bitstream/handle/10665/254610/WHO-MSD-MER-2017.2-eng.pdf [accessed 2023-04-04] 9]. Other studies estimate 585,000 deaths only in 2017 associated with the addiction of different substances such as hepatitis C, liver cancer, or cirrhosis [World drug report 2021. United Nations Office on Drugs and Crime. 2021. URL: https://www.unodc.org/unodc/en/data-and-analysis/wdr2021.html [accessed 2023-04-04] 10].
Mental health and substance use problems are also present in Mexico. According to the results obtained from the WHO World Mental Health Survey Initiative, one-fourth of Mexican respondents aged 18 to 65 years and residents in urban areas present with a mental health condition [Kessler RC, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ustün TB. The WHO World Mental Health (WMH) Surveys. Psychiatrie (Stuttg). Jan 01, 2009;6(1):5-9. [FREE Full text] [Medline]11]. The most frequent mental disorder was anxiety, followed by other affective disorders such as depression and substance abuse. These results vary according to the sex of the individuals; men reported a more significant number of substance abuse disorders (particularly alcohol) than women. In contrast, women reported more frequent anxiety and affective disorders than men [Borges G, Medina-Mora ME, López-Moreno S. [The role of epidemiology in mental disorder research]. In: Rodríguez J, Kohn R, Aguilar S, editors. Salud Publica Mex. Washington, DC. Organización Panamericana de la Salud; 2004;451-463.12]. Similar to the worldwide statistics, in Mexico, the presence of a mental or substance abuse disorder is strongly associated with suicidal behaviors; about half of people with suicidal ideation (48.8%) and two-thirds (65.2%) of those who have tried it at least once have these types of disorders [Borges G, Nock MK, Medina-Mora ME, Hwang I, Kessler RC. Psychiatric disorders, comorbidity, and suicidality in Mexico. J Affect Disord. 2010;124(1-2):98-107. [FREE Full text] [CrossRef] [Medline]13]. These percentages highlight the importance of detecting and treating these types of disorders, especially considering a growing trend in the suicide rate from 3.5 suicides per 100,000 inhabitants in the year 2000 to 5.2 in 2017, reaching a rate of 9.3 among the young population (20-24 years old), which represent the second cause of death in this population group [Estadísticas a propósito del día mundial para la prevención del suicidio (10 de septiembre). Instituto Nacional de Estadística y Geografía. Comunicado de prensa Núm. 2019. URL: https://www.inegi.org.mx/contenidos/saladeprensa/aproposito/2019/suicidios2019_Nal.pdf [accessed 2023-04-04] 14].
Despite these statistics, mental health care and addiction prevention have been pending issues for public health for years in many countries, and unfortunately, Mexico is not the exception. Although 1 in 4 Mexicans have had a mental disorder at some point in their life, only 1 in 5 of those who have it receive any treatment [Berenzon GS, Saavedra Solano N, Medina-Mora ME, Aparicio Basaurí V, Galván Reyes J. Evaluación del sistema de salud mental en México: ¿hacia dónde encaminar la atención? [Evaluation of the mental health system in Mexico: where is it headed?]. Rev Panam Salud Publica. 2013;33(4):252-582. [FREE Full text] [CrossRef]15]. Recent studies have revealed that the treatment gaps for severe mental disorders, severe to moderate mental disorders, and substance use disorders in Mexico and other countries across the Americas are 77.4%, 78.7%, and 83.7%, respectively. This gap in treatment is even greater in children and adolescents, reaching up to 86% in Mexico [Kohn R, Ali AA, Puac-Polanco V, Figueroa C, López-Soto V, Morgan K, et al. Mental health in the Americas: an overview of the treatment gap. Rev Panam Salud Publica. 2018;42:e165. [FREE Full text] [CrossRef] [Medline]16]. Some of the main causes of the lack of care for people with mental and substance use disorders in Mexico are the low percentage of resources invested; not enough psychiatric hospitalization units in general hospitals as well as specific services for children and adolescents; the lack of evaluation and treatment protocols for this type of disorder in primary care; and the low rate of psychiatrists, doctors, and psychologists per 100,000 inhabitants [Berenzon GS, Saavedra Solano N, Medina-Mora ME, Aparicio Basaurí V, Galván Reyes J. Evaluación del sistema de salud mental en México: ¿hacia dónde encaminar la atención? [Evaluation of the mental health system in Mexico: where is it headed?]. Rev Panam Salud Publica. 2013;33(4):252-582. [FREE Full text] [CrossRef]15].
The Pan American Health Organization has proposed different strategies to reduce the gap in attention to mental health problems and addictions in the region. Some of these strategies include the development of national plans, policies, and laws on mental health; the promotion of mental health and the prevention of psychosocial disorders with an emphasis on children and adolescents; decentralization of outpatient mental health services; the need to develop and expand mental health care in primary care; and the need to strengthen the development of national mental health information systems [Plan of action on mental health 2015-2020. 53rd Directing Council 66th Session of the Regional Commitee of WHO for the Americas. World Health Organization, Pan American Health Organization. 2014. URL: https://www.paho.org/hq/dmdocuments/2015/plan-of-action-on-MH-2014.pdf [accessed 2023-04-04] 17]. For the specific case of Mexico, the gradual increase in health spending for mental health and the restructuring of its distribution mode has also been identified as vitally important. Additional recommended actions are strengthening mental health teaching in medical careers, maintaining continuous training for primary care personnel, and increasing society’s participation in establishing solid links with the health sector [Berenzon GS, Saavedra Solano N, Medina-Mora ME, Aparicio Basaurí V, Galván Reyes J. Evaluación del sistema de salud mental en México: ¿hacia dónde encaminar la atención? [Evaluation of the mental health system in Mexico: where is it headed?]. Rev Panam Salud Publica. 2013;33(4):252-582. [FREE Full text] [CrossRef]15].
Implementing these strategies must have an interinstitutional and multidisciplinary approach allowing for maximum efficiency and does not entirely leave the responsibility to the health sector. In this sense, information and communication technologies are a fundamental tool that would improve the current care model from the phases of detection, early intervention, and continuous monitoring of patients in the community to the creation of information systems for epidemiological surveillance. These computational tools would help in the decision-making and evaluation of the public policies implemented. These digital-based tools would also facilitate a smooth integration between the different levels of health care, offering timely and comprehensive care for people detected with mental health and substance use problems.
One of the main benefits of digital tools for the prevention and treatment of mental and substance use disorders is the increment of access to health care services due to the wide availability of, for example, web-based and mobile apps. Through these apps, adolescents and young adults can be more easily reached and intervened because they are familiar with new technologies or are more technologically literate and mainly involved in using these digital solutions [Lehtimaki S, Martic J, Wahl B, Foster KT, Schwalbe N. Evidence on digital mental health interventions for adolescents and young people: systematic overview. JMIR Ment Health. 2021;8(4):e25847. [CrossRef] [Medline]18]. Examples of these digital solutions and their reported effectiveness can be found in different reviews for both mental health and substance use disorders (see, eg, [Philippe TJ, Sikder N, Jackson A, Koblanski ME, Liow E, Pilarinos A, et al. Digital health interventions for delivery of mental health care: systematic and comprehensive meta-review. JMIR Ment Health. 2022;9(5):e35159. [FREE Full text] [CrossRef] [Medline]19-Tofighi B, Abrantes A, Stein MD. The role of technology-based interventions for substance use disorders in primary care: a review of the literature. Med Clin North Am. 2018;102(4):715-731. [FREE Full text] [CrossRef] [Medline]22]). Moreover, digital platforms also facilitate the screening of substance use disorders and subsequent referral of patients to specialized services [Konkle-Parker D, Williams D, McAfee N, Schumacher JA, Parker J. Low-burden universal substance use screening in a primary care clinic to lower implementation barriers. J Behav Health Serv Res. 2023;50(1):108-118. [FREE Full text] [CrossRef] [Medline]23], expanding and enhancing their treatment [Sweeney MM, Holtyn AF, Stitzer ML, Gastfriend DR. Practical technology for expanding and improving substance use disorder treatment: telehealth, remote monitoring, and digital health interventions. Psychiatr Clin North Am. 2022;45(3):515-528. [CrossRef] [Medline]24], or performing analysis for epidemiological studies and supporting clinical decision-making [Patel R, Wee SN, Ramaswamy R, Thadani S, Tandi J, Garg R, et al. NeuroBlu, an electronic health record (EHR) trusted research environment (TRE) to support mental healthcare analytics with real-world data. BMJ Open. 2022;12(4):e057227. [FREE Full text] [CrossRef] [Medline]25].
Objective
This protocol describes the implementation and evaluation of a computational platform to support the early detection and intervention of mental and substance use disorders at the scholar community level and in primary care units and facilitate monitoring, treatment, and epidemiological surveillance at the second level of care. Three specific objectives lead to the development of the computational platform:
- Facilitate the early detection of symptoms and risk factors associated with mental and substance abuse disorders through a web-based module for the screening of symptoms and risk factors related to mental and substance abuse disorders in the scholar community.
- Support the follow-up process and the surveillance of detected cases through the module to collect, process, and visualize the information of individuals screened and under treatment. Integrating the collected information from the screening, the first contact in primary care, and the treatment and follow-up provided at the secondary care level will optimize the whole care process of individuals with mental health and substance use disorders.
- Support early interventions and the continuous monitoring of patients under treatment. These applications aim to prevent and minimize the appearance of risk behaviors or promote and motivate the change of these behaviors to maintain an adequate state of health.
Consortium
The development and evaluation of this computational platform is a collaborative effort between 4 institutions located in the state of Nayarit, Mexico. The Centre for Scientific Research and Higher Education at Ensenada is a public research center and is the project’s coordinating institution. Moreover, it contributes to the technical development of the computational platform integrating artificial intelligence and human-computer interaction techniques in the different modules of the platform. The Health Services of Nayarit is the local government institution responsible for the health services in Nayarit. The clinical specialists of this institution contribute to defining the screening, intervention, and follow-up processes supported by the computational platform. The specialists of this institution are also involved in the deployment and evaluation of the platform involving the patients at different stages of the detection and follow-up processes. The Public Education Department of Nayarit is the institution that coordinates with the educative institutions in Nayarit. The participants from this institution contribute to facilitating access to the selected secondary and high schools for the early detection process. They will also contribute to evaluating the platform’s impact on the scholar community. The Autonomous University of Nayarit is the fourth participant institution. The researchers of this institution contribute to the definition of the functional and user’s requirements, participate in the detection and follow-up process of students from high schools, and evaluate the platform.
Methods
Modules of the Computational Platform
The achievement of the specific objectives guides the identification of the different functionalities that the computational platform provides to all the users involved: clinicians, teachers, and individuals at risk or detected with mental health and substance use disorders. Three main modules make up the proposed computational platform:
- The module to support the screening of symptoms and risk factors. This module implements a set of standardized and validated instruments to detect individuals at risk. The screening module can be accessed from the scholar community (secondary and high schools) and primary care units. Based on the screening results and when necessary, this module provides personalized suggestions to refer detected individuals to the different services offered by the health sector. Moreover, the personnel responsible for the prevention and early detection processes (clinical specialists and school staff) will be informed about those individuals at risk to continue with the follow-up process.
- The module to facilitate the referral, intervention, treatment, and epidemiological surveillance of the detected cases of mental health and substance use disorders. The specialists will use this module at the primary and secondary care to aid in the management and monitoring of individuals under treatment in both care levels. All the collected information from the detected cases is processed to generate graphical and statistical reports at the aggregated level for epidemiological surveillance purposes.
- The module to support early intervention and continuous monitoring. This component includes the integration of web-based or mobile apps used by patients or individuals at risk. Our research group has experience in developing these types of apps with advanced interaction and artificial intelligence techniques such as embodied conversational agents and serious games (eg, [Martínez-Miranda J, Martínez A, Ramos R, Aguilar H, Jiménez L, Arias H, et al. Assessment of users' acceptability of a mobile-based embodied conversational agent for the prevention and detection of suicidal behaviour. J Med Syst. 2019;43(8):246. [CrossRef] [Medline]26,Espinosa-Curiel IE, Pozas-Bogarin EE, Lozano-Salas JL, Martínez-Miranda J, Delgado-Pérez EE, Estrada-Zamarron LS. Nutritional education and promotion of healthy eating behaviors among Mexican children through video games: design and pilot test of foodRateMaster. JMIR Serious Games. 2020;8(2):e16431. [FREE Full text] [CrossRef] [Medline]27]). Together with clinical specialists of our research consortium, we are assessing the development of the most appropriate strategy according to the characteristics and conditions of the target population.
The visual representation of the components and deployment of the computational platform to be developed is shown in Figure 1. Each of the computational platform modules is accessible by different users according to the phases of detection, intervention, monitoring, and epidemiological surveillance. The screening module can be accessed from any device, and the implemented questionnaires can be answered directly by the individuals to assess with the guidance of a specialist. This process makes it easier to reach a greater number of people and can be applied anywhere: schools, primary care units, or emergency areas of hospitals. Depending on the obtained results, individuals’ referral to primary or secondary health care services is also supported by the platform.
The collected information during the screening process is sent to the primary care units facilitating an early identification of those individuals detected at risk who would require a complementary medical assessment. All these detected individuals are asked to attend the primary care unit. When the person arrives at the primary care unit, the computer platform will facilitate recording the data and the complementary assessment and, if required, referring to the second level of care to receive specialized treatment. The information collected during this process is stored in a central information repository available to all the specialists involved in the care process. Additionally, the analysis and processing of the collected information in an aggregated and anonymized fashion is performed for epidemiological surveillance purposes.
Finally, as part of the computational platform, web- or mobile-based apps are considered to support early intervention or complement psychotherapeutic treatment through continuous monitoring. Examples of these apps are serious games to help in the prevention of alcohol and drug consumption, or an interactive app for the monitoring of, for example, emotional states, behavioral activities, or frequent thoughts would help to assess the evolution of the patient’s condition. The information collected from these apps is integrated into the patient’s electronic file stored in the data repository for subsequent consultation by the specialist. This information has proven helpful for specialists as it makes it easier to get relevant details about a patient’s condition during interconsultation periods.
User-Centered Design
One of the main issues when developing computer-based systems within the health sector is the failure to adopt these solutions as part of the activities within clinical practice. Scientific evidence in the area agrees that technological factors do not cause this problem, but it is caused by the systematic lack of consideration of human and sociotechnical factors from the target users, especially during the design and implementation stages of these solutions [Stumpf SH, Zalunardo RR, Chen RJ. Barriers to telemedicine implementation. Usually it's not technology issues that undermine a project—it's everything else. Healthc Inform. 2002;19(4):45-48. [Medline]28]. The lack of adequate involvement of end users leads to a poor understanding of the functional requirements, suboptimal usability of these systems, and an exacerbated resistance to the change and adoption of these systems. To minimize these risks and maximize the acceptability (and consequently the effective adoption) of the proposed computational platform, we follow a user-centered design methodology, which is widely used in developing software and technological solutions. The most relevant characteristics of this methodology are as follows [Pagliari C. Design and evaluation in eHealth: challenges and implications for an interdisciplinary field. J Med Internet Res. 2007;9(2):e15. [FREE Full text] [CrossRef] [Medline]29]:
- Emphasize the identification of the needs and requirements of end users that the technological product must cover.
- Identify and understand the context in which the technological product will be implemented.
- Design the technological solution based on these real needs of the users and the identified context and not on preconceived ideas of the developers or established and rigid guidelines.
Thanks to the participation of the different institutions in the consortium, the adoption of the user-centered design methodology will be facilitated by involving all the direct and indirect users of the platform: clinical specialists at the different levels of care, personnel from the educational institutions, and people at risk or under treatment of mental health and substance use disorders. All these users collaborate from the beginning of the project and throughout its final deployment and evaluation.
Workplan
The designed workplan for the development of the computational platform considers the 4 work packages (WPs), as illustrated in Figure 2, distributed into 3 annual stages: WP1 identification of the functional and user requirements; WP2 development of the system to support the screening, follow-up, treatment, and epidemiological surveillance; WP3 development of the apps to support early interventions and continuous monitoring of patients; and WP4 deployment and evaluation of the platform.
The activities defined in WP1 are focused on identifying functional requirements for every module of the computational platform. Examples of these requirements include the selection of all the standardized and validated—in the Mexican population—instruments used in the screening process. Depending on the characteristics of the individuals (eg, the age) to screen, the system will show the adequate set of instruments (eg, the Problem-Oriented Screening Instrument for Teenagers [POSIT] [del Carmen Marino M, González-Forteza C, Andrade P, Medina-Mora ME. Validación de un cuestionario para detectar adolescentes con problemas por el uso de drogas. Salud Mental. 1998;21(1):27-36.30]) that the specialist selects to detect the type of mental health or substance use problem. This WP1 also define the data to collect from each screened person, the recommendations provided according to the screening results, and the process to facilitate the follow-up and treatment of the individuals detected at risk in the subsequent attention at primary and secondary health units.
Other activities in this WP1 include the identification of the user and functional requirements for the development of the apps to support early interventions and continuous monitoring. Different focus groups with the target users will be considered to identify the specific objectives of these apps. Examples of these apps are to support (universal or particular) prevention of substance use through a gamified app for teenagers or an app for the remote and continuous monitoring of individuals with a mental health disorder (eg, depression and anxiety) based on cognitive behavioral therapy contents. Moreover, in this WP1, the selection of the scholar community forming the study sample for the screening process is performed. The schools’ selection follows a set of agreed criteria (eg, geographical location, the quantity of student population, number of cases previously detected, or students’ sociodemographic characteristics). Sensibilization sessions will be carried out with the personnel of the selected schools to inform them about the characteristics and objectives of the project.
WP2 and WP3 contain all the activities for the design and development of the different modules of the computational platform. The design, development, and testing process are iterative and follow the user-centered design methodology. Based on the information identified in WP1, each module is designed for the collection and processing of the data at different stages of the health care process: screening, intervention, treatment, monitoring, and epidemiological surveillance. Focus groups with different types of users have been considered since the first iterative design process. The result of these 2 WPs is the integration of the different modules forming the computational platform ready for its deployment and use in the selected educative institutions and health units.
The last WP4 includes all the activities required for the deployment, use, and evaluation of the computational platform. The deployment is planned to be gradual along the project's final year in the selected schools and health units. Training sessions will be carried out with the personnel of all the institutions where the platform is deployed. All technical issues that could emerge during the platform use are collected for the functional improvement of each module. Moreover, the collected information from the use of the platform will be processed for usability, acceptability, and impact evaluation in the health care process. Activities for the diffusion and dissemination of the project and the obtained results are also included in this WP4.
Recruitment
The study participants from whom information will be collected in the computational platform are of two types:
- Participants in the scholar community (secondary and high schools) will be screened using a set of validated and standardized questionnaires to detect symptoms and risk factors associated with mental or substance abuse disorders.
- People attending a health unit because of the presence of a mental or substance abuse problem. These participants can be 12 years and older and of both sexes. Personal data and relevant information related to the follow-up process will be recorded, for example, reference data between the different levels of health units, personal data, and notes of diagnostic evolution that will form their electronic clinical file.
For the screening process in the scholar community, the participants are the students (males and females aged 12-18 years) of the selected schools for the study sample. In coordination with the school personnel in each school, the health professionals select the specific groups for the screening. Explicit informed consent is asked from each student and their parents or legal guardians. Then, the screening instrument (the POSIT questionnaire) is applied to all the students who provide their explicit authorization. The teacher or the health specialist provides the instructions to respond to the questionnaire and is available to answer any questions during the process. The screening session is expected to last around 45 minutes for each group.
For the people who attend primary care units to receive medical attention, the doctor who receives them will inform them that the screening is part of the diagnostic assessment process. If the patient is a minor, an explicit authorization to carry out the screening process must be provided by the minor and by the accompanying adult. The duration of the session will be the time of the medical visit that the specialist decides.
In both groups, depending on the obtained results provided by the computational platform, health personnel identify those individuals who require a follow-up intervention delivered by a specialist and are referred to the corresponding health care unit.
The recruitment of participants who will use the apps to support early intervention and continuous monitoring will be carried out by the specialist responsible for their treatment. In the case of minors, explicit authorization from their parents or guardians will be asked before the provision of the application. In all the cases, the following exclusion criteria are considered:
- A diagnosis of schizophrenia, psychosis, or borderline personality disorder
- Not having a digital device to execute the app
- Any disability that makes the individual unable to use a digital app
- Requirement to be under personal surveillance due to current symptoms associated with a mental health or substance use disorder.
Data Collection
The collected data from all the participants include personal and sociodemographic data such as age and sex. For participants of secondary and high schools, the answers to each of the POSIT’s questions and the final score are also collected. For the individuals recruited in primary care units, the results obtained from different instruments to assess their condition (eg, the Alcohol, Smoking, and Substance Involvement Screening Test questionnaire [Newcombe DA, Humeniuk RE, Ali R. Validation of the World Health Organization alcohol, smoking and substance involvement screening test (ASSIST): report of results from the Australian site. Drug Alcohol Rev. 2005;24(3):217-226. [CrossRef] [Medline]31], a suicide risk measure [Plutchik R, van Praag HM, Conte HR, Picard S. Correlates of suicide and violence risk 1: the suicide risk measure. Compr Psychiatry. 1989;30(4):296-302. [CrossRef] [Medline]32], or the Hamilton Anxiety Rating Scale [Hamilton M. The assessment of anxiety states by rating. Br J Med Psychol. 1959;32(1):50-55. [CrossRef] [Medline]33]) are also collected. The epidemiological surveillance module uses the final scores and the corresponding interpretation of these instruments to visualize the type of risks or disorders detected in schools and health care units. Moreover, all the information produced during the follow-up process is also collected to support the specialists with the whole treatment of the individuals who require the services of a secondary level of care. The data generated during the use of the web- or mobile-based apps by the participants are also collected, and the information is used for a continuous patient evolution monitoring. These data include, for example, the current mood, frequent—rational or irrational—thoughts, or the planning and development of specific activities.
Storage and Security of the Information
The data collected at schools and health units will be sent via the internet, using a secure data transfer protocol (https) to a central information repository. All data will be textual, and no multimedia files such as photographs and audio or video recordings are included. The data repository is located in the central offices of the Health Services of Nayarit, with the appropriate access and security protocols and the necessary data backup processes. The collected data are accessed through a username and encrypted password through the developed computer platform. The access depends on the user’s role; the personnel who analyze the screening results have access to consult the data that allow the person screened to be located and recommend the appropriate follow-up. The specialists responsible for clinical treatment have access to all the information collected in the electronic health record created for each patient. Finally, the users of the epidemiological surveillance module have access to the aggregated and anonymized data to know the incidence and prevalence of the different mental and substance use disorders registered in the computer platform.
Evaluation
According to the WHO, the evaluation of a digital health intervention involves the measures taken and analysis performed to assess two main issues: (1) the interaction of users or a health system with the digital health intervention strategy or (2) the changes attributable to the digital health intervention [Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment. World Health Organization. 2016. URL: https://apps.who.int/iris/handle/10665/252183 [accessed 2023-04-04] 34]. The assessment of the interaction between the platform and the target users will be performed through a mixed methods approach [Creswell JW. Research Design: Qualitative, Quantitative and Mixed Methods Approaches. 4th ed. Thousand Oaks, CA. Sage Publications; 2014. 35] with an explanatory design study using validated and standardized questionnaires to get information about the usability, acceptability, and perceived usefulness from the users of the different modules of the platform: health specialists, teachers and personnel of the educational institutions, and individuals at risk or patients. Existent validated instruments will be applied to a representative set of users after the deployment and use of each module. Qualitative information will be gathered throughout focus groups with a Logical Framework Approach.
For all web-based modules, the System Usability Scale and the Technology Acceptance Module will be provided to the users to rate the platform modules’ usability, acceptance, and ease of use. The System Usability Scale consists of a 10-item questionnaire with 5 response options for respondents: from strongly agree to strongly disagree. This instrument allows evaluating a wide variety of products and services, including web-based health apps [Tanbeer SK, Sykes ER. MyHealthPortal—a web-based e-Healthcare web portal for out-of-hospital patient care. Digit Health. 2021;7:2055207621989194. [FREE Full text] [CrossRef] [Medline]36,Day NJB, Carranza KALR, Lin LMS, Ponce AR, Reyes WRO, Bugtai NT, et al. Design of a web-based and electronic health record management system for medical teleconsultation. 2018. Presented at: International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM); 2018;1-5; Baguio City, Philippines. [CrossRef]37]. The Technology Acceptance Module measures the constructs of perceived usefulness, ease of use, and user acceptance of the technological product in the participant’s workflow by explaining the user’s “behavioral intention” with the system. This instrument is based on the theory of reasoned action [Hale JL, Householder BJ, Greene KL. The theory of reasoned action. In: Dillard JP, Pfau M, editors. The Persuasion Handbook: Developments in Theory and Practice. Thousand Oaks, CA. Sage Publications; 2002;259-286.38], a psychological approach that seeks to explain behavior, and has also been widely applied in eHealth systems [Kataria P, Dang G, Kaur D, Singh P, Gupta VP. TAM model for e-health implementation in rural areas of Uttarakhand, post covid-19 pandemic. Asia Pac J Health Manag. 2021;16(3):67-74. [CrossRef]39]. If any of the platform modules is deployed through a mobile device (eg, the apps for early intervention and continuous monitoring of patients in the community), a complementary instrument such as the Mobile App Rating Scale will be used to evaluate these modules. The Mobile App Rating Scale is a simple, objective, and reliable tool for classifying and assessing the quality of mobile health apps [Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3(1):e27. [FREE Full text] [CrossRef] [Medline]40].
The changes in the health care process attributable to the platform will be assessed through a quantitative study by comparing the population coverage achieved with the computational platform in relation to current and historical data. Moreover, a Logical Framework Approach will be adopted to identify individual, social, and contextual factors affecting the mental and substance use health care process at primary and secondary levels. This approach has previously used to identify relevant factors and characteristics in different health care processes such as emergency care [Buttigieg SC, Dey PK, Cassar MR. Combined quality function deployment and logical framework analysis to improve quality of emergency care in Malta. Int J Health Care Qual Assur. 2016;29(2):123-140. [CrossRef] [Medline]41], hospital-based health care services [Dey PK, Hariharan S, Brookes N. Managing healthcare quality using logical framework analysis. Manag Serv Qual. 2006;16(2):203-222. [CrossRef]42], or rural health missions [Kumar R. Impact of National Health Mission of India on infant and maternal mortality: a logical framework analysis. J Health Manag. 2021;23(1):155-165. [CrossRef]43]. The Logical Framework Approach will be implemented through focus group sessions involving specialists and asking to identify the main problems (barriers) and solutions (facilitators) each participant faces during the different stages of the health care process. These sessions will be carried out before the platform’s implementation and then after its deployment and use by the different specialists and patients or individuals at risk. The collected information from these sessions will allow the identification of specific problems that could be minimized or removed due to the different functionalities of the platform. The detected changes will help to assess the impact of the digital intervention along the process: from the early detection in the scholar community to the follow-up and treatment of individuals with mental health and substance use disorders in primary and secondary health units.
The evaluation results will be disseminated among the community and public health policy makers, emphasizing the platform advantages of adopting it as part of a public health program. Moreover, these results will lead to the identification of lessons learned during the deployment and use of the platform providing valuable recommendations to maximize the benefits for the attention of mental health and substance use disorders in other regional and national health systems.
Ethics Approval
The study has obtained research ethics approval from the institutional review board of the Health Services of Nayarit (CEBN/04/2020). Participation will be voluntary, and informed written consent or digital consent will be obtained from participants and from parents of those participants younger than 18 years. The participants will be informed about the confidentiality of their answers to the applied questionnaires. All identifiable information will not be accessible, except for the clinicians who will provide formal care services to the participants. Participants’ data will not be identifiable in any publication or report. No monetary compensation will be offered to the participants.
Results
The project has been running since July 2021 and is intended to complete in June 2024. An initial version of the modules to support the screening and follow-up treatment processes has been developed, and the initial deployment and testing of these modules in a school sample of 10 secondary schools and 10 high schools located in the city of Tepic has started during the second semester of 2022. Currently, 6 schools have used the screening module implementing the POSIT questionnaire, and as of February 2023, a total of 1501 students have undergone screening. The referral of those students presenting a risk in mental health or substance use to primary care units has also started. The second stage includes the development of the interactive apps to support early intervention and continuous monitoring and the epidemiological surveillance module. The use and evaluation of the complete platform are the main activities for the final year of the project, and the obtained results will be disseminated between the research community, health specialists, and the general public.
Discussion
Principal Findings
This protocol describes the development and evaluation of a computational platform to support the detection, intervention, treatment, and epidemiological surveillance of mental health and substance use disorders in the community and primary and secondary health units. Three main modules form the computational platform: (1) a module to support the screening of symptoms and risk factors; (2) a module to facilitate the referral, intervention, treatment, and epidemiological surveillance of the detected cases; and (3) interactive apps to support and complement the provision of early intervention and continuous monitoring. Some modules of the platform are currently under development, and their complete deployment and evaluation are expected at the end of 2024.
It is expected that the proposed platform will contribute to a better integration of the involved institutions, professionals, and processes in the attention to mental health and substance use disorders. The early detection of risks in the scholar community will contribute to a timely referral to formal health services, minimizing the future chronicity of these disorders and the subsequent associated problems, including suicides. The functionalities of the computational platform to support the follow-up and monitoring of patients under formal treatment, as well as the generation of epidemiological information on the incidence and prevalence of these disorders, will help to perform qualitative and quantitative analyses to target better public policies and strategies implemented as responses to this problem, as well as their evaluation.
Limitations
This study has some limitations that require consideration. First, the recruitment of participants aged 13 to 17 years is restricted to those attending secondary and high schools. In Mexico, there are a significant number of individuals within this age range who are not in school and are at high risk of substance use. Second, the platform will only be used by clinicians belonging to the public health services of Nayarit. However, there are various public health systems in Mexico, even within the same city or region, and individuals identified with risk factors or symptoms will be referred to the corresponding institution where they receive their health services. Therefore, individuals referred to health units outside of the public health services of Nayarit will not be followed up or treated with the platform. It is expected that positive results, such as a better integration between the different levels of care, from early detection to follow-up and epidemiological surveillance, will encourage the adoption of the platform by other public health systems.
Conclusions
Digital-based solutions designed to support health care processes have the potential to increase the accessibility of the general population to health services, mainly due to the wide availability of, for example, web-based and mobile apps. This is particularly important for mental health and substance use disorders, where treatment gaps reach percentages above 75% in Mexico. The development, deployment, and evaluation of the computational platform proposed in this study have the potential to contribute to the reduction of this treatment gap by improving the integration and exchange of information between the different specialists and health care units involved in the different processes of attention: from the early detection of these health problems in the community to the analysis and visualization of the identified cases with epidemiological surveillance objectives.
Acknowledgments
This work has been funded by the Mexican “Consejo Nacional de Ciencia y Tecnología—CONACyT” under the research program “PRONACE-Salud,” with project 3210 and title “Desarrollo y evaluación de una plataforma tecnológica de ayuda a la detección, seguimiento e intervención temprana de problemas de salud mental y adicciones en la comunidad escolar, primer y segundo nivel de atención.”
Data Availability
Data are not publicly available but can be obtained via contacting the corresponding author.
Conflicts of Interest
None declared.
References
- Mental health action plan 2013-2020. World Health Organization. 2013. URL: https://apps.who.int/iris/bitstream/handle/10665/89966/9789241506021_eng.pdf [accessed 2023-04-04]
- Ritchie H, Roser M. Mental health. Our World In Data. 2018. URL: https://ourworldindata.org/mental-health [accessed 2023-04-04]
- Trautmann S, Rehm J, Wittchen HU. The economic costs of mental disorders: Do our societies react appropriately to the burden of mental disorders? EMBO Rep. Sep 2016;17(9):1245-1249. [FREE Full text] [CrossRef] [Medline]
- Czeisler ME, Lane RI, Wiley JF, Czeisler CA, Howard ME, Rajaratnam SMW. Follow-up shurvey of US adult reports of mental Health, substance use, and suicidal ideation during the COVID-19 pandemic, September 2020. JAMA Netw Open. Feb 01, 2021;4(2):e2037665. [FREE Full text] [CrossRef] [Medline]
- Ettman CK, Abdalla SM, Cohen GH, Sampson L, Vivier PM, Galea S. Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic. JAMA Netw Open. Sep 01, 2020;3(9):e2019686. [FREE Full text] [CrossRef] [Medline]
- Pierce M, Hope H, Ford T, Hatch S, Hotopf M, John A, et al. Mental health before and during the COVID-19 pandemic: a longitudinal probability sample survey of the UK population. Lancet Psychiatry. 2020;7(10):883-892. [FREE Full text] [CrossRef] [Medline]
- Pollard MS, Tucker JS, Green HD. Changes in adult alcohol use and consequences during the COVID-19 pandemic in the US. JAMA Netw Open. 2020;3(9):e2022942. [FREE Full text] [CrossRef] [Medline]
- Czeisler ME, Wiley JF, Facer-Childs ER, Robbins R, Weaver MD, Barger LK, et al. Mental health, substance use, and suicidal ideation during a prolonged COVID-19-related lockdown in a region with low SARS-CoV-2 prevalence. J Psychiatr Res. Aug 2021;140:533-544. [FREE Full text] [CrossRef] [Medline]
- Depression and other common mental disorders: global health estimates. World Health Organization. 2017. URL: https://apps.who.int/iris/bitstream/handle/10665/254610/WHO-MSD-MER-2017.2-eng.pdf [accessed 2023-04-04]
- World drug report 2021. United Nations Office on Drugs and Crime. 2021. URL: https://www.unodc.org/unodc/en/data-and-analysis/wdr2021.html [accessed 2023-04-04]
- Kessler RC, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ustün TB. The WHO World Mental Health (WMH) Surveys. Psychiatrie (Stuttg). Jan 01, 2009;6(1):5-9. [FREE Full text] [Medline]
- Borges G, Medina-Mora ME, López-Moreno S. [The role of epidemiology in mental disorder research]. In: Rodríguez J, Kohn R, Aguilar S, editors. Salud Publica Mex. Washington, DC. Organización Panamericana de la Salud; 2004;451-463.
- Borges G, Nock MK, Medina-Mora ME, Hwang I, Kessler RC. Psychiatric disorders, comorbidity, and suicidality in Mexico. J Affect Disord. 2010;124(1-2):98-107. [FREE Full text] [CrossRef] [Medline]
- Estadísticas a propósito del día mundial para la prevención del suicidio (10 de septiembre). Instituto Nacional de Estadística y Geografía. Comunicado de prensa Núm. 2019. URL: https://www.inegi.org.mx/contenidos/saladeprensa/aproposito/2019/suicidios2019_Nal.pdf [accessed 2023-04-04]
- Berenzon GS, Saavedra Solano N, Medina-Mora ME, Aparicio Basaurí V, Galván Reyes J. Evaluación del sistema de salud mental en México: ¿hacia dónde encaminar la atención? [Evaluation of the mental health system in Mexico: where is it headed?]. Rev Panam Salud Publica. 2013;33(4):252-582. [FREE Full text] [CrossRef]
- Kohn R, Ali AA, Puac-Polanco V, Figueroa C, López-Soto V, Morgan K, et al. Mental health in the Americas: an overview of the treatment gap. Rev Panam Salud Publica. 2018;42:e165. [FREE Full text] [CrossRef] [Medline]
- Plan of action on mental health 2015-2020. 53rd Directing Council 66th Session of the Regional Commitee of WHO for the Americas. World Health Organization, Pan American Health Organization. 2014. URL: https://www.paho.org/hq/dmdocuments/2015/plan-of-action-on-MH-2014.pdf [accessed 2023-04-04]
- Lehtimaki S, Martic J, Wahl B, Foster KT, Schwalbe N. Evidence on digital mental health interventions for adolescents and young people: systematic overview. JMIR Ment Health. 2021;8(4):e25847. [CrossRef] [Medline]
- Philippe TJ, Sikder N, Jackson A, Koblanski ME, Liow E, Pilarinos A, et al. Digital health interventions for delivery of mental health care: systematic and comprehensive meta-review. JMIR Ment Health. 2022;9(5):e35159. [FREE Full text] [CrossRef] [Medline]
- Eilert N, Wogan R, Leen A, Richards D. Internet-delivered interventions for depression and anxiety symptoms in children and young people: systematic review and meta-analysis. JMIR Pediatr Parent. 2022;5(2):e33551. [FREE Full text] [CrossRef] [Medline]
- Steinkamp JM, Goldblatt N, Borodovsky JT, LaVertu A, Kronish IM, Marsch LA, et al. Technological interventions for medication adherence in adult mental health and substance use disorders: a systematic review. JMIR Ment Health. 2019;6(3):e12493. [CrossRef] [Medline]
- Tofighi B, Abrantes A, Stein MD. The role of technology-based interventions for substance use disorders in primary care: a review of the literature. Med Clin North Am. 2018;102(4):715-731. [FREE Full text] [CrossRef] [Medline]
- Konkle-Parker D, Williams D, McAfee N, Schumacher JA, Parker J. Low-burden universal substance use screening in a primary care clinic to lower implementation barriers. J Behav Health Serv Res. 2023;50(1):108-118. [FREE Full text] [CrossRef] [Medline]
- Sweeney MM, Holtyn AF, Stitzer ML, Gastfriend DR. Practical technology for expanding and improving substance use disorder treatment: telehealth, remote monitoring, and digital health interventions. Psychiatr Clin North Am. 2022;45(3):515-528. [CrossRef] [Medline]
- Patel R, Wee SN, Ramaswamy R, Thadani S, Tandi J, Garg R, et al. NeuroBlu, an electronic health record (EHR) trusted research environment (TRE) to support mental healthcare analytics with real-world data. BMJ Open. 2022;12(4):e057227. [FREE Full text] [CrossRef] [Medline]
- Martínez-Miranda J, Martínez A, Ramos R, Aguilar H, Jiménez L, Arias H, et al. Assessment of users' acceptability of a mobile-based embodied conversational agent for the prevention and detection of suicidal behaviour. J Med Syst. 2019;43(8):246. [CrossRef] [Medline]
- Espinosa-Curiel IE, Pozas-Bogarin EE, Lozano-Salas JL, Martínez-Miranda J, Delgado-Pérez EE, Estrada-Zamarron LS. Nutritional education and promotion of healthy eating behaviors among Mexican children through video games: design and pilot test of foodRateMaster. JMIR Serious Games. 2020;8(2):e16431. [FREE Full text] [CrossRef] [Medline]
- Stumpf SH, Zalunardo RR, Chen RJ. Barriers to telemedicine implementation. Usually it's not technology issues that undermine a project—it's everything else. Healthc Inform. 2002;19(4):45-48. [Medline]
- Pagliari C. Design and evaluation in eHealth: challenges and implications for an interdisciplinary field. J Med Internet Res. 2007;9(2):e15. [FREE Full text] [CrossRef] [Medline]
- del Carmen Marino M, González-Forteza C, Andrade P, Medina-Mora ME. Validación de un cuestionario para detectar adolescentes con problemas por el uso de drogas. Salud Mental. 1998;21(1):27-36.
- Newcombe DA, Humeniuk RE, Ali R. Validation of the World Health Organization alcohol, smoking and substance involvement screening test (ASSIST): report of results from the Australian site. Drug Alcohol Rev. 2005;24(3):217-226. [CrossRef] [Medline]
- Plutchik R, van Praag HM, Conte HR, Picard S. Correlates of suicide and violence risk 1: the suicide risk measure. Compr Psychiatry. 1989;30(4):296-302. [CrossRef] [Medline]
- Hamilton M. The assessment of anxiety states by rating. Br J Med Psychol. 1959;32(1):50-55. [CrossRef] [Medline]
- Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment. World Health Organization. 2016. URL: https://apps.who.int/iris/handle/10665/252183 [accessed 2023-04-04]
- Creswell JW. Research Design: Qualitative, Quantitative and Mixed Methods Approaches. 4th ed. Thousand Oaks, CA. Sage Publications; 2014.
- Tanbeer SK, Sykes ER. MyHealthPortal—a web-based e-Healthcare web portal for out-of-hospital patient care. Digit Health. 2021;7:2055207621989194. [FREE Full text] [CrossRef] [Medline]
- Day NJB, Carranza KALR, Lin LMS, Ponce AR, Reyes WRO, Bugtai NT, et al. Design of a web-based and electronic health record management system for medical teleconsultation. 2018. Presented at: International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM); 2018;1-5; Baguio City, Philippines. [CrossRef]
- Hale JL, Householder BJ, Greene KL. The theory of reasoned action. In: Dillard JP, Pfau M, editors. The Persuasion Handbook: Developments in Theory and Practice. Thousand Oaks, CA. Sage Publications; 2002;259-286.
- Kataria P, Dang G, Kaur D, Singh P, Gupta VP. TAM model for e-health implementation in rural areas of Uttarakhand, post covid-19 pandemic. Asia Pac J Health Manag. 2021;16(3):67-74. [CrossRef]
- Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3(1):e27. [FREE Full text] [CrossRef] [Medline]
- Buttigieg SC, Dey PK, Cassar MR. Combined quality function deployment and logical framework analysis to improve quality of emergency care in Malta. Int J Health Care Qual Assur. 2016;29(2):123-140. [CrossRef] [Medline]
- Dey PK, Hariharan S, Brookes N. Managing healthcare quality using logical framework analysis. Manag Serv Qual. 2006;16(2):203-222. [CrossRef]
- Kumar R. Impact of National Health Mission of India on infant and maternal mortality: a logical framework analysis. J Health Manag. 2021;23(1):155-165. [CrossRef]
Abbreviations
POSIT: Problem-Oriented Screening Instrument for Teenagers |
WHO: World Health Organization |
WP: work package |
Edited by A Mavragani; submitted 25.11.22; peer-reviewed by K Gliske, J Ford Ii; comments to author 02.03.23; revised version received 18.03.23; accepted 23.03.23; published 25.04.23.
Copyright©Juan Martínez-Miranda, Martha Janet Meza Magallanes, Cándido Silva-Peña, Martha Xitlali Mercado Rivas, María del Rocío Figueroa-Varela, Magda Lidiana Sánchez Aranda. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 25.04.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.