Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, December 24 through Wednesday, December 26 inclusive. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 23.04.18 in Vol 7, No 4 (2018): April

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/8810, first published Oct 12, 2017.

This paper is in the following e-collection/theme issue:

    Protocol

    Cultural and Contextual Adaptation of an eHealth Intervention for Youth Receiving Services for First-Episode Psychosis: Adaptation Framework and Protocol for Horyzons-Canada Phase 1

    1School of Rehabilitation, Faculty of Medicine, University of Montreal, Montreal, QC, Canada

    2Health Innovation and Evaluation Hub, University of Montreal Hospital Research Center, Montreal, QC, Canada

    3Douglas Mental Health University Institute, Montreal, QC, Canada

    4School of Psychology, Australian Catholic University, Fitzroy, Australia

    5Department of Psychiatry, McGill University, Montreal, QC, Canada

    6Chatham-Kent Health Alliance, Chatham-Kent, ON, Canada

    7Centre for Youth Mental Health, The University of Melbourne, Melbourne, Australia

    8Orygen, The National Centre of Excellence in Youth Mental Health, Parkville, Australia

    Corresponding Author:

    Shalini Lal, BScOT, MSc, PhD

    School of Rehabilitation

    Faculty of Medicine

    University of Montreal

    CP 6128

    succ. Centre-ville

    Montreal, QC, H3C 3J7

    Canada

    Phone: 1 514 890 8000 ext 31676

    Email:


    ABSTRACT

    Background: eHealth interventions have the potential to address challenges related to access, service engagement, and continuity of care in the delivery of mental health services. However, the initial development and evaluation of such interventions can require substantive amounts of financial and human resource investments to bring them to scale. Therefore, it may be warranted to pay greater attention to policy, services, and research with respect to eHealth platforms that have the potential to be adapted for use across settings. Yet, limited attention has been placed on the methods and processes for adapting eHealth interventions to improve their applicability across cultural, geographical, and contextual boundaries.

    Objective: In this paper, we describe an adaptation framework and protocol to adapt an eHealth intervention designed to promote recovery and prevent relapses in youth receiving specialized services for first-episode psychosis. The Web-based platform, called Horyzons, was initially developed and tested in Australia and is now being prepared for evaluation in Canada.

    Methods: Service users and service providers from 2 specialized early intervention programs for first-episode psychosis located in different provinces will explore a beta-version of the eHealth intervention through focus group discussions and extended personal explorations to identify the need for, and content of contextual and cultural adaptations. An iterative consultation process will then take place with service providers and users to develop and assess platform adaptations in preparation for a pilot study with a live version of the platform.

    Results: Data collection was completed in August 2017, and analysis and adaptation are in process. The first results of the study will be submitted for publication in 2018 and will provide preliminary insights into the acceptability of the Web-based platform (eg, perceived use and perceived usefulness) from service provider and service user perspectives. The project will also provide knowledge about the adaptations and process needed to prepare the platform for evaluation in Canada.

    Conclusions: This study contributes to an important gap in the literature pertaining to the specific principles, methods, and steps involved in adapting eHealth interventions for implementation and evaluation across a diverse range of cultural, geographical, and health care settings.

    JMIR Res Protoc 2018;7(4):e100

    doi:10.2196/resprot.8810

    KEYWORDS

    Crowdfunding campaign to support this specific research

    We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.

    keyboard with crowdfunding key instead of enter key

    Suggested contribution levels: $20/$50/$100



    Introduction

    Background

    eHealth interventions have the potential to address challenges related to access, service engagement, and continuity of care in the delivery of mental health services [1,2]. However, the initial development and evaluation of such interventions can require substantive amounts of financial and human resource investments to bring them to a level of scale. It is therefore important to consider alternative avenues to advance the practice of eHealth in a global context. One possibility for health system planners and service providers is leveraging the existing eHealth interventions that have been developed and tested in one country or jurisdiction and adapting these interventions for use in different communities and settings. This would reduce duplication of efforts at a global scale in terms of spending public, industry, and philanthropic resources to produce seemingly novel services and products that have already been developed elsewhere. It would also be in alignment with how health care innovations have traditionally been scaled up. However, more attention on how best to transport promising eHealth innovations across geographical, cultural, and contextual boundaries is warranted.

    There are two general approaches to transporting eHealth interventions from one context to another: adoption and adaptation [3]. Adoption refers to a direct transport of the intervention by the developer or importation by the new context without systematically or extensively considering how the innovation fits with the needs and characteristics of the local service context, culture, and population. Adaptation involves making changes to the intervention to increase its fit with the local population and setting in which it is to be newly implemented and tested for its efficacy and effectiveness. It involves, for example, consideration of language, culture, and context [4,5]. Building on the definition of intervention adaptation from Sundell et al [3] and cultural adaptation from Bernal et al [4] and Castro et al [5], we define eHealth adaptation as the systematic, purposeful, and collaborative process of making changes to increase the relevance and acceptability of an eHealth innovation to a local population and health care setting and ultimately increase its effectiveness.

    Thus, the purpose of adapting an intervention is to ensure that it is meaningful and satisfactory for a population that is different from the population for which the intervention was originally developed [6]. It has been suggested that acceptability of an intervention may influence the extent to which individuals engage with and participate in an intervention, which can ultimately affect its effectiveness [5]. Moreover, engaging in an adaptation process could help increase ownership of the intervention by the local setting and improve its sustainability especially if conducted using a collaborative and shared decision-making process [3,7]. Interventions that are matched in terms of linguistic, educational, and developmental needs of a population, and that have content that is perceived as interesting, useful, and relevant to a population’s everyday life may elicit higher levels of engagement, and ultimately contribute to effectiveness [3].

    In fact, recent systematic reviews indicate that the effectiveness of mental health–related interventions (in-person or Web-based) developed in one context and evaluated in another, are influenced by whether the intervention was adapted before the implementation [3,6,8,9]. In other words, those studies that involved cultural and contextual adaptations of interventions yielded larger effect sizes when compared with interventions that were not adapted for the same clientele group; however, it is important to note that these results have not been consistent across studies. As such, scholars have argued for more research to determine the effect of adaptations when transferring interventions across populations, settings, and countries [3,5]. This can help in determining whether the benefits of adaptation are worth the costs [5] and also to begin identifying what types of adaptations contribute the most toward outcomes.

    Part of the challenge in reviewing the effectiveness of intervention adaptation is that there is limited consensus on the methods and processes for adapting an intervention. This is particularly the case for the eHealth field as many of the adaptation frameworks that have been developed were originally meant for face-to-face interventions. For example, Harper Shehadeh et al [6] highlight that some of the elements proposed in the cultural adaptation framework documented by Bernal and colleagues [4] may not be applicable in minimally guided interventions (including those delivered online). The cultural adaptation framework documented by Bernal and colleagues is widely cited in the psychosocial intervention literature pertaining to cultural adaptation. A second challenge in this field is limited documentation on adaptations undertaken by researchers when transporting or importing innovations from one context to another. For example, 2 recent systematic and meta-analytic reviews [3,6] on the adaptation of mental health interventions, including those delivered online, found few studies reporting details on the methods and processes of adaptation. This type of information is needed to inform the interpretation of findings as well as implementation and scale-up [6]. The lack of documentation on adaptations undertaken may in part be due to the dearth of guidance on the methods, processes, and impact of adapting eHealth interventions when implementing them across populations, settings, and countries.

    In summary, more information and research attention are needed on the steps involved in transporting or importing interventions from one context to another, as well as the influence of adaptation on acceptability and outcomes. Toward this end, we report on an eHealth adaptation research framework and protocol for a Web-based intervention developed in Australia, Horyzons, in preparation for a pilot implementation study in Canada.

    Description of the Intervention

    Horyzons is a Web-based therapeutic platform designed to sustain the treatment benefits of specialized services for psychosis especially in relation to relapse prevention and social functioning through the provision of psychosocial interventions during transitions from specialized to regular mental health care. Horyzons was originally developed in Australia by coauthors (A2, A7), an interdisciplinary team of experts (professional writers, clinical psychologists, comic developers, artists, experts in computer science and human computer interaction), and codeveloped with young people who have received specialized services for a first-episode psychosis (FEP). The team worked iteratively over a 30-month period following participatory design principles, positive psychology, evidence-based interventions (eg, mindfulness), and strengths-based models [10,11]. The Web-based portal consists of interactive strengths-based psychosocial interventions, peer-to-peer Web-based social networking, as well as clinical and peer moderation to provide guidance and ensure safety. The moderation approach of the intervention is informed by self-determination theory and supportive accountability to enhance engagement with the Web-based intervention and motivation in social and psychological functioning [12,13]. It has been tested on a sample of 20 young Australian adults for its feasibility, acceptability, utility, and safety [10,14]. Further details on the Horyzons platform and its core features are provided in Textbox 1 and illustrated in Multimedia Appendices 1 and 2.

    Our aim is to create an adapted version of Horyzons that is tailored for a Canadian young adult population. It could be argued that cultural, language, and contextual differences between Westernized countries such as Australia and Canada are minimal as, for instance, both countries have publicly funded health care and a high proportion of cultural and ethnic diversity. However, there are differences in relation to how mental health services are implemented at the front-line, which may influence implementation of the intervention. Moreover, Canada has a history of both French and British colonization whereas Australian colonial history is British, which highlights the importance of attending to communication practices and related linguistic considerations in the context of transporting or importing an eHealth intervention.

    The adaptation of the Horyzons platform is the first step in a multiphased, international research program.


    Textbox 1. Overview of the Horyzons system.
    View this box

    Specifically, the aim of this phase I study is to assess the initial acceptability of the platform by analyzing perspectives of Canadian young adults receiving specialized services for FEP and service providers on the Horyzons platform (eg, in relation to perceived usefulness and ease of use), and to adapt the platform in preparation for evaluation. The results will then inform the design for phase II, a pilot test of the adapted platform with a small sample of mental health service users. Subsequently, these results will support detailed planning for controlled evaluations of the intervention (eg, randomized controlled trial).

    Conceptual Framework

    To inform and guide the adaptation, we conducted a literature review on research pertaining to adapting interventions across cultural and contextual settings. We identified several models on the adaptation process developed across a range of different fields (eg, psychology, education); for example, in relation to psychotherapy and evidence-based health interventions [4,15-23]. We also identified frameworks evaluating Web-based tools [24,25], implementation research models (eg, Revised Ottawa Model of Research Use) [26], and technology and innovation models (eg, technology acceptance model) [27]. Some of the key elements drawn from this review are summarized in the sections below followed by a presentation of the eHealth adaptation framework that will be used in this study.

    According to Castro et al [5], there are 3 broad elements that need to be considered when adapting interventions: characteristics of the population that will receive the intervention; the staff that would be involved in delivering the intervention; and other administrative, contextual, and community factors. Where there are mismatches between aspects of the current intervention with these 3 elements, adaptations should be considered. Moreover, several models suggest a staged process for adaptation that incorporates qualitative and quantitative data over the course of a series of steps leading to changes in an intervention [5,15,16]. A synthesis of these models suggests the following steps that are important to consider in the adaptation process: (1) assess and generate knowledge from target population, program implementers, and stakeholders; (2) determine the need to adopt or adapt the intervention; (3) identify elements to adapt, respect core elements of the original intervention, pilot-test adaptations with target population, program implementers, and stakeholders; (4) integrate adaptations into the intervention; (5) conduct a formal evaluation of the adapted intervention (eg, pilot study); (6) refine the intervention if necessary; and (7) conduct efficacy, effectiveness, and implementation trials.

    In terms of specific elements to assess, the Ecological Validity Model from Bernal et al [4] suggests culturally sensitive elements, such as language, concepts, and content, to address during the adaptation process, whereas the Framework for Evaluating the Quality of Multimedia Learning Resources [24] and the Mobile Assessment Rating Scale [25] identify several items that help evaluate users’ experiences of a Web-based platform, for example, motivation, aesthetics, accessibility, interaction, quality and credibility of information, and usability. The Revised Ottawa Model of Research Use [26] highlights the importance of considering barriers and supports, including the adaptors, the practice environment, and implementation strategies. Finally, the technology acceptance model suggests that the perceived ease of use and perceived usefulness of an information technology will influence users’ acceptance of a technology [27].

    Moreover, before engaging in an adaptation of an eHealth intervention, it is important to clarify the therapeutic intervention principles upon which it is based, including what the intervention aims to achieve and how it achieves it [28]. For example, Horyzons is based on supportive accountability principles that highlight that human support (ie, social presence of an individual online that is seen as trustworthy and having expertise, such as a clinician moderator) increases motivation to engage in the intervention, which is important for clinical outcomes [13]. Thus, to maintain internal validity of an eHealth intervention, adaptations would not focus on the core principles (eg, supportive accountability through clinician moderation) but rather on content and features of the platform to enhance its usability, interactivity, relevance to a local population and context, and alignment with current technologies.

    These aforementioned principles and models were used to develop our research framework, which is organized into the following 3 objectives and stages: (1) to assess initial perspectives of service users and providers of the eHealth intervention (without any modifications) following a brief overview and interaction with the website, (2) to assess perspectives of the eHealth intervention after an extended exploration, and (3) to adapt the eHealth intervention based on feedback from key stakeholder groups (while respecting its core therapeutic elements and principles, and considering feasibility of adaptations in terms of resources available). The second objective is important as it provides an opportunity for participants to explore the platform in the community at their own pace and more extensively, which could help elicit additional perspectives pertinent for adaptation. Further details on the eHealth adaptation framework in terms of methods and processes are provided in Table 1. All stages of the study seek to better understand participant perspectives of all 4 components of the platform. We anticipate that most of the adaptations that will be recommended will be in relation to the therapeutic modules; however, this remains to be assessed based on the results of the study.

    Table 1. eHealth adaptation framework. ICT: information and communication technology; N/A: not applicable.
    View this table

    Methods

    Participants and Setting

    This research will take place in 2 specialized early intervention clinics for FEP, 1 urban and 1 semirural, located in different provinces. Both programs provide a comprehensive range of services for young people diagnosed with FEP and follow best practice guidelines for real-world settings [29,30]. Service users and providers from both sites will take part in the study. Eligibility criteria for service users are as follows: diagnosed with a psychotic disorder, within their first 3 years of treatment and currently followed by a clinician, considered to be symptomatically stable and capable of participating in focus groups as judged by their primary treating clinician, and 18 years of age and older. Eligible service providers include psychiatrists, case managers, or other health care professionals with a minimum of 2 years of experience working in the field of specialized early intervention for FEP and regularly involved in delivering services to youth with FEP. We aim to recruit a minimum of 11 service providers (6 urban and 5 rural) and 11 service users (6 urban and 5 rural).

    Ethics approval has been obtained from the ethics review board of the primary recruitment site and from the ethics review board of the secondary site. All participants will provide written, informed consent before participating in the study.

    The same data collection activities will be conducted at both sites and with both groups separately on a beta-version of the eHealth intervention: sociodemographic and technology use questionnaire, focus group discussions with written feedback forms, and extended explorations of the platform with written feedback forms.

    Stage 1: Assessing Initial Perspectives and Experiences of the eHealth Intervention

    To address the first objective, service users and providers will respond to a survey and take part in focus group sessions. In addition to collecting sociodemographic information, the survey will assess participants’ access, experiences, and attitudes on their use of information and communication technology (ICT) as well as their use of ICT in relation to obtaining mental health information, services, and supports. The focus group sessions with service users and providers will take place separately in a computer lab with approximately 4 to 5 participants per session and will last approximately 90 min. Each participant will be assigned to their own computer station (or laptop) and logged into the platform as an individual user with a personalized access code. The focus groups will be led by 2 facilitators and will include a brief tutorial on the core features of the intervention, for instance, the persuasive system, the social networking features, the role of moderators, the main content areas, and the core therapeutic principles. The facilitator will also describe how the platform is envisioned to be implemented in the future pilot study and a subsequent randomized controlled trial. The aim of this first step is 2-fold: first, to help participants understand the intention and functioning of the platform as well as the overall vision for its future implementation before considering local and contextual adaptations; and second, to provide participants with a general understanding of how the website is organized to facilitate their subsequent individual explorations of the website. Next, participants will individually explore the platform at their workstations and provide feedback on the following: general impressions (likes, dislikes, questions, comments); usefulness, safety and support; design, layout, and navigations; ease of use; and suggestions for modifications and adaptations (Canadian context and language). Patient participants will receive $25 CAD, and clinician participants will be offered lunch for their participation in this component of the study.

    Stage 2: Assessing Perspectives and Experiences of the eHealth Intervention After an Extended Exploration

    At the end of the focus group session, service providers and service users will be invited to individually explore a beta version of the eHealth intervention for a maximum of 120 min over a 2- to 4-week period from a personal computer. Each participant will be given personal log-in information (username and password) to access the platform providing them with the opportunity to continue their exploration of the platform’s therapeutic content and activities. Participants will be given either an email or electronic copy of a feedback form with detailed instructions and questions to capture their impressions and suggestions for modifications and adaptations. Patient participants will receive $50 CAD for their participation in this component of the study.

    Data obtained during stages 1 and 2 of the research will provide insights on whether the platform and its aims as a whole are understandable and whether participants would be interested in using the platform as a complement to the services they receive. The qualitative data from the focus groups will be recorded and transcribed verbatim, and the written feedback responses (from the focus groups and extended explorations) will be organized into tables. The data will be managed using Atlas.ti (Scientific Software Development GmbH, Version 7.5.6), and a coding framework will be developed based on the interview guide and a thematic analysis approach. The quantitative data will be assessed using descriptive statistics. In line with the convergent mixed-methods model, the quantitative and qualitative data will first be analyzed separately and then considered for an integrated analysis of the findings [31].

    Stage 3: Adapting the eHealth Intervention

    The adaptations identified in stages 1 and 2 will be considered in relation to the feasibility of making the adaptations as well as how they might affect the core features of the intervention (eg, fidelity). The adaptations that are suggested by participants will be discussed with the intervention authors to assess the extent to which these adaptations would affect fidelity of the platform. Moreover, results from this initial adaptation study will provide insights on strategies that may need to be implemented to ensure fidelity of the intervention during the pilot implementation.

    If needed, an additional process of consensus discussion will be added to prioritize the adaptations that will be pursued. Service providers who take part in the focus groups will first be consulted on an individual basis to identify the details of the adaptations that will be made. Service users will be invited to assess the usefulness and accessibility of the adapted content and to share their feedback. Patient participants will receive $25 CAD for their participation in this final stage of the study. The adapted eHealth intervention will be further assessed during the second phase of the research program, that is, a small pilot study using a live version of the site. A live version of the site will provide participants access to the full range of social media features of the platform such as communicating with others, as well as posting images, videos, and links. Moreover, a live version would also provide access to a Web-based peer support worker and clinician moderator.


    Results

    The project was funded March 2015 and data collection was completed in August 2017. Analysis and adaptations are currently under way, and the first results are expected to be submitted for publication in 2018.


    Discussion

    Study Rationale and Significance

    This protocol addresses an important gap in the eHealth intervention literature in terms of frameworks, methods, and processes used by researchers to adapt an eHealth intervention before its implementation and evaluation in different contexts and settings. Although more research is needed on the effectiveness of adapting interventions, there is a general consensus by several authors of systematic and meta-analytical reviews of psychological and health-promotion interventions (eg, [3,6]) that considering adaptation when transporting interventions and programs is well-warranted. Moreover, not only is there a “moral case to test and demonstrate the appropriateness, acceptability, and harmlessness of interventions up front” [6], there is increasing evidence indicating that such a process can positively impact the effectiveness of an intervention. We believe this would extend similarly to the adaptation of eHealth innovations when considering their implementation across geographical, cultural, and contextual settings, particularly those that are based on psychological and social therapy principles and interventions.

    Access to details on the adaptation of eHealth interventions is important for supporting the interpretation of results obtained from effectiveness studies when an innovation is implemented and studied across different settings. Although the importance of retaining therapeutic principles and mechanisms of an intervention when scaling up evaluation are recognized, there are limited examples of how changes to increase relevancy, alignment with current technologies, interactivity, and fit can be considered when scaling up evaluation of eHealth innovation across cultural and contextual settings. The eHealth adaptation framework that we have developed for this study provides a concrete example of the process and methods for how adaptations to psychological, social, and educational interventions in the field of eHealth could be addressed. It highlights the importance of considering the therapeutic principles and mechanisms upon which the intervention is based; the population, the service providers, and the setting (eg, urban, rural, program delivery model) in which the innovation will be implemented; extended opportunities to explore the eHealth intervention at a pace that is more reflective of real-life implementation; considering the perspectives of different stakeholder groups, including their experiences, skills, access, and attitudes toward the use of technology; and, providing different media and methods through which to collect data pertaining to adaptation (eg, focus groups, written feedback, consultation).

    In addition, we will be able to compare adaptations suggested across settings (eg, urban, multiethnic vs semirural). Our framework also attends to the various types of media that participants can access on the website, including the visual images, audio, and video supports, and the importance of understanding whether these media are presented in a manner that is relatable to different audience groups. For example, given that the graphics are created by an Australian visual artist, it is possible that some of the imagery and symbolism may not be readily understandable to the Canadian population. Also, the voice recordings for therapeutic activities (eg, mindfulness, breathing) have an Australian accent, and this might hinder participation and engagement. The study will also provide information on words that may need to be added or rephrased in accordance with Canadian English language. The system has a database of synonyms obtained from Web-based dictionaries and can make suggestions on aspects of the website that may be of interest to participants based on their posts (by matching words used in their posts and related synonyms from the dictionary to therapeutic content on the website). As such, it will be important to assess the appropriateness of the dictionary being used by the system during the adaptation of the intervention.

    Limitations and Future Research

    Certain limits of the adaptation protocol are also acknowledged. For example, the protocol invites participants to reflect on features of the platform that would be available during the live implementation (eg, clinician moderator, peer support worker); in this regard, some of their perspectives will be based on projections into the future, rather than actual experience. To mitigate this limitation, we plan to pilot-test the adapted version, with all features accessible, with a small sample (n=20) of participants over a period of 8 weeks. The pilot study will also have a qualitative component assessing participants’ experiences of all aspects of the platform, for example, interactions with peers, peer support worker, and clinician moderators. This will facilitate obtaining additional data on the acceptability of the eHealth intervention and any further adaptations needed before conducting controlled evaluations.

    Conclusions

    The results of this study will provide preliminary insights into the acceptability of the Horyzons Web-based platform (eg, perceived use and perceived usefulness) and knowledge about the adaptations and process needed to prepare the platform for evaluation in Canada. Moreover, this protocol contributes to an important gap in the literature pertaining to the specific principles, methods, and steps involved in the adaptation process for scaling up evaluation of eHealth innovations. This type of research is novel from a Canadian and international eHealth perspective and is increasingly relevant in a global environment where eHealth innovations are being considered for implementation across a range of cultural, geographical, and health system contexts.

    Acknowledgments

    We gratefully acknowledge the contributions of all patient and clinician participants that dedicated time to this study. Phase 1 of the Horyzons-Canada project is supported by a NARSAD Young Investigator Grant from the Brain and Behaviour Research Foundation. SL was supported in part by a New Investigator Salary Award from the Canadian Institutes of Health Research and previously in part by a Research Scholar Salary Award from the Fonds de recherche du Québec—Santé (FRQS). AM is funded in part by the Canada Research Chair Program. MAJ was supported by a Career Development Fellowship (APP1082934) from the National Health and Medical Research Council.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Horyzons' Screenshot: How Horyzons Works.

    PNG File, 151KB

    Multimedia Appendix 2

    Horyzons' Screenshot: Strengths.

    PNG File, 207KB

    References

    1. Lal S, Adair CE. E-mental health: a rapid review of the literature. Psychiatr Serv 2014 Jan 1;65(1):24-32. [CrossRef] [Medline]
    2. Lal S, Malla A. Service engagement in first-episode psychosis: current issues and future directions. Can J Psychiatry 2015 Aug;60(8):341-345 [FREE Full text] [CrossRef] [Medline]
    3. Sundell K, Beelmann A, Hasson H, von Thiele Schwartz U. Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. J Clin Child Adolesc Psychol 2016;45(6):784-796. [CrossRef] [Medline]
    4. Bernal G, Bonilla J, Bellido C. Ecological validity and cultural sensitivity for outcome research: issues for the cultural adaptation and development of psychosocial treatments with Hispanics. J Abnorm Child Psychol 1995 Feb;23(1):67-82. [Medline]
    5. Castro FG, Barrera M, Holleran Steiker LK. Issues and challenges in the design of culturally adapted evidence-based interventions. Annu Rev Clin Psychol 2010;6:213-239 [FREE Full text] [CrossRef] [Medline]
    6. Harper Shehadeh M, Heim E, Chowdhary N, Maercker A, Albanese E. Cultural adaptation of minimally guided interventions for common mental disorders: a systematic review and meta-analysis. JMIR Ment Health 2016 Sep 26;3(3):e44 [FREE Full text] [CrossRef] [Medline]
    7. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol 2008 Jun;41(3-4):327-350. [CrossRef] [Medline]
    8. Chowdhary N, Jotheeswaran AT, Nadkarni A, Hollon SD, King M, Jordans MJ, et al. The methods and outcomes of cultural adaptations of psychological treatments for depressive disorders: a systematic review. Psychol Med 2014 Apr;44(6):1131-1146 [FREE Full text] [CrossRef] [Medline]
    9. Smith TB, Rodríguez MD, Bernal G. Culture. J Clin Psychol 2011 Feb;67(2):166-175. [CrossRef] [Medline]
    10. Alvarez-Jimenez M, Bendall S, Lederman R, Wadley G, Chinnery G, Vargas S, et al. On the HORYZON: moderated online social therapy for long-term recovery in first episode psychosis. Schizophr Res 2013 Jan;143(1):143-149. [CrossRef] [Medline]
    11. Fredrickson BL, Losada MF. Positive affect and the complex dynamics of human flourishing. Am Psychol 2005 Oct;60(7):678-686 [FREE Full text] [CrossRef] [Medline]
    12. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol 2000 Jan;55(1):68-78. [Medline]
    13. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res 2011;13(1):e30 [FREE Full text] [CrossRef] [Medline]
    14. Gleeson JF, Lederman R, Wadley G, Bendall S, McGorry PD, Alvarez-Jimenez M. Safety and privacy outcomes from a moderated online social therapy for young people with first-episode psychosis. Psychiatr Serv 2014;65(4):546-550. [CrossRef] [Medline]
    15. Barrera Jr M, Castro FG, Strycker LA, Toobert DJ. Cultural adaptations of behavioral health interventions: a progress report. J Consult Clin Psychol 2013 Apr;81(2):196-205 [FREE Full text] [CrossRef] [Medline]
    16. Wingood GM, DiClemente RJ. The ADAPT-ITT model: a novel method of adapting evidence-based HIV Interventions. J Acquir Immune Defic Syndr 2008 Mar 01;47 Suppl 1:S40-S46. [CrossRef] [Medline]
    17. Hwang WC. The psychotherapy adaptation and modification framework: application to Asian Americans. Am Psychol 2006 Oct;61(7):702-715. [CrossRef] [Medline]
    18. Domenech Rodríguez MM, Baumann AA, Schwartz AL. Cultural adaptation of an evidence based intervention: from theory to practice in a Latino/a community context. Am J Community Psychol 2011 Mar;47(1-2):170-186. [CrossRef] [Medline]
    19. Bowen SA, Saunders RP, Richter DL, Hussey J, Elder K, Lindley L. Assessing levels of adaptation during implementation of evidence-based interventions: introducing the Rogers-Rütten framework. Health Educ Behav 2010 Dec;37(6):815-830. [CrossRef] [Medline]
    20. Marsiglia FF, Booth JM. Cultural adaptation of interventions in real practice settings. Res Soc Work Pract 2015 Jul 01;25(4):423-432 [FREE Full text] [CrossRef] [Medline]
    21. McKleroy VS, Galbraith JS, Cummings B, Jones P, Harshbarger C, Collins C, ADAPT Team. Adapting evidence-based behavioral interventions for new settings and target populations. AIDS Educ Prev 2006 Aug;18(4 Suppl A):59-73. [CrossRef] [Medline]
    22. Poulsen MN, Vandenhoudt H, Wyckoff SC, Obong'o CO, Ochura J, Njika G, et al. Cultural adaptation of a U.S. evidence-based parenting intervention for rural Western Kenya: from parents matter! To families matter!. AIDS Educ Prev 2010 Aug;22(4):273-285. [CrossRef] [Medline]
    23. Robinson BE, Galbraith JS, Lund SM, Hamilton AR, Shankle MD. The process of adaptation of a community-level, evidence-based intervention for HIV-positive African American men who have sex with men in two cities. AIDS Educ Prev 2012 Jun;24(3):206-227. [CrossRef] [Medline]
    24. Leacock TL, Nesbit JC. A framework for evaluating the quality of multimedia learning resources. J Educ Techno Soc 2007;10(2):44-59 [FREE Full text]
    25. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015;3(1):e27 [FREE Full text] [CrossRef] [Medline]
    26. Santesso N, Tugwell P. Knowledge translation in developing countries. J Contin Educ Health Prof 2006;26(1):87-96. [CrossRef] [Medline]
    27. Holden RJ, Karsh BT. A theoretical model of health information technology usage behaviour with implications for patient safety. Behav Inf Technolol 2009 Jan;28(1):21-38. [CrossRef]
    28. Mohr DC, Schueller SM, Riley WT, Brown CH, Cuijpers P, Duan N, et al. Trials of intervention principles: evaluation methods for evolving behavioral intervention technologies. J Med Internet Res 2015;17(7):e166 [FREE Full text] [CrossRef] [Medline]
    29. Malla A, Lal S, Vracotas NC, Goldberg K, Joober R. Early intervention in psychosis: specialized intervention and early case identification. Encephale 2010 Mar;36 Suppl 3:S38-S45. [CrossRef] [Medline]
    30. Malla A, Norman R, McLean T, Scholten D, Townsend L. A Canadian programme for early intervention in non-affective psychotic disorders. Aust N Z J Psychiatry 2003 Aug;37(4):407-413. [CrossRef] [Medline]
    31. Creswell JW, Klassen AC, Plano Clark VL, Smith KC. Best Practices for Mixed Methods Research in the Health Sciences. Bethesda, Maryland: National Institutes of Health; 2011.


    Abbreviations

    FEP: first-episode psychosis
    ICT: Information and communication technology


    Edited by G Eysenbach; submitted 12.10.17; peer-reviewed by M Harper Shehadeh, N Unciano; comments to author 22.11.17; revised version received 05.02.18; accepted 11.02.18; published 23.04.18

    ©Shalini Lal, John Gleeson, Ashok Malla, Lysanne Rivard, Ridha Joober, Ranjith Chandrasena, Mario Alvarez-Jimenez. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 23.04.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.