ResProt JMIR Res Protoc JMIR Research Protocols 1929-0748 JMIR Publications Toronto, Canada v9i1e14588 31904576 10.2196/14588 Protocol Protocol Using Mobile Devices to Deliver Lifestyle Interventions Targeting At-Risk High School Students: Protocol for a Participatory Design Study Eysenbach Gunther Hallewell Madeline Kessel Schneider Shari Turner Nigel Yaw Yong Heng Müssener Ulrika PhD 1
Department of Medical and Health Sciences Linköping University Sandbäcksgatan Linköping, 58183 Sweden 46 073 2702426 ulrika.mussener@liu.se
https://orcid.org/0000-0001-5173-5419 Löf Marie PhD 2 https://orcid.org/0000-0001-9522-5824 Bendtsen Preben PhD 1 https://orcid.org/0000-0001-5913-2903 Bendtsen Marcus PhD 1 https://orcid.org/0000-0002-8678-1164 Department of Medical and Health Sciences Linköping University Linköping Sweden Department of Biosciences and Nutrition Karolinska Institutet Huddinge Sweden Corresponding Author: Ulrika Müssener ulrika.mussener@liu.se 1 2020 6 1 2020 9 1 e14588 18 6 2019 23 9 2019 9 10 2019 22 10 2019 ©Ulrika Marianne Müssener, Marie Löf, Preben Bendtsen, Marcus Bendtsen. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 06.01.2020. 2020

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.

 Background

Unhealthy lifestyle behaviors such as insufficient physical activity, unhealthy diet, smoking, and harmful use of alcohol tend to cluster (ie, individuals may be at risk from more than one lifestyle behavior that can be established in early childhood and adolescence and track into adulthood). Previous research has underlined the potential of lifestyle interventions delivered via mobile phones. However, there is a need for deepened knowledge on how to design mobile health (mHealth) interventions taking end user views into consideration in order to optimize the overall usability of such interventions. Adolescents are early adopters of technology and frequent users of mobile phones, yet research on interventions that use mobile devices to deliver multiple lifestyle behavior changes targeting at-risk high school students is lacking.

 Objective

This protocol describes a participatory design study with the aim of developing an mHealth lifestyle behavior intervention to promote healthy lifestyles among high school students.

 Methods

Through an iterative process using participatory design, user requirements are investigated in terms of technical features and content. The procedures around the design and development of the intervention, including heuristic evaluations, focus group interviews, and usability tests, are described.

 Results

Recruitment started in May 2019. Data collection, analysis, and scientific reporting from heuristic evaluations and usability tests are expected to be completed in November 2019. Focus group interviews were being undertaken with high school students from October through December, and full results are expected to be published in Spring 2020. A planned clinical trial will commence in Summer 2020. The study was funded by a grant from the Swedish Research Council for Health, Working Life, and Welfare.

 Conclusions

The study is expected to add knowledge on how to design an mHealth intervention taking end users’ views into consideration in order to develop a novel, evidence-based, low-cost, and scalable intervention that high school students want to use in order to achieve a healthier lifestyle.

 International Registered Report Identifier (IRRID)

DERR1-10.2196/14588

 mHealth intervention lifestyle behavior high school students qualitative methods participatory design Introduction Health Habits Among Youths and the Need for Scalable Interventions

The lifestyles of young people affect not only their current health but also their risk of a number of noncommunicable diseases (NCDs) such as cardiovascular diseases, cancers, chronic respiratory diseases, and diabetes. Insufficient physical activity, unhealthy diet, smoking, and harmful use of alcohol are all modifiable behaviors that increase the risk of NCDs [1-3]. Swedish national surveys have revealed that the majority of young people in Sweden do not consume the recommended daily amount of fruits and vegetables nor do they meet the recommended physical activity guidelines [4-6]. Also, smoking remains a global public health issue, and there is a high prevalence of smoking in youth [7] that also applies to Sweden [6]. Alcohol consumption has declined, but heavy episodic drinking continues to be a problem among alcohol-drinking adolescents [4,8]. Clearly, effective and evidence-based interventions to promote healthier lifestyles in adolescents are warranted.

Adolescence is characterized by rapid physical and psychological changes, together with increasing demands and influences of peers, school, and wider society. It is well documented that behaviors developed during this period influence health in adulthood. Adolescence is the peak period for initiation of substance use, which creates large health burdens in this age group [9,10]. As unhealthy lifestyle behaviors tend to be established in early childhood and adolescence and track into adulthood [11-13], efforts for outreach to high school students are vital. The prevention of diseases related to modifiable behavior has been emphasized as a key component of adolescent health [14]. Part of the success to reduce NCDs requires helping individuals to change their lifestyles to promote health [1,3,10]. According to the World Health Organization (WHO), the education sector can play an important role in health promotion for youths [15]. School health systems, with qualified professionals such as school nurses, welfare officers, and health educators, provide services for students that promote optimum health for their academic success. School multidisciplinary teams provide good accessibility for adolescents and a natural setting for attempting to endorse healthy lifestyle behaviors for as many adolescents as possible [16]. However, to be delivered by school health professionals, interventions require minimal resources and time.

 Mobile Health Interventions to Promote a Healthier Lifestyle Among Youths

Over the past decade, interest has increased in providing lifestyle interventions via mobile phones, often referred to as mobile health (mHealth) interventions. mHealth is defined by WHO as a medical or public health practice that is supported by mobile devices [15]. Major advantages with mHealth interventions are that they require fewer resources than traditional face-to-face interventions and they can be delivered at any time. To date, most mHealth interventions have focused on improving one or two lifestyle behaviors such as nutrition and/or physical activity or smoking cessation. However, there is also evidence that lifestyle behaviors may cluster (ie, individuals may be at risk from more than one lifestyle behavior) [17-19]. Interventions targeting multiple lifestyle behaviors at the same time may be beneficial for improving general lifestyle among adults [19,20] and may be more effective and efficient than those targeting a single behavior [21].

To date, although young people are early adopters of technology and frequent users of mobile phones, studies on interventions that use mobile devices to deliver multiple lifestyle interventions to high school students are few, and most interventions target only one or two single behaviors [22]. In this context, it is also relevant to note that a meta-analysis [23] examined the effectiveness of text message–based interventions for tobacco and alcohol cessation within a young adult population. Only 5 of the 14 studies reported significant differences between groups of substance use behavior outcomes. The authors concluded that the included randomized controlled trials (RCTs) lacked detail regarding intervention content. Consequently, replication of the RCTs and the possibility of identifying why and how previous interventions in youth were effective are difficult.

 Formative Research Processes

A neglected area of research is the documentation and critical analysis of the formative research processes required in the development and refinement of effective mHealth interventions [24]. A systematic review stressed the need for further research to evaluate the efficacy and effectiveness of intervention approaches in promoting preventive behavior among adolescents [25]. A more recent systematic review emphasized the urgent need to examine development processes for mHealth interventions. The authors concluded that it is important to fully understand how interventions have been developed to allow replication and adaptation of interventions across settings [26].

The prompt expansion of device capability presents many challenges for developers of mHealth interventions, especially when designing interventions that aim to affect multiple individual lifestyle behaviors [27]. As described in Bock et al [27], one set of challenges concerns the structure, content, and tone of the intervention. Previous research has pointed out that the most important factors during the design process are to be flexible and responsive to the input and feedback of the target audience: if they do not enjoy the program they may disengage [28]. A systematic review called for greater transparency in use of theory in developing mHealth interventions [29]. An additional challenge is that of technological cultural consistency (ie, to ensure the developed interventions and modes of access are compatible with the ways in which the intended target group uses technology) [27]. Given the identified challenges and needs regarding development of mHealth interventions, research is needed on how best to design mHealth interventions taking end user assessments into account [28].

 Aim

The aim of this research protocol is to describe the research process in developing a novel mHealth intervention to change risky lifestyle behaviors among high school students (LIFE4YOUth).

LIFE4YOUth is one of seven mHealth interventions in a research program (funded by Forte 2018-01410; principal investigator: ML) aiming to promote healthy eating, physical activity, smoking cessation, and nonrisky drinking in seven different populations in the health care system [30]. All included studies will follow a harmonized procedure for intervention development, and hence a secondary aim of this protocol is to describe the formative work for LIFE4YOUth as a framework for the included interventions in the research program.

 Methods Study Overview

The development of the LIFE4YOUth intervention is based on a review of the literature and will be inspired by the same phases of development and evaluation as any intervention provided by the National Institutes of Health [31] and further developed and described as recommended by Abroms et al [28] in their guide based on collective experiences in designing, developing, and evaluating mHealth interventions (Figure 1). The recommended steps for developing mHealth interventions include (1) conduct research for insight into target audience and target health behavior, (2) design the intervention, (3) pretest the intervention, and (4) revise the intervention [28]. This paper will focus on step 2 (designing the intervention) and step 3 (pretesting the intervention). The intervention will be designed and pretested during an iterative process, involving multiple rounds of feedback.

A simplified picture of the steps for developing an mHealth intervention (inspired by Abroms et al 2015).

 Procedures Preparations: Development of a Preliminary Version of LIFE4YOUth

The structure of a preliminary version of LIFE4YOUth was developed in early 2019. The intervention aims to target physical activity, diet, alcohol consumption, and smoking by giving high school students access to a mobile phone app to promote a healthy lifestyle. The structure and content are based on current best practices gathered from scientific literature on lifestyle interventions and behavior change and are inspired by fundamental theoretical constructs such as behavior change theories and psychological models [32,33]. The technical platform is based on our previous research in developing mHealth interventions [34-36].

 Participatory Design Processes

The participatory design process used in this study will include three activities: (1) heuristic evaluation, (2) focus group interviews, and (3) usability tests. We will invite end users including high school students and university students and employees at Linköping University. The knowledge, experiences, ideas, and skills of the participants will be used to revise the intervention. Figure 2 presents the activities included in the design of the intervention.

Activities in the development process of LIFE4YOUth.

 Heuristic Evaluation

Effectiveness, as part of usability defined by the International Organization for Standardization standard 9421-11:2018, will be investigated using heuristic evaluation [37], a usability inspection method. During heuristic evaluation, trained evaluators review an intervention to find usability problems, assign them to a specific category of heuristics, and ascribe a severity rating in order to provide distinct usability information. The experts recruited for this evaluation are not necessarily usability experts but should have some level of expertise with the subject matter or technology required to use the investigated app. The heuristics will identify usability issues such as problems with unclear functions, confusing navigation, and consistency issues [38-40].

 Focus Group Interviews

Initially, a series of focus groups will be conducted to enable the collection and analysis of three complementary forms of data: individual data, group-level data, and data generated from participant interactions [41,42]. Focus groups are semistructured discussions with research participants that aim to explore a specific set of issues [43]. The focus groups will be designed to elicit feedback on content, understandability, and acceptability of the proposed intervention so that modifications can be made.

 Usability Tests

Usability tests [44-46] will be completed in order to further modify and improve the intervention. Usability tests consist of a human-computer interaction and refer to evaluating an intervention by testing it with potential end users with the goal of identifying understandability, learnability, and attractiveness and determining participant satisfaction with the intervention. The usability tests will provide information on whether participants are able to complete specified tasks successfully, identify how long it take to complete tasks, and identify changes required to improve user performance and satisfaction [44,47].

 Setting, Participants, and Recruitment Heuristic Evaluation

Participants for the heuristic evaluation will be recruited by members of the research team through paper advertising (posters) in public areas at Linköping University. Participants will register their interest by contacting the research leader by email.

 Focus Groups and Usability Tests

School staff at five high schools selected for convenience in Östergötland (Sweden) will be contacted via email and informed about the research project. Approximately 1000 students, both female and male, aged 15 to 18 years, attend these high schools and will all be invited to take part in the focus group interviews and usability tests. High school students at the selected schools are expected to be similar to the overall target population for mHealth interventions.

Participants among high school students will be recruited by the school staff through paper advertising (posters and leaflets), digital advertising (student email and school website), and information in the classrooms. High school students will register their interest by contacting the research leader by email or telephone or by contacting school staff who will send students the telephone number of the research leader.

 Selection Criteria

Inclusion criteria for the heuristic evaluation will include university students and employees at the Faculty of Medicine and Health Sciences at Linköping University who are willing to participate and who own a mobile phone. Inclusion criteria for the focus group interviews and usability tests will include high school students aged 15 to 18 years at selected high schools in Östergötland who are willing to participate and who own a mobile phone. A total of 32 to 44 participants are expected. Exclusion criteria for the focus group interviews and usability tests will be high school students who are not Swedish-speaking or do not own a mobile phone.

 Data Collection Heuristic Evaluations

A total of 15 heuristic evaluators, both students and employees at Linköping University, will be recruited. A research assistant will give participants a short (eg, 45 minutes) training session to instruct them on the main principles of heuristic evaluation during a meeting with all participants. The introduction will take place in a conference room at Linköping University. For the heuristic evaluation, a set of 10 standardized heuristics published by Nielsen [37] will be used. The heuristics for usability evaluation according to Nielsen are listed in Textbox 1.[37]

Participants will be taught how to use the heuristics to evaluate the intervention. All participants will be sent a link with a prototype of the intervention. Each evaluator will go through the prototype one time and independently identify issues tied to a specific heuristic (eg, visibility of system status, plain language, flexibility and efficiency of use, aesthetic design) and give them a severity rating [38-40]. The evaluation will be performed wherever the participants prefer and sent back to the research assistant in a prepaid envelope within 1 week of receipt. Heuristic evaluations will be gathered in May 2019.

Heuristics for usability evaluation according to Nielsen.

Visibility of system status: system should always keep users informed about what is going on through appropriate feedback within reasonable time.

Match between system and the real world: system should speak the users’ language with words, phrases, and concepts familiar to the user rather than system-oriented terms. Follow real-world conventions, making information appear in a natural and logical order.

User control and freedom: users often choose system functions by mistake and will need a clearly marked “emergency exit” to leave the unwanted state without having to go through an extended dialog. Support undo and redo.

Consistency and standards: users should not have to wonder whether different words, situations, or actions mean the same thing.

Error prevention: even better than good error messaging is a careful design that prevents problems from occurring in the first place. Either eliminate error-prone conditions or check for them and present users with a confirmation option before they commit to the action.

Recognition rather than recall: minimize users’ memory load by making objects, actions, and options visible. The user should not have to remember information from one part of the dialog to another. Instructions for use of the system should be visible or easily retrievable whenever appropriate.

Flexibility and efficiency of use: accelerators, unseen by the novice user, may often speed up the interaction for the expert user such that the system can cater to both inexperienced and experienced users. Allow users to tailor frequent actions.

Aesthetic and minimalist design: dialogs should not contain irrelevant or rarely needed information. Every extra unit of information in a dialog competes with relevant units of information and diminishes their relative visibility.

Help users recognize, diagnose, and recover from errors: error messages should be expressed in plain language (no codes), precisely indicate the problem, and constructively suggest a solution.

Help and documentation: even though it is better if the system can be used without documentation, it may be necessary to provide help and documentation. Any such information should be easy to search, be focused on the user’s task, list concrete steps to be completed, and not be too large.

 Focus Group Interviews

A total of 4 focus group interviews with 3 to 6 participants in each group (12 to 24 participants) will be conducted between May and June 2019. Teachers will not be present during the interviews. The consolidated criteria for reporting qualitative research (COREQ) 32-item checklist [48] will be applied to give an explicit and comprehensive structure to the focus group interviews according to the following domains:

Research team and reflexivity: a female researcher with a PhD degree and training and experience in qualitative methodology (UM) will be responsible for conducting the focus groups. A female observer (AS) will ask complementary questions at the end of the interview. The interviewer will explain the purpose of the interview and her interests in doing the research.

Study design: an explorative qualitative approach [41,42] will be used for methodological orientation. All focus group interviews will be conducted in a high school setting. Each semistructured interview will be audiorecorded and will last approximately 1.5 hours. An interview guide (Multimedia Appendix 1) will be used [41]. Interview questions will be framed around the following domains: (1) making lifestyle changes, (2) use of the mobile phone for health informatics, (3) intervention content, (4) overall feedback, and (5) visual prototype. After discussing the first four domains, UM will present a low-fidelity paper-based prototype [49] including a series of printouts of the LIFE4YOUth program.

Analysis and findings: analyses will be performed using systematic thematic analyses (further described under Data Analysis). Data will be coded by two researchers. Themes will not be identified in advance but will derive from the data. Quotations will be used to illustrate the themes and elucidate the findings.

 Usability Tests

A total of 5 usability tests [45-47] will be completed. Five high school students will go through a 60-minute session during which all interactions with the intervention are videorecorded. A high-fidelity prototype [49], including the actual software start page, menu page, and 4 intervention modules (alcohol, smoking, physical activity, and diet) will be used. During this high-fidelity prototype testing, participants will go through the entire intervention module. A research assistant will ask participants to complete tasks while explaining their actions using a think aloud method [50,51]. An observer (AS) will note potential issues as the given tasks are performed by the participants. The assistant will not offer any help during the task execution to minimize any disruptions of spontaneous thoughts as well as to avoid bias in the results. After completing the session, the participants will be asked to complete a paper version of the system usability scale (SUS). The SUS is a standardized tool to get a global view of the participants’ subjective assessments of usability based on 10 questions [52]. The tests will be run on an iPhone and take place in June 2019 in a medical informatics lab room.

 Data Analyses Heuristic Evaluation

All issues from evaluators will be pooled with potential duplicates merged and issues with high average severity ratings rectified [37,53]. Descriptive statistics will be used to summarize heuristic violations and associated severity scores.

 Focus Group Interviews

Transcripts will be analyzed thematically in an iterative process of coding [54]. Analyses will focus on end user experiences and opinions regarding making lifestyle changes using the mobile device as a health tool, as well as on content, structure, and implementation of LIFE4YOUth. Systematic thematic analyses will follow a prescribed, sequential process: (1) noting overall impressions, (2) reducing and coding into themes, (3) searching for patterns and interconnections, (4) mapping and building themes, and (5) drawing conclusions. In order to ensure validity of the results and prevent bias in the qualitative analysis process, data will be independently coded by two researchers with a consensus reached by adjudication [41].

 Usability Tests

After all user tests have been completed, observers and other members of the research group will discuss whether specific tasks stood out or hindered the progress in development of the program. Analysis of the videorecordings will be informed inspired by inductive program theory development [55].

Analysis will focus on features of the intervention related to design, format, instructions, navigation, terminology, and learnability that need to be redesigned. Descriptive statistics will be used to analyze problem counts and time taken. Average scores from the SUS will be used to identify average satisfaction [52].

 Ethics Approval and Consent to Participate

The study has been approved by the Swedish Ethical Review Authority (Dnr 2019-01320). All participants will give written informed consent prior to participation in any study procedure (focus group interview, heuristic evaluation, user test).

 Results

Recruitment started in May 2019. Data collection, analysis, and scientific reporting are expected to be completed in December 2019. The study was funded by a grant from the Swedish Research Council for Health, Working Life, and Welfare. Focus group interviews were being undertaken with high school students from October through December, and full results are expected to be published in Spring 2020. A planned clinical trial will commence in Summer 2020.

 Discussion

As a growing body of research suggests that health risk behaviors often do not occur in isolation, this study considers interventions that address lifestyle behaviors related to diet, physical activity, smoking, and alcohol. Also, more research is needed into the documentation and critical analysis of the formative research processes required in the development and refinement of effective mHealth interventions [24,26]. This protocol describes a participatory design study with the aim of developing an mHealth intervention to promote healthy lifestyles among high school students that can be delivered via school health staff. This protocol provides a scientific record of the methodologies used when developing the intervention in order to enhance transparency of research. Additionally, as described above, the LIFE4YOUth intervention program is part of a larger research program (funded by Forte, the Swedish funding agency for health and social affairs research) [28], and the formative work presented here will also be used as a framework for the other trials in the program.

Through formative research and participatory design, we believe this study will result in deepened knowledge regarding what aspects of content and structure end users (eg, high school students) consider important for designing mHealth lifestyle behavior interventions. More specifically, the study is expected to give answers as to whether an mHealth intervention that gives access to interactive and personal modules contained within a mobile phone–based dashboard is useful and accepted among high school students. This knowledge is valuable in order to guide further development of a final version of the novel mHealth intervention program LIFE4YOUth targeting high school students. An RCT will be conducted to determine the efficacy of the intervention. If found effective in the RCT, the program has the potential to be implemented nationally through school health services.

Interview guide.

 Abbreviations COREQ

consolidated criteria for reporting qualitative research

 mHealth

mobile health

 NCD

noncommunicable disease

 RCT

randomized controlled trial

 SUS

system usability scale

 WHO

World Health Organization

This study was funded by a grant from the Swedish Research Council for Health, Working Life, and Welfare (Forte 2018-01410; principal investigator: ML).

None declared.

 Ford ES Bergmann MM Kröger J Schienkiewitz A Weikert C Boeing H Healthy living is the best revenge: findings from the European Prospective Investigation Into Cancer and Nutrition-Potsdam study Arch Intern Med 2009 08 10 169 15 1355 1362 10.1001/archinternmed.2009.237 19667296 169/15/1355 Gore FM Bloem PJN Patton GC Ferguson J Joseph V Coffey C Sawyer SM Mathers CD Global burden of disease in young people aged 10-24 years: a systematic analysis Lancet 2011 06 18 377 9783 2093 2102 10.1016/S0140-6736(11)60512-6 21652063 S0140-6736(11)60512-6 Mokdad AH Forouzanfar MH Daoud F Mokdad AA Moradi-Lakeh M Kyu HH Barber RM Wagner J Cercy K Kravitz H Coggeshall M Chew A O'Rourke KF Steiner C Tuffaha M Charara R Al-Ghamdi EA Adi Y Afifi RA Alahmadi H AlBuhairan F Allen N AlMazroa M Al-Nehmi AA AlRayess Z Arora M Azzopardi P Barroso C Basulaiman M Bhutta ZA Bonell C Breinbauer C Degenhardt L Denno D Fang J Fatusi A Feigl AB Kakuma R Karam N Kennedy E Khoja TAM Maalouf F Obermeyer CM Mattoo A McGovern T Memish ZA Mensah GA Patel V Petroni S Reavley N Zertuche DR Saeedi M Santelli J Sawyer SM Ssewamala F Taiwo K Tantawy M Viner RM Waldfogel J Zuñiga MP Naghavi M Wang H Vos T Lopez AD Al RAA Patton GC Murray CJL Global burden of diseases, injuries, and risk factors for young people's health during 1990-2013: a systematic analysis for the Global Burden of Disease Study 2013 Lancet 2016 06 11 387 10036 2383 2401 10.1016/S0140-6736(16)00648-6 27174305 S0140-6736(16)00648-6 Public Health Agency of Sweden 2019-11-13 Health Behaviour in School-aged Children 2017/2018 https://www.folkhalsomyndigheten.se/contentassets/fbcbd76d2cae4fc0981e35dddf246cf0/skolbarns-halsovanor-sverige-2013-14.pdf National Food Administration 2018 2019-11-14 Dietary habits in Swedish adolescents, report no. 14 https://www.livsmedelsverket.se/globalassets/publikationsdatabas/rapporter/2018/2018-nr-14-riksmatenungdom-huvudrapport_del-1-livsmedelskonsumtion.pdf Delisle NC Results from Sweden's 2018 report card on physical activity for children and youth J Phys Act Health 2018 15 S2 S413 S414 10.1123/jpah.2018-0519 Fanshawe T Halliwell W Lindson N Aveyard P Livingstone-Banks J Hartmann-Boyce J Tobacco cessation interventions for young people Cochrane Database Syst Rev 2017 11 17 11 CD003289 10.1002/14651858.CD003289.pub6 29148565 PMC6486118 The Swedish Council for Information on Alcohol and Other Drugs 2019-11-14 Drug trends in Sweden 2017 https://www.can.se/contentassets/14703e2c9a1340f49bfd35ef7da495b1/befolkningens-sjalvrapporterade-alkoholvanor-2004-2017.pdf Patton GC Coffey C Sawyer SM Viner RM Haller DM Bose K Vos T Ferguson J Mathers CD Global patterns of mortality in young people: a systematic analysis of population health data Lancet 2009 09 12 374 9693 881 892 10.1016/S0140-6736(09)60741-8 19748397 S0140-6736(09)60741-8 Catalano RF Fagan AA Gavin LE Greenberg MT Irwin CE Ross DA Shek DTL Worldwide application of prevention science in adolescent health Lancet 2012 04 28 379 9826 1653 1664 10.1016/S0140-6736(12)60238-4 22538180 S0140-6736(12)60238-4 PMC4398056 Simmonds M Llewellyn A Owen CG Woolacott N Predicting adult obesity from childhood obesity: a systematic review and meta-analysis Obes Rev 2016 02 17 2 95 107 10.1111/obr.12334 26696565 Hall WD Patton G Stockings E Weier M Lynskey M Morley KI Degenhardt L Why young people's substance use matters for global health Lancet Psychiatry 2016 03 3 3 265 279 10.1016/S2215-0366(16)00013-4 26905482 S2215-0366(16)00013-4 Stockings E Hall WD Lynskey M Morley KI Reavley N Strang J Patton G Degenhardt L Prevention, early intervention, harm reduction, and treatment of substance use in young people Lancet Psychiatry 2016 03 3 3 280 296 10.1016/S2215-0366(16)00002-X 26905481 S2215-0366(16)00002-X Global action plan for the prevention and control of noncommunicable diseases—2020 2013 2019-11-13 Geneva World Health Organization https://www.who.int/iris/bitstream/10665/94384/1/9789241506236_eng.pdf New horizons for health through mobile technologies 2011 2019-11-14 Geneva World Health Organization https://apps.who.int/iris/bitstream/handle/10665/44607/9789241564250_eng.pdf Kraag G Zeegers MP Kok G Hosman C Abu-Saad HH School programs targeting stress management in children and adolescents: a meta-analysis J School Psychol 2006 12 44 6 449 472 10.1016/j.jsp.2006.07.001 Meader N King K Wright K Graham HM Petticrew M Power C White M Sowden AJ Multiple risk behavior interventions: meta-analyses of RCTs Am J Prev Med 2017 07 53 1 e19 e30 10.1016/j.amepre.2017.01.032 28258777 S0749-3797(17)30091-0 Schuit AJ van Loon AJ Tijhuis M Ocké M Clustering of lifestyle risk factors in a general adult population Prev Med 2002 09 35 3 219 224 12202063 S0091743502910649 de Vries H Kremers S Smeets T Reubsaet A Clustering of diet, physical activity and smoking and a general willingness to change Psychol Health 2008 23 3 265 278 10.1080/14768320701349107 25160478 Prochaska JJ Spring B Nigg CR Multiple health behavior change research: an introduction and overview Prev Med 2008 03 46 3 181 188 10.1016/j.ypmed.2008.02.001 18319098 S0091-7435(08)00052-2 PMC2288583 Hale DR Fitzgerald-Yau N Viner RM A systematic review of effective interventions for reducing multiple health risk behaviors in adolescence Am J Public Health 2014 05 104 5 e19 e41 10.2105/ajph.2014.301874 Suffoletto B Text message behavioral interventions: from here to where? Curr Opin Psychol 2016 02 01 9 16 21 10.1016/j.copsyc.2015.09.012 26665157 PMC4671292 Mason M Ola B Zaharakis N Zhang J Text messaging interventions for adolescent and young adult substance use: a meta-analysis Prev Sci 2015 02 16 2 181 188 10.1007/s11121-014-0498-7 24930386 Maar MA Yeates K Toth Z Barron M Boesch L Hua-Stewart D Liu P Perkins N Sleeth J Wabano MJ Williamson P Tobe SW Unpacking the black box: a formative research approach to the development of theory-driven, evidence-based, and culturally safe text messages in mobile health interventions JMIR Mhealth Uhealth 2016 01 22 4 1 e10 10.2196/mhealth.4994 26800712 v4i1e10 PMC4744330 Badawy SM Kuhns LM Texting and mobile phone app interventions for improving adherence to preventive behavior in adolescents: a systematic review JMIR Mhealth Uhealth 2017 04 19 5 4 e50 10.2196/mhealth.6837 28428157 v5i4e50 Ricci-Cabello I Bobrow K Islam SMS Chow CK Maddison R Whittaker R Farmer AJ Examining development processes for text messaging interventions to prevent cardiovascular disease: systematic literature review JMIR Mhealth Uhealth 2019 03 29 7 3 e12191 10.2196/12191 30924790 v7i3e12191 PMC6460311 Bock BC Rosen RK Barnett NP Thind H Walaska K Foster R Deutsch C Traficante R Translating behavioral interventions onto mhealth platforms: developing text message interventions for smoking and alcohol JMIR Mhealth Uhealth 2015 3 1 e22 10.2196/mhealth.3779 25714907 v3i1e22 PMC4376101 Abroms LC Whittaker R Free C Mendel VAJ Schindler-Ruwisch JM Developing and pretesting a text messaging program for health behavior change: recommended steps JMIR Mhealth Uhealth 2015 12 21 3 4 e107 10.2196/mhealth.4917 26690917 v3i4e107 PMC4704898 Free C Phillips G Galli L Watson L Felix L Edwards P Patel V Haines A The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review PLoS Med 2013 10 1 e1001362 10.1371/journal.pmed.1001362 23349621 PMEDICINE-D-12-00520 PMC3548655 Bendtsen M Multiple lifestyle mobile health interventions: promoting a healthy lifestyle across the lifespan? The mobile research program JMIR [submitted] 2019 National Cancer Institute, National Institutes of Health 2002 2019-11-14 Making health communication programs work https://www.cancer.gov/publications/health-communication/pink-book.pdf Bandura A Social cognitive theory: an agentic perspective Annu Rev Psychol 2001 52 1 26 10.1146/annurev.psych.52.1.1 11148297 52/1/1 Godin G Kok G The theory of planned behavior: a review of its applications to health-related behaviors Am J Health Promot 1996 11 2 87 98 10.4278/0890-1171-11.2.87 10163601 Müssener U Bendtsen M Karlsson N White IR McCambridge J Bendtsen P Effectiveness of short message service text-based smoking cessation intervention among university students: a randomized clinical trial JAMA Intern Med 2016 03 176 3 321 328 10.1001/jamainternmed.2015.8260 26903176 2495276 Bendtsen M Bendtsen P Feasibility and user perception of a fully automated push-based multiple-session alcohol intervention for university students: randomized controlled trial JMIR Mhealth Uhealth 2014 2 2 e30 10.2196/mhealth.3233 25098296 v2i2e30 PMC4114423 Thomas K Müssener U Linderoth C Karlsson N Bendtsen P Bendtsen M Effectiveness of a text messaging-based intervention targeting alcohol consumption among university students: randomized controlled trial JMIR Mhealth Uhealth 2018 06 25 6 6 e146 10.2196/mhealth.9642 29941417 v6i6e146 PMC6037945 Nielsen J Nielsen J Mack RL Heuristic evaluation Usability Inspection Methods 1994 New York John Wiley & Sons Usability.gov 2019-11-14 Heuristic evaluations and expert reviews https://www.usability.gov/howto-and-tools/methods/heuristic-evaluation.html Georgsson M Staggers N Weir C A modified user-oriented heuristic evaluation of a mobile health system for diabetes self-management support Comput Inform Nurs 2016 02 34 2 77 84 10.1097/CIN.0000000000000209 26657618 PMC4743707 Baumel A Muench F Heuristic evaluation of eHealth interventions: establishing standards that relate to the therapeutic process perspective JMIR Ment Health 2016 01 13 3 1 e5 10.2196/mental.4563 26764209 v3i1e5 PMC4730107 Patton M Qualitative Research and Evaluation Methods: Integrating Theory and Practice. 4th Edition 2015 Thousand Oaks SAGE Publications Miles M Huberman A Qualitative Data Analysis: An Expanded Sourcebook, 2nd Edition 1994 Thousand Oaks Sage Publication Krueger R Casey M Focus Groups: A Practical Guide for Applied Research. 5th edition 2014 Thousand Oaks Sage Publications Hinchliffe A Mummery WK Applying usability testing techniques to improve a health promotion website Health Promot J Austr 2008 04 19 1 29 35 18481929 Usability.gov 2019-11-14 Running a usability test https://www.usability.gov/how-to-andtools/methods/running-usability-tests.html Nielsen J Usability Engineering 1993 San Fransisco Academic Press Ehrler F Weinhold T Joe J Lovis C Blondon K A mobile app (BEDSide Mobility) to support nurses' tasks at the patient's bedside: usability study JMIR Mhealth Uhealth 2018 03 21 6 3 e57 10.2196/mhealth.9079 29563074 v6i3e57 PMC5885064 Tong A Sainsbury P Craig J Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups Int J Qual Health Care 2007 12 19 6 349 357 10.1093/intqhc/mzm042 17872937 mzm042 Walker M Takayama L Landay JA High-fidelity or low-fidelity, paper or computer? Choosing attributes when testing web prototypes Proc Hum Factors Erg Soc Ann Mtg 2016 11 06 46 5 661 665 10.1177/154193120204600513 Jaspers MWM Steen T van den Bos C Geenen M The think aloud method: a guide to user interface design Int J Med Inform 2004 11 73 11-12 781 795 10.1016/j.ijmedinf.2004.08.003 15491929 S1386-5056(04)00182-0 Charters E The use of think-aloud methods in qualitative research: an introduction to think-aloud methods Brock Education Journal 2003 07 01 12 2 10.26522/brocked.v12i2.38 Bangor A Kortum PT Miller JT An empirical evaluation of the system usability scale Int J Hum Comput Interact 2008 07 30 24 6 574 594 10.1080/10447310802205776 Baumel A Muench F Heuristic evaluation of eHealth interventions: establishing standards that relate to the therapeutic process perspective JMIR Ment Health 2016 01 13 3 1 e5 10.2196/mental.4563 26764209 v3i1e5 PMC4730107 Brown KG Gerhardt MW Formative evaluation: an integrative practice model and case study Personnel Psychol 2002 12 55 4 951 983 10.1111/j.1744-6570.2002.tb00137.x Health C Video in Qualitative Research 2010 Thousand Oaks Sage Publishing