ResProt JMIR Res Protoc JMIR Research Protocols 1929-0748 JMIR Publications Inc. Toronto, Canada v5i1e18 26825111 10.2196/resprot.4428 Protocol Protocol Increasing Access to Mental Health Care With Breathe, an Internet-Based Program for Anxious Adolescents: Study Protocol for a Pilot Randomized Controlled Trial Eysenbach Gunther Donovan Caroline Cassimatis Mandy Fogel Joshua Newton Amanda S PhD 1
University of Alberta 3-526, Edmonton Clinic Health Academy 11405-85 Avenue Edmonton, AB, T6G 1C9 Canada 1 7802485581 1 7802485625 mandi.newton@ualberta.ca
http://orcid.org/0000-0003-3020-674X Wozney Lori PhD 2 http://orcid.org/0000-0001-6933-9596 Bagnell Alexa MD, MA 2 3 http://orcid.org/0000-0002-1484-9676 Fitzpatrick Eleanor RN, MN 2 3 http://orcid.org/0000-0001-5223-8860 Curtis Sarah MD, MSc 1 http://orcid.org/0000-0003-4996-7784 Jabbour Mona MD, MEd 4 http://orcid.org/0000-0002-0031-2026 Johnson David MD 5 http://orcid.org/0000-0001-8453-7849 Rosychuk Rhonda J PhD 1 http://orcid.org/0000-0001-8019-5466 Young Michael MD 2 3 http://orcid.org/0000-0002-0256-3224 Ohinmaa Arto PhD 1 http://orcid.org/0000-0002-7094-1573 Joyce Anthony PhD 1 http://orcid.org/0000-0002-6728-2415 McGrath Patrick PhD 2 3 http://orcid.org/0000-0002-9568-2571 1 University of Alberta Edmonton, AB Canada 2 IWK Health Centre Halifax, NS Canada 3 Dalhousie University Halifax, NS Canada 4 University of Ottawa Ottawa, ON Canada 5 University of Calgary Calgary, AB Canada Corresponding Author: Amanda S. Newton mandi.newton@ualberta.ca Jan-Mar 2016 29 01 2016 5 1 e18 13 3 2015 16 7 2015 5 8 2015 11 11 2015 ©Amanda S. Newton, Lori Wozney, Alexa Bagnell, Eleanor Fitzpatrick, Sarah Curtis, Mona Jabbour, David Johnson, Rhonda J. Rosychuk, Michael Young, Arto Ohinmaa, Anthony Joyce, Patrick McGrath. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 29.01.2016. 2016

This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.

 Background

There is a demand to make first-line treatments, including cognitive behavioural therapy (CBT) for adolescent anxiety disorders, more widely available. Internet-based CBT is proposed to circumvent access and availability barriers and reduce health care system costs. Recent reviews suggest more evidence is needed to establish the treatment effects of Internet-based CBT in children and adolescents and to determine related economic impacts.

 Objective

This pilot trial aims to collect the necessary data to inform the planning of a full-scale RCT to test the effectiveness of the Internet-based CBT program Breathe (Being Real, Easing Anxiety: Tools Helping Electronically).

 Methods

We are conducting a 27-month, 2-arm parallel-group, pilot randomized controlled trial (RCT). Outcomes will inform the planning of a full-scale RCT aimed to test the effectiveness of Internet-based CBT with a population of adolescents with moderate to mild anxiety problems. In the pilot RCT we will: (1) define a minimal clinically important difference (MCID) for the primary outcome measure (total anxiety score using the Multidimensional Anxiety Scale for Children); (2) determine a sample size for the full-scale RCT; (3) estimate recruitment and retention rates; (4) measure intervention acceptability to inform critical intervention changes; (5) determine the use of co-interventions; and (6) conduct a cost-consequence analysis to inform a cost-effectiveness analysis in the full-scale RCT. Adolescents aged 13-17 years seeking care for an anxiety complaint from a participating emergency department, mobile or school-based crisis team, or primary care clinic are being screened for interest and eligibility. Enrolled adolescents are being randomly allocated to either 8 weeks of Internet-based CBT with limited telephone and e-mail support, or a control group with access to a static webpage listing anxiety resources. Adolescents are randomly assigned using a computer generated allocation sequence. Data are being collected at baseline, treatment completion, and at a 3-month follow-up.

 Results

Currently, adolescents are being enrolled in the study. Enrolment is taking place between March 2014 and February 2016; data collection will conclude May 2016. We expect that analysis and results will be available by August 2016.

 Conclusions

In many communities, the resources available for front-line anxiety treatment are outweighed by the need for care. This pilot RCT is an essential step to designing a robust RCT to evaluate the effectiveness of an Internet-based CBT program for adolescents with moderate to mild anxiety problems.

 Trial Registration

Clinicaltrials.gov NCT02059226; http://clinicaltrials.gov/ct2/show/NCT02059226 (Archived by WebCite at http://www.webcitation.org/6epF8v7k4)

 anxiety etherapy cognitive behavioral therapy adolescents mental health Internet intervention pilot randomized controlled trial Introduction

Anxiety disorders are the most common mental disorders diagnosed in adolescence, with prevalence before age 18 reported as greater than 30% [1,2]. The median age of onset is 11 years, making these disorders some of the earliest to develop [3]. Early onset disorders often follow a chronic course [4] and can significantly interfere with interpersonal relationships, academic performance and daily functioning [5-7]. Anxiety disorders range in severity and specific symptomology, but the more frequently diagnosed disorders in adolescents include social anxiety disorder (social phobia) [8-10], generalized anxiety disorder [8,11,12], and specific phobia [8,12]. The most prevalent is social anxiety disorder, with studies showing a two-fold increase in the prevalence of this disorder during teenage years [13,14]. The high prevalence of social anxiety disorder in adolescence can be understood in the context of developmental and environmental transitions (eg, puberty, dating, new schools, peer experiences) [9]. Undetected or undertreated, these disorders present significant future risk for adult anxiety disorders, educational underachievement, suicidality, depression, substance abuse and future hospitalization [5-7,15-19].

Cognitive behavioral therapy (CBT) as a first-line treatment for anxiety disorders in children and adolescents is well established [20,21,22] and supported by meta-analytic work [23,24,25]. CBT combines systematic exposure to feared situations with skills training and the learning of activities to help replace anxious thoughts about feared situations with more adaptive thoughts [20,21]. These treatment elements are based on the premise that repeated exposure to feared situations results in desensitization, reducing anxiety and avoidant behaviors, and improving functioning. Relaxation strategies, such as imagery and deep breathing, are included in skills training to provide ways to manage discomfort during repeated exposures [21].

Trained mental health professionals have traditionally delivered CBT, but the structured and sequential nature of CBT translates well to computer-based delivery. Within this approach, the use of the Internet as a delivery mode provides researchers with unobtrusive ways to capture data and examine access patterns, compliance, and usability issues [26]. Internet-based delivery also circumvents multiple barriers to receiving in-person CBT including: social stigma, direct and incidental costs (eg, time out of school), lack of trained deliverers, and inconvenient service times and locations [27]. This delivery method may also increase the number of young people seeking professional help. A published paper in 2002 reported that over a one-year timeframe, only 8.3% of young people with recent onset anxiety and 21.4% with chronic anxiety had sought professional help [28]. While Internet-based CBT is considered lower-intensity than in-person treatment, the majority of adolescents with anxiety disorders experience mild to moderate distress and impairment, making treatment availability paramount. Thus, Internet-based CBT is proposed to reduce demand for therapy delivered in-person, introduce cost savings, and increase timely access to recommended treatment [29].

Three recent systematic reviews of the literature have shown that self-led, computer-based and computer-assisted CBT, in combination with in-person or therapist-guided care, are viable and effective treatment approaches for children and adolescents [30,31,32]. Studies of treating adolescents using Internet-based CBT are limited to two [33,34], but provide important evidence and methodological considerations for other treatment studies. In a study targeting social fears (mainly centered on public speaking) in high school students who met the diagnostic criteria for social anxiety disorders, Tillfors et al. found that significant reductions in anxiety symptoms and improvements to mood were achieved post-intervention and maintained at one-year follow-up [34]. These treatment effects were noted as comparable to those achieved through traditional face-to-face CBT. Focusing on the treatment of adolescents who had a “markedly disturbing/disabling” anxiety disorder (predominantly generalized anxiety disorder and social phobia), Spence et al. also found that Internet-based CBT with minimal therapist support was equally efficacious as face-to-face CBT delivery in reducing anxiety symptoms post-intervention and up to one-year post-treatment [33]. The parents of participating adolescents also took part in this online program. In both studies, methods to improve treatment compliance, and the impact of compliance on treatment outcome, were noted as issues that required further investigation. Tillfors et al. reported that, of nine online modules available to complete within a 9-week period, the average number of completed modules was 2.9 [34]. Spence et al. noted that on average, adolescents and parents completed 7.5/10 and 4.48/5 sessions, respectively [33].

While the reported treatment effects of Internet-based CBT for treating adolescent anxiety are promising [33,34], published systematic reviews highlight important methodological issues that future studies must consider, in order to mature the evidence base [30,31,32]. Two reviews reported that the overall quality of the outcomes reported by studies of computerized CBT, including Internet-based CBT for adolescents, was low to very low [30,32]. Key limitations of the evidence base that were identified included: small sample sizes, intervention and comparator (waitlist or active control) differences between studies, and inconclusive treatment effects when anxiety was self-rated (versus clinician rated) [30,31,32]. Many of these limitations were also noted in the Tillfors and Spence studies [33,34]. Reviews to date have recommended that higher quality evidence is needed to firmly establish the treatment effects of computerized CBT, and that the study of associated economic impacts is needed [30,31,32].

We designed a pilot randomized controlled trial (RCT) that addresses several of the limitations highlighted in the literature to date. This pilot trial aims to collect the necessary data to inform the planning of a full-scale RCT to test the effectiveness of the Internet-based CBT program Breathe (Being Real, Easing Anxiety: Tools Helping Electronically). In the pilot RCT we will (1) define a minimal clinically important difference (MCID), as defined by adolescents, for the primary outcome measure, (2) determine a sample size for a full-scale RCT, (3) estimate recruitment and retention rates to determine the number of study sites needed, (4) measure intervention acceptability to inform critical intervention changes, (5) determine the use of co-interventions, and (6) conduct a cost-consequence analysis to inform a cost-effectiveness analysis for a full-scale RCT.

 Methods Study Design

We are conducting a 27-month, 2-arm parallel-group, pilot RCT. Eighty adolescents will be randomly assigned to either 8 weeks of Internet-based CBT with telephone and e-mail support (the Breathe program), or a control (minimal intervention) group with 8 weeks of access to a static webpage with general anxiety resources and information. Study enrolment is taking place from March 2014 to February 2016; data collection will conclude May 2016. Details of the study design are illustrated in Figure 1. The study has been approved by host institutions’ Research Ethics Boards.

Trial flow diagram.

 Participants

Participants are adolescents from three Canadian provinces (Alberta, Ontario, and Nova Scotia) seeking care from a pediatric emergency department, mobile or school-based mental health team, or primary care setting that is participating as a study recruitment site. Study inclusion criteria are: (1) ages 13 to 17 years, (2) self-reported mild to moderate anxiety, (3) ability to read and write English, (4) regular access to a telephone and a computer system with high speed Internet service, and (5) ability to use a computer to interact with web material. Adolescents aged 13 to 14 years must also have a consenting parent.

Adolescents are screened for study inclusion criteria via a secure online recruitment process or telephone-based recruitment phone call. Demography is collected during the screening process to characterize adolescents who meet and do not meet clinical eligibility. Screening criteria (1), (3), (4), and (5) are assessed through yes/no answers. We are using the Screen for Child Anxiety Related Emotional Disorders (SCARED) [35] to screen for mild-to-moderate anxiety symptoms (eligibility criteria #2). The SCARED is a 41-item self-report screen for symptoms of panic disorder, social phobia and anxiety disorder, and general anxiety disorder in clinical and community adolescent samples, based on DSM-IV criteria [36,37,38]. Adolescents can report any experience of anxiety (ie, responds to any of the 41 items of anxiety symptoms/experiences as being “Somewhat/Sometimes True” or “Very/Often True”) to be considered eligible for study participation.

We are also screening for risk of suicide using the Ask Suicide-Screening Questions (ASQ) [39]. The ASQ is a brief 4-item instrument originally validated for use in emergency departments with high sensitivity for identifying the risk of suicide [39]. A “yes” response to questions 1 (“In the past few weeks, have you wished you were dead?”), 2 (“In the past few weeks, have you felt that you or your family would be better off if you were dead?”) or 4 (“Have you ever tried to kill yourself?”) on the ASQ involves a safety-follow up phone call from a research team member to evaluate intent/severity/immediacy of risk before deciding on adolescent eligibility. Adolescents who respond “yes” to question 3 on the ASQ (“In the past week, have you been having thoughts about killing yourself?”) are excluded from the study and receive brief telephone based support from a research team member to evaluate intent/severity/immediacy of risk and encourage the adolescent to seek further mental health care/crisis care.

 Procedure and Randomization

Potentially eligible participants (and their parents) can receive oral, written, and/or online information about the study. In the Canadian provinces involved in this study, there is no specified age of consent. A minor’s ability to consent or assent is decided after assessing capacity to consent. In this study, 15 to 17 year-olds will be allowed to consent to the study on their own behalf. We will require parental consent for adolescents aged 13 to 14 years. This decision was not based on any age of consent law; we want to acknowledge the role that parents have in their younger adolescent’s activities and their ability to provide perspective on their child’s potential participation in the study. Requiring parental consent will provide us with a formal mechanism to engage with parents before study enrolment. We will seek assent from adolescents aged 13 to 14 years even if they were assessed as being able to consent.

Randomization takes place after informed consent/assent is obtained. Adolescents are randomly assigned using a computer-generated allocation sequence. Participants are randomly allocated to one of two treatment conditions and receive this allocation information via e-mail from a graduate student trainee affiliated with the project. The e-mail also provides login/website information to the allocated intervention. Given the study objectives, the pilot was designed as open-label.

 Measures Primary Outcome Measure

Change in anxiety symptoms in adolescents will be measured using the total score from the Multidimensional Anxiety Scale for Children (MASC2; 50 items). The MASC2 is one of the most widely used self-report measures in clinical trials in adolescents with anxiety disorders. It assesses physical symptoms, social anxiety, harm avoidance, separation/panic, and total anxiety, and has excellent 3-month test-retest reliability [40] and excellent validity [41,42]. Adolescent self-report is desirable because of the internalizing nature of anxiety [43]. The MASC2 is administered online via Intelligent Research Intervention Software (IRIS) to adolescents in the treatment group at three data collection time points: baseline (pre-treatment), 8 weeks/end of 8th Breathe module (post-treatment) and 3 months post-treatment (follow-up). Adolescents in the control group complete the MASC2 at baseline and 8 weeks after study enrolment via IRIS. Table 1 outlines screening and outcome measurement time points.

Outcome measurement schedule.

Study time points
Study eligibility screening Baseline 8 weeks(postintervention) 20 weeks (3-month follow-up) End of study enrolment period (22 months from trial start) End of data collection period (27 months from trial start)
Demography X
SCARED X
ASQ X
Co-intervention use/costs X
MASC2 X X X
MCID X
Treatment satisfaction X
Treatment adherence X
Number of adolescents screened X
Number of adolescents enrolled X
Number of adolescents retained at 3-month follow-up X
Secondary Outcome Measures

All secondary outcome data are collected via self-report using IRIS. The MCID will be determined for the primary outcome measure following module 8 completion (post-intervention). Adolescents allocated to the treatment condition are asked to indicate the minimum change in anxiety for which they would consider treatment participation. We will use the MCID to guide interpretation and application of outcome change in a full-scale RCT. To estimate the MCID, we will use adolescents’ global ratings of change on a 10-point Likert scale (-5 to +5), a commonly used anchor [44,45].

Satisfaction will be measured in adolescents allocated to the treatment condition at the end of module 8 (post-intervention) to infer intervention acceptability. A 12-item instrument developed by the research team will measure satisfaction based on the adolescent’s report of the program’s engagement and sense of safety/privacy, expectations and usefulness, communication, and technical (intervention) management. For 10 statements, a 5-point Likert response format ranging from strongly agree (score 5) to strongly disagree (score 1) will be used. Scores range from 10 to 50 with scores of 40 or greater indicating higher acceptability. Two open-ended questions to inform the larger trial will allow adolescents to identify challenges or barriers that were faced in taking part in the trial, and the extent to which adolescents used the skills learned.

Treatment adherence will be measured at 8 weeks to further evaluate intervention acceptability. Adherence is measured by documenting the number of treatment modules and homework tasks completed. We will also record the number of tailored modules completed by each participant (treatment arm) and site visits (control arm). These data are being collected through IRIS.

Health care resource use will be detailed for a preliminary cost-consequence analysis [46,47]. The following are being reviewed: (1) software development and maintenance costs, (2) training and personnel costs for the treatment arm, (3) health care utilization data (eg, visits to the emergency department, hospital admission), and (4) other costs reported by adolescent (ie, time off from work/school). Adolescents will be asked at the post-intervention assessment to report on the use of co-interventions during the study period (eg, emergency department visits, other treatments, medication) and reasons for this use (eg, unmet need, medication prescribed before the study).

 Sample Size

We have been conservative in estimating our ability to enroll and retain participants, by assuming that 50% will refuse to participate and 50% of enrolled adolescents will drop out. A total of 160 adolescents are being invited to participate with the expectation that we will enroll 80 adolescents (40 assigned to each study arm) and retain 40 adolescents (20 per arm) by module 8 completion (post-intervention). In keeping with the standard goals of a pilot RCT, a sample size of 40 adolescents at post-intervention (20 per arm) will provide sufficient data on the primary outcome to calculate a sample size based on 90% power for a full-scale RCT [48,49].

 Treatment Condition Essential Clinical Components

Consistent with published CBT treatment recommendations [20,21,22], the Breathe program consists of 8 core CBT treatment modules (8 weeks of treatment; Figure 2) that involve (1) multi-media based education about anxiety problems and approaches to overcoming anxiety (eg, reviewing why exposure exercises are important), (2) self-assessment activities to determine level of treatment and safety needs (Figure 3), (3) activities to teach adolescents about anxiety sensitivity, how to identify anxious thoughts, and how to develop realistic thinking about anxiety-producing situations (Figure 4), (4) coping and relaxation skill activities with self-assessment of performance and rewards, (5) development of a hierarchy of feared situations and steps for gradual and repeated exposure to feared situations (using imagery and in vivo activities), (6) contingency management (examining the function of anxiety from a reinforcement perspective) and modeling (viewing videos of others confronting feared situations), and (7) skills for maintenance and relapse prevention. Animations, embedded video, audio playback, graphic novel style vignettes, image maps, timed prompts and on screen pop-ups provide an interactive and multimodal experience to promote sustained engagement with the treatment content across modules.

Adolescents are instructed at the beginning of the trial to use the program weekly. Adolescents who do not log in for one week receive an e-mail encouraging them to log in to complete their weekly module. During the program, adolescents have access to an Ask the Expert feature where they can e-mail a trained research team member with questions regarding the program and/or treatment. Breathe successfully underwent iterative usability testing cycles with five clinicians and five adolescents prior to the pilot study to ensure adherence to CBT therapeutic principles, developmental appropriateness for the target age group, satisfaction, and engagement with the multi-media content.

A screenshot of the Breathe program home screen.

A screenshot of a weekly self-assessment activity.

A screenshot of a learning activity.

 Persuasive Design Mechanisms

Breathe is delivered via the Internet-based platform IRIS, which supports the integration of persuasive design mechanisms [50] for Internet-based interventions that are proven to encourage user engagement. Through the adaptive informatics architecture of IRIS, Breathe personalizes the program for adolescents via three primary mechanisms: tailoring content (ie, providing custom information and feedback to the adolescent based on their actions); self-monitoring (ie, enabling the adolescent to track their own behavior toward intended outcomes); and automated suggestions/reminders (ie, providing adolescents with information at the right time and the right context to help them keep on track). For example, an adolescent who indicates issues with alcohol or other drug use would receive material on these topics, while an adolescent who indicates alcohol or other drug use is not an issue would not. Breathe also engages the adolescent’s parent(s) by sending e-mails with educational materials about the nature of adolescent anxiety and highlights of key topics their child is working on in the program. Adolescents are given the choice as to whether they want parents to receive these e-mail updates.

 Safety Monitoring

The risks for adolescents participating in this pilot trial are considered minimal, but those in the treatment group are monitored each time they start and finish a module in the intervention program, to assess clinical functioning. Adolescents complete a check-in and check-out whereby they answer questions related to anxiety symptoms and indicate whether they are having thoughts of self-harm or harming others. This check-in/check-out is a typical clinical feature of CBT programs. The research team monitors the adolescents’ answers through automated indicators built into the IRIS program. If IRIS flags a safety issue (eg, decompensation in anxiety symptoms, thoughts of self-harm), a research team member contacts the adolescent and their parent(s) by phone follow-up within 36 hours and directs them to emergency services if the adolescent requires more immediate care. Additionally, the adolescent is automatically directed onscreen to a safety video on self-harm and a pop-up box appears in the program encouraging the adolescent to notify a parent/guardian of their thoughts and to seek immediate help. Access to the Ask the Expert feature in Breathe and e-mail contact also allow adolescents to identify distressing issues that may be activated during treatment. Such adolescents are re-assessed to determine if continuing in the study is advisable. Those adolescents not able to use the program independently or who are struggling with additional mental health issues may be referred to a higher level of care. Any serious adverse event will be reported to the institutional ethics board according to the standard operating procedures. Adolescents randomized to the control group are provided with contact information for local emergency resources (crisis lines, emergency department and/or other crisis mental health resources).

 Control (Minimal Intervention) Condition

Adolescents assigned to the control group are provided with access to a static webpage that houses suggested anxiety-related trade publications, print-based workbooks for adolescents, and the names of organizations and websites where the adolescent might find support. There is no interactivity or personalization included in the webpage. Adolescents assigned to the control group are provided with the option to use the Breathe program at the end of their 8-week control group participation. At that time, the study will follow the same processes to monitor safety and support adolescents who may require additional help, as detailed above.

 Statistical Analyses

Adolescent reports of anxiety, intervention acceptability and adherence, use of co-interventions, recruitment and retention rates, and demography will be described by numerical summaries (mean, frequency, range, and standard deviation [SD]). The mean difference in primary outcome change scores (and SDs) from baseline to the completion of module 8 (post-intervention) will be calculated with 95% CIs. SD values from the primary outcome change scores will be used to guide the full-scale RCT sample size calculations [51]. Adolescent global ratings of change (within the ranges of +2 to +3 or -2 to -3 for reported change using the 10-point Likert scale) will serve as the estimate for the MCID value [52]. The study recruitment rate (number of adolescents enrolled during the study recruitment period) and the retention rate (number of adolescents retained at the 3-month follow-up as indicated by MASC2 completion) will be calculated. These rates will be used to determine the number of study sites and time period needed for a full-scale RCT. Frequencies and proportions (with 95% CIs) will be used to describe categorical variables (eg, gender). We will summarize characteristics of completers (>75% of modules) and non-completers, and conduct tests of association to identify particular adolescents (eg, by gender) that may benefit from additional measures to maintain engagement, and will explore potential confounders (eg, age, sex, co-morbidity) that may be adjusted for in the full-scale RCT. Mean costs (and SDs) will be calculated (with 95% CIs) using published recommendations [46,47]. To account for the amortization of intervention use after upfront costs, we will distribute the investment costs over a 3- to 5-year investment time duration using a 5% societal interest rate and using 3% and 0% rates in the sensitivity analysis. Costs for reported co-interventions (health care services) will be estimated using Alberta costing and using 2015-dollar values.

 Results

Currently, adolescents are being enrolled in the study. Enrolment is taking place between March 2014 and February 2016; data collection will conclude May 2016. We expect that analysis and results will be available by August 2016.

 Discussion

As current systems-based models of health care look to enhance local community resource capacity, stepped care options and improved access to mental health services for adolescents are needed. Recent systematic reviews have shown that self-led, computer-based and computer-assisted CBT are viable treatment approaches for adolescents, but suggest that maturation of the evidence base is needed [30,31,32]. This pilot RCT is an essential step to designing a robust RCT to evaluate the effectiveness of Internet-based CBT for adolescents with moderate to mild anxiety problems. As a first step, satisfaction and treatment adherence results will indicate whether we need to make any critical intervention changes prior to a full-scale RCT.

We will use our pilot RCT results to develop a protocol for a full-scale trial. This trial will be designed to test the effectiveness of the Breathe program compared to a web-based, minimal control intervention providing psychoeducation (static webpage) in reducing anxiety symptoms in adolescents with moderate to mild anxiety problems. The MCID, sample calculation, and co-intervention use determined from the pilot RCT will inform full-scale trial methodology. Our sample calculation will ensure the full-scale trial is adequately powered, and will address sample size limitations noted in the literature to date [30]. The use of the MCID in the full-scale trial may also help to clarify inconclusive self-rated treatment effects reported across similar trials [30]. Our cost-consequence analysis will inform a cost-effectiveness analysis in the full-scale RCT. Finally, we will use the recruitment and retention rates calculated in the pilot trial to determine the number of study sites and timeline necessary to recruit the full-scale RCT sample.

 Abbreviations ASQ

Ask Suicide-Screening Questions

 Breathe

Being Real, Easing Anxiety: Tools Helping Electronically

 CBT

cognitive behavioral therapy

 IRIS

Intelligent Research Intervention Software

 MASC

Multidimensional Anxiety Scale for Children

 MCID

minimal clinically important difference

 RCT

randomized controlled trial

 SCARED

Screen for Child Anxiety Related Emotional Disorders

 SD

standard deviation

This project is funded by an operating grant from the Canadian Institutes of Health Research (CIHR; MOP119531) and the Royal Bank of Canada (RBC) Foundation—Children’s Mental Health Project. Dr. Newton holds a CIHR New Investigator Award. Dr. Rosychuk is a Health Scholar with Alberta Innovates-Health Solutions. Dr. McGrath holds a Canada Research Chair (Tier 1) in children’s health. Funders had no role in designing this study.

ASN and PM conceived of the study, acquired funding, and participated in its design and coordination and helped to draft the manuscript. LW participated in the drafting of the study protocol and drafted the manuscript. AB, SC, EF, and MY participated in the design of the study related to clinical processes and safety monitoring, and will contribute to study monitoring. MJ and DWJ participated in the design of the study and multi-site trial management, and will contribute to trial monitoring. RJR and AO participated in the design of the study and will contribute to statistical and cost-consequence analyses, respectively. AJ participated in the design of the study related to measurement outcomes. All authors will participate in results interpretation and full-scale trial planning, and have read and approved the final manuscript.

The IRIS platform used in this study was developed by co-author Patrick McGrath and is currently being redesigned for commercialization.

 Merikangas KR He J Burstein M Swanson SA Avenevoli S Cui L Benjet C Georgiades K Swendsen J Lifetime prevalence of mental disorders in U.S. adolescents: results from the national comorbidity survey replication--adolescent supplement (NCS-A) J Am Acad Child Adolesc Psychiatry 2010 10 49 10 980 9 10.1016/j.jaac.2010.05.017 20855043 S0890-8567(10)00476-4 PMC2946114 Kessler RC Avenevoli S Costello EJ Georgiades K Green JG Gruber MJ He J Koretz D McLaughlin KA Petukhova M Sampson NA Zaslavsky AM Merikangas KR Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the national comorbidity survey replication adolescent supplement Arch Gen Psychiatry 2012 04 69 4 372 80 10.1001/archgenpsychiatry.2011.160 22147808 archgenpsychiatry.2011.160 PMC3445020 Kessler RC Berglund P Demler O Jin R Merikangas KR Walters EE Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication Arch Gen Psychiatry 2005 06 62 6 593 602 10.1001/archpsyc.62.6.593 15939837 62/6/593 Keller MB Lavori PW Wunder J Beardslee WR Schwartz CE Roth J Chronic course of anxiety disorders in children and adolescents J Am Acad Child Adolesc Psychiatry 1992 07 31 4 595 9 10.1097/00004583-199207000-00003 1644719 S0890-8567(09)64072-7 Ialongo N Edelsohn G Werthamer-Larsson L Crockett L Kellam S The significance of self-reported anxious symptoms in first grade children: prediction to anxious symptoms and adaptive functioning in fifth grade J Child Psychol Psychiatry 1995 03 36 3 427 37 7782406 Woodward LJ Fergusson DM Life course outcomes of young people with anxiety disorders in adolescence J Am Acad Child Adolesc Psychiatry 2001 09 40 9 1086 93 10.1097/00004583-200109000-00018 11556633 S0890-8567(09)60451-2 Simon Ellin Bögels Susan Maria Screening for anxiety disorders in children Eur Child Adolesc Psychiatry 2009 10 18 10 625 34 19415415 PMC2744785 O'Connell ME Boat T Warner KE Preventing mental, emotional, and behavioral disorders among young people: progress and possibilities The National Academies Collection: Reports funded by National Institutes of Health 2009 20662125 Kendall PC Compton SN Walkup JT Birmaher B Albano AM Sherrill J Ginsburg G Rynn M McCracken J Gosch E Keeton C Bergman L Sakolsky D Suveg C Iyengar S March J Piacentini J Clinical characteristics of anxiety disordered youth J Anxiety Disord 2010 04 24 3 360 5 10.1016/j.janxdis.2010.01.009 20206470 S0887-6185(10)00026-5 PMC2838990 Chavira DA Stein MB Childhood social anxiety disorder: from understanding to treatment Child Adolesc Psychiatr Clin N Am 2005 10 14 4 797 818, ix 10.1016/j.chc.2005.05.003 16171703 S1056-4993(05)00053-2 Costello EJ Egger HL Angold A The developmental epidemiology of anxiety disorders: phenomenology, prevalence, and comorbidity Child Adolesc Psychiatr Clin N Am 2005 10 14 4 631 48, vii 10.1016/j.chc.2005.06.003 16171696 S1056-4993(05)00061-1 Beesdo K Knappe S Pine DS Anxiety and anxiety disorders in children and adolescents: developmental issues and implications for DSM-V Psychiatr Clin North Am 2009 09 32 3 483 524 10.1016/j.psc.2009.06.002 19716988 S0193-953X(09)00056-2 PMC3018839 Essau CA Conradt J Petermann F Frequency and comorbidity of social phobia and social fears in adolescents Behav Res Ther 1999 09 37 9 831 43 10458047 S0005-7967(98)00179-X Wittchen HU Stein MB Kessler RC Social fears and social phobia in a community sample of adolescents and young adults: prevalence, risk factors and co-morbidity Psychol Med 1999 03 29 2 309 23 10218923 Hughes AA Lourea-Waddell B Kendall PC Somatic complaints in children with anxiety disorders and their unique prediction of poorer academic performance Child Psychiatry Hum Dev 2008 06 39 2 211 20 10.1007/s10578-007-0082-5 17786552 Mazzone L Ducci F Scoto MC Passaniti E D'Arrigo VG Vitiello B The role of anxiety symptoms in school performance in a community sample of children and adolescents BMC Public Health 2007 7 347 10.1186/1471-2458-7-347 18053257 1471-2458-7-347 PMC2228292 Egger HL Costello EJ Angold A School refusal and psychiatric disorders: a community study J Am Acad Child Adolesc Psychiatry 2003 07 42 7 797 807 10.1097/01.CHI.0000046865.56865.79 12819439 Brent DA Kalas R Edelbrock C Costello AJ Dulcan MK Conover N Psychopathology and its relationship to suicidal ideation in childhood and adolescence J Am Acad Child Psychiatry 1986 09 25 5 666 73 3760416 Compton SN Burns BJ Helen LE Robertson E Review of the evidence base for treatment of childhood psychopathology: internalizing disorders J Consult Clin Psychol 2002 12 70 6 1240 66 12472300 Connolly SD Suarez L Sylvester C Assessment and treatment of anxiety disorders in children and adolescents Curr Psychiatry Rep 2011 04 13 2 99 110 10.1007/s11920-010-0173-z 21225481 Seligman LD Ollendick TH Cognitive-behavioral therapy for anxiety disorders in youth Child Adolesc Psychiatr Clin N Am 2011 04 20 2 217 38 10.1016/j.chc.2011.01.003 21440852 S1056-4993(11)00004-6 PMC3091167 Compton SN March JS Brent D Albano AM Weersing R Curry J Cognitive-behavioral psychotherapy for anxiety and depressive disorders in children and adolescents: an evidence-based medicine review J Am Acad Child Adolesc Psychiatry 2004 08 43 8 930 59 15266189 00004583-200408000-00005 In-Albon T Schneider S Psychotherapy of childhood anxiety disorders: a meta-analysis Psychother Psychosom 2007 76 1 15 24 10.1159/000096361 17170560 96361 James AC James G Cowdrey FA Soler A Choke A Cognitive behavioural therapy for anxiety disorders in children and adolescents Cochrane Database Syst Rev 2013 6 CD004690 10.1002/14651858.CD004690.pub3 23733328 Chu BC Harrison TL Disorder-specific effects of CBT for anxious and depressed youth: a meta-analysis of candidate mediators of change Clin Child Fam Psychol Rev 2007 12 10 4 352 72 10.1007/s10567-007-0028-2 17985239 Essau CA Conradt J Petermann F Course and outcome of anxiety disorders in adolescents J Anxiety Disord 2002 16 1 67 81 12171214 Clarke AM Kuosmanen T Barry MM A systematic review of online youth mental health promotion and prevention interventions J Youth Adolesc 2015 01 44 1 90 113 10.1007/s10964-014-0165-0 25115460 Berry R Lai B The emerging role of technology in cognitive–behavioral therapy for anxious youth: a review J Rat-Emo Cognitive-Behav Ther 2014 2 1 32 1 57 66 10.1007/s10942-014-0184-5 Long AC Palermo TM Brief report: Web-based management of adolescent chronic pain: development and usability testing of an online family cognitive behavioral therapy program J Pediatr Psychol 2009 06 34 5 511 6 10.1093/jpepsy/jsn082 18669578 jsn082 PMC2684485 Pennant ME Loucas CE Whittington C Creswell C Fonagy P Fuggle P Kelvin R Naqvi S Stockton S Kendall T Expert Advisory Group Computerised therapies for anxiety and depression in children and young people: a systematic review and meta-analysis Behav Res Ther 2015 04 67 1 18 10.1016/j.brat.2015.01.009 25727678 S0005-7967(15)00016-9 Rooksby M Elouafkaoui P Humphris G Clarkson J Freeman R Internet-assisted delivery of cognitive behavioural therapy (CBT) for childhood anxiety: systematic review and meta-analysis J Anxiety Disord 2015 01 29 83 92 10.1016/j.janxdis.2014.11.006 25527900 S0887-6185(14)00172-8 Arnberg FK Linton SJ Hultcrantz M Heintz E Jonsson U Internet-delivered psychological treatments for mood and anxiety disorders: a systematic review of their efficacy, safety, and cost-effectiveness PLoS One 2014 9 5 e98118 10.1371/journal.pone.0098118 24844847 PONE-D-14-08409 PMC4028301 Spence SH Donovan CL March S Gamble A Anderson RE Prosser S Kenardy J A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety J Consult Clin Psychol 2011 10 79 5 629 42 10.1037/a0024512 21744945 2011-14202-001 Tillfors M Andersson G Ekselius L Furmark T Lewenhaupt S Karlsson A Carlbring P A randomized trial of Internet-delivered treatment for social anxiety disorder in high school students Cogn Behav Ther 2011 40 2 147 57 10.1080/16506073.2011.555486 25155815 Birmaher B Brent DA Chiappetta L Bridge J Monga S Baugher M Psychometric properties of the screen for child anxiety related emotional disorders (SCARED): a replication study J Am Acad Child Adolesc Psychiatry 1999 10 38 10 1230 6 10.1097/00004583-199910000-00011 10517055 S0890-8567(09)63237-8 Hale Iii WW Raaijmakers QA van Hoof A Meeus WH Improving screening cut-off scores for DSM-5 adolescent anxiety disorder symptom dimensions with the screen for child anxiety related emotional disorders Psychiatry J 2014 2014 517527 10.1155/2014/517527 24829901 PMC3994902 Desousa DA Salum GA Isolan LR Manfro GG Sensitivity and specificity of the screen for child anxiety related emotional disorders (SCARED): a community-based study Child Psychiatry Hum Dev 2013 06 44 3 391 9 10.1007/s10578-012-0333-y 22961135 Crocetti E Hale WW Fermani A Raaijmakers Q Meeus W Psychometric properties of the screen for child anxiety related emotional disorders (SCARED) in the general Italian adolescent population: a validation and a comparison between Italy and The Netherlands J Anxiety Disord 2009 08 23 6 824 9 10.1016/j.janxdis.2009.04.003 19427168 S0887-6185(09)00098-X Horowitz LM Bridge JA Teach SJ Ballard E Klima J Rosenstein DL Wharff EA Ginnis K Cannon E Joshi P Pao M Ask suicide-screening questions (ASQ): a brief instrument for the pediatric emergency department Arch Pediatr Adolesc Med 2012 12 166 12 1170 6 10.1001/archpediatrics.2012.1276 23027429 1363508 March JS Parker JD Sullivan K Stallings P Conners CK The multidimensional anxiety scale for children (MASC): factor structure, reliability, and validity J Am Acad Child Adolesc Psychiatry 1997 04 36 4 554 65 10.1097/00004583-199704000-00019 9100431 S0890-8567(09)62527-2 March J Parker JD Maruish ME The multidimensional anxiety scale for children (MASC) The Use of Psychological Testing for Treatment Planning Outcome Assessment. 3rd ed. Volume 2 Instruments for Children and Adolescents 2004 Mahwah, NJ Lawrence Erlbaum Associates 39 62 Dierker LC Albano AM Clarke GN Heimberg RG Kendall PC Merikangas KR Lewinsohn PM Offord DR Kessler R Kupfer DJ Screening for anxiety and depression in early adolescence J Am Acad Child Adolesc Psychiatry 2001 08 40 8 929 36 10.1097/00004583-200108000-00015 11501693 S0890-8567(09)60341-5 Jellinek MS Murphy JM Screening for psychosocial disorders in pediatric practice Am J Dis Child 1988 11 142 11 1153 7 3177320 Jaeschke R Singer J Guyatt GH Measurement of health status. Ascertaining the minimal clinically important difference Control Clin Trials 1989 12 10 4 407 15 2691207 Crosby RD Kolotkin RL Williams GR Defining clinically meaningful change in health-related quality of life J Clin Epidemiol 2003 05 56 5 395 407 12812812 S0895435603000441 Drummond MF Sculpher MJ Torrance GW O’Brien BJ Stoddart GL Methods for the Economic Evaluation of Health Care Programmes. 3rd edition 2005 Oxford Oxford University Press Marshall DA Hux M Design and analysis issues for economic analysis alongside clinical trials Med Care 2009 07 47 7 Suppl 1 S14 20 10.1097/MLR.0b013e3181a31971 19536012 Lancaster GA Dodd S Williamson PR Design and analysis of pilot studies: recommendations for good practice J Eval Clin Pract 2004 05 10 2 307 12 10.1111/j.2002.384.doc.x 15189396 JEP384 Arain M Campbell MJ Cooper CL Lancaster GA What is a pilot or feasibility study? A review of current practice and editorial policy BMC Med Res Methodol 2010 10 67 10.1186/1471-2288-10-67 20637084 1471-2288-10-67 PMC2912920 Kelders SM Kok RN Ossebaard HC Van Gemert-Pijnen JE Persuasive system design does matter: a systematic review of adherence to web-based interventions J Med Internet Res 2012 14 6 e152 10.2196/jmir.2104 23151820 v14i6e152 PMC3510730 Browne RH On the use of a pilot sample for sample size determination Stat Med 1995 09 15 14 17 1933 40 8532986 Juniper EF Guyatt GH Willan A Griffith LE Determining a minimal important change in a disease-specific quality of life questionnaire J Clin Epidemiol 1994 01 47 1 81 7 8283197 0895-4356(94)90036-1 Multimedia Appendix 1

Peer reviewer comments from the CIHR grant supporting this study. This manuscript reports Phase 3 (the pilot RCT) that is commented on in the reviews.