Published on in Vol 9 , No 12 (2020) :December

Preprints (earlier versions) of this paper are available at, first published .
Feasibility, Acceptability, and Effectiveness of Enhanced Cognitive Behavioral Therapy (eCBT) for Children and Adolescents With Obsessive-Compulsive Disorder: Protocol for an Open Trial and Therapeutic Intervention

Feasibility, Acceptability, and Effectiveness of Enhanced Cognitive Behavioral Therapy (eCBT) for Children and Adolescents With Obsessive-Compulsive Disorder: Protocol for an Open Trial and Therapeutic Intervention

Feasibility, Acceptability, and Effectiveness of Enhanced Cognitive Behavioral Therapy (eCBT) for Children and Adolescents With Obsessive-Compulsive Disorder: Protocol for an Open Trial and Therapeutic Intervention


1Department of Mental Health, Regional Centre for Child and Youth Mental Health and Child Welfare (RKBU Central Norway), Norwegian University of Science and Technology (NTNU), Trondheim, Norway

2de Bascule/Levvel, Academic Center for Child and Adolescent Psychiatry, Amsterdam, Netherlands

3Department of Child and Adolescent Psychiatry, St Olavs University Hospital, Trondheim, Norway

Corresponding Author:

Lidewij H Wolters, PhD

Department of Mental Health

Regional Centre for Child and Youth Mental Health and Child Welfare (RKBU Central Norway)

Norwegian University of Science and Technology (NTNU)

Klostergata 46

Trondheim, 7030


Phone: 47 73 55 15 00


Background: Although the evidence base of cognitive behavioral therapy (CBT) for pediatric obsessive-compulsive disorder (OCD) has been broadly established, the treatment is hampered by limited access, poor compliance, and nonresponse. New technologies offer the opportunity to improve the accessibility, user friendliness, and effectiveness of traditional office-based CBT. By employing an integrated and age-appropriate technologically enhanced treatment package, we aim to execute a more focused and attractive application of CBT principles to increase the treatment effect for pediatric OCD.

Objective: The aim of this open study is to explore the acceptability, feasibility, and effectiveness of a newly developed enhanced CBT (eCBT) package for pediatric OCD.

Methods: This study is an open trial using a historical control design conducted at the outpatient clinic of the Department of Child and Adolescent Psychiatry at St. Olavs University Hospital (Trondheim) or at BUP Klinikk (Aalesund). Participants are 30 children (age 7-17 years) with a primary Diagnostic and Statistical Manual of Mental Disorders (DSM)-5 diagnosis of OCD, and their parents. All participants receive eCBT. eCBT consists of the usual evidence-based CBT for pediatric OCD in an “enhanced” format. Enhancements include videoconferencing sessions (supervision and guided exposure exercises at home) in addition to face-to-face sessions; an app system of interconnected apps for the child, the parents, and the therapist; psychoeducative videos; and frequent online self-assessments with direct feedback to patients and the therapist. Primary outcome measures are the Children’s Yale-Brown Obsessive Compulsive Scale (CY-BOCS) (effectiveness), the Client Satisfaction Questionnaire-8 (acceptability), and treatment drop out (feasibility). Assessments are conducted pretreatment, posttreatment, and at 3- and 6-month follow-ups. A 12-month follow-up assessment is envisioned. The treatment outcome (CY-BOCS) will be compared to traditional face-to-face CBT (data collected in the Nordic Long-term OCD Treatment Study).

Results: Ethical approval has been obtained (2016/716/REK nord). Inclusion started on September 04, 2017. Data collection is ongoing.

Conclusions: This study is the first step in testing the acceptability, feasibility, and preliminary effectiveness of eCBT. In case of positive results, future steps include improving the eCBT treatment package based on feedback from service users, examining cost-effectiveness in a randomized controlled trial, and making the package available to clinicians and other service providers treating OCD in children and adolescents.

Trial Registration: ISRCTN, ISRCTN37530113; registered on January 31, 2020 (retrospectively registered);

International Registered Report Identifier (IRRID): DERR1-10.2196/24057

JMIR Res Protoc 2020;9(12):e24057




Pediatric obsessive-compulsive disorder (OCD) is a relatively common, severe, and debilitating condition [1], leading to substantial impairment in family, academic, and social functioning [2,3] and reduced quality of life [4]. Cognitive behavioral therapy (CBT) is the treatment of choice [5,6], and its effectiveness has been extensively demonstrated [7-9]. However, treatment for pediatric OCD is limited by several problems.

First, not all children benefit sufficiently from treatment. In general, after standardized CBT, average symptom improvement is about 50%, with large individual differences [10,11]. The combination of CBT with pharmacotherapy is an option for partial responders and nonresponders, but recent studies have cast doubts on the additional effect of medication [12,13]. Furthermore, use of medication entails several disadvantages, such as possible adverse effects, a heightened chance of relapse by discontinuation, and unknown effects in the long term [14]. This highlights the need for new ways to improve treatment for pediatric OCD.

Second, there are organizational and practical barriers to treatment. Particularly in remote areas, CBT is not always available, and in many places, there has been a long tradition of a shortage of experienced therapists and long waitlists for treatment [15-18]. Practical problems with scheduling, treatment associated costs, disorder-specific symptoms that restrict mobility, shame, and stigma can further limit accessibility to treatment [16,19-22].

In parallel, the use of digital technology in child mental health care is rapidly increasing [23]. Technologies (computers, internet, mobile devices, and apps) offer a unique opportunity to address several limitations associated with traditional treatment, such as access, suitability, expense, and stigma. In addition, new technologies can be appealing to children and adolescents, which may increase treatment compliance and motivation.

Several types of technology-based CBT (tCBT) programs for OCD have been developed and implemented, including online bibliotherapy, online self-help therapy, therapist-supported computerized CBT, smartphone apps, traditional CBT delivered via telephone or videoconferencing, and combinations of these forms [22,24-27]. Preliminary evidence shows that these programs yield positive effects overall. A meta-analysis on tCBT for OCD, which was based on eight randomized controlled trials (N=420, including youth, n=31), showed a large effect size for tCBT (d=1.18, CI 0.80-1.56) [25]. Moreover, tCBT was found to be superior to control conditions (waitlist and active controls, d=0.82), and no difference was found in efficacy between tCBT and traditional therapist-delivered CBT [25]. Results from a recent systematic review on tCBT for pediatric OCD (N=96) indicated that tCBT can be a feasible and acceptable treatment for youth with OCD [24].

However, tCBT for OCD is still in its infancy. Current evidence is limited by small numbers of trials, small sample sizes, methodological shortcomings, and focus on adults in most studies. In addition, tCBT programs vary greatly in format, duration, intensity, length, and their specific aims, making it hard to draw firm conclusions. This stresses the need for further research, especially in children with OCD.

In this protocol, we propose an enhanced cognitive behavioral therapy (eCBT) package for pediatric OCD, integrating modern internet technology and traditional CBT, in order to improve treatment response as well as user friendliness.

eCBT for Pediatric OCD

eCBT is an innovative treatment package for children and adolescents with OCD, which has been developed by academic OCD experts, clinicians, information technology and media developers, and service users. eCBT integrates modern technology with well-validated principles of CBT, with the aim to address some challenges faced by traditional therapy. eCBT employs the Norwegian [28] and Dutch [29] treatment manuals for CBT for pediatric OCD. For both protocols, effectiveness has been demonstrated [11,30]. Equivalent to traditional CBT, eCBT contains psychoeducation, exposure with response prevention (ERP), cognitive interventions, and relapse prevention. Parents are actively involved in the treatment. eCBT enhances traditional CBT by offering treatment at home via a webcam in addition to face-to-face sessions, more frequent therapist contact, and an app system to support and monitor treatment. Taking into account the shortage of experienced therapists and high societal health care costs, total therapist time for eCBT is kept equivalent to traditional CBT.

Treatment Components

The following five closely linked components are integrated in the eCBT treatment process: videoconferencing sessions in combination with face-to-face sessions, an app system, a psychoeducation tool, and frequent online ratings with direct feedback to the patient. We describe these components in more detail below.

eCBT combines face-to-face treatment sessions with videoconferencing sessions from home. During the videoconferencing sessions, therapists assist children in ERP exercises at home or at other places that elicit OCD symptoms. The videoconferencing sessions aim to improve the ecological validity of the treatment and to encourage generalization of CBT principles by extending treatment from the therapist’s office to settings in which the problems naturally occur. In addition, treatment at home may be more convenient and may reduce travelling time, costs, and stigma. Children and therapists have access to the video-teleconferencing software via their smartphones, using Cisco Webex Teams [31]. Face-to-face sessions, allowing for full contact, may facilitate the building of therapeutic alliance and may provide the therapist with other information since observations are not limited to the scope of the webcam.

The app system consists of a smartphone app for children, a smartphone app for parents, and a web-based application for therapists on the computer, which are all interconnected. The main goals of the app system are to increase motivation and treatment adherence, and to encourage parents’ involvement in the treatment process. The app system further contributes to personalizing treatment to individual needs. The app provides information about OCD and CBT (psychoeducation videos), supports and structures ERP exercises at home, and closely monitors treatment progress. The web-based application for therapists has a coordinating and monitoring function. The app can be used in the treatment sessions together with the therapist and independently at home. Multimedia Appendix 1 provides an overview of the app system.

The app system is fully integrated in the treatment process, starting in the first session with the psychoeducation tool. The psychoeducation tool contains four video stories showing animated narratives of children with OCD. The aim is to provide information about OCD and treatment (CBT), to increase insight in an attractive and accessible way, to give recognition to a patient’s struggle with OCD and take away shame, and to provide hope and motivation for treatment. The videos, displaying cartoons voiced over by a child or a parent, show how OCD has interfered in the lives of these children and their families, and show their experiences with treatment. The tone is positive and encouraging. The portraits represent children of different ages and both sexes, with different OCD symptomatology to facilitate recognition and identification with one of the portraits. Figure 1 displays a picture of one of the video stories. Multimedia Appendix 2 provides a description of the stories.

The app is also used to facilitate listing and monitoring of OCD symptoms. OCD symptoms can be entered via the therapist application during the treatment sessions or directly in the child and parent apps. Symptoms are scored on a subjective units of distress (SUD) scale. The three symptoms identified by the child and parents as most important are marked, forming the top problems measure that is used for idiographic patient-guided assessment of treatment progress [32]. Parents can make a list of the child’s symptoms from their perspective, for example, in case of young children who are not able to list the symptoms themselves and in the case of different views on the symptoms between parents and the child. This approach allows the therapist to get a more complete picture of the OCD and keep parents involved, and it may facilitate discussion when the child and parents disagree, opening the way to a shared vision.

Figure 1. Psychoeducation tool.
View this figure

The app further contains a feature to structure and support ERP exercises at home. During the treatment sessions, ERP exercises are described in the app and can be displayed at any moment in the child and parent versions of the app. The child can receive daily reminders for the ERP exercises. When the child activates an ERP exercise in the app, the description of the exercise appears, followed by a button to confirm the start and end of the exercise, and finally, an evaluation question (“How much discomfort did you have during the exercise?”; visual analog scale [VAS]). The app contains a virtual reward system for the number of completed ERP exercises to keep the child motivated. The description of the ERP exercises in the parents’ app keeps parents informed and may facilitate parents to support the exercises. Therapists can add, modify, and monitor exercises via the therapist application.

The child can build a personal support and relapse prevention plan via the app. Any kind of support (ie, coping strategies and tools for dealing with distress) in overcoming OCD can be added to the “toolbox” in the form of text, images, pictures, and video and audio files. The toolbox is a working file that is continuously supplemented and refined throughout the treatment. At the end of the treatment, an individualized relapse prevention plan is added to the toolbox. This plan can be exported to a PDF file, allowing for a paper version of the plan as well.

The child and parents are encouraged to daily rate OCD severity and overall psychological well-being using short idiographic ratings in the app with direct feedback to the patient and the therapist (Multimedia Appendix 3). In addition, the three OCD-related problems identified by the child and parents as most important (top problems measure) are evaluated weekly in the app. Reminders can be set for completing the ratings. Results (visually displayed in graphs showing progress during the last week and last 6 months) are directly accessible via the child and parent apps, since direct feedback to patients may enhance motivation and thereby treatment effect [33]. In addition, the outcomes provide the therapist with actual information. Signs of noncompliance can be monitored regularly, and early steps can be taken to address problems. Figure 2 displays a screenshot of the app.

Figure 2. Screenshot of the app for children.
View this figure
Treatment Process

eCBT covers a 14-week treatment period. The first part of the treatment (weeks 1-5) consists of weekly face-to-face sessions, equivalent to traditional CBT. Regular face-to-face sessions allow the therapist to start therapy in full contact with the child and the parents in order to build therapeutic alliance and establish treatment principles. However, as soon as the child starts with ERP exercises at home (week 2), an additional videoconferencing meeting is scheduled, resulting in two appointments with the therapist per week. During the videoconferencing sessions, the therapist guides the child while carrying out an ERP exercise at home or at another location if applicable. In this way, the therapist can provide extra support to the child when performing ERP exercises and solve problems directly. In the second part of the treatment, from week 6 onwards, the frequency of the face-to-face sessions is reduced from weekly to once in 2 weeks, since the treatment principles are expected to be established by this time and the main focus becomes continuation of ERP exercises. From this point, two videoconferencing sessions (guided ERP at home) and one face-to-face session are scheduled in a 2-week period. This schedule offers more frequent therapist contact than the usual weekly sessions in traditional CBT and provides the therapist with extra tools to ensure adequate execution of ERP exercises in a natural environment.

In the first face-to-face session (week 1), the therapist provides psychoeducation about OCD and treatment (CBT), augmented with the psychoeducation tool in the app. The eCBT concept is introduced, including an explanation of the app system. The therapist starts with an OCD symptom inventory, which will be completed during the coming weeks. The child as well as parents identify the three most important OCD-related problems (top problems measure). In the coming week, the child and/or parents report OCD symptoms in the app. They also start with ratings via the app. The therapist discusses the outcomes of the ratings during the face-to-face sessions. In the next session (week 2), the therapist and child establish a symptom hierarchy, and ERP exercises are set up. The first ERP exercise is practiced together in the session and will be further practiced at home. An appointment is made for a videoconferencing session later that week to guide the ERP exercise at home. In the third face-to-face session (week 3), the therapist evaluates the ratings (app) with the family and discusses the first experiences with practicing ERP at home. A new ERP exercise is selected (or the previous ERP exercise is adapted) to be practiced during the coming week. The new ERP exercise is first practiced during the session and will be further practiced at home. Based on clinical considerations, the therapist may introduce cognitive interventions (eg, challenging dysfunctional thoughts) during this session. Cognitive interventions are not mandatory but can be used to support the ERP exercises and increase motivation. The manual provides for different cognitive interventions, including guidelines for when to apply these interventions, allowing the therapist to customize the treatment to the child’s needs, capacities, and preferences. The face-to-face session will be followed by a videoconferencing session (guided ERP at home) later that week. From this point, the face-to-face sessions have the same structure and include evaluating the ratings and the ERP exercises practiced at home, preparing new ERP exercises, practicing ERP exercises in the session, and introducing optional cognitive interventions. From week 4, the child works on a personal support plan, which is supported by the “toolbox” feature in the app. The “toolbox” will be continuously supplemented and refined during the treatment. At the end of the treatment (weeks 12-14), an individualized relapse prevention plan is added to the toolbox. Multimedia Appendix 4 provides an overview of the treatment.

Research Protocol

The research protocol (version March 2020) describes an open study to explore the acceptability, feasibility, and effectiveness of eCBT for pediatric OCD.

Aims and Hypotheses

The aim of the study is to explore whether eCBT is (1) a feasible intervention in terms of treatment drop out; (2) an acceptable intervention; and (3) an effective intervention for children and adolescents with OCD in terms of positive treatment outcomes and showing noninferiority to traditional CBT (Nordic Long-term OCD Treatment Study [NordLOTS]) [11] for the primary outcome measure (Children’s Yale-Brown Obsessive-Compulsive Scale [CY-BOCS]).

We hypothesize that (1) preterm treatment drop out will be equivalent or lower than that found for traditional CBT (≤10%) [11]; (2) eCBT will be positively evaluated by children and their parents; (3) there will be a considerable reduction in OCD symptoms after treatment; and (4) the treatment outcome (CY-BOCS) for eCBT will show noninferiority to traditional CBT (NordLOTS) [11].

Study Design and Sample Size

This study is an open trial using a historical control design to explore the feasibility, acceptability, and effectiveness of eCBT in children and adolescents with OCD. To examine noninferiority of eCBT to traditional CBT, the treatment outcome for eCBT (CY-BOCS) will be compared to data collected in the NordLOTS [11]. The intended sample size is 30 participants.

Study Setting and Recruitment

Children who visit the outpatient clinic of the Department of Child and Adolescent Psychiatry at St. Olavs University Hospital (Trondheim) or at BUP Klinikk (Aalesund), and meet the study’s eligibility criteria are informed about the study and asked to consider participation. They receive the opportunity to ask questions and have a reasonable amount of time for consideration. Consenting patients are enrolled in the study. During the intake procedure, a qualified professional confirms OCD diagnosis and comorbid disorders using a semistructured interview (Schedule for Affective Disorders and Schizophrenia for School-Age Children Present and Lifetime Version [K-SADS-PL]) [34] if not completed prior to the trial. A standardized questionnaire is used to collect information about demographics and symptom/treatment history.

Study Procedures

All participants receive eCBT. For participants not having a smartphone and for those using an iPhone, an Android smartphone will be lent for the purpose of the study. Concurrent medication is allowed and will be reported during the study. Ongoing psychological treatment for OCD other than eCBT is not allowed. Participants can leave the study at any time for any reason if they wish to do so without any consequences. The investigator can decide to withdraw a participant from the study for urgent medical reasons. The following stop rules for study participation are applied: (1) problems other than OCD requiring acute other treatment (eg, severe depression and suicidal ideation) and (2) severe increase in OCD symptoms and insufficient response to eCBT treatment. Figure 3 shows the flow diagram of the study.

Figure 3. Flow diagram.
View this figure


To be eligible for study participation, a participant must meet all of the following criteria: (1) age 7-17 years (inclusive); (2) primary Diagnostic and Statistical Manual of Mental Disorders (DSM)-5 diagnosis of OCD; and (3) CY-BOCS score ≥16.

A potential participant meeting any of the following criteria will be excluded from participation: (1) a psychiatric comorbidity that has a higher treatment priority than OCD and makes participation clinically inappropriate (eg, primary anorexia nervosa, depression with suicidality, and psychosis); (2) mental retardation (if suspected based on the level of functioning, or in the presence of neuropsychiatric comorbidity, an IQ test is performed); and (3) insufficient understanding of the Norwegian language.


Assessments are performed pretreatment and posttreatment, and at 3- and 6-month follow-ups. A 12-month follow-up assessment is envisioned.

Outcome Measures

Outcome measures for treatment acceptability, feasibility, and effectiveness are specified below. Table 1 provides an overview of the assessments. Acceptability involves the following: Client Satisfaction Questionnaire-8 (CSQ-8) [35], primary outcome; a treatment evaluation questionnaire for children and their parents composed of the User Experience Questionnaire (UEQ) [36], and qualitative and quantitative treatment-specific questions; a modified version of the Barriers to Treatment Participation Scale (BTPS) [37], child and parent version (for the aim of this study, we shortened the questionnaire, added a child version, and adapted some items to increase the fit to the eCBT treatment package); and a short qualitative interview examining clinicians’ treatment satisfaction and their suggestions to improve the treatment. Feasibility involves the following: preterm treatment drop out, primary outcome; and number of eligible participants that rejected/accepted eCBT. Effectiveness involves the following: CY-BOCS [38], primary outcome; Child Obsessive-Compulsive Impact Scale-Revised (COIS-R) [39]; and Family Accommodation Scale for OCD–Self-Rated Version (FAS-SR) [40]. Comorbidity/psychological well-being involves the following: Strengths and Difficulties Questionnaire (SDQ) [41]; Child Behavior Checklist (CBCL) [42]; Youth Self-Report Questionnaire (YSR) [42]; Screen for Child Anxiety-Related Emotional Disorders-Revised (SCARED-R) [43,44]; Mood and Feelings Questionnaire (MFQ) [45]; KINDL-R [46]; Children’s Global Assessment Scale (CGAS) [47]; and Clinical Global Impressions Scale-Severity/Improvement (CGI-S, CGI-I) [48]. Other study parameters include the following: study-specific treatment integrity forms completed by the therapist following each treatment session and the Trimbos/iMTA Questionnaire for Costs associated with Psychiatric Illness (TiC-P) [49].

Table 1. Overview of assessments.
AssessmentPretreatmentDuring treatmentPosttreatmentFollow-up 3 monthsFollow-up 6 months
COIS-RgChild and parentN/AChild and parentChild and parentChild and parent
YSRjChild (≥11 years)N/AChild (≥11 years)N/AChild (≥11 years)
SCAREDkChild and parentN/AChild and parentChild and parentChild and parent
MFQlChild and parentN/AChild and parentChild and parentChild and parent
SDQmChild and parentN/AChild and parentChild and parentChild and parent
KINDLChild and parentN/AChild and parentChild and parentChild and parent
CSQ-8nN/AN/AChild and parentN/AN/A
Treatment evaluation questionnaireN/AN/AChild and parentN/AN/A
BTPSo (modified version)N/AN/AChild and parentN/AN/A
Session integrity formN/ATherapistN/AN/AN/A

aCY-BOCS: Children’s Yale-Brown Obsessive-Compulsive Scale.

bIE: independent evaluator.

cN/A: not applicable.

dCGI-S: Clinical Global Impressions Scale-Severity.

eCGI-I: Clinical Global Impressions Scale-Improvement.

fCGAS: Children’s Global Assessment Scale.

gCOIS-R: Child Obsessive-Compulsive Impact Scale-Revised.

hFAS: Family Accommodation Scale for obsessive-compulsive disorder.

iCBCL: Child Behavior Checklist.

jYSR: Youth Self-Report Questionnaire.

kSCARED: Screen for Child Anxiety-Related Emotional Disorders.

lMFQ: Mood and Feelings Questionnaire.

mSDQ: Strengths and Difficulties Questionnaire.

nCSQ-8: Client Satisfaction Questionnaire-8.

oBTPS: Barriers to Treatment Participation Scale.

pTiC-P: Trimbos/iMTA Questionnaire for Costs associated with Psychiatric Illness.

Data Management

All hard-copy forms and informed consent forms will be stored in a secured facility. Protection of participant identity will be guaranteed by assigning study-specific unique participant codes. Only the principle investigator (NS) and the executive investigator (LBE) have access to the key for unique study IDs. Codes will be used to conceal identities in all external communications. Rechecks or later use of the data will be possible using the anonymized data file. Later use of the data will only be possible with consent of the participant. Information (raw data) will be stored for 10 years.

Regular reports are sent to the funding agency. The study is not monitored or audited by an independent party.

Safety Procedures

Children and parents are encouraged to report the occurrence of adverse events or undesirable treatment effects to their therapists or to the investigator. Therapists report this information in the treatment integrity forms and contact the research team if needed. In addition, a member of the research team (BW) will discuss the occurrence of adverse events and undesirable treatment effects with the therapists at regular times. The investigator will report all serious adverse events that logically could be expected to be related to study participation or eCBT treatment to the sponsor without undue delay after obtaining knowledge of the events.

In case a participant’s condition deteriorates seriously during treatment, the therapist will perform an immediate assessment of the symptoms and will discuss this with the investigator to determine necessary actions.

The additional risk related to study participation for participants is assessed as negligible compared to regular treatment. eCBT follows the treatment principles of CBT, which is the evidence-based treatment for pediatric OCD. In addition, treatment progress and signs of noncompliance are monitored regularly, and immediate steps can be taken when problems are detected. In case of faltering technology (app or webcam), the therapist can be contacted by telephone, email, or face-to-face appointment. Patients can terminate treatment participation at any time and switch to regular treatment if desired. Risks related to technology and security cannot be excluded (ie, hacked data or spyware compromising patient confidentiality). However, security measures are undertaken. Data gathered with the app are stored on a secured server.

Statistical Analysis

Regarding feasibility and acceptability, descriptive statistics will be provided as follows: CSQ-8, treatment evaluation questionnaire, and modified BTPS for treatment acceptability, and preterm treatment drop out and number of eligible participants that rejected/accepted eCBT for treatment feasibility.

Regarding effectiveness, the treatment effect is expressed as percentage symptom improvement based on the CY-BOCS, the percentage of patients with OCD symptoms in the clinical range (CY-BOCS ≥ 16) and in remission (CY-BOCS ≤ 12), and the percentage of treatment responders (≥35% symptom reduction on the CY-BOCS plus CGI-I rating of 1 or 2 “[very] much improved”) [50]. Effect size (d) is calculated by the mean difference in the CY-BOCS score before and after eCBT divided by the SD of the difference in the score before and after eCBT. We will run a series of linear mixed models with treatment outcome (CY-BOCS, CGAS, COIS-R, FAS-SR, CBCL/YSR, SCARED, and MFQ) as the dependent factor and time as the independent factor. An independent t test will be performed to compare the treatment outcome (difference in the CY-BOCS score before and after treatment) in this study with the treatment outcome reported for the NordLOTS [11].

In terms of other study parameters, for treatment adherence, treatment integrity forms are evaluated by two raters independently, and Cohen kappa will be calculated. To get an impression of treatment costs, outcomes for the TiC-P (related to the SDQ) will be described.

In case of missing assessments, all possible attempts will be made to contact participants.

For feasibility and acceptability analyses, missing data will be described. Acceptability analyses will be conducted on cases having complete data on these measures after treatment.

Regarding treatment outcome, an algorithm for handling missing data is integrated in linear mixed model analyses. Cases with missing data at baseline will be excluded from analyses.

Sample Size

As the intervention concerns an innovative treatment, the study is primarily aimed at studying acceptability and feasibility. For this goal, a power calculation cannot be performed.

To explore noninferiority of eCBT to traditional CBT (as delivered in the NordLOTS), we will use a historical control design. A power calculation (noninferiority margin set at 4 points on the CY-BOCS) shows that 21 participants per treatment arm would be sufficient to show noninferiority (80% power).

The study has been approved by the Regionale komiteer for medisinsk og helsefaglig forskningsetikk (REK 2016/716/REK nord) and has been registered in the ISRCTN registry (ID: ISRCTN37530113). The study will be conducted according to the principles of the Declaration of Helsinki (version October 19, 2013; WMA, 2013) [51] and in accordance with the Medical Research Involving Human Subjects Act (WMO) and Good Clinical Practice (GCP) standards.

Multimedia Appendix 5 provides a summary of the trial registration data. Informed consent will be obtained prior to enrollment in the study. Inclusion started on September 04, 2017. Data collection is ongoing. The results will be published in peer-reviewed academic journals, presented at scientific conferences, and communicated to the participants and patient organizations. International Committee of Medical Journal Editors (ICMJE) criteria on contributorship and authorship are applied.

This study is the first step in testing the acceptability, feasibility, and preliminary effectiveness of eCBT. In case of positive results, future steps include improving the eCBT treatment package based on feedback from service users, examining cost-effectiveness in a randomized controlled trial, and making the package available to clinicians and other service providers treating OCD in children and adolescents.

Although eCBT has not been developed with the intention to overcome all barriers to treatment, we aim to improve treatment response by offering a more focused application of CBT principles in a user-friendly way. A future step would be to examine which approach works best for which patients.


We thank all collaborators in Norway and internationally who contributed to the development of the enhanced cognitive behavioral therapy approach. This work was supported by the Liaison Committee for Education, Research and Innovation in Central Norway (Samarbeidsorganet mellom Helse Midt-Norge RHF og NTNU; grant number 90023600).

Conflicts of Interest

None declared. For the sake of completeness, LHW reports personal fees from Bohn Stafleu van Loghum, Houten, the Netherlands (publisher), outside the submitted work, and BW reports personal fees from Gyldendal Akademisk forlag, Olso, Norway (publisher), outside the submitted work.

Multimedia Appendix 1

Overview of the app system.

PDF File (Adobe PDF File), 59 KB

Multimedia Appendix 2

Psychoeducation tool: stories.

PDF File (Adobe PDF File), 60 KB

Multimedia Appendix 3

Questions for monitoring treatment progress via the app system.

PDF File (Adobe PDF File), 74 KB

Multimedia Appendix 4

Enhanced cognitive behavioral therapy: treatment overview.

PDF File (Adobe PDF File), 99 KB

Multimedia Appendix 5

Summary of trial registration data.

PDF File (Adobe PDF File), 98 KB

  1. Geller DA, Biederman J, Faraone S, Agranat A, Cradock K, Hagermoser L, et al. Developmental aspects of obsessive compulsive disorder: findings in children, adolescents, and adults. J Nerv Ment Dis 2001 Jul;189(7):471-477. [CrossRef] [Medline]
  2. Piacentini J, Bergman RL, Keller M, McCracken J. Functional impairment in children and adolescents with obsessive-compulsive disorder. J Child Adolesc Psychopharmacol 2003 Jul;13 Suppl 1(supplement 1):S61-S69. [CrossRef] [Medline]
  3. Stewart S, Geller D, Jenike M, Pauls D, Shaw D, Mullin B, et al. Long-term outcome of pediatric obsessive-compulsive disorder: a meta-analysis and qualitative review of the literature. Acta Psychiatr Scand 2004 Jul;110(1):4-13. [CrossRef] [Medline]
  4. Weidle B, Ivarsson T, Thomsen P, Lydersen S, Jozefiak T. Quality of life in children with OCD before and after treatment. Eur Child Adolesc Psychiatry 2015 Sep 20;24(9):1061-1074. [CrossRef] [Medline]
  5. National Institute for Health and Care Excellence (NICE). Obsessive–Compulsive Disorder and Body Dysmorphic Disorder: treatment. Clinical Guideline [CG31].London: NICE. 2005.   URL: [accessed 2020-12-08]
  6. Geller DA, March J, The AACAP Committee on Quality Issues (CQI). Practice parameter for the assessment and treatment of children and adolescents with obsessive-compulsive disorder. J Am Acad Child Adolesc Psychiatry 2012 Jan;51(1):98-113 [FREE Full text] [CrossRef] [Medline]
  7. McGuire J, Piacentini J, Lewin A, Brennan E, Murphy T, Storch E. A meta-analysis of cognitive behavior therapy and medication for child obsessive-compulsive disorder: Moderators of treatment efficacy, response, and remission. Depress Anxiety 2015 Aug 30;32(8):580-593 [FREE Full text] [CrossRef] [Medline]
  8. O'Kearney RT, Anstey KJ, von Sanden C. Behavioural and cognitive behavioural therapy for obsessive compulsive disorder in children and adolescents. Cochrane Database Syst Rev 2006 Oct 18;4(4):CD004856. [CrossRef] [Medline]
  9. Öst LG, Riise E, Wergeland G, Hansen B, Kvale G. Cognitive behavioral and pharmacological treatments of OCD in children: A systematic review and meta-analysis. J Anxiety Disord 2016 Oct;43:58-69. [CrossRef] [Medline]
  10. Pediatric OCD Treatment Study (POTS) Team. Cognitive-behavior therapy, sertraline, and their combination for children and adolescents with obsessive-compulsive disorder: the Pediatric OCD Treatment Study (POTS) randomized controlled trial. JAMA 2004 Oct 27;292(16):1969-1976. [CrossRef] [Medline]
  11. Torp N, Dahl K, Skarphedinsson G, Thomsen P, Valderhaug R, Weidle B, et al. Effectiveness of cognitive behavior treatment for pediatric obsessive-compulsive disorder: acute outcomes from the Nordic Long-term OCD Treatment Study (NordLOTS). Behav Res Ther 2015 Jan;64:15-23 [FREE Full text] [CrossRef] [Medline]
  12. Skarphedinsson G, Weidle B, Thomsen P, Dahl K, Torp N, Nissen J, et al. Continued cognitive-behavior therapy versus sertraline for children and adolescents with obsessive-compulsive disorder that were non-responders to cognitive-behavior therapy: a randomized controlled trial. Eur Child Adolesc Psychiatry 2015 May;24(5):591-602 [FREE Full text] [CrossRef] [Medline]
  13. Storch E, Bussing R, Small B, Geffken G, McNamara J, Rahman O, et al. Randomized, placebo-controlled trial of cognitive-behavioral therapy alone or combined with sertraline in the treatment of pediatric obsessive-compulsive disorder. Behav Res Ther 2013 Dec;51(12):823-829 [FREE Full text] [CrossRef] [Medline]
  14. Strayhorn J. Editorial: Cognitive-Behavioral Therapy Versus Serotonin Reuptake Inhibitors for Pediatric Obsessive-Compulsive Disorder. J Am Acad Child Adolesc Psychiatry 2020 Feb;59(2):219-221. [CrossRef] [Medline]
  15. Heyman I, Fombonne E, Simmons H, Ford T, Meltzer H, Goodman R. Prevalence of obsessive-compulsive disorder in the British nationwide survey of child mental health. Br J Psychiatry 2001 Oct;179:324-329. [CrossRef] [Medline]
  16. Marques L, LeBlanc NJ, Weingarden HM, Timpano KR, Jenike M, Wilhelm S. Barriers to treatment and service utilization in an internet sample of individuals with obsessive-compulsive symptoms. Depress Anxiety 2010 May;27(5):470-475. [CrossRef] [Medline]
  17. Stobie B, Taylor T, Quigley A, Ewing S, Salkovskis PM. “Contents May Vary”: A Pilot Study of Treatment Histories of OCD Patients. Behav. Cogn. Psychother 2007 Feb 09;35(3):273-282. [CrossRef]
  18. Valderhaug R, Gunnar Götestam K, Larsson B. Clinicians' views on management of obsessive-compulsive disorders in children and adolescents. Nord J Psychiatry 2004;58(2):125-132. [CrossRef] [Medline]
  19. Braddick F, Carral V, Jenkins R, Jané-Llopis E. Child and Adolescent Mental Health in Europe: Infrastructures, Policy and Programmes. European Communities. 2009.   URL: [accessed 2020-12-08]
  20. Farrell L, Oar E, Waters A, McConnell H, Tiralongo E, Garbharran V, et al. Brief intensive CBT for pediatric OCD with E-therapy maintenance. J Anxiety Disord 2016 Aug;42:85-94. [CrossRef] [Medline]
  21. Goodwin R, Koenen K, Hellman F, Guardino M, Struening E. Helpseeking and access to mental health treatment for obsessive-compulsive disorder. Acta Psychiatr Scand 2002 Aug;106(2):143-149. [CrossRef] [Medline]
  22. Herbst N, Voderholzer U, Stelzer N, Knaevelsrud C, Hertenstein E, Schlegl S, et al. The potential of telemental health applications for obsessive-compulsive disorder. Clin Psychol Rev 2012 Aug;32(6):454-466. [CrossRef] [Medline]
  23. Fairburn CG, Patel V. The impact of digital technology on psychological treatments and their dissemination. Behav Res Ther 2017 Jan;88:19-25 [FREE Full text] [CrossRef] [Medline]
  24. Babiano-Espinosa L, Wolters L, Weidle B, Op de Beek V, Pedersen S, Compton S, et al. Acceptability, feasibility, and efficacy of Internet cognitive behavioral therapy (iCBT) for pediatric obsessive-compulsive disorder: a systematic review. Syst Rev 2019 Nov 20;8(1):284 [FREE Full text] [CrossRef] [Medline]
  25. Dèttore D, Pozza A, Andersson G. Efficacy of technology-delivered cognitive behavioural therapy for OCD versus control conditions, and in comparison with therapist-administered CBT: meta-analysis of randomized controlled trials. Cogn Behav Ther 2015;44(3):190-211. [CrossRef] [Medline]
  26. Lovell K, Bee P. Optimising treatment resources for OCD: a review of the evidence base for technology-enhanced delivery. J Ment Health 2011 Dec;20(6):525-542. [CrossRef] [Medline]
  27. Wootton BM. Remote cognitive-behavior therapy for obsessive-compulsive symptoms: A meta-analysis. Clin Psychol Rev 2016 Feb;43:103-113. [CrossRef] [Medline]
  28. Weidle B, Christensen K, Englyst I, Hybel K, Ivarsson T, Korsoski I et al . OCD behandling steg for stegn praksis manual (OCD Treatment Step by Step: Treatment Manual). Oslo: Gyldendal Norsk Forlag; 2014.
  29. de Haan E, Wolters LH. Behandeling van de dwangstoornis bij kinderen en adolescenten. Met het cognitief-gedragstherapeutisch protocol Bedwing je dwang (Treatment of OCD in Children and Adolescents. With the Cognitive Behavioral Treatment Protocol Control Your OCD). Houten: Bohn Stafleu van Loghum; 2009.
  30. Wolters LH, de Haan E, Hogendoorn SM, Boer F, Prins PJ. Severe pediatric obsessive compulsive disorder and co-morbid autistic symptoms: Effectiveness of cognitive behavioral therapy. Journal of Obsessive-Compulsive and Related Disorders 2016 Jul;10:69-77. [CrossRef]
  31. WebEx.   URL: [accessed 2020-04-15]
  32. Weisz JR, Chorpita BF, Frye A, Ng MY, Lau N, Bearman SK, Research Network on Youth Mental Health. Youth Top Problems: using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. J Consult Clin Psychol 2011 Jun;79(3):369-380. [CrossRef] [Medline]
  33. Lambert MJ, Harmon C, Slade K, Whipple JL, Hawkins EJ. Providing feedback to psychotherapists on their patients' progress: clinical results and practice suggestions. J Clin Psychol 2005 Feb;61(2):165-174. [CrossRef] [Medline]
  34. Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry 1997 Jul;36(7):980-988. [CrossRef] [Medline]
  35. Attkisson C. The CSQScales® Reprint Portfolio. Chicago, IL: Tamalpais Matrix Systems, LLC; 2019.
  36. Laugwitz B, Held T, Schrepp M. Construction and Evaluation of a User Experience Questionnaire. In: Holzinger A, editor. HCI and Usability for Education and Work. USAB 2008. Lecture Notes in Computer Science, vol 5298. Berlin, Heidelberg: Springer; 2008.
  37. Kazdin AE, Holland L, Crowley M, Breton S. Barriers to Treatment Participation Scale: evaluation and validation in the context of child outpatient treatment. J Child Psychol Psychiatry 1997 Nov;38(8):1051-1062. [CrossRef] [Medline]
  38. Scahill L, Riddle MA, McSwiggin-Hardin M, Ort SI, King RA, Goodman WK, et al. Children's Yale-Brown Obsessive Compulsive Scale: reliability and validity. J Am Acad Child Adolesc Psychiatry 1997 Jun;36(6):844-852. [CrossRef] [Medline]
  39. Piacentini J, Peris T, Bergman R, Chang S, Jaffer M. Functional impairment in childhood OCD: development and psychometrics properties of the Child Obsessive-Compulsive Impact Scale-Revised (COIS-R). J Clin Child Adolesc Psychol 2007;36(4):645-653. [CrossRef] [Medline]
  40. Pinto A, Van Noppen B, Calvocoressi L. Development and preliminary psychometric evaluation of a self-rated version of the Family Accommodation Scale for Obsessive-Compulsive Disorder. J Obsessive Compuls Relat Disord 2013 Oct 01;2(4):457-465 [FREE Full text] [CrossRef] [Medline]
  41. Goodman R. The extended version of the Strengths and Difficulties Questionnaire as a guide to child psychiatric caseness and consequent burden. J Child Psychol Psychiatry 1999 Jul;40(5):791-799. [Medline]
  42. Achenbach TM, Rescorla LA. Manual for the ASEBA School-age Forms & Profiles: An Integrated System of Multi-informant Assessment. Burlington, VT: ASEBA; 2001.
  43. Ivarsson T, Skarphedinsson G, Andersson M, Jarbin H. The Validity of the Screen for Child Anxiety Related Emotional Disorders Revised (SCARED-R) Scale and Sub-Scales in Swedish Youth. Child Psychiatry Hum Dev 2018 Apr;49(2):234-243 [FREE Full text] [CrossRef] [Medline]
  44. Muris P, Merckelbach H, Schmidt H, Mayer B. The revised version of the Screen for Child Anxiety Related Emotional Disorders (SCARED-R): Factor structure in normal children. Personality and Individual Differences 1998 Jan;26(1):99-112. [CrossRef]
  45. Messer S, Angold A, Costello E, Loeber R, Van Kammen W, Stouthamer-Loeber M. Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents: Factor composition and structure across development. Int J Meth Psych Res 1995;5(4):251-262.
  46. Erhart M, Ellert U, Kurth B, Ravens-Sieberer U. Measuring adolescents' HRQoL via self reports and parent proxy reports: an evaluation of the psychometric properties of both versions of the KINDL-R instrument. Health Qual Life Outcomes 2009 Aug 26;7:77 [FREE Full text] [CrossRef] [Medline]
  47. Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, et al. A children's global assessment scale (CGAS). Arch Gen Psychiatry 1983 Nov;40(11):1228-1231. [CrossRef] [Medline]
  48. Busner J, Targum SD. The clinical global impressions scale: applying a research tool in clinical practice. Psychiatry (Edgmont) 2007 Jul;4(7):28-37 [FREE Full text] [Medline]
  49. Bouwmans C, De Jong K, Timman R, Zijlstra-Vlasveld M, Van der Feltz-Cornelis C, Tan Swan S, et al. Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P). BMC Health Serv Res 2013 Jun 15;13:217 [FREE Full text] [CrossRef] [Medline]
  50. Mataix-Cols D, Fernández de la Cruz L, Nordsletten A, Lenhard F, Isomura K, Simpson H. Towards an international expert consensus for defining treatment response, remission, recovery and relapse in obsessive-compulsive disorder. World Psychiatry 2016 Feb;15(1):80-81 [FREE Full text] [CrossRef] [Medline]
  51. World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA 2013 Nov 27;310(20):2191-2194. [CrossRef] [Medline]

BTPS: Barriers to Treatment Participation Scale
CBCL: Child Behavior Checklist
CBT: cognitive behavioral therapy
CGAS: Children’s Global Assessment Scale
CGI-I: Clinical Global Impressions Scale-Improvement
CGI-S: Clinical Global Impressions Scale-Severity
COIS-R: Child Obsessive-Compulsive Impact Scale-Revised
CSQ-8: Client Satisfaction Questionnaire-8
CY-BOCS: Children’s Yale-Brown Obsessive-Compulsive Scale
eCBT: enhanced cognitive behavioral therapy
ERP: exposure with response prevention
FAS-SR: Family Accommodation Scale for OCD–Self-Rated Version
K-SADS-PL: Schedule for Affective Disorders and Schizophrenia for School-Age Children Present and Lifetime Version
MFQ: Mood and Feelings Questionnaire
OCD: obsessive-compulsive disorder
SCARED-R: Screen for Child Anxiety-Related Emotional Disorders-Revised
SDQ: Strengths and Difficulties Questionnaire
tCBT: technology-based cognitive behavioral therapy
TiC-P: Trimbos/iMTA Questionnaire for Costs associated with Psychiatric Illness
UEQ: User Experience Questionnaire
YSR: Youth Self-Report Questionnaire

Edited by G Eysenbach; submitted 02.09.20; peer-reviewed by J Dudeney, A Austin; comments to author 03.11.20; revised version received 15.11.20; accepted 17.11.20; published 18.12.20


©Lidewij H Wolters, Bernhard Weidle, Lucía Babiano-Espinosa, Norbert Skokauskas. Originally published in JMIR Research Protocols (, 18.12.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.