Background: Emotion regulation has been identified as an important transdiagnostic factor relevant to the treatment of mental health disorders. Many empirically validated psychotherapeutic treatments incorporate elements targeting emotion regulation. Most of these treatment approaches are conceptualized as standard face-to-face treatments not as blended treatments, which include an internet-based intervention.
Objective: The aim of this study is to examine, for the first time, a new internet-based intervention—REMOTION—that will be provided transdiagnostically, as an add-on to psychotherapy, to provide a blended treatment format.
Methods: A total of 70 participants will be assigned (1:1 allocation ratio) to either the intervention group (REMOTION + psychotherapy) or the treatment-as-usual group that receives psychotherapy alone. To maximize external validity, a typical outpatient treatment sample of patients diagnosed with a range of disorders such as depression, anxiety disorders, and adjustment disorder will be recruited from a university outpatient clinic. Patients with bipolar disorder, psychotic disorders, or acute suicidality will be excluded from the study. The feasibility and potential effectiveness of the intervention will be examined by assessing data at baseline, 6 weeks (post), and 12 weeks (follow-up). The primary outcome is general symptom severity, assessed with the Brief Symptom Inventory. Secondary outcomes are emotion regulation, depressive symptoms, anxiety symptoms, health related quality of life, well-being, and a variety of feasibility parameters. Quantitative data will be analyzed on an intention-to-treat basis.
Results: Participant recruitment and data collection started in February 2020, and as of November 2020, are ongoing. Results for the study are expected in 2022.
Conclusions: This pilot randomized controlled trial will inform future studies using transdiagnostic blended treatment.
Trial Registration: ClinicalTrials.gov NCT04262726; http://clinicaltrials.gov/ct2/show/NCT04262726
International Registered Report Identifier (IRRID): DERR1-10.2196/20936
Emotion Regulation and Mental Health
According to Gross , emotion regulation refers to “the processes by which individuals influence which emotions they have, when they have them, and how they experience and express these emotions.” Emotion regulation can describe how individuals modulate the intensity or duration of an emotion and or the quality of an emotional response; it is often a conscious process, however, can also be an unconscious one [ ].
According to several theoretical frameworks, successful emotion regulation is associated with positive health outcomes . In recent years, research has continually shown that emotion regulation is an important transdiagnostic factor relevant to the treatment of mental health disorders [ - ]. Emotion regulation deficits play a role in the development, maintenance, and treatment of a variety of mental health disorders [ ]. A number of empirically validated psychotherapeutic treatments incorporate elements of emotion regulation. For example, elements concerning emotion regulation can be found in the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders [ ], dialectical behavior therapy [ ], accelerated experiential-dynamic psychotherapy [ ], and emotion-focused therapy [ ].
Treatments Specifically for Emotion Regulation
Over the past years, there has also been an increase in treatment programs which explicitly target emotion regulation in order to improve mental illness symptoms. Many of these treatments have been carefully developed, and effectiveness has been shown in a number of trials. Examples are acceptance-based emotion regulation group therapy ; affect regulation training [ ]; emotion regulation therapy [ ]; Managing Emotions: Emotions Under Control [ ]; Group Therapy for the Improvement of Emotion Regulation Skills [ ]; and Gross model–based emotion regulation strategies training on anger reduction [ ].
Notably, some of these treatment concepts have also made links to findings from research in basic affective science. Berking and colleagues , for example, have integrated findings from affective neuroscience in affect regulation training; they present 7 neural “vicious cycles” important to emotion regulation which are then complemented with 7 skills that are trained in sequence for adaptive emotion regulation. The effects of affect regulation training have been shown in several studies [ , ]. Gratz and Gunderson [ ] developed emotion regulation group therapy by using a definition that draws on theoretical literature on emotion regulation during childhood and development, and places emphasis on the control of behavior while experiencing an emotion instead of control of the emotion [ ]. Emotion regulation group therapy has shown effectiveness in several studies, and mechanisms of change have also been studied [ , , ]. Emotion regulation therapy [ , ] also includes links to affective science by targeting motivational awareness, the development of regulatory capacities, and contextual learning [ ] while making reference to theory by Gross [ ]. In line with Gross’ differentiation of antecedent and response-focused strategies, emotion regulation therapy first teaches individuals adaptive response-focused strategies and then antecedent-focused strategies [ ].
The Extended Process Model of Emotion Regulation
In 2015, Gross presented a valuable extension to the process model of emotion regulation, named the extended process model of emotion regulation , elaborating that emotion regulation is an interaction of valuation systems and identifying emotion regulation stages: identification, selection, and implementation. The identification stage is concerned with whether to regulate emotion, the selection stage is concerned with what strategy should be used to regulate emotion, and the implementation stage is concerned with implementing a specific tactic suited to the situation [ ]. Furthermore, Gross [ ] also mentions the importance of flexibility in emotion regulation, described as matching strategy to circumstance.
A valuable contribution by Gross et al  described how elements from the extended process model of emotion regulation pertain to mental illness; maladaptive affect regulation can arise from identification, selection, implementation, and monitoring decisions and individuals can benefit from different treatment aspects and exercises depending on which stage of the model is affected. The intervention in this study, REMOTION, aims to use the stages of emotion regulation of the extended process model of emotion regulation [ ] as a general framework for a highly structured transdiagnostic intervention. This intervention aims to foster the use of emotion regulation strategies, while also addressing potential difficulties encountered at each stage of regulation and focuses on training flexibility in emotion regulation strategy use.
Over- and Underregulated Emotional States
In the field of psychotherapy research, the distinction between over- and underregulated emotional states and its relevance to psychotherapy have been made explicit [, , , ]. According to Corcoran and colleagues [ ], “one way to classify psychiatric disorders is to consider the degree to which emotions, reported within their syndromal presentation, are over or underregulated.” Greenberg [ ] states that one guiding factor for integrative psychotherapy interventions may be the type of affect dysregulation involved (too little or too much emotion). Moreover, “whether clients are under- or overregulated and which emotions are to be regulated and how are important issues in any treatment [ ]” . In accordance with this view, the same patient can experience both over- and underregulated states, and also exhibit patterns linked more closely to one or the other. Linehan [ , ] developed, in detail, distress tolerance skills relevant to overwhelming underregulated states.
On the other hand, more recently, radically open dialectical behavior therapy was developed for individuals with disorders characterized by overcontrol [, , ]. Emotional loneliness is seen as an important problem in disorders characterized by overcontrol [ ]. The treatment is aimed at increasing flexible responding, prosocial signaling, openness, and emotional expressiveness of patients while reducing rigid inhibitory control [ ]. Within radically open dialectical behavior therapy, specific skills for individuals with overcontrol problems have been developed [ ]. REMOTION provides explicit strategies for both over- and underregulated states as described by Linehan [ ] and Lynch [ ], in a blended therapy format.
Over the last decades, the use of internet-based interventions has increased rapidly in the health sector and also in psychotherapeutic treatment. Internet-based interventions have become a popular and effective treatment format for the treatment of a variety of mental health disorders in various countries [- ]; this has been shown mainly for internet-based cognitive behavioral therapy interventions but also for other treatment contents [ ]. Such treatments often allow for more flexibility and convenience in use for the patient [ ]. With regard to internet interventions focusing on emotion regulation, González-Robles and colleagues [ ] have very recently published a study investigating the effect of an emotion-focused, guided internet treatment in specialized care; the internet intervention was superior to treatment as usual on measures of depression, anxiety, and health-related quality of life.
The combination of internet interventions with conventional face-to-face therapy (blended treatment) is only in its early stages, and studies in a routine care setting are rare. Available studies on blended treatment in routine patient care show positive effects or positive trends for blended treatment [- ]. For example, a study by Berger and colleagues [ ] was able to show that a combination of psychotherapy and internet-based treatment was more effective than psychotherapy alone. Furthermore, Rizvi and colleagues [ ], piloted an adjunct treatment for dialectical behavioral therapy called DBT Coach. DBT Coach was given to patients with borderline personality disorder and substance use for 10 to 14 days during outpatient treatment. A decrease of depressive symptoms and general distress was reported [ ]. Moreover, Lukas and colleagues [ ] piloted a blended therapy emotion regulation approach for individuals with elevated levels of alexithymia that showed positive effects on reducing alexithymia scores.
According to Erbe and colleagues , in comparison to purely internet-based treatments or purely face-to-face therapy, blended treatments could offer the following benefits: cost-effectiveness, increased effectiveness of treatment, improved transfer to everyday life, and ability to reach individuals for whom sole face-to-face or internet-based approaches are not suitable. A further benefit of providing interventions in a blended therapy format instead of solely internet-based is the argument that patient emotion regulation is assisted by the therapeutic relationship in session [ , ].
This study aims to pilot a blended treatment that uses an internet-based transdiagnostic program to improve emotion regulation (REMOTION) as an add-on to outpatient face-to-face psychotherapy. REMOTION aims to incorporate a variety of elements from effective treatment approaches into the emotion regulation framework provided by Gross , while also making explicit to patients specific strategies for over- and underregulated states [ , , ]. The study aims to make use of the benefits of blended therapy format in order to convey emotion regulation skills to patients who are in psychotherapy. REMOTION aims to be a resource for both patient and therapist. This study aims to evaluate the feasibility and first effects of a transdiagnostic, blended treatment focused on emotion regulation in a mixed outpatient sample.
The study is a 2-arm pilot randomized controlled trial comparing an intervention group (REMOTION + psychotherapy) with a treatment as usual group (psychotherapy alone). Participants in the intervention group will immediately be given access to REMOTION whereas participants in the treatment as usual group will receive access to REMOTION after 12 weeks. Assessments will occur at baseline, 6 weeks (post), and 12 weeks (follow-up) for all participants. Assessment at 6 and 12 weeks will occur irrespective of whether the patient is still in face-to-face treatment.depicts the design of the trial. The single center trial will take place at the outpatient clinic of the Department of Clinical Psychology and Psychotherapy at the University of Bern, Switzerland.
According to Sim and Lewis , 55 participants are the minimum necessary for a pilot trial. Moreover, according to Whitehead and colleagues [ ], for a main trial designed with 90% power and 2-sided 5% significance, 25 participants per treatment arm are necessary in the pilot for standardized effect sizes that are small. Furthermore, previous unpublished data at the outpatient clinic for psychotherapy at the University of Bern has shown dropout rates of 15%. Therefore, a final sample size of 70 is planned for the study (35 per trial arm).
The inclusion criteria are age over 18 years, in psychotherapeutic treatment, with mental illness, with internet access, and who provide written informed consent. The exclusion criteria are current participation in another intervention specifically for emotion regulation, a current episode or a history of psychotic disorders or bipolar disorder, acute suicidality, and not fluent in the German language.
Recruitment, Randomization, and Blinding
Patients registering at the outpatient clinic will be informed about the study. Interested patients receive an information sheet, are invited to ask questions, and can provide written informed consent if they wish to participate. After study eligibility is proven, participants are randomly assigned to 1 of 2 groups (intervention or treatment as usual). Participants are randomized using a computerized random number generator and randomly permuted block sizes. The allocation schedule is generated by a researcher not involved in the research process and is unknown to the investigators and participants. There is no blinding implemented in the study, consistent with recommendations for the conduct of pragmatic randomized controlled trials in routine practice , in which the focus is on external validity and generalizability of the results to routine practice.
Ethical Criteria and Ethics Committee
The study will be conducted according to local regulations and the Declaration of Helsinki. The study was approved by the ethics committee of the canton of Bern (ID 2019-01929). Written informed consent will be obtained from all patients. The trial is registered with clinicaltrials.gov (NCT04262726).
REMOTION is an internet-based program that was created at the University of Bern (by LLB in collaboration TB and with input from FM). A more detailed description of the program can be found in. It is a 6-part program (introduction and 5 modules), and the general sequence and components of the modules are based on the stages of emotion regulation in the extended process model [ ]. A variety of elements from different evidence-based psychotherapeutic treatment approaches—dialectical behavior therapy [ ], emotion-focused therapy [ ], cognitive behavioral therapy [ ], mindfulness based cognitive therapy [ ], radically open dialectical behavior therapy [ ], and Unified Protocol [ ]—are incorporated into each module of REMOTION. Furthermore, the focus placed on overregulated as well as underregulated states as described by Greenberg [ ] and Lynch [ ].
|Introduction||Information about the structure of the intervention, about the theoretical background, and a user guide are provided in this module.|
|Psychoeducation||Information is provided about what emotions are, what their functions are, and what types of emotional experiences there are. The concept of emotion regulation is introduced, and the relationship between emotion regulation and mental illness is explored.|
|Identification||Emotional awareness, which is identified as key to the perception substep of the identification stage of emotion regulation , is explored in this module. If and when to regulate emotions, along with information on the value of emotion regulation, are introduced in this module.|
|Selection||This module shows patients what types of emotion regulation strategies are available. The focus is on the selection of an emotion regulation strategy . The strategies—situation selection or modification, attentional deployment, change of cognitions, and response modulation [ ]—are introduced in this module. Furthermore, strategies specific to over- and underregulated states [ , , ] are also introduced.|
|Implementation||This module shows patients how the previously introduced strategies can be implemented, for example, translated to different tactics . Exercises are introduced for every emotion regulation strategy, and advice is provided as to how these exercises can be implemented into daily life.|
|Monitoring/flexibility||Being able to modify strategies, being able to apply them flexibly, maintaining, switching, and stopping [, ] are discussed in this module. Patients are encouraged to flexibly use strategies, to apply them to different contexts, to practice, and to try sequences or blends of strategies that work for them as individuals.|
The program is provided to study participants on a platform (hosted by the University of Bern) free of charge and uses text, video, and audio material along with various exercises (). Additionally, every week for 6 weeks, individuals in the intervention group receive an email reminding them which module they should be working on. After 9 weeks, patients will receive another email as a reminder to work on the program. Patients will also take part in their routine psychotherapy sessions while using REMOTION. Also, along with the internet-based program given to the patients, the therapists will receive information about the content of REMOTION in the form of an information booklet. The information given to the therapists is meant to explain the content of the internet-based program and provide suggestions as to how elements from the program can be integrated in face-to-face sessions. A detailed description of the information given to the therapist can be found in .
|Information about REMOTION||Information about the structure of REMOTION and theoretical background is provided for the therapists.|
|Information about each module||Each module and its content are outlined for the therapists. Therapists are informed about the exercises that patients complete in each module.|
|Information on using REMOTION exercises in face-to-face sessions||Therapists are provided with information as to how they can integrate specific exercises that patients have completed in the program, in their therapy sessions.|
Treatment as Usual
Treatment as usual, in this study, consists of psychotherapy as administered in routine practice at the outpatient clinic of the Department of Clinical Psychology and Psychotherapy at the University of Bern. Psychotherapy at the outpatient clinic is an integrative form of cognitive behavioral therapy based on psychological therapy principles . Individual case formulations are key in this treatment approach. This integrative form of cognitive behavioral therapy places a focus on empirically validated interventions and on the following general change factors in psychotherapy: clarification, resource activation, problem activation, and problem solving [ ]. A further focus is placed on the analysis of problems and potentials for the therapeutic relationship, such as motive-oriented therapy relationship [ ], and on plan analysis [ ], which analyses the instrumental functions of patient behavior and experience. Patients in the treatment as usual group will not have access to REMOTION during the 12-week assessment period. Treatment sessions at the outpatient clinic usually take place once a week. The exact number of treatment sessions during the 12-week assessment period will be recorded for each patient.
Psychotherapy is administered by licensed psychotherapists who work at the outpatient clinic of the University of Bern and who have completed postgraduate training in psychotherapy at the University of Bern (Master of Advanced Studies in Psychotherapy), or by psychotherapists in said postgraduate training under regular supervision. All psychotherapists have master’s degrees in psychology. Psychotherapists in training have been in training for at least half a year and are regularly supervised. Therapists will be allocated to patients according to capacity at the outpatient clinic, a within-therapist design is used in the study.
Items recording demographic information of patients will be recorded at baseline, post and follow-up. Also, as part of routine practice in the outpatient clinic, patient diagnostic status will be obtained during the study by conducting a Structured Clinical Interview I (German version) for Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition) . Furthermore, a qualitative interview with questions created specifically for the study will be conducted with a share of participants and therapists in the REMOTION group after 6 weeks. The purpose of this interview is to assess both experience and satisfaction with REMOTION, and thereby, should complement information from the questionnaires.
If deemed necessary, data collection will be aided by emails and phone calls in cases of poor data retention. A full description of all outcomes in the study is provided in the next sections. Unless stated otherwise, measures will be provided online.
Primary Outcome Measure
The primary outcome measure in this study is general symptom severity as measured with the Brief Symptom Inventory (German version) . The Brief Symptom Inventory will be given to patients at baseline, post and follow-up. The Brief Symptom Inventory contains 53 items and is one of the most frequently used questionnaires to measure general symptom severity. A study [ ] has shown that it has good psychometric properties, comparable with those of the Symptom Checklist-90-Revised instrument .
Secondary Outcome Measures
Emotion regulation will be assessed using 2 different instruments: (1) the German version  of Difficulties in Emotion Regulation Scale [ ], a 36-item self-report questionnaire consisting of 6 subscales assessing difficulties in emotion regulation, and (2) Fragebogen zur standardisierten Selbsteinschätzung emotionaler Kompetenzen (SEK-27, Emotion Competencies Questionnaire) [ ], a 27-item self-report instrument that addresses a range of emotion regulation skills, given to all patients in the study at baseline, 6 weeks, and 12 weeks. Moreover, therapists will also be asked to fill out ratings of patient emotion regulation. Good psychometric properties have been shown for the English [ ] and German versions [ ] of the Difficulties in Emotion Regulation Scale. The SEK-27 shows both good reliability and validity [ ].
Depressive symptoms will be assessed with the German version  of the 9-item Patient Health Questionnaire, which is one of the most widely used self-report scales to assess depressive symptoms; criterion validity and change sensitivity have been reported [ ].
Anxiety symptoms will be assessed with the German version  of the 7-item Generalized Anxiety Disorder Scale, a self-report measure that also shows good psychometric properties.
Health-related quality of life will be assessed with the German version  of the 12-item Short Form Health Survey, a frequently used, valid, reliable and change sensitive self-report questionnaire [ ] used to assess both physical and psychological aspects of health-related quality of life.
Well-being will be assessed with the German version  of the World Health Organization Five Well-Being Index, a widely used economic instrument that shows excellent psychometric properties [ ].
Feasibility parameters will be assessed in the study at different measurement timepoints: (1) The number of participants consenting to take part in the study and number of participants randomized will be recorded at the beginning of the study. (2) A previous study has shown that adherence may be an important factor in explaining the difference between effects of internet-based cognitive behavioral therapy in open recruitment and routine practice trials ; therefore, adherence to the program in this study will be assessed by number of modules completed at 6 weeks and 12 weeks for the REMOTION group, number of pages visited in the program at 6 weeks and 12 weeks for the REMOTION group, and number of exercises completed at 6 weeks and 12 weeks for the REMOTION group. (3) Usability of REMOTION will be assessed with the 10-item System Usability Scale [ ] at 6 weeks and 12 weeks in the REMOTION group. (4) User experience of the REMOTION group will be recorded with the meCUE questionnaire [ ], a self-report questionnaire that assesses user experience of products with 34 items at 6 and 12 weeks and with a qualitative interview that will be conducted with a share of the participants after the 6 week point, by telephone. (5) Patient attitudes toward online interventions will be assessed with the German version [ ] of the Attitudes toward Psychological Online Interventions Questionnaire at baseline, 6 weeks, and 12 weeks for both study groups. (6) Satisfaction with the intervention will be assessed with the Client Satisfaction Questionnaire (in German [ ] and adapted for internet interventions) at 6 and 12 weeks in the REMOTION group. Also, satisfaction will be assessed with qualitative interviews conducted with a share of the participants in the REMOTION group by telephone, after the 6-week point.
Therapeutic alliance measured with the German version  of the Working Alliance Inventory—short revised, a 12-item self-report scale that has shown good psychometric properties [ ] will be given to all patients at 6 and 12 weeks. Patient self-compassion will be assessed with the German version [ ] of the Self-Compassion Scale, a 26-item self-report scale that is both reliable and valid and will be given to all patients at baseline, 6 weeks, and 12 weeks. In order to assess negative effects of the intervention, an adapted version of the Inventory to Assess Negative Effects of Psychotherapy [ ] for internet intervention will be used. Only 15 out of 21 items will be used; 6 items geared specifically at conventional psychotherapy will be exempt. The questionnaire is a self-report and will be given to REMOTION group patients at 6 and 12 weeks.
A variety of therapist variables will be recorded in the study, also including demographic data (experience, background, etc) and individual items on general use of emotion regulation interventions in therapy and general use of online interventions in therapy. In the REMOTION group, therapists perceived effect of REMOTION on therapy (attitude toward the intervention, use, satisfaction with the intervention, etc) will also be assessed with a set of items created specifically for the study. An interview will be conducted with a share of the therapists in the REMOTION group after the 6 week timepoint in order to further assess perceived effect of REMOTION on therapy. This interview will also collect data on therapist experience and satisfaction with REMOTION. It will be conducted per telephone.
Patient difficulties in emotion regulation and patient emotion compentencies will be rated by therapists using versions of the Difficulties in Emotion Regulation Scale (original , German version [ ]) and SEK-27 [ ], adapted specifically for this study, at the same measurement timepoints as patients. The wording of the questions is changed as little as possible from the original, but the questions are from an observer’s perspective about their patient.
Control of contamination between REMOTION and treatment as usual due to within-therapist design will be controlled in the following ways: the number of therapists who provide both REMOTION and treatment as usual therapies will be recorded, therapists who provide both conditions will be asked explicitly not to talk about REMOTION or use the REMOTION exercises provided in the REMOTION therapist booklet during treatment as usual therapy (a strategy utilized by studies in a review by Magill and colleagues ). Adherence to this condition will be recorded with items at post and follow-up for the therapists.
Data will be analyzed on an intention-to-treat basis, meaning that all randomized patients will be included in the outcome analyses and missing data be handled accordingly. The primary outcome measure, general symptom severity, will initially be analyzed descriptively. Within- and between-group effect sizes will be calculated, and linear mixed models will be calculated. These models use all available data on a participant and estimate parameters of missing values. The various secondary outcomes will also be analyzed descriptively, then analyzed with linear mixed models, where applicable. With regard to feasibility parameters, the data will be characterized by descriptive statistics (means, standard deviations, and confidence intervals) in order to allow for comparison with other studies in the field. For categorical data, amount or percentage will be reported. The qualitative interviews generated for this study, will be analyzed using qualitative content analysis as recommended by Mayring . Results will be reported in accordance with CONSORT (Consolidated Standards of Reporting Trials) [ ] and CONSORT-EHEALTH [ ].
The study was approved by the regional ethics committee in January 2020 and was registered with clinicaltrials.gov in February 2020. Participant recruitment and data collection started in February 2020, and as of November 2020, are ongoing. Results for the study are expected in 2022.
This study aims to evaluate the benefit of adding a new transdiagnostic treatment tool, REMOTION, to outpatient psychotherapy. The study aims to provide a tool to improve emotion regulation transdiagnostically and to make use of the benefits of blended therapy as described, for example, by Erbe and colleagues . More generally speaking, the results of this study could be used to improve transdiagnostic treatments of mental illness for patients and provide valuable information on the provision of blended therapy. Although many studies on internet-based and blended treatments are conducted in Switzerland, corresponding intervention formats are not implemented and available in routine practice. With regard to the concept of emotion regulation, to our knowledge, this is the first time an emotion regulation intervention structurally based on the stages of emotion regulation as specified in the extended process model of emotion regulation [ ] is used with a clinical population in a blended psychotherapy setting. The application of a basic theoretical concept to a clinical psychotherapy context is a further strength of the study.
The following limitations of the study need to be considered. First, as this is a pilot trial, the number of patients examined in the study is small and thus only preliminary results on the effects of the treatment can be provided. However, this pilot trial can inform future larger studies that would be necessary to examine the efficacy or effectiveness in the future. Also, as this is a pilot study, no conclusions on specificity or mechanisms of change can be made. Moreover, most of the outcomes assessed in the study will be measured via self-report. In emotion regulation literature, the fact that self-report may be limiting has been described . We have, as a result, tried to also include an observer rated assessment of emotion regulation by the therapist. Also, it should be considered, that unlike therapists for treatment as usual, therapists in the intervention group are encouraged to integrate elements of the REMOTION program into their psychotherapy sessions therapy. This may also lead to differences between the 2 study groups. Furthermore, it currently remains unclear what impact the COVID-19 pandemic may have on patient recruitment and data collection.
REMOTION is a pilot randomized controlled study, assessing for the first time the feasibility and potential effectiveness of an internet-based emotion regulation treatment (REMOTION) as an add-on to psychotherapy in the form of a blended treatment. The study aims to make emotion regulation tools accessible to a broad range of patients and will provide insight into ways to improve psychotherapy for patients by the provision of internet-based tools. The strength of the approach lies in the application of the theoretical framework in a psychotherapy context and in the use of the treatment modality (blended).
We would like to thank Dania Spagnuolo and Noé Weigl for their contributions to programming the internet-based version of REMOTION. Funding for the study is provided by the Department of Clinical Psychology and Psychotherapy, University of Bern, Switzerland.
LLB wrote the initial version of the manuscript. All authors contributed to further drafts of the manuscript. TB is the principal investigator of the study.
Conflicts of Interest
- Gross JJ. The emerging field of emotion regulation: an integrative review. Review of General Psychology 1998 Sep;2(3):271-299 p 275. [CrossRef]
- Gross JJ. Emotion regulation: current status and future prospects. Psychological Inquiry 2015 Mar 09;26(1):1-26. [CrossRef]
- Aldao A, Nolen-Hoeksema S, Schweizer S. Emotion-regulation strategies across psychopathology: A meta-analytic review. Clin Psychol Rev 2010 Mar;30(2):217-237. [CrossRef] [Medline]
- Berking M, Wupperman P, Reichardt A, Pejic T, Dippel A, Znoj H. Emotion-regulation skills as a treatment target in psychotherapy. Behav Res Ther 2008 Nov;46(11):1230-1237. [CrossRef] [Medline]
- Sloan E, Hall K, Moulding R, Bryce S, Mildred H, Staiger PK. Emotion regulation as a transdiagnostic treatment construct across anxiety, depression, substance, eating and borderline personality disorders: A systematic review. Clin Psychol Rev 2017 Nov;57:141-163. [CrossRef] [Medline]
- Berking M, Wupperman P. Emotion regulation and mental health: recent findings, current challenges, and future directions. Curr Opin Psychiatry 2012 Mar;25(2):128-134. [CrossRef] [Medline]
- Barlow DH, Allen LB, Choate ML. Toward a unified treatment for emotional disorders. Behavior Therapy 2004;35(2):205-230. [CrossRef]
- Linehan MM. Cognitive-behavioural treatment of borderline personality disorder. New York, NY: Guilford Press; 1993.
- Fosha D, Yeung D. AEDP exemplifies the seamless integration of emotional transformationdyadic relatedness at work. In: Stricker G, Gold J, editors. A Casebook of Psychotherapy Integration. Washington DC: APA Press; 2006.
- Greenberg LS. Emotion-Focused Therapy: Coaching Clients to Work Through their Feelings (2nd ed.). Washington, DC: American Psychological Association; 2015.
- Gratz KL, Gunderson JG. Preliminary data on an acceptance-based emotion regulation group intervention for deliberate self-harm among women with borderline personality disorder. Behav Ther 2006 Mar;37(1):25-35. [CrossRef] [Medline]
- Berking M. Training emotionaler Kompetenzen. Berlin: Springer-Verlag; 2017.
- Mennin DS, Fresco DM. Emotion Regulation Therapy. In: Gross JJ, editor. Handbook of Emotion Regulation (Second Edition). New York: Guilford Press; 2014:469-490.
- Barnow S, Löw CA, Dodek A, Stopsack M. Gefühle im Griff – Emotionen intelligent regulieren [Managing emotions--emotions under control]. Psychother Psychosom Med Psychol 2014 Jul 20;64(7):284-289. [CrossRef] [Medline]
- Endtner K, Hänni M, Tschacher W. Wirksamkeitsüberprüfung eines gruppenpsychotherapeutischen Verfahrens zur Emotionsregulation. Forschungsberichte der Universitären Psychiatrischen Dienste Bern 2011(11):1.
- Massah O, Sohrabi F, A'azami Y, Doostian Y, Farhoudian A, Daneshmand R. Effectiveness of Gross model-based emotion regulation strategies training on anger reduction in drug-dependent individuals and its sustainability in follow-up. Int J High Risk Behav Addict 2016 Mar 20;5(1):e24327 [FREE Full text] [CrossRef] [Medline]
- Berking M, Ebert D, Cuijpers P, Hofmann SG. Emotion regulation skills training enhances the efficacy of inpatient cognitive behavioral therapy for major depressive disorder: a randomized controlled trial. Psychother Psychosom 2013;82(4):234-245. [CrossRef] [Medline]
- Berking M, Eichler E, Luhmann M, Diedrich A, Hiller W, Rief W. Affect regulation training reduces symptom severity in depression - A randomized controlled trial. PLoS One 2019 Aug 29;14(8):e0220436 [FREE Full text] [CrossRef] [Medline]
- Gratz KL, Tull MT, Levy R. Randomized controlled trial and uncontrolled 9-month follow-up of an adjunctive emotion regulation group therapy for deliberate self-harm among women with borderline personality disorder. Psychol. Med 2013 Aug 28;44(10):2099-2112. [CrossRef]
- Gratz KL, Bardeen JR, Levy R, Dixon-Gordon KL, Tull MT. Mechanisms of change in an emotion regulation group therapy for deliberate self-harm among women with borderline personality disorder. Behav Res Ther 2015 Feb;65:29-35 [FREE Full text] [CrossRef] [Medline]
- Mennin DS, Fresco DM, Ritter M, Heimberg RG. An open trial of emotion regulation therapy for generalized anxiety disorder and co-occurring depression. Depress Anxiety 2015 Aug 06;32(8):614-623 [FREE Full text] [CrossRef] [Medline]
- Mennin DS, Fresco DM, O'Toole MS, Heimberg RG. A randomized controlled trial of emotion regulation therapy for generalized anxiety disorder with and without co-occurring depression. J Consult Clin Psychol 2018 Mar;86(3):268-281 [FREE Full text] [CrossRef] [Medline]
- Renna ME, Fresco DM, Mennin DS. Emotion regulation therapy and its potential role in the treatment of chronic stress-related pathology across disorders. Chronic Stress 2020 Feb 13;4. [CrossRef] [Medline]
- Mennin DS, Fresco DM. Emotion regulation as an integrative framework for understanding and treating psychopathology. In: Kring AM, Sloan DM, editors. Emotion regulation and psychopathology: A transdiagnostic approach to etiology and treatment. NY: The Guilford Press; 2009:356-379.
- Gross JJ, Uusberg H, Uusberg A. Mental illness and well-being: an affect regulation perspective. World Psychiatry 2019 Jun;18(2):130-139 [FREE Full text] [CrossRef] [Medline]
- Lynch TR. The Skills Training Manual for Radically Open Dialectical Behavior Therapy: A Clinician's Guide for Treating Disorders of Overcontrol. Oakland CA: New Harbinger Publications; 2018.
- Corcoran KM, Farb N, Anderson A, Segal ZV. Mindfulness and Emotion Regulation: Outcomes and Possible Mediating Mechanisms. In: Kring AM, Sloan DM, editors. Emotion Regulation and Psychopathology: A Transdiagnostic Approach to Etiology and Treatment. New York, NY: Guilford Press; 2009:339-355.
- Greenberg LS. Integrating an emotion-focused approach to treatment into psychotherapy integration. Journal of Psychotherapy Integration 2002;12(2):154-189. [CrossRef]
- Greenberg LS, Pascual-Leone A. Emotion in psychotherapy: a practice-friendly research review. J Clin Psychol 2006 May;62(5):611-630 p 616. [CrossRef] [Medline]
- Bohus M, Wolf-Arehult M. Interaktives Skillstraining für Borderline-Patienten. 2. korr Auflage. Stuttgart: Schattauer; 2016.
- Lynch TR, Gray KL, Hempel RJ, Titley M, Chen EY, O’Mahen HA. Radically open-dialectical behavior therapy for adult anorexia nervosa: feasibility and outcomes from an inpatient program. BMC Psychiatry 2013 Nov 7;13(1). [CrossRef]
- Lynch TR, Hempel RJ, Dunkley C. Radically open-dialectical behavior therapy for disorders of over-control: signaling matters. Am J Psychother 2015 Apr;69(2):141-162. [CrossRef] [Medline]
- Andersson G. Internet-Delivered Psychological Treatments. Annu Rev Clin Psychol 2016;12:157-179. [CrossRef] [Medline]
- Berger T, Krieger T, Sude K, Meyer B, Maercker A. Evaluating an e-mental health program ("deprexis") as adjunctive treatment tool in psychotherapy for depression: Results of a pragmatic randomized controlled trial. J Affect Disord 2018 Feb;227:455-462. [CrossRef] [Medline]
- Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res 2012 Dec;12(6):745-764. [CrossRef] [Medline]
- Richards D, Richardson T, Timulak L, McElvaney J. The efficacy of internet-delivered treatment for generalized anxiety disorder: A systematic review and meta-analysis. Internet Interventions 2015 Sep;2(3):272-282. [CrossRef]
- Cuijpers P, Marks IM, van Straten A, Cavanagh K, Gega L, Andersson G. Computer-aided psychotherapy for anxiety disorders: a meta-analytic review. Cogn Behav Ther 2009;38(2):66-82. [CrossRef] [Medline]
- Mayo-Wilson E, Montgomery P. Media-delivered cognitive behavioural therapy and behavioural therapy (self-help) for anxiety disorders in adults. Cochrane Database Syst Rev 2013 Sep 09;9(9). [CrossRef] [Medline]
- Cheng SK, Dizon J. Computerised cognitive behavioural therapy for insomnia: a systematic review and meta-analysis. Psychother Psychosom 2012;81(4):206-216. [CrossRef] [Medline]
- Donker T, Bennett K, Bennett A, Mackinnon A, van SA, Cuijpers P, et al. Internet-delivered interpersonal psychotherapy versus internet-delivered cognitive behavioral therapy for adults with depressive symptoms: randomized controlled noninferiority trial. J Med Internet Res 2013;15(5):e82 [FREE Full text] [CrossRef] [Medline]
- Berger T. Internetbasierte Interventionen bei psychischen Störungen. Göttingen: Hogrefe; 2015.
- González-Robles A, Díaz-García A, García-Palacios A, Roca P, Ramos-Quiroga JA, Botella C. Effectiveness of a Transdiagnostic Guided Internet-Delivered Protocol for Emotional Disorders Versus Treatment as Usual in Specialized Care: Randomized Controlled Trial. J Med Internet Res 2020 Jul 07;22(7):e18220 [FREE Full text] [CrossRef] [Medline]
- Wright JH, Wright AS, Albano AM, Basco MR, Goldsmith LJ, Raffield T, et al. Computer-assisted cognitive therapy for depression: maintaining efficacy while reducing therapist time. Am J Psychiatry 2005 Jun;162(6):1158-1164. [CrossRef] [Medline]
- Kooistra LC, Ruwaard J, Wiersma JE, van Oppen P, van der Vaart R, van Gemert-Pijnen JEWC, et al. Development and initial evaluation of blended cognitive behavioural treatment for major depression in routine specialized mental health care. Internet Interv 2016 May;4:61-71 [FREE Full text] [CrossRef] [Medline]
- Fitzpatrick M, Nedeljkovic M, Abbott J, Kyrios M, Moulding R. "Blended" therapy: The development and pilot evaluation of an internet-facilitated cognitive behavioral intervention to supplement face-to-face therapy for hoarding disorder. Internet Interv 2018 Jun;12:16-25 [FREE Full text] [CrossRef] [Medline]
- Erbe D, Eichert H, Riper H, Ebert DD. Blending Face-to-Face and Internet-Based Interventions for the Treatment of Mental Disorders in Adults: Systematic Review. J Med Internet Res 2017 Sep 15;19(9):e306 [FREE Full text] [CrossRef] [Medline]
- Lindhiem O, Bennett CB, Rosen D, Silk J. Mobile technology boosts the effectiveness of psychotherapy and behavioral interventions: a meta-analysis. Behav Modif 2015 Nov;39(6):785-804 [FREE Full text] [CrossRef] [Medline]
- Rizvi SL, Dimeff LA, Skutch J, Carroll D, Linehan MM. A pilot study of the DBT coach: an interactive mobile phone application for individuals with borderline personality disorder and substance use disorder. Behav Ther 2011 Dec;42(4):589-600. [CrossRef] [Medline]
- Lukas CA, Trevisi Fuentes HT, Berking M. Smartphone-based emotion recognition skills training for alexithymia - A randomized controlled pilot study. Internet Interv 2019 Sep;17 [FREE Full text] [CrossRef] [Medline]
- Auszra L, Herrmann IR, Greenberg LS. Emotionsfokussierte Therapie: Ein Praxismanual. Göttingen: Hogrefe Verlag; 2017.
- Sim J, Lewis M. The size of a pilot study for a clinical trial should be calculated in relation to considerations of precision and efficiency. J Clin Epidemiol 2012 Mar;65(3):301-308. [CrossRef] [Medline]
- Whitehead AL, Julious SA, Cooper CL, Campbell MJ. Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Stat Methods Med Res 2016 Jun;25(3):1057-1073. [CrossRef] [Medline]
- Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, CONSORT group, Pragmatic Trials in Healthcare (Practihc) group. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ 2008 Nov 11;337:a2390 [FREE Full text] [CrossRef] [Medline]
- Butler AC, Chapman JE, Forman EM, Beck AT. The empirical status of cognitive-behavioral therapy: a review of meta-analyses. Clin Psychol Rev 2006 Jan;26(1):17-31. [CrossRef] [Medline]
- Segal ZV, Williams M, Teasdale J. Mindfulness-based Cognitive Therapy for Depression. New York, NY: Guilford Publications; 2018.
- Grawe K. Psychologische Therapie. Göttingen: Hogrefe Verlag für Psychotherapie; 1998.
- Grawe K. Neuropsychotherapie. Göttingen: Hogrefe; 2004.
- Grawe K, Caspar F, Ambühl H. Die Berner Therapievergleichsstudie: Wirkungsvergleich und differentielle Indikation [The Bern therapy comparison study: Comparison of effectiveness and differential indication]. Zeitschrift für klinische Psychologie 1990;19(4):338-361.
- Caspar F. Beziehungen und Probleme verstehen. Eine Einführung in die psychotherapeutische Plananalyse. Bern: Hans Huber; 2007.
- Witzchen HU, Zaudig M, Fydrich T. Strukturiertes Klinisches Interview für DSM-IV (SKID). Göttingen: Hogrefe; 1997.
- Franke GH. BSI. Brief Symptom Inventory - Deutsche Version. Manual. Göttingen: Beltz; 2000.
- Geisheim C, Hahlweg K, Fiegenbaum W, Frank M, Schröder B, von Witzleben I. Das Brief Symptom Inventory (BSI) als Instrument zur Qualitätssicherung in der Psychotherapie. Diagnostica 2002 Jan;48(1):28-36. [CrossRef]
- Ehring T, Fischer S, Schnülle J, Bösterling A, Tuschen-Caffier B. Characteristics of emotion regulation in recovered depressed versus never depressed individuals. Personality and Individual Differences 2008 May;44(7):1574-1584. [CrossRef]
- Gratz KL, Roemer L. Multidimensional Assessment of Emotion Regulation and Dysregulation: Development, Factor Structure, and Initial Validation of the Difficulties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral Assessment 2004 Mar;26(1):41-54. [CrossRef]
- Berking M, Znoj H. SEK-27 Fragebogen zur standardisierten Selbsteinschätzung emotionaler Kompetenzen [Self-Report Measure for the Assessment of Emotion Regulation Skills]. Elektronisches Testarchiv. Trier: Leibniz-Zentrum für Psychologische; 2011. URL: https://www.psycharchives.org//handle/20.500.12034/400 [accessed 2020-11-06]
- Löwe B, Spitzer R, Zipfel S, Herzog W. Gesundheitsfragebogen für Patienten (PHQ-D). Manual und Testunterlagen. 2. Auflage. Medizinische Universitätsklinik Heidelberg. Karlsruhe: Pfizer; 2002. URL: https://www.klinikum.uni-heidelberg.de/fileadmin/Psychosomatische_Klinik/download/PHQ_Manual1.pdf [accessed 2020-11-06]
- Löwe B, Kroenke K, Herzog W, Gräfe K. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9). Journal of Affective Disorders 2004 Jul;81(1):61-66. [CrossRef] [Medline]
- Löwe B, Decker O, Müller S, Brähler E, Schellberg D, Herzog W, et al. Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Med Care 2008 Mar;46(3):266-274. [CrossRef] [Medline]
- Gandek B, Ware JE, Aaronson NK, Apolone G, Bjorner JB, Brazier JE, et al. Cross-validation of item selection and scoring for the SF-12 Health Survey in nine countries: results from the IQOLA Project. International Quality of Life Assessment. J Clin Epidemiol 1998 Nov;51(11):1171-1178. [CrossRef] [Medline]
- Brähler E, Mühlan H, Albani C, Schmidt S. Teststatistische Prüfung und Normierung der deutschen Versionen des EUROHIS-QOL Lebensqualität-Index und des WHO-5 Wohlbefindens-Index. Diagnostica 2007 Apr;53(2):83-96. [CrossRef]
- Romijn G, Batelaan N, Kok R, Koning J, van Balkom A, Titov N, et al. Internet-delivered cognitive behavioral therapy for anxiety disorders in open community versus clinical service recruitment: meta-analysis. J Med Internet Res 2019 Apr 17;21(4):e11706 [FREE Full text] [CrossRef] [Medline]
- Brooke J. SUS-A quick and dirty usability scale. Usability evaluation in industry (194) 1996;189:4-7. [CrossRef]
- Minge M, Riedel L. meCUE - Ein modularer Fragebogen zur Erfassung des Nutzungserlebens. In: Boll S, Maass S, Malaka R, editors. Mensch und Computer 2013: Interaktive Vielfalt. München: Oldenbourg Verlag; 2013:89-98.
- Schröder J. [Psychometrische Messung von Einstellungen gegenüber psychologischen Online-Interventionen bei depressiven Personen und Psychotherapeuten [ Psychometrical assessment of attitudes towards psychological online interventions in people with depression and psychotherapists]. Universität Hamburg Dissertations. 2015. URL: https://ediss.sub.uni-hamburg.de/handle/ediss/6428 [accessed 2020-11-06]
- Schmidt J, Lamprecht F, Wittmann WW. Zufriedenheit mit der stationären Versorgung. Entwicklung eines Fragebogens und erste Validitätsuntersuchungen [Satisfaction with inpatient management. Development of a questionnaire and initial validity studies]. Psychother Psychosom Med Psychol 1989 Jul;39(7):248-255. [Medline]
- Wilmers F, Munder T, Leonhart R, Herzog T, Plassmann R, Barth J, et al. Die deutschsprachige Version des Working Alliance Inventory - short revised (WAI-SR) - Ein schulenübergreifendes, ökonomisches und empirisch validiertes Instrument zur Erfassung der therapeutischen Allianz. Klinische Diagnostik und Evaluation 2008;1(3):343-358.
- Hupfeld J, Ruffieux N. Validierung einer deutschen Version der Self-Compassion Scale (SCS-D). Zeitschrift für Klinische Psychologie und Psychotherapie 2011 Apr;40(2):115-123. [CrossRef]
- Ladwig I, Rief W, Nestoriuc Y. Welche Risiken und Nebenwirkungen hat Psychotherapie? - Entwicklung des Inventars zur Erfassung Negativer Effekte von Psychotherapie (INEP). Verhaltenstherapie 2014 Oct 30;24(4):252-263. [CrossRef]
- Magill N, Knight R, McCrone P, Ismail K, Landau S. A scoping review of the problems and solutions associated with contamination in trials of complex interventions in mental health. BMC Med Res Methodol 2019 Jan 07;19(1) [FREE Full text] [CrossRef] [Medline]
- Mayring P. Qualitative Inhaltsanalyse. Grundlagen und Techniken. 12., überarbeitete. Auflage. Weinheim/Basel: Beltz Verlag; 2015.
- Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Med 2010 Mar 24;8:18 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G, CONSORT- E. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
|SEK-27: Fragebogen zur standardisierten Selbsteinschätzung emotionaler Kompetenzen (Emotion Competencies Questionnaire)|
Edited by G Eysenbach; submitted 02.06.20; peer-reviewed by J Apolinário-Hagen, D Erbe; comments to author 14.07.20; revised version received 10.08.20; accepted 27.10.20; published 12.11.20Copyright
©Laura Luisa Bielinski, Tobias Krieger, Franz Moggi, Leonie Trimpop, Ulrike Willutzki, Christoph Nissen, Thomas Berger. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 12.11.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.