Background: Many adolescents in residential care have been exposed to prolonged traumatic experiences such as violence, neglect, or abuse. Consequently, they suffer from posttraumatic stress. This not only negatively affects psychological and behavioral outcomes (eg, increased anxiety, depression, and aggression) but also has adverse effects on physiological outcomes, in particular on their neurobiological stress systems. Although current evidence-based treatment options are effective, they have their limitations. An alternative to traditional trauma treatment is meditation-based treatment that focuses on stress regulation and relaxation. Muse is a game-based meditation intervention that makes use of adolescents’ intrinsic motivation. The neurofeedback element reinforces relaxation abilities.
Objective: This paper describes the protocol for a randomized controlled trial in which the goal is to examine the effectiveness of Muse (InteraXon Inc) in reducing posttraumatic stress and normalizing neurobiological stress systems in a sample of traumatized adolescents in residential care.
Methods: This will be a multicenter, multi-informant, and multimethod randomized controlled trial. Participants will be adolescents (N=80), aged 10 to 18 years, with clinical levels of posttraumatic symptoms, who are randomized to receive either the Muse therapy sessions and treatment as usual (intervention) or treatment as usual alone (control). Data will be collected at 3 measurement instances: pretest (T1), posttest (T2), and at 2-month follow-up. Primary outcomes will be posttraumatic symptoms (self-report and mentor report) and stress (self-report) at posttest. Secondary outcomes will be neurobiological stress parameters under both resting and acute stress conditions, and anxiety, depression, and aggression at posttest. Secondary outcomes also include all measures at 2-month follow-up: posttraumatic symptoms, stress, anxiety, depression aggression, and neurobiological resting parameters.
Results: The medical-ethical committee Arnhem-Nijmegen (NL58674.091.16) approved the trial on November 15, 2017. The study was registered on December 2, 2017. Participant enrollment started in January 2018, and the results of the study are expected to be published in spring or summer 2021.
Conclusions: Study results will demonstrate whether game-based meditation therapy improves posttraumatic stress and neurobiological stress systems, and whether it is more effective than treatment as usual alone for traumatized adolescents.
Trial Registration: Netherlands Trial Register NL6689 (NTR6859); https://www.trialregister.nl/trial/6689
International Registered Report Identifier (IRRID): DERR1-10.2196/19881
Rates of chronic traumatic exposure among adolescents in residential care are staggering. Over 90% of these adolescents have been exposed to domestic violence, neglect, or emotional, physical, or sexual abuse at a young age . Most of these traumatic experiences take place in the primary caregiving environment, even though caregiver support is essential for adolescents’ attachment, resilience, and stress adaptation [ ]. Abuse by caregivers is probably the most interfering stressor that they can experience. Early traumatization interferes with adolescents’ healthy development [ ]. It can have devastating effects on their psychosocial development [ ], physical health [ ], and neurobiological stress response systems [ , - ].
Neurobiological Stress Systems
Stress activates the autonomic nervous system and the hypothalamic-pituitary-adrenal axis to produce an appropriate stress response. The autonomic nervous system consists of the sympathetic nervous system and the parasympathetic nervous system. Activation of the sympathetic nervous system occurs rapidly after stress exposure—usually within milliseconds to seconds. When confronted with a stressor, the sympathetic nervous system activates physiological processes frequently referred to as the fight or flight response . The increase in sympathetic nervous system activity is reflected by a shorter pre-ejection period (the length of time between the contraction of the heart and the ejection of blood out of the heart into the aorta), corresponding with a higher heart rate [ ]. When the stressor disappears, the parasympathetic nervous system inhibits sympathetic activation and facilitates bodily homeostasis (ie, recovery and digestion) [ ]. Generally, it has been assumed that the sympathetic nervous system and parasympathetic nervous system are reciprocally coupled: when sympathetic nervous system activity increases, parasympathetic nervous system activity decreases, and vice versa. However, various individual variations of autonomic nervous system and parasympathetic nervous system contributions to stress responses exist [ , ]. One key parameter of the parasympathetic nervous system is respiratory sinus arrhythmia, also referred to as vagal tone. Respiratory sinus arrhythmia is a measure of heart rate variability that represents parasympathetic nervous system control over heart rate and occurs at the frequency of respiration and that facilitates adaptive responses to the environment [ , ]. Lower respiratory sinus arrhythmia is associated with more internalizing and externalizing problems [ ] and may increase the risk on internalizing problems after trauma [ , ].
The response of the hypothalamic-pituitary-adrenal axis is slower and has a longer duration than that of the sympathetic nervous system [, ]. The primary effectors of the hypothalamic-pituitary-adrenal axis system are glucocorticoids (steroid hormones). These have a slower onset and longer duration than the catecholamines of the sympathetic nervous system. Stress activates the paraventricular nucleus of the hypothalamus, which releases corticotropin-releasing hormone within a few minutes, usually peaking 15 minutes after the stressor [ ]. This stimulates the production of adrenocorticotropic hormone by the pituitary, which in turn signals the adrenal gland to release cortisol. Cortisol is also produced during nonstressful situations, referred to as basal cortisol [ ]. Research in adolescents on the impact of trauma on cortisol shows evidence for a link between trauma and hypothalamic-pituitary-adrenal axis alterations but is characterized by the lack of a clear physiological profile. Exposure to trauma has been related to increased [ , ] and decreased cortisol levels [ - ].
In healthy individuals, the autonomic nervous system and the hypothalamic-pituitary-adrenal axis together generate adaptive responses in the face of acute threat. However, the experience of multiple, prolonged traumatic events can result in chronic activation of these stress systems, even when the original stressor has disappeared . The unpredictable and ongoing nature of the traumatic events make these adolescents feel as if they are under constant threat of survival [ ]. Unsurprisingly, the adverse effects of trauma become more severe and pervasive as the trauma lasts for a long period or the number of traumatic events increases [ , ].
Although trauma-focused cognitive behavioral therapy and eye movement desensitization and reprocessing are well-established effective treatments for traumatized adolescents , there are some inherent limitations. Both treatment models incorporate exposure techniques, verbal expression, and rely on the integration of cognition, emotion, and physiology. In order for the therapy to succeed in promoting change, sufficient capacity to regulate these systems is required [ ]. Yet, traumatized adolescents often lack the capacity to control and regulate their impulses and emotions [ , ], and even when adolescents do exhibit the necessary skills in order for therapy to succeed in promoting change, residential care provides an often chaotic living environment that impedes the development of a therapeutic relationship and treatment progress [ ]. Also, adolescents are often not motivated to talk about their experiences and re-experience their traumatic past [ ].
Given the difficulties faced in traditional trauma treatment, alternative forms of intervention have gained popularity. The focus has shifted from mainly cognitive-oriented and verbally dependent therapies to interventions that target physiological sensations. One promising approach is fostered by meditation interventions that focus on adolescents’ stress regulation abilities. Meditation techniques (eg, deep-breathing practices) focus on one’s own bodily sensations and increase a sense of control over the body. Not only can feelings of stress be reduced and emotion-regulation capacities improved, individuals also showed beneficial changes in cardiovascular activity [- ]. Meditation can restore activity and connectivity in brain regions associated with posttraumatic symptoms [ ], lead to more balanced patterns of neurobiological stress responses [ ], and modulate both hypothalamic-pituitary-adrenal axis and autonomic nervous system reactivity [ ]. Research on the effectiveness of meditation interventions for posttraumatic stress shows encouraging findings. Most studies have been conducted among adults [ - ], but promising outcomes have been reported in traumatized adolescents too [ ].
This study aims to test the efficacy of game-based neurofeedback meditation therapy as an addition to treatment as usual in a population of traumatized adolescents in residential care. Gaming forms a novel strategy to engage adolescents into treatment and holds several advantages over traditional therapy. Videogame or gamified interventions make use of adolescents’ intrinsic motivation , while conventional treatment often depends upon imparting psychoeducational information, a didactic style of learning that contains few elements that are intrinsically motivating. Yet, motivation is an important predictor of treatment effectiveness [ ], and adolescents in residential institutions are usually characterized by a lack of motivation to change their behavior [ ]. Gamified treatment teaches adolescents techniques and skills but with less thinking and more doing [ ]. This way of learning suits them better than memorizing certain principles [ ]—conventional therapy—does [ ]. Game-play is characterized by its repetitive nature. Repetition promotes long-term learning [ ], and thus may foster generalization of its effects to adolescents’ daily lives. There have been some studies [ - ] conducted among adolescents in residential institutions that evaluated biofeedback videogame interventions. Results showed high user satisfaction, minimal attrition, and improved emotion-regulation [ - ].
Recently, the authors conducted a feasibility study  that evaluated 3 game-based meditation interventions in traumatized adolescents in residential care. The interventions incorporated either bio- or neurofeedback and were assessed on their potential to improve physiological stress regulation, user satisfaction, and preliminary effectiveness on posttraumatic symptoms, stress, depression, and aggression. The intervention that was evaluated positive on all outcomes and considered the best fit was Muse (InteraXon Inc)—a game-based neurofeedback meditation intervention.
The primary aim of this study is to investigate the effectiveness of Muse as an addition to treatment as usual in reducing posttraumatic symptoms (self- and mentor report) and stress (self-report) compared with treatment as usual in traumatized adolescents in residential care. We expect that playing Muse will result in a greater reduction of posttraumatic symptoms and stress than treatment as usual alone.
As a secondary aim, we will investigate the effectiveness of Muse on neurobiological stress systems under both resting and social stress conditions. It is hypothesized that participants who play Muse will show normalized neurobiological parameter compared to participants in the control group. We will also assess the effects of playing Muse on anxiety (self-report), depression (self-report) and aggression (self- and mentor report). It was expected that playing Muse would result in reduced anxiety, depression, and aggression.
This study is a multicenter randomized controlled trial with 2 parallel intervention groups. Outcomes will be compared at 3 measurement instances: before the intervention (T1), immediately after the intervention (T2), and at a 2-month follow-up. Participants will be randomly assigned to the intervention or the treatment-as-usual (control) group, stratified by gender and intellect to ensure equal ratios of participants in both groups.
Recruitment will take place in 3 residential institutions in The Netherlands that provide open and secured care for children and adolescents with and without intellectual disability. Residential care is the most intensive form of youth care and includes out-of-home placement and 24-hour care. These adolescents are unable to live at home due to severe psychiatric or behavioral problems, parental problems, or an unsafe home environment—often a combination of all of these. Adolescents live in group homes with group care workers as substitute care givers and receive treatment to target problem behavior. Residential care is often seen as a last-resort solution when there are no other options for treatment .
Inclusion and Exclusion Criteria
Inclusion criteria are (1) clinical levels of posttraumatic symptoms, measured as a score of 30 or higher on the Children’s Revised Impact of Event Scale (CRIES-13) ; (2) age between 10 and 18 years; (3) capable of understanding and speaking Dutch; (4) active informed assent to participate in the study from participants themselves and active consent from legal guardians when participants are under the age of 16 (obtained by the first author). Exclusion criteria are (1) negative clinician advice, for example, when the participant already has other forms of treatment and the clinical fears that treatment burden would become too heavy (at this stage, participants are not randomized yet, so this exclusion criterion will affect both groups equally); (2) simultaneous participation in another clinical intervention study; (3) acute psychotic symptoms; (4) current or recent (within the previous 3 months) trauma treatment, specifically eye movement desensitization and reprocessing or trauma-focused cognitive behavioral therapy specifically targeting posttraumatic symptoms. There are no restrictions for other types of interventions that participants may receive (eg, medication, individual therapy, or group therapy). We will keep track of additional interventions and use them as covariates in the analyses, if necessary.
At adolescents’ admission to the residential institutions taking part in the study, the CRIES-13 is included in the standard questionnaire battery that adolescents fill out at intake. Adolescents with a clinical score of posttraumatic symptoms on the CRIES-13 (≥30), filled in less than 3 months before T1, will be considered eligible participants for this study. We will include adolescents with clinical levels of posttraumatic symptoms rather than adolescents who qualify for the diagnosis of posttraumatic stress disorder because many adolescents who do not meet the criteria for posttraumatic stress disorder do suffer from posttraumatic symptoms and are in need of treatment .
Additionally, clinicians will be asked whether the adolescent in question can be invited to take part in this study. After clinician consult, eligible participants will be contacted by the coordinating researcher who will explain the studies. We will obtain verbal and written assent from all participants, and when they are younger than the age of 16, also written consent from their legal guardians. Potential participants will be invited for an individual meeting with the coordinating researcher who will explain the study. Participants will be explicitly informed about the study design and that they can quit study participation at any moment without disadvantages. The researcher will also bring information letters with information on all aspects of the study. When adolescents initially agree to participate, they will be given the information letters, and 2 to 3 weeks later, they will be asked for their written assent and invited for the pretest measurement (T1).
Allocation and Randomization
If all inclusion and no exclusion criteria are fulfilled, participants will be randomly assigned (1:1 ratio) to 1 of the 2 groups using a randomization schedule that is generated by a Python script and stratified by gender, intellect, and residential institution. Allocation to groups is not masked, but participants and their mentors will not be informed about the specific expectations regarding posttraumatic symptoms and neurobiological stress reactivity. We will explain that Muse is a relaxation app, designed to help participants deal with stress. Participant enrollment and assignment to the groups will be performed by the first author.
All participants receive treatment as usual: the treatment as recommended by their clinicians regardless of this study (eg, individual or family therapy; medication). There are no restrictions for the type of interventions that participants can receive other than trauma-focused treatment, we only keep track of them. Participants in the intervention group will receive the intervention sessions as an addition to treatment as usual.
Muse is a game-based meditation app that is played on an iPad with a electroencephalography (EEG)–based headband that utilizes real-time neurofeedback. The intervention takes 6 weeks and consists of two 15- to 20-minute gameplay sessions per week. If participants are unable to make it to a session, this session will be rescheduled. All participants will complete 12 gameplay sessions in total. These sessions will take place in an office room located on the campus of the residential institution. Muse includes 10 relaxation tutorials that resemble elements of trauma-focused cognitive behavioral therapy such as deep-breathing techniques . The tutorials are followed by 3-minute meditation sessions. The meditation tutorials are in English, so we have created a standardized protocol with Dutch translations of each tutorial. The gameplay sessions will be supervised by research assistants who are trained to explain the tutorials according to this protocol.
Participants can choose the in-game environment that will be shown during the meditation sessions (eg, beach, rainforest, city park). Before each tutorial, a short calibration will take place, during which the headband records the participants’ brain activity during rest, as a reference point for the upcoming meditation session. The tutorials are followed by 3-minute meditation sessions. Participants will complete at least 2 tutorials and subsequent meditation sessions each intervention session. During the meditation sessions, participants hear sounds in the in-game environment that they have chosen. The EEG-based headband provides real-time neurofeedback that is reflected by the intensity of activity in the environment. When the participant's mind is calm, the environment shows calm and settled winds, but these winds will pick up and blow when the participant's mind becomes more active. When participants succeed in remaining in a calm state for a sufficient amount of time, they will hear birds whistling. The neurofeedback element of the intervention involves retraining brain patterns through operant conditioning. Neurofeedback reinforces individuals’ relaxation abilities  and can reduce posttraumatic symptoms [ ].
After each meditation session, participants get feedback on their performance through a series of simple graphs. In order to motivate, Muse calculates points, provides awards, and sets goals and challenges. Performances are saved and tracked so participants can see their progress over time.
Seefor an overview of all measurements and outcomes. The pretest (T1) will take place in week 1 and will include an interview, an aquatic video, a social stress task, and a hair cortisol measurement. During the interview, the self-report questionnaires will be administered. We will conduct interviews rather than let participants fill in the questionnaires themselves, to ensure cooperation and comprehension. The interview format is, in particular, suitable for adolescents with lower intelligence, since this makes it easier for them to ask for additional explanation when they do not understand the question. Adolescents in residential care are often school dropouts and some of them may have trouble with reading, while they can easily answer the questions when these are read out aloud. The interviews will take approximately 30 minutes, with breaks in-between, and will be conducted by the coordinating researcher.
|Time point||Study timeline||Procedure||Measures|
|T0||≤3 months before T1||Screening||Questionnaire|
|Posttraumatic stress (CRIES-13a)|
|T1||Week 1||Pretest measurement||Questionnaires|
|Posttraumatic symptoms (CROPSb and PROPSc)|
|Stress, depression, anxiety (DASS-21d)|
|Aggression (RPQe and PRPAf)|
|Neurobiological activity during rest|
|Basal ANSg activity|
|Basal HPAh axis activity|
|Neurobiological reactivity to acute stress|
|HPA axis reactivity|
|T2||Week 8||Posttest measurement||Questionnaires|
|Posttraumatic symptoms (CROPS and PROPS)|
|Stress, depression, anxiety (DASS-21)|
|Aggression (RPQ and PRPA)|
|Neurobiological activity during rest|
|Basal ANS activity|
|Basal HPA axis activity|
|Neurobiological reactivity to acute stress|
|HPA axis reactivity|
|Follow-up||Week 16||Two-month follow-up||Questionnaires|
|Posttraumatic symptoms (CROPS and PROPS)|
|Stress, depression, anxiety (DASS-21)|
|Aggression (RPQ and PRPA)|
|Neurobiological activity during rest|
|Basal ANS activity|
|Basal HPA axis activity|
aCRIES-13: Children’s Revised Impact of Event Scale.
bCROPS: Child Report of Posttraumatic Symptoms.
cDASS-21: Depression Anxiety Stress Scales.
dPROPS: Parent Report of Posttraumatic Symptoms.
ePRPA: Parent-rating scale for Reactive and Proactive Aggression.
fRPQ: Reactive and Proactive Aggression Questionnaire.
gANS: autonomic nervous system.
Participants will watch an aquatic video for 5 minutes  to derive basal autonomic nervous system parameters during rest, in order to compare to the autonomic nervous system parameters derived during the stress task. The social stress task is an adapted and combined version of the Trier Social Stress Task for Children (TRIER-C) [ , ] and the Sing-a-Song Stress Test (SSST) [ ]. Participants receive the introduction of a story and are told that they have 5 minutes to compose the end of the story. Then, they will present their story for 4 minutes in front of a camera. Unlike the original TRIER-C, the judge panel will be replaced by a video camera [ ]. Participants will be recorded, allegedly for later assessment by a group of peers who will judge their performance. If the participant does not complete the 4 minutes for presenting, the researcher can use a standard set of prompts to encourage further narration. Immediately after the 4 minutes, participants will be asked to fill in a 3-item manipulation check to rate how nervous the presentation task has made them on a scale from 1 (not nervous at all) to 10 (very nervous). Next, participants are given a booklet with song texts and are told that they have to sing a song in front of the camera. Participants have 30 seconds to choose a song and are expected to sing the song aloud for 30 seconds. Again, they will be asked to fill out the manipulation check immediately after the task. For an overview of the stress task, see . Participants will not be fully debriefed until they completed the second stress task at T2.
|Task timeline||Activity||ANSa recordings||Cortisol samples|
|–5 minutes||Aquatic video||Basal ANS parameters||—|
|Anticipation speech task||ANS reactivity||—|
|Speech task||ANS reactivity||—|
|Anticipation song task||ANS reactivity||—|
|Song task||ANS reactivity||—|
|0 minutes||Recovery||ANS recovery||Post|
aANS: autonomic nervous system.
The posttest (T2) will take place in week 8 and includes, like the pretest (T1), an interview, aquatic video, social stress task, and a hair cortisol measurement. Since participants will be exposed to the social stress task twice, it is expected that they show habituation-related decreased levels of stress at T2 [, ]. To lower the risk for stress habituation and to improve methodological rigor for the second social stress task, participants will be given another story introduction that is comparable to the story that will be used for T1. At the end of T2, participants will be debriefed and told that the video recordings were deleted immediately after the measurement session.
The 2-month follow-up will take place in week 16 and includes an interview, aquatic video, and a hair cortisol measurement. The 2-month follow-up measurement is conducted to provide additional information about potential long-term intervention effects. Therefore, we will use questionnaires and the parameters to measure neurobiological activity during rest that are relatively simple to obtain (ie, a 5-minute autonomic nervous system measurement during the aquatic video and cutting the hair). Measuring neurobiological reactivity requires the execution of a stress task that is time-consuming, and even more important, eliciting stress among traumatized adolescents is not without risks and should only be done when essential for research purposes. For those reasons, neurobiological reactivity to acute stress was not included at 2-month follow-up measurement.
Participants will receive a gift voucher of €15 (approximately US $17.86) at T1, a gift voucher of €10 (approximately US $11.91) and a stress ball at T2, and a gift voucher of €15 at 2-month follow-up measurement. Participants’ mentors (ie, the group home worker with whom they have the most contact) will fill in the questionnaires in the same week as when the measurements with the participants are conducted.
The screening instrument is the CRIES-13 , a questionnaire with 13 four-point items to screen whether adolescents suffer from posttraumatic symptoms.
Posttraumatic symptoms will be measured by participants’ self-report as well as by mentor report. The Child Report of Posttraumatic Symptoms (CROPS)  is a self-report questionnaire that consists of 24 three-point items. The Parent Report of Posttraumatic Symptoms (PROPS) [ ] is a 30-item questionnaire that measures posttraumatic symptoms as reported by parents or other caretakers. In this study, participants’ group home mentors will fill out the questionnaire. Several studies have demonstrated the validity and reliability of the CROPS and the PROPS in general populations [ ]. Additionally, the CROPS has been validated in a sample of juvenile offenders [ ]. The CROPS and the PROPS have been jointly developed so that the CROPS focuses on internal thoughts and feelings, whereas the PROPS focuses on observable behaviors.
Stress will be examined with the 7-item stress subscale of the Depression Anxiety Stress Scales (DASS-21) [, ]. The DASS-21 is a self-report questionnaire that in total consists of 21 four-point items. Its validity and reliability are good and the subscales have an excellent internal consistency [ ].
Anxiety will be measured with the 7-item anxiety subscale of the DASS-21 [, ].
Depression will be measured with the 7-item depression subscale of the DASS-21 [, ].
Aggression will be measured by participants self-report as well as by mentor report. The Reactive and Proactive Aggression Questionnaire (RPQ)  is a self-report questionnaire that is composed of 23 three-point items. The RPQ consists of proactive aggression and reactive aggression subscales. Its validity and reliability are good, and both subscales have good internal consistency [ ]. The Parent-rating scale for Reactive and Proactive Aggression (PRPA) [ ] is a questionnaire that can be filled out by parents or other caretakers. The PRPA has 11 three-point items and consists of reactive aggression and proactive aggression subscales. The PRPA total score and both its subscale scores have good validity [ ].
Neurobiological Activity During Rest
Autonomic nervous system parameters will be measured with the Vrije Universiteit Ambulatory Monitoring System (VU-AMS) [, ]. This a lightweight ambulatory device that records electrocardiograms and changes in thorax impedance with 5 electrodes that are placed on participants’ chest and 2 that are placed on the back. The electrocardiogram has a sampling rate of 1000 Hz and heart rate is obtained from the time between 2 adjacent R peaks. Heart rate data will be extracted and visually inspected for artifacts with the Vrije Universiteit Data Analysis and Management Software program (VU-DAMS; version 4.0) [ ]. We will derive heart rate, respiratory sinus arrhythmia, pre-ejection period, respiration rate, and skin conductance parameters from the VU-AMS recordings.
Basal autonomic nervous system parameters during rest will be derived from VU-AMS recordings while participants are watching an aquatic video for 5 minutes .
For basal hypothalamic-pituitary-adrenal axis activity, basal cortisol levels will be measured in participants’ hair. Whereas saliva captures real-time cortisol levels that are subject to major fluctuations , hair cortisol provide a reliable way to assess average long-term activity of the hypothalamic-pituitary-adrenal axis (thus cortisol exposure over longer time). Hair samples will be cut as close to the scalp as possible from a posterior vertex position. At least 15 mg of the most proximal 1.5 cm of each hair sample will be used for analysis—representing the basal level over the 6 weeks before the hair sample was taken. Hair processing and analyses will be conducted by the Laboratory of Endocrinology of the Erasmus Medical Center, Rotterdam, the Netherlands. Hair samples will be washed in isopropanol and after solid phase extraction, hair cortisol will be quantified by liquid chromatography–tandem mass spectrometry [ ].
Neurobiological Reactivity to Acute Stress
For autonomic nervous system reactivity to acute stress, autonomic nervous system parameters will be measured while participants complete the social stress task (see). We will derive autonomic nervous system parameters during the following segments of the stress task: (1) anticipation speech task, (2) performing speech task, (3) anticipation song task, (4) song task, and (5) recovery.
For hypothalamic-pituitary-adrenal axis reactivity to acute stress, salivary cortisol levels will be measures before and after completion of the social stress task (see). Six saliva samples will be obtained with a collection device (Salivette; Sarstedt AG and Co) twenty minutes (–20), immediately before the social stress task (pre), immediately after (post), ten minutes (+10), twenty minutes (+20), and forty (+40) minutes after the task ( ). Cortisol levels will be measured using the liquid chromatography–tandem mass spectrometry method with CHS MSMS Steroid kit (PerkinElmer).
Sample Size Calculation
Power calculations were performed using G*Power . An a priori power analysis for analysis of variance (repeated measures, within-between interaction) was conducted. Based on previous meditation-based interventions for posttraumatic stress [ , - , ], we expected a small to medium effect size of d=0.30 and a repeated measures correlation of 0.60. To achieve a statistical power of at least .80, a sample size of 72 participants was required. We aim to include 80 participants in total to allow for 10% attrition, which was estimated from previous studies [ , , ] on game-based interventions in this population.
To assess intervention efficacy, we will use repeated measure analysis of variance to detect differences in mean outcome scores between the 2 groups at T2 and at 2-month follow-up. All analyses will be conducted in accordance with the intention-to-treat principle. Missing data will be imputed using Markov Chain Monte Carlo . Results will be expressed as differences in mean scores between the 2 groups with 95% confidence intervals. P values<.05 will be considered statistically significant.
Ethical and Safety Issues
Ethical review and approval of this study has been provided by the medical-ethical committee Arnhem-Nijmegen (protocol NL58674.091.16). All substantial amendments will be presented to the committee and competent authority. Before participants are included in the study, they will be informed about the study design, including randomization. Participants who are assigned to the control group will be offered the opportunity to play Muse after the study has ended. Participants can withdraw from participation at any time without consequences.
Participant privacy will be protected by allocating identification numbers to personal information that is traceable in a separate file using double-key encryption. Data will be analyzed in a way that no conclusions can be drawn about individual participants. The 3 researchers that will have access to the data work at the residential institutions where the study is being conducted. Data entry will be double-checked to ensure accuracy. Biological materials will be stored in a locked cabinet or a locked medical freezer at Pluryn until the end of the study. The material will be destroyed after laboratory analysis, as requested by the medical-ethical committee that approved the study.
Adverse events reported by participants or group care workers or observed by the researchers will be recorded and assessed in collaboration with participant’s clinician. The potential relation to the intervention will be examined and participants will be followed until they are reached stable. The risk in participating for this study is considered negligible, but if a participant seems negatively affected by the measurements or intervention, study participation will be discussed with the clinician and discontinued, if necessary.
This study has been registered (Netherlands Trial Register NL6689 [NTR6859]). This study was approved by the medical-ethical committee Arnhem-Nijmegen (NL58674.091.16) on November 15, 2017. Participant enrollment started in January 2018. The results of the study will be published in international journals and presented at international conferences. Research findings are expected to be published in the spring or summer of 2021.
This study is the first to examine the effectiveness of a game-based meditation intervention in a clinical population of traumatized adolescents in residential care. To test the effectiveness of interventions within this population is crucial, since early alterations of these systems increase the risk of psychopathology at a later age . At an early age, neurobiological stress systems contain high rates of plasticity [ ], so adolescents could benefit substantially from effective treatment.
A particular strength of this study is that we use a multimodal, multi-informant approach with different types of assessment (ie, questionnaires and physiological measures) and different informants (ie, self-report and mentor-report). This type of approach is the most accurate way to assess and monitor adolescent mental health . Additionally, we will measure hypothalamic-pituitary-adrenal axis and autonomic nervous system reactivity, since both neurobiological stress systems are hypothesized to play a role in the development and maintenance of posttraumatic symptoms [ ]. To gain understanding in how trauma affects neurobiology, multisystem approaches need to be considered [ ].
Limitations to the design of this study are the nonactive control group, and because of that, the lack of group concealment. Active control groups are more rigorous and leave no room for alternative explanations regarding attention, motivation, and behavioral expectation, but only when participants in both groups have the same expectations of improvement . An optimal control group would require a game-based intervention that is comparable to that of Muse, but without its hypothesized working mechanisms. This is not feasible since this study will be conducted in residential institutions that have tight restrictions for casual gameplay. Clinicians do not agree on implementing a gameplay intervention that is not expected to be beneficial for participants. The primary purpose of this study, however, is to test the effectiveness of Muse as an addition to treatment as usual, not to determine its superiority to another form of treatment. Therefore, treatment as usual can be considered as a valid control group [ ]. Due to the inactive control group, masking of groups is not possible. Participants and mentors will be aware of the groups to which the participants are assigned. Thus, it might be possible that differential expectations will bias study outcomes.
This study has been funded by the Couvée-stichting (the Netherlands) and the Innovatiefonds Zorgverzekeraars (the Netherlands). These funders have no part in the design of the study, data collection, analysis, and interpretation, or in writing the manuscript.
Conflicts of Interest
- Collin-Vézina D, Coleman K, Milne L, Sell J, Daigneault I. Trauma Experiences, Maltreatment-Related Impairments, and Resilience Among Child Welfare Youth in Residential Care. Int J Ment Health Addiction 2011 Apr 12;9(5):577-589. [CrossRef]
- Van der Kolk BA. Developmental Trauma Disorder. A new, rational diagnosis for children with complex trauma histories. Psychiatric Annals 2005;35(5):401-408.
- Ellis BJ, Del Giudice M. Developmental Adaptation to Stress: An Evolutionary Perspective. Annu Rev Psychol 2019 Jan 04;70:111-139. [CrossRef] [Medline]
- Afari N, Ahumada SM, Wright LJ, Mostoufi S, Golnari G, Reis V, et al. Psychological trauma and functional somatic syndromes: a systematic review and meta-analysis. Psychosom Med 2014 Jan;76(1):2-11 [FREE Full text] [CrossRef] [Medline]
- Corrigan F, Fisher J, Nutt D. Autonomic dysregulation and the Window of Tolerance model of the effects of complex emotional trauma. J Psychopharmacol 2011 Jan;25(1):17-25. [CrossRef] [Medline]
- De Bellis MD. Developmental traumatology: the psychobiological development of maltreated children and its implications for research, treatment, and policy. Dev Psychopathol 2001;13(3):539-564. [CrossRef] [Medline]
- Bremner JD, Vermetten E. Stress and development: behavioral and biological consequences. Dev Psychopathol 2001;13(3):473-489. [CrossRef] [Medline]
- Bauer AM, Quas JA, Boyce WT. Associations between physiological reactivity and children's behavior: advantages of a multisystem approach. J Dev Behav Pediatr 2002 Apr;23(2):102-113. [CrossRef] [Medline]
- Lozano DL, Norman G, Knox D, Wood BL, Miller BD, Emery CF, et al. Where to B in dZ/dt. Psychophysiology 2007 Jan;44(1):113-119. [CrossRef] [Medline]
- Berntson GG, Cacioppo JT, Quigley KS. Autonomic determinism: the modes of autonomic control, the doctrine of autonomic space, and the laws of autonomic constraint. Psychol Rev 1991 Oct;98(4):459-487. [CrossRef] [Medline]
- Berntson GG, Cacioppo JT, Binkley PF, Uchino BN, Quigley KS, Fieldstone A. Autonomic cardiac control. III. Psychological stress and cardiac response in autonomic space as revealed by pharmacological blockades. Psychophysiology 1994 Nov;31(6):599-608. [CrossRef] [Medline]
- Porges SW. Cardiac vagal tone: a physiological index of stress. Neurosci Biobehav Rev 1995;19(2):225-233. [CrossRef] [Medline]
- Porges SW. The polyvagal perspective. Biol Psychol 2007 Feb;74(2):116-143 [FREE Full text] [CrossRef] [Medline]
- Graziano P, Derefinko K. Cardiac vagal control and children's adaptive functioning: a meta-analysis. Biol Psychol 2013 Sep;94(1):22-37 [FREE Full text] [CrossRef] [Medline]
- McLaughlin KA, Alves S, Sheridan MA. Vagal regulation and internalizing psychopathology among adolescents exposed to childhood adversity. Dev Psychobiol 2014 Jul 11;56(5):1036-1051 [FREE Full text] [CrossRef] [Medline]
- McLaughlin KA, Rith-Najarian L, Dirks MA, Sheridan MA. Low vagal tone magnifies the association between psychosocial stress exposure and internalizing psychopathology in adolescents. J Clin Child Adolesc Psychol 2015 Oct 24;44(2):314-328 [FREE Full text] [CrossRef] [Medline]
- Gunnar M, Quevedo K. The neurobiology of stress and development. Annu Rev Psychol 2007 Jan;58(1):145-173. [CrossRef] [Medline]
- Herman JP, McKlveen JM, Ghosal S, Kopp B, Wulsin A, Makinson R, et al. Regulation of the Hypothalamic-Pituitary-Adrenocortical Stress Response. Compr Physiol 2016 Mar 15;6(2):603-621 [FREE Full text] [CrossRef] [Medline]
- Laceulle OM, Nederhof E, van Aken MA, Ormel J. Adversity-driven changes in hypothalamic-pituitary-adrenal axis functioning during adolescence. The trails study. Psychoneuroendocrinology 2017 Nov;85:49-55. [CrossRef] [Medline]
- Ouellet-Morin I, Robitaille M, Langevin S, Cantave C, Brendgen M, Lupien SJ. Enduring effect of childhood maltreatment on cortisol and heart rate responses to stress: The moderating role of severity of experiences. Dev Psychopathol 2019 May;31(2):497-508. [CrossRef] [Medline]
- Busso DS, McLaughlin KA, Sheridan MA. Dimensions of Adversity, Physiological Reactivity, and Externalizing Psychopathology in Adolescence: Deprivation and Threat. Psychosom Med 2017;79(2):162-171 [FREE Full text] [CrossRef] [Medline]
- Kliethermes M, Schacht M, Drewry K. Complex trauma. Child Adolesc Psychiatr Clin N Am 2014 Apr;23(2):339-61, ix. [CrossRef] [Medline]
- Cicchetti D, Rogosch FA. Diverse patterns of neuroendocrine activity in maltreated children. Dev Psychopathol 2001 Sep 27;13(3):677-693. [CrossRef] [Medline]
- Leenarts LEW, Diehle J, Doreleijers TAH, Jansma EP, Lindauer RJL. Evidence-based treatments for children with trauma-related psychopathology as a result of childhood maltreatment: a systematic review. Eur Child Adolesc Psychiatry 2013 May 25;22(5):269-283. [CrossRef] [Medline]
- Warner E, Koomar J, Lary B, Cook A. Can the Body Change the Score? Application of Sensory Modulation Principles in the Treatment of Traumatized Adolescents in Residential Settings. J Fam Viol 2013 Sep 10;28(7):729-738. [CrossRef]
- Cook A, Spinazzola J, Ford J, Lanktree C, Blaustein M, Cloitre M, et al. Complex Trauma in Children and Adolescents. Psychiatric Annals 2005 May 01;35(5):390-398. [CrossRef]
- Cohen JA, Mannarino AP, Kliethermes M, Murray LA. Trauma-focused CBT for youth with complex trauma. Child Abuse Negl 2012 Jun;36(6):528-541 [FREE Full text] [CrossRef] [Medline]
- Struik A, Ensink JBM, Lindauer RJL. I Won’t Do EMDR! The Use of the “Sleeping Dogs” Method to Overcome Children’s Resistance to EMDR Therapy. J EMDR Prac Res 2017 Jan 01;11(4):166-180. [CrossRef]
- Sarang P, Telles S. Effects of two yoga based relaxation techniques on heart rate variability (HRV). International Journal of Stress Management 2006 Nov 13;13(4):460-475. [CrossRef]
- Streeter C, Gerbarg P, Saper R, Ciraulo D, Brown R. Effects of yoga on the autonomic nervous system, gamma-aminobutyric-acid, and allostasis in epilepsy, depression, and post-traumatic stress disorder. Med Hypotheses 2012 May;78(5):571-579. [CrossRef] [Medline]
- Wu S, Lo P. Inward-attention meditation increases parasympathetic activity: a study based on heart rate variability. Biomed Res 2008 Oct;29(5):245-250 [FREE Full text] [CrossRef] [Medline]
- Boyd JE, Lanius RA, McKinnon MC. Mindfulness-based treatments for posttraumatic stress disorder: a review of the treatment literature and neurobiological evidence. J Psychiatry Neurosci 2018 Jan;43(1):7-25 [FREE Full text] [Medline]
- Pascoe MC, Thompson DR, Jenkins ZM, Ski CF. Mindfulness mediates the physiological markers of stress: Systematic review and meta-analysis. J Psychiatr Res 2017 Dec;95:156-178. [CrossRef] [Medline]
- Nguyen-Feng VN, Clark CJ, Butler ME. Yoga as an intervention for psychological symptoms following trauma: A systematic review and quantitative synthesis. Psychol Serv 2019 Aug;16(3):513-523. [CrossRef] [Medline]
- Macy RJ, Jones E, Graham LM, Roach L. Yoga for Trauma and Related Mental Health Problems: A Meta-Review With Clinical and Service Recommendations. Trauma Violence Abuse 2018 Jan 09;19(1):35-57. [CrossRef] [Medline]
- Kim SH, Schneider SM, Kravitz L, Mermier C, Burge MR. Mind-Body Practices for Posttraumatic Stress Disorder. J Investig Med 2015 Dec 14;61(5):827-834. [CrossRef] [Medline]
- Spinazzola J, Rhodes AM, Emerson D, Earle E, Monroe K. Application of yoga in residential treatment of traumatized youth. J Am Psychiatr Nurses Assoc 2011 Aug 25;17(6):431-444. [CrossRef] [Medline]
- Granic I, Lobel A, Engels RCME. The benefits of playing video games. Am Psychol 2014 Jan;69(1):66-78. [CrossRef] [Medline]
- Harder AT, Knorth EJ, Kalverboer ME. Securing the Downside Up: Client and Care Factors Associated with Outcomes of Secure Residential Youth Care. Child Youth Care Forum 2012 Jun 26;41(3):259-276 [FREE Full text] [CrossRef] [Medline]
- Van Binsbergen MH. Motivatie voor behandeling: Ontwikkeling van behandelmotivatie in een justitiële instelling [Motivation for treatment. Development of treatment motivation in juvenile justice institutions]. Leiden: University of Leiden; 2003.
- Vygotsky L. Mind in Society: The Development of Higher Psychological Functions. Cambridge, MA: Harvard Press; 1978.
- Weisz JR, Kazdin AE. Evidence-Based Psychotherapies for Children and Adolescents. New York, NY: Guilford Press; 2010.
- Rosas R, Nussbaum M, Cumsille P, Marianov V, Correa M, Flores P, et al. Beyond Nintendo: design and assessment of educational video games for first and second grade students. Computers & Education 2003 Jan;40(1):71-94. [CrossRef]
- Schuurmans AA, Nijhof KS, Vermaes IP, Engels RC, Granic I. A Pilot Study Evaluating "Dojo," a Videogame Intervention for Youths with Externalizing and Anxiety Problems. Games Health J 2015 Oct;4(5):401-408. [CrossRef] [Medline]
- Schuurmans AAT, Nijhof KS, Engels RCME, Granic I. Using a Videogame Intervention to Reduce Anxiety and Externalizing Problems among Youths in Residential Care: an Initial Randomized Controlled Trial. J Psychopathol Behav Assess 2018 Nov 29;40(2):344-354 [FREE Full text] [CrossRef] [Medline]
- Kahn J, Ducharme P, Rotenberg A, Gonzalez-Heydrich J. "RAGE-Control": A Game to Build Emotional Strength. Games Health J 2013 Feb;2(1):53-57. [CrossRef] [Medline]
- Schuurmans AAT, Nijhof KS, Scholte R, Popma A, Otten R. A novel approach to improve stress regulation among traumatized youth in residential care: Feasibility study testing three game-based meditation interventions. Early Interv Psychiatry 2020 Aug 10;14(4):476-485. [CrossRef] [Medline]
- Knorth EJ, Harder AT, Zandberg T, Kendrick AJ. Under one roof: A review and selective meta-analysis on the outcomes of residential child and youth care. Children and Youth Services Review 2008 Feb;30(2):123-140. [CrossRef]
- Verlinden E, van Meijel EPM, Opmeer BC, Beer R, de Roos C, Bicanic IAE, et al. Characteristics of the Children's Revised Impact of Event Scale in a clinically referred Dutch sample. J Trauma Stress 2014 Jun;27(3):338-344. [CrossRef] [Medline]
- Griffin G, McClelland G, Holzberg M, Stolbach B, Maj N, Kisiel C. Addressing the impact of trauma before diagnosing mental illness in child welfare. Child Welfare 2011;90(6):69-89. [Medline]
- Price J, Budzynski T. Anxiety, EEG patterns, and neurofeedback. In: Budzynski T, Kogan H, Budzynski HK, Evans JR, Abarbanel A, editors. Introduction to quantitative EEGneurofeedback: Advanced theoryapplications. New York, NY: Academic Press; 2009.
- Panisch LS, Hai AH. The Effectiveness of Using Neurofeedback in the Treatment of Post-Traumatic Stress Disorder: A Systematic Review. Trauma Violence Abuse 2020 Jul 11;21(3):541-550. [CrossRef] [Medline]
- Piferi RL, Kline KA, Younger J, Lawler KA. An alternative approach for achieving cardiovascular baseline: viewing an aquatic video. Int J Psychophysiol 2000 Aug;37(2):207-217. [CrossRef] [Medline]
- Buske-Kirschbaum A, Jobst S, Wustmans A, Kirschbaum C, Rauh W, Hellhammer D. Attenuated free cortisol response to psychosocial stress in children with atopic dermatitis. Psychosom Med 1997;59(4):419-426. [CrossRef] [Medline]
- Kirschbaum C, Pirke K, Hellhammer DH. The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology 1993;28(1-2):76-81. [CrossRef] [Medline]
- Brouwer A, Hogervorst MA. A new paradigm to induce mental stress: the Sing-a-Song Stress Test (SSST). Front Neurosci 2014 Jul 29;8:224 [FREE Full text] [CrossRef] [Medline]
- Popma A, Jansen LMC, Vermeiren R, Steiner H, Raine A, Van Goozen SHM, et al. Hypothalamus pituitary adrenal axis and autonomic activity during stress in delinquent male adolescents and controls. Psychoneuroendocrinology 2006 Sep;31(8):948-957. [CrossRef] [Medline]
- Schommer NC, Hellhammer DH, Kirschbaum C. Dissociation between reactivity of the hypothalamus-pituitary-adrenal axis and the sympathetic-adrenal-medullary system to repeated psychosocial stress. Psychosom Med 2003;65(3):450-460. [CrossRef] [Medline]
- Hoge EA, Bui E, Palitz SA, Schwarz NR, Owens ME, Johnston JM, et al. The effect of mindfulness meditation training on biological acute stress responses in generalized anxiety disorder. Psychiatry Res 2018 Apr;262:328-332 [FREE Full text] [CrossRef] [Medline]
- Greenwald R, Rubin A. Assessment of Posttraumatic Symptoms in Children: Development and Preliminary Validation of Parent and Child Scales. Research on Social Work Practice 2016 Aug 19;9(1):61-75. [CrossRef]
- Greenwald R, Rubin A, Jurkovic GJ, Wiedemann J, Russell AM, O'Connor MB, et al. Psychometrics of the CROPS & PROPS in multiple cultures/translations. 2002 Nov Presented at: The annual meeting of the International Society for Traumatic Stress Studies; 2002, November; Baltimore.
- Edner BJ, Glaser BA, Calhoun GB. Predictive accuracy and factor structure of the Child Report of Posttraumatic Symptoms (CROPS) among adjudicated youth. Psychol Trauma 2017 Nov;9(6):706-713. [CrossRef] [Medline]
- De Beurs E, Van Dyck R, Marquenie LA, Lange A, Blonk RW. The DASS: a questionnaire for the measurement of depression, anxiety, and stress. Gedragstherapie 2001;34(1):35-53. [CrossRef]
- Lovibond P, Lovibond S. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther 1995 Mar;33(3):335-343. [CrossRef] [Medline]
- Cima M, Raine A, Meesters C, Popma A. Validation of the Dutch Reactive Proactive Questionnaire (RPQ): differential Correlates of Reactive and Proactive Aggression from childhood to adulthood. Aggress Behav 2013 Feb 05;39(2):99-113. [CrossRef] [Medline]
- Kempes M, Matthys W, Maassen G, van Goozen S, van Engeland H. A parent questionnaire for distinguishing between reactive and proactive aggression in children. Eur Child Adolesc Psychiatry 2006 Feb;15(1):38-45. [CrossRef] [Medline]
- de Geus EJ, Willemsen GH, Klaver CH, van Doornen LJ. Ambulatory measurement of respiratory sinus arrhythmia and respiration rate. Biol Psychol 1995 Nov 16;41(3):205-227. [CrossRef] [Medline]
- Willemsen GHM, De Geus EJ, Klaver CHAM, Van Doornen LJ, Carroll D. Ambulatory monitoring of the impedance cardiogram. Psychophysiology 1996 Mar;33(2):184-193. [CrossRef] [Medline]
- VU University. Data Analysis and Management Software (DAMS) for the Vrije Universiteit Monitoring System (VU-AMS). Amsterdam: VU University; 2015.
- van Ockenburg SL, Booij SH, Riese H, Rosmalen JG, Janssens KA. How to assess stress biomarkers for idiographic research? Psychoneuroendocrinology 2015 Dec;62:189-199. [CrossRef] [Medline]
- Noppe G, de Rijke YB, Dorst K, van den Akker ELT, van Rossum EFC. LC-MS/MS-based method for long-term steroid profiling in human scalp hair. Clin Endocrinol (Oxf) 2015 Aug 27;83(2):162-166. [CrossRef] [Medline]
- Faul F, Erdfelder E, Lang A, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007 May;39(2):175-191. [CrossRef] [Medline]
- Blanck P, Perleth S, Heidenreich T, Kröger P, Ditzen B, Bents H, et al. Effects of mindfulness exercises as stand-alone intervention on symptoms of anxiety and depression: Systematic review and meta-analysis. Behav Res Ther 2018 Mar;102:25-35. [CrossRef] [Medline]
- Graham JW. Missing data analysis: making it work in the real world. Annu Rev Psychol 2009 Jan;60(1):549-576. [CrossRef] [Medline]
- McLaughlin KA, Green JG, Gruber MJ, Sampson NA, Zaslavsky AM, Kessler RC. Childhood adversities and adult psychiatric disorders in the national comorbidity survey replication II: associations with persistence of DSM-IV disorders. Arch Gen Psychiatry 2010 Feb 01;67(2):124-132 [FREE Full text] [CrossRef] [Medline]
- Pynoos RS, Steinberg AM, Layne CM, Briggs EC, Ostrowski SA, Fairbank JA. DSM-V PTSD diagnostic criteria for children and adolescents: a developmental perspective and recommendations. J Trauma Stress 2009 Oct;22(5):391-398. [CrossRef] [Medline]
- De Los Reyes A, Augenstein TM, Wang M, Thomas SA, Drabick DAG, Burgers DE, et al. The validity of the multi-informant approach to assessing child and adolescent mental health. Psychol Bull 2015 Jul;141(4):858-900 [FREE Full text] [CrossRef] [Medline]
- Koss KJ, Gunnar MR. Annual Research Review: Early adversity, the hypothalamic-pituitary-adrenocortical axis, and child psychopathology. J Child Psychol Psychiatry 2018 Apr 17;59(4):327-346 [FREE Full text] [CrossRef] [Medline]
- Boot WR, Simons DJ, Stothart C, Stutts C. The Pervasive Problem With Placebos in Psychology: Why Active Control Groups Are Not Sufficient to Rule Out Placebo Effects. Perspect Psychol Sci 2013 Jul;8(4):445-454. [CrossRef] [Medline]
- Freedland KE, Mohr DC, Davidson KW, Schwartz JE. Usual and unusual care: existing practice control groups in randomized controlled trials of behavioral interventions. Psychosom Med 2011 May;73(4):323-335 [FREE Full text] [CrossRef] [Medline]
|CRIES-13: Children’s Revised Impact of Event Scale|
|CROPS: Child Report of Posttraumatic Symptoms|
|DASS-21: Depression Anxiety Stress Scales|
|PROPS: Parent Report of Posttraumatic Symptoms|
|PRPA: Parent-rating scale for Reactive and Proactive Aggression|
|RPQ: Reactive and Proactive Aggression Questionnaire|
|SSST: Sing-a-Song Stress Test|
|TRIER-C: Trier Social Stress Task for Children|
|VU-AMS: Vrije Universiteit Ambulatory Monitoring System|
|VU-DAMS: Vrije Universiteit Data Analysis and Management Software|
Edited by G Eysenbach; submitted 05.05.20; peer-reviewed by A Conrrero, CYY Lai; comments to author 29.06.20; revised version received 16.07.20; accepted 01.08.20; published 23.09.20Copyright
©Angela A T Schuurmans, Karin S Nijhof, Ron Scholte, Arne Popma, Roy Otten. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 23.09.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.