This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.
The association between behavioral difficulties and academic attainment is well established. Recent policy advising schools on managing behavior has promoted the early identification of behavioral difficulties. There is also increasing research into mHealth interventions to provide support for emotional and behavioral difficulties for young people.
The primary aim of the proposed research is to examine the effectiveness of an mHealth intervention, ReZone, in reducing emotional and behavioral difficulties in young people.
The protocol is a cluster trial of 12 classes with N=120 students with classes randomized to ReZone or management as usual. Multilevel modeling will be used to compare ReZone versus management as usual accounting for classroom-level variation.
Baseline data collection started in February 2017 and ended in April 2017. Follow-up data collection started in April 2017 and ended in June 2017.
The proposed research will provide evidence as to whether ReZone is effective at helping young people to self-manage when feeling overwhelmed.
ISRCTN 13425994; http://www.isrctn.com/ISRCTN13425994 (Archived by WebCite at http://www.webcitation.org/6tePwwiHk)
In England, between 3% and 7% of school-aged children experience behavioral difficulties [
A range of programs exist to support social and emotional aspects of learning (SEAL) in students, with a systematic review identifying 113 school interventions and 222 out-of-school interventions in the United Kingdom [
In terms of mental health, delivering services using new technologies is a developing area of interest in the English government, which recommends the increased use of technology-enabled interventions to improve access to services [
Technology-enabled health care is “not just about technology, but about empowering patients to exercise greater choice and control” [
There is increasing research into mHealth interventions [
The aims of this research are to bridge research gaps by developing an mHealth self-management support intervention to help students engage with learning and ensuring the intervention is evidence-based. Therefore, the primary aim of the proposed research is to examine the effectiveness of an mHealth intervention, ReZone, in reducing emotional and behavioral difficulties in young people to support engagement with school. The secondary aims are to examine the effectiveness of ReZone in improving self-management, well-being, and health-related quality of life in young people.
The sample size calculation was performed using the clustersampsi command [
A minimum of 12 clusters (classes) of 10 students will be recruited. This is based on a mean effect size for universal classroom management programs of
All students aged 10 to 15 years in the schools taking part in the project will be eligible to participate. To ensure matched ages across the conditions, 5th grade students (aged 10 to 11 years) will be recruited from mainstream schools; the alternative provision schools have classes with mixed ages, and, therefore, students aged 10 to 15 years will be recruited from these schools. Students will be informed about the study by schools, which will disseminate information sheets and consent forms. Consent will be recorded in writing from parents with assent recorded from young people. Participants will be assigned a unique number and their data will only be identified by this number; consent forms and contact details will be stored securely and separately from anonymized study data. Participant lists of all classes and students will be obtained from schools.
An independent trials unit will randomize classes to management as usual or ReZone stratified by school type (alternative provision vs mainstream) using random sequence generation after classes have been recruited and baseline measures assessed. To reduce the predictability of randomization, classes will be randomized in blocks of 2, and allocation will be implemented via a secure online portal.
Management as usual was deemed an appropriate comparator as there is no routinely used mHealth intervention in classes when students feel overwhelmed. The trial will be open label.
Research assistants will attend classes, and students will complete baseline paper questionnaires (this took place from February to April 2017). Classes will then begin management as usual or download and start using ReZone. Research assistants will attend classes to collect follow-up paper questionnaires 3 months later (this took place from April to June 2017).
A favorable opinion has been received from University College London (UCL) Research Ethics (number 7969/001), and the study is adhering to relevant ethical guidelines from the British Psychology Society [
There are 3.6 million school students aged 10 to 15 years old in the United Kingdom [
ReZone was made for Apple iOS, Google Android, and Google ChromeBook. It was developed using HTML, Cascading Style Sheets, and JavaScript and using Phonegap to convert into iOS and Android apps. The server querying was performed using hypertext preprocessor (PHP) and a MySQL database. The server is a Dell PowerEdge R210 with Quad Core 2.40 Ghz Linux-based dedicated server with 1 TB bandwidth. The ChromeBook app is kept as a packaged HTML app.
As ReZone is being used in a classroom setting, it is not necessary to connect or interact with national or regional health information systems at this stage.
Students are able to download the ReZone app from the iTunes, Google Play, and Windows app stores. Students can then use the app as much as they like, using the tools on the platform as well as being able to download and email the flat graphics of tools without personal data. Students can use ReZone on their own accord or be directed by teachers to use it during classes at times the student is becoming overwhelmed.
The app aims to help students manage their emotional well-being in the classroom by encouraging them to refocus if they are feeling angry, stressed, or anxious. ReZone contains a series of tools designed to improve concentration, help relieve stress, and help students to reflect and think through problems logically. Consultations with staff from alternative provision schools were conducted where researchers discussed the therapeutic tools already being used within the school and which elements of the tools they felt were important. ReZone was then reviewed as part of the App Approval Application panel at the Anna Freud National Centre for Children and Families. This feedback, along with mentalization-based therapy, cognitive behavioral therapy (CBT), mindfulness breathing, and evidence-based training such as attention bias modification training (ABMT) aided the design of ReZone.
There are 6 functions of Rezone (stress bucket, chill out, art therapy, timeout, happy faces, and games) (
Stress bucket (
Timeout: Timeout asks the user to think through a time when they have felt stressed, angry, or upset. The user then works through on the app all the events that led up to feeling this way and what happened afterwards. The user can also think through what they could have done differently to help the situation as a behavioral plan. The visualization is a rocket, and each thought process creates a cloud.
Chill out (
Art therapy: The user can choose between a castle, dinosaur, fish, goat, heart, helicopter, unicorn, rocket, footballer, sea, or turtle to color in. There is a range of colors and utensils to complete the drawing.
Happy faces: The user is given 30 seconds to find as many happy faces as they can among other faces depicting negative emotions.
Game: There is game of Balloon Blast on the app. The user taps the screen to move the balloon up, trying to avoid all the obstacles, as hitting one will mean the game is over. This is a game created to provide a break or reward for the user in between the other features.
ReZone home page.
ReZone stress bucket (before).
ReZone stress bucket (after).
ReZone chill out function; breathing exercise.
The stress bucket and timeout are based on the mechanism of CBT, a widely used technique looking at how a person thinks about a situation and how this affects the way they act [
Chill out and art therapy are based on the concept of mindfulness [
Happy faces uses techniques from ABMT, which aims to alter cognitive biases that selectively focus on negative emotional cues in the environment [
Designing the app began with formative research with alternative provider schools to elicit feedback about the current use of tools when feeling angry, stressed, or anxious and current mobile phone and tablet use in and outside of the classroom. Students were also recruited to test prototypes and provide feedback on the usability, content, and design of the app. We will also be conducting focus groups and interviews with teachers and students at the end of the trial to gather further feedback on usability and content.
In the initial feedback on the designs, students reported that the tools were useful and easy to understand, and they appreciated the ability to have a range of tools in one place. Students offered their opinions on the design and wording of the app for their age range and on how best to share their data with their teachers. Given the existing user feedback, it is not anticipated that ReZone will cause distress. However, if students were to experience distress from using ReZone, it would be recorded as a serious adverse event, the ethics committee and sponsor would be notified, and the trial would be stopped if necessary.
ReZone is designed to be used in school settings with 10- to 15-year-old students, who commonly have access to tablets within school. Access could be affected by socioeconomic status due to the cost of a mobile phone or tablet to families or schools.
ReZone is free to download from the relevant app stores and, therefore, the cost of the intervention to the school is for Internet access in order to download and run the app and the cost of the tablets and/or phones. The financial strategy of ReZone and other digital products in our center is to cover ongoing technical maintenance of the app and systems through costed training for schools and mental health services in using specific products such as ReZone, using digital products in these settings in general, and developing and evaluating in-house digital products.
ReZone has information points and examples throughout the app and the 6 individual functions so that the intervention use is clear to both students and staff. Students were recruited to give feedback on the information points and usability of the app. Additional training will not be provided as ReZone has been developed to be used as a standalone intervention.
Access to mobile phones and tablets at school is the main limitation for delivery at scale, but this is more applicable to mainstream schools than alternative provider schools where mobile phones and tablets are routinely used during learning.
The functionality of ReZone applies to a range of school settings. The intervention is free and easily downloaded from various app stores; it is not limited to specific users or geographical localities. It will be important to examine how best to adapt ReZone for other cultures, groups, and settings as part of other projects.
Screenshots of content are included in
Students are asked to enter their name, school, and date of birth each time they start using the app. The app combines the 3 sets of data encryption before submitting to the server using an Internet connection. These data are encrypted again at server level using PHP and saved in encrypted format inside a MySQL database with a unique identifier. Name, school, and date of birth are not stored as plain text in the database. If the data were to be intercepted, the data would be meaningless because they are encrypted before leaving the app. With regard to the ChromeBook app, a SHA256 Secure Sockets Layer certificate will be added to encrypt the data further. The server itself has physical and software-based security such as cameras around the hardware, daily backups, and a firewall.
The tools used on ReZone are based on the relevant supporting evidence base for mentalization-based therapy, CBT techniques, and ABMT. They are evidence-informed tools that have been previously created and align with relevant recommendations, such as CBT for anxiety as recommended by National Institute for Health and Care Excellence guidelines [
Activity data are stored on the app and will be reviewed to determine how long students spend on ReZone, which tools they use the most, and for how long they use each tool. Metrics of participant engagement with the intervention will also be measured by teachers on self-reported forms. Teachers will record fidelity (eg, the number of times ReZone is used per class, the number of students using ReZone), class disruption, other SEAL interventions being used, and length of time to reinstate student to the class. Participants can also print off activities completed on the app to show teachers or family members.
Age, gender, and ethnicity will be self-reported by young people at baseline. Ethnicity will be captured using the categories from the 2001 Census. Special educational needs will be obtained from school records.
To measure emotional and behavioral difficulties, the 16-item Me and My School (M&MS) [
To measure mental well-being, the 7-item Short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS) [
To measure self-management, the 6-item self subscale of the Youth Empowerment Scale–Mental Health (YES-MH) [
To measure health-related quality of life, the 6-item EuroQol 5-Dimension–Youth (EQ-5D-Y) [
Data will be entered into an Excel (Microsoft Corp) spreadsheet by research assistants with a random 20% double-entered for cross-checking. Data will only be stored on the organization’s secured servers, accessible only by members of the research team. Data will be analyzed using Stata 12 (StataCorp LLC) in order to examine the effectiveness of ReZone in reducing emotional and behavioral difficulties and improving self-management, well-being, and health-related quality of life in young people in need of targeted support to engage with learning. Three models will be tested for each of the outcome variables with time nested within students within classrooms. In model 0, the null model without predictors will be computed to examine change in outcome (eg, behavioral difficulties) over time, and the ICC will be calculated. In model 1, the association patient-level grand mean centered age, ethnicity, and special educational needs will be entered as a level-1 predictor. In model 2, the condition (ReZone vs management as usual) will be entered. School-type (ie, alternative provision vs mainstream) will be entered as a fixed effect. The likelihood ratio test will be used to compare the fit of subsequent models. An intention-to-treat analysis will be performed with last-item carried forward imputation.
Funding for the trial has been secured from University College London (UCL). Baseline data collection started in February 2017 and ended in April 2017. Follow-up data collection started in April 2017 and ended in June 2017. Data analysis and write-up will be completed by December 2017.
Any updates to this protocol will be published, and the findings of the proposed research will be submitted for publication in a peer-reviewed journal by the current authors in line with International Committee of Medical Journal Editors’ guidelines. The research team will also disseminate findings to the participating schools, the study sponsor, and relevant conferences. A public summary of the findings will be available on our organization’s website (www.ucl.ac.uk/ebpu).
The trial and its findings will develop an evidence-based mHealth self-management support intervention to help students engage with learning and manage their emotions. The findings will contribute to the growing use of technology to support children and young people with their mental health. Anticipated limitations of the proposed research include the fidelity of the intervention, assessed through teacher self-report and activity data; the content of management as usual, as different classes in this arm may use a variety of different social and emotional learning interventions despite not using ReZone, assessed through teacher self-report; and attrition, addressed by designing ReZone with young people to ensure it is usable and through using existing questionnaires that balance length with capturing the necessary range of relevant outcomes. Notwithstanding the above limitations, the proposed research will provide evidence as to whether ReZone is effective in helping young people to self-manage when feeling overwhelmed.
attention bias modification training
cognitive behavioral therapy
EuroQol 5-Dimension–Youth
intraclass correlation coefficient
Me and My School
hypertext preprocessor
social and emotional aspects of learning
Short Warwick-Edinburgh Mental Well-being Scale
University College London
Youth Empowerment Scale–Mental Health
The research was supported by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) North Thames at Bart’s Health NHS Trust. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.
None declared.