Background: Severe obesity among youths (BMI for age≥120th percentile) has been steadily increasing. The home environment and parental behavioral modeling are two of the strongest predictors of child weight loss during weight loss interventions, which highlights that a family-based treatment approach is warranted. This strategy has been successful in our existing evidence-based pediatric weight management program, Brenner Families in Training (Brenner FIT). However, this program relies on face-to-face encounters, which are limited by the time constraints of the families enrolled in treatment.
Objective: This study aims to refine and test a tailored suite of mobile health (mHealth) components to augment an existing evidence-based pediatric weight management program.
Methods: Study outcomes will include acceptability from a patient and clinical staff perspective, feasibility, and economic costs relative to the established weight management protocol alone (ie, Brenner FIT vs Brenner FIT + mHealth [Brenner mFIT]). The Brenner mFIT intervention will consist of 6 mHealth components designed to increase patient and caregiver exposure to Brenner FIT programmatic content including the following: (1) a mobile-enabled website, (2) dietary and physical activity tracking, (3) caregiver podcasts (n=12), (4) animated videos (n=6) for adolescent patients, (5) interactive messaging, and (6) in-person tailored clinical feedback provided based on a web-based dashboard. For the study, 80 youths with obesity (aged 13-18 years) and caregiver dyads will be randomized to Brenner FIT or Brenner mFIT. All participants will complete baseline measures before randomization and at 3- and 6-month follow-up points.
Results: This study was approved by the Institutional Review Board in July 2019, funded in August 2019, and will commence enrollment in April 2020. The results of the study are expected to be published in the fall/winter of 2021.
Conclusions: The results of this study will be used to inform a large-scale implementation-effectiveness clinical trial.
International Registered Report Identifier (IRRID): PRR1-10.2196/18098
Severe obesity among youths (BMI for age ≥120th percentile) has been steadily increasing. Declines in physical activity over the last four decades have been accompanied by concurrent declines in dietary quality , increased sugar consumption [ ], and increased energy intake [ ]. The combination of these factors has contributed to the increased prevalence of overweight/obesity in youths during this period, particularly severe childhood obesity [ ]. Clinical interventions to treat obesity through healthy eating and physical activity show that improvements in these behaviors are linked to modest, positive weight outcomes [ ] and improvement in cardiometabolic risk factors [ ]. However, pediatric weight loss programs have relied on in-person visits, creating difficulties for parents’ work schedules and the need to travel. A US Preventive Task Force panel noted that intensive clinical programs are effective but require ≥26 hours of contact to achieve positive results, which is difficult for the youths and their families to do [ ]. Mobile technology supporting health practices (mobile health [mHealth]) can reduce these barriers by delivering theoretically based content, facilitating self-monitoring, and connecting families to enhance treatment adherence and improve weight status [ ].
Involving family members in the treatment of adolescents with obesity can be effective, but adherence is suboptimal . Few studies have targeted youths and their families with an mHealth approach to supplement a clinical weight loss intervention [ ] despite evidence for its acceptability and feasibility in adolescents and adults [ , ]. Parent-child interventions are more effective than treatment programs that focus primarily on the child, and mHealth strategies are ideally suited for intervention targets identified in previous conceptual models (eg, increasing parental competence, self-efficacy, parent-child communication, and parents’ support of the adolescent’s autonomy) [ ]. Engaging parents or other caregivers in treatment plans can be challenging, but mHealth strategies can potentially increase the caregivers’ exposure to and engagement with intervention strategies by providing caregivers with more easily implemented tools to monitor youth behaviors and facilitate communication between caregivers and adolescents.
Self-monitoring is the cornerstone of behavioral treatment for weight loss , and both adherence to self-monitoring [ ] and tailored feedback on self-monitoring behaviors [ ] are associated with weight loss. mHealth technologies can be used to deliver the behavioral content of a weight loss intervention and provide participants with ways to self-monitor and receive feedback. Moreover, mHealth can deliver efficacious approaches for weight loss as phone ownership is pervasive in both adults [ ] and children [ ]. mHealth has the potential to make monitoring of healthy eating and physical activity less burdensome, although limited tools exist for parents and children. Therefore, there is an opportunity to develop and test mHealth tools to augment clinical practices. This paper describes the study design and conceptual approach of developing mHealth tools that will then be formally evaluated in a full-scale randomized trial to assess their effectiveness. The current project will randomize 80 youths with obesity (aged 13-18 years) and caregiver dyads to a pediatric weight management program or the same program plus a suite of mHealth tools. This study will establish the acceptability, feasibility, and costs of the mHealth program relative to the standard of care (ie, family-based, multidisciplinary weight management), and the proposed sample of 80 dyads will give sufficient power for the estimation of retention rates and confidence intervals to inform a large-scale implementation-effectiveness clinical trial (see Trial Sample Size section).
Brenner Children’s Hospital is a 160-bed children’s hospital, which is part of the Wake Forest Baptist Medical Center (WFBMC). Located at the WFBMC, Brenner Families in Training (Brenner FIT) is an interdisciplinary, family-based pediatric weight management program [- ] that focuses on the treatment of obesity in children aged 2 to 18 years. A physician referral is required, and treatment involves the entire family. The Brenner FIT team includes physicians, family counselors, dietitians, social workers, an activity/play specialist, and a physical therapist. Brenner FIT materials are available in English and Spanish. Brenner FIT also offers free nutrition and face-to-face parenting classes to all members of the community. Given that Brenner FIT provides care for a diverse patient population, it will serve as the base of the study. The average patient is clinically obese, as indicated by a BMI of 35.9 kg/m2 (SD 8.6) and a BMI z-score of 2.6 (SD 0.5). Half of the patient population is in their teenage years (13-18 years). Brenner FIT is successful in enrolling a diverse population of families into research studies [ , ]. Approximately 66% of those enrolled in Brenner FIT improve their weight status [ ], and the children who are successful display a decrease in BMI z-score of 0.07 to 0.1, with an average BMI z-score decrease of 0.11 at 8 months. A 0.1 to 0.15 decrease in BMI z-score is linked with healthy changes in cardiometabolic biomarkers [ ].
Study Design: Inclusion/Exclusion Criteria and Recruitment
Caregiver/adolescent dyads referred to the Brenner FIT program are invited to participate. Dyads are eligible if the adolescent under treatment is aged 13 to 18 years, a caregiver who lives in the house (eg, a parent or grandparent) agrees to participate, both members of the dyad (the adolescent and caregiver) own a smartphone or tablet, and the adolescent has no contraindications for physical activity as indicated by their physician. Research suggests that smartphone ownership is greater than 95% in the target population . The youth will be excluded from participation in the study if they have functional limitations that preclude engaging in physical activity as directed by the program because of our inability to tailor the mHealth materials for those requiring adaptations. Those deemed eligible initially are informed of the study following their intake visit by Brenner FIT clinical staff. Those who express interest receive an in-person warm handoff to a research team member who confirms eligibility, reassesses interest, and performs or schedules an intake visit.
Informed Consent and Intake
Following the clinical visit, caregivers and patients are informed of the study and are invited to learn more from the research staff. At this orientation session, the research staff describe the study and administer consent/assent forms to those who wish to enroll. Participants complete the consent/assent forms, then complete all baseline survey measures, have their weight/height assessed, and are oriented to the procedure for physical activity measurement via an accelerometer. ActiGraph accelerometers are affixed to all youth participants via a wrist strap, and the family is given a self-addressed, padded envelope to return the accelerometer in after 7 days of wear. Once participants return the monitor and complete dietary assessments, they are contacted to learn their group assignment (ie, Brenner FIT or Brenner FIT + mHealth [Brenner mFIT]). Follow-up visits are scheduled by the clinical staff in coordination with the research staff who complete assessments at 3 months (a subset of measures), and at 6 months, with the participating dyads following their clinical appointments at both time points.
Study Design: Randomization
This study is registered in ClinicalTrials.gov (NCT03961061). The study will be a two-group, randomized controlled superiority trial design. Dyads will be block randomized by our statistician to 1 of 2 groups. The 2 groups are (1) Brenner FIT (standard care: n=40 dyads) and (2) Brenner mFIT (standard care plus mHealth features: n=40 dyads). Owing to the nature of the study, it is impossible to blind the clinical staff or participants, but all data will be collected by an independent evaluator who is blind to the condition and not involved in the delivery of the intervention.
Control Condition: Brenner Families in Training (Standard Care)
Brenner FIT is an interdisciplinary, family-based pediatric weight management clinic. Treatment teams comprised a pediatrician, counselor, dietitian, and physical activity specialist, with others (eg, social workers, physical therapists) as needed. The entire family is encouraged to attend all aspects of the treatment program, although only 1 caregiver is required. As recommended with tertiary care stage 3 to 4 weight management programs , treatment is guided by an established protocol that is monitored using a clinical database.
After referral to Brenner FIT, families attend an orientation, following which they are scheduled for an initial introductory 2-hour intake group session; these occur within 2 to 4 weeks of the orientation. Monthly 1-hour-long visits with the dietitian, counselor, and physical activity specialist are held for 6 months, after which the child and caregiver see the pediatrician. During the 6 months of treatment, they attend 4 group classes, choosing from topics such as meal planning, physical activity, and parenting. Specialized visits with the physical activity specialist or physical therapist are scheduled when pertinent issues arise. Clinic visits include individualized goal setting (for behaviors that the family/clinician have jointly agreed to address), healthy eating and physical activity education, and behavioral counseling to implement changes at home. Motivational interviewing, modified by Brenner FIT for use with families , is key to treatment; family counselors are trained in cognitive behavioral therapy as well as parenting support and education, nonrestrictive approaches to dietary modification, and mindfulness and employ these approaches to assist families in developing healthy habits. Self-monitoring is part of the intervention: parents and children complete handwritten paper diet and physical activity logs and return them to clinicians.
Intervention Condition: Brenner Families in Training Plus Mobile Health
Brenner mFIT includes all components of the standard Brenner FIT program and 6 mHealth components that are designed to target theoretically supported constructs (). The 6 mHealth components are (1) a mobile-enabled website, (2) dietary and physical activity tracking and a physical activity tracker, (3) caregiver podcasts (n=12), (4) animated videos (n=6) for adolescent patients, (5) interactive messaging (between the participants and clinical staff), and (6) tailored clinical feedback. All Brenner mFIT components are delivered by the clinical staff. The components are outlined individually as follows.
|Mobile-enabled website||The mobile-enabled website will serve as the central hub of the mHealth components and will enable easy access to study materials and feedback||Facilitation (SCTa)|
|Diet and physical activity tracking||Tracking physical activity via the Fitbit wearable and behavioral food goals tracked via the mobile-enabled website||Facilitation (SCT); self-regulation (SCT)|
|Caregiver podcasts||A 12-part episodic story about caregivers who are working with their adolescent children to help them to be active, eat healthy, and achieve a healthy weight. The podcasts will deliver theoretically informed content around emotional regulation, proper use of incentives, and providing support for their child to gain autonomy over their weight loss program||Outcome expectations (SCT); self-efficacy (SCT); incentive motivation (SCT); autonomy support (SDTb)|
|Youth-animated videos||A 6-part series of short videos about teenagers who are struggling but succeeding with commonly encountered challenges to weight loss. Each episode will take on a different scenario that youth face successfully. The brief videos will use a compelling story and humor to address tough situations that the youths may find themselves in, such as navigating the holidays, being active despite barriers (eg, rain, inactive friends), shopping/cooking for oneself, or lack of motivation to be active||Observational learning (SCT); outcome expectations (SCT); autonomy (SDT); relatedness (SDT)|
|Peer and professional support||Secure platforms will be created so that caregivers can give and receive encouragement and feedback from peers and the clinical staff. The clinical staff will also give direct feedback regarding goal progress via directs texts and emails with families based on personalized reports provided to the clinical staff||Relatedness (SDT); self-efficacy (SCT)|
|Tailored clinical feedback||Personalized reports from each dyad will be provided to the clinical team on a weekly basis, which will give insight into successes and challenges related to self-monitoring, goal setting, goal attainment, and engagement with intervention materials||N/Ac|
aSCT: social cognitive theory.
bSDT: self-determination theory.
cN/A: not applicable.
Component 1: A Mobile-Enabled Website
A mobile-enabled website () developed for the project and accessible via a telephone, tablet, or personal computer serves as a central hub for the materials. Podcasts, animated videos, tracking summaries (for the parent and child), goal setting, and messages are delivered via the website utilizing an application program interface that integrates data from a commercial app (Fitbit) with data entered by participants.
Component 2: Dietary and Physical Activity Tracking
A wearable tracking device, chosen by the study team after consultation with caregivers and patients from previous work, is utilized for physical activity self-monitoring. Caregivers and adolescents are instructed to download the Fitbit app to their mobile devices, and adolescents are given a Fitbit Inspire HR activity tracker which synchronizes with the Fitbit app. Mobile phone apps have been shown to facilitate increased self-monitoring , which supports tracking of progress on behavioral goals (a component of Brenner FIT) by the youth and reporting to the caregiver and clinical team. Tracking app data are integrated into the mobile-enabled website.
Dietary behavioral tracking is supported by the mobile-enabled website. This strategy was chosen over the use of commercially available apps because no commercially available apps are congruent with the goals of the Brenner FIT program. The mobile-enabled website lets caregivers and youths track their goals in a manner that is appropriate for their role in the weight loss journey. For example, parents are asked to set goals related to providing a healthy food environment (eg, provide 5 family dinners this week), whereas youths are asked to set goals related to their behaviors (eg, eat 5 dinners with my family).
Component 3: Caregiver Podcasts
Caregiver podcasts tell a story of a caregiver of an adolescent Brenner FIT patient helping his/her child achieve a healthy weight. Through an engaging story, podcasts will help caregivers deal with the emotions that come with raising an adolescent in treatment for a medical condition (ie, obesity), provide strategies and encouragement to caregivers to help their adolescent build autonomy for healthy behaviors, engage in age-/ability-appropriate physical activity with their child, cook healthy family meals, and provide healthy snacks. Podcasts additionally focus on positive communication, interactions, and challenges often encountered in parenting. Podcasts have been used successfully in 4 previous studies by the team [- ] and target several constructs from the self-determination theory and social cognitive theory, including (1) outcome expectations, (2) self-efficacy, (3) incentive motivation, and (4) autonomy support. Podcasts will be 5 to 10 mins long each and downloadable via the mobile-enabled website. Caregivers can download and listen to 1 podcast each week in weeks 1 to 12.
Component 4: Animated Videos
Animated videos were created based on feedback from adolescents previously enrolled in the Brenner FIT program. In this study, youths are given access to these animated episodic videos in six 30-second episodes. Animated videos are available to the youth biweekly for the first 12 weeks. Animated videos introduce scenarios encountered by adolescents who are part of a program like Brenner FIT. Each episode follows the youths as they deal with the negative and positive emotions of their weight loss journey and the difficult social situations in which they find themselves engaged. The stories and scenarios contain elements of humor and drama while targeting several constructs from the self-determination theory and social cognitive theory, including (1) observational learning, (2) outcome expectations, (3) autonomy, and (4) relatedness. Similar to the podcasts, the videos are accessible from the mobile-enabled website. The scenarios were developed based on feedback provided by the clinical staff with input from a panel of families enrolled in the Brenner FIT program. Audio for the videos is available in English with subtitles available in English and Spanish.
Component 5: Interactive Messaging
Peer support is associated with weight loss . Therefore, opportunities are created for peer social support among caregivers and youths on the mobile-enabled website. As many adults do not have social media accounts, we also created a private, secure, moderated message board on the mobile-enabled website. Participants (caregivers and adolescents) are encouraged to (1) post questions to the clinical staff, (2) participate in group discussions and challenges (eg, post a picture of your healthiest meal today), (3) post about physical activities, and (4) share their success stories and challenges. Participants on social media are encouraged to follow each other as well as a curated list of health professionals on social media.
Component 6: Tailored Clinical Feedback
Tailored feedback is provided at regularly scheduled clinic visits by the clinical staff based on a web-based dashboard generated from self-monitoring data. The clinical staff have access to the web-based dashboard that provides a summary of the level of self-monitoring, level of physical activity, and progress on behavioral/weight loss goals for the adolescent and their caregiver. The staff use this information to engage with dyads via regularly scheduled face-to-face meetings and emails to give feedback based on behavioral progress, encouragement to engage in greater self-monitoring, and/or theoretically informed messages to promote self-efficacy, positive outcome expectations, and self-regulatory behaviors.
Primary Aim: Pilot the Intervention in Dyads Recruited From a Pediatric Weight Loss Clinic to Establish Acceptability and Feasibility of the Intervention Relative to Standard Care
Acceptability is measured using a brief survey from caregivers and youths to gain insight into their reception of the 6 mHealth components following the completion of the 6-month assessment (ie, completion of the study). Surveys include the system usability scale  to inquire about the usability of the mobile-enabled website, tracking apps, Fitbit tracking device, podcast format and content, animated video format and content, and web-based interactions with other participants and the clinical staff.
Feasibility is assessed consistent with the recommendations of Leon et al . Specifically, the team examines screening, recruitment, randomization, retention, adherence, fidelity, and the assessment process. The number of patients screened per month, the number enrolled per month, the proportion of those enrolled who are eligible, and the number who remain enrolled in the study by condition are all tracked. Retention rates (completion of at least 75% of monthly sessions through 6 months) are tracked for each intervention condition. The time needed for assessments is monitored, and feedback on participant burden is recorded. Examples of clinical staff data include increases in clinical staff time interacting with patients and families, costs of delivering clinical staff training (eg, orientation to the technology), time spent in technical support with families related to mHealth components, and hosting/maintenance of the mobile-enabled website. The team developed a brief survey for the clinical staff to gain insight into the benefits and challenges of using the mHealth components and suggestions for improvements. Previous publication documents from the study group have demonstrated good engagement, retention, feasibility, and acceptability of a mobile tracking intervention in youths and their families [ ].
Implementation fidelity is assessed to inform a future implementation-effectiveness study. Specifically, activity by the clinical staff and participants is compared against what has been directed (staff) or prescribed (participants). For example, the number of downloads of podcasts/videos, frequency of dietary and physical activity self-monitoring, goal setting, and open rates for web-based messaging from the clinical staff are recorded (). The logs of participant engagement with website components are utilized rather than using self-reporting to remove recall bias. In addition, the participant retention rate is considered as a measure of fidelity (the criterion for retention rate has been detailed in the Trial Sample Size section). These data give indicators of fidelity and dose and highlight areas for improvement in future studies.
Procedures and Measures
Youth Measures Only: Physical Activity and Diet
Accelerometer data are collected at a 7-day interval at baseline and again at 6 months using ActiGraph GT3X+ accelerometers. The accelerometers are set to collect data in the raw format and analyzed by converting the data to 1-second epochs to account for the intermittent and sporadic nature of children’s physical activity  and to improve the ability to capture the transitory physical activity patterns of children. During each 7-day data collection period, these monitors are affixed to a wrist strap on the participant’s nondominant hand. Research by our team and others suggest that compliance is greater when the accelerometer is worn on the wrist, and this placement also allows for comparison with the National Health and Nutrition Examination Survey normative data collected at the wrist beginning in 2011 [ - ]. The cut points are distilled in a manner consistent with emerging research that allows for comparability with waist-based estimates [ ]. Participants are instructed to wear the monitor continuously over the next 7 days except during bathing and sleeping. Once an accelerometer is received, data from the accelerometer are downloaded using the manufacturer’s software and a USB computer interface. The accelerometer data are reduced, cleaned, and processed using custom scripts in Stata (StataCorp). The accelerometers are initialized and set to record beginning at 5 AM the day following their distribution. This provides 7 days of data for analysis, from which 4 or more complete (>10 hours) days will be extracted. Participant’s accelerometer data are included in the analyses if 4 days with 10 hours of data are available.
Diet is assessed using the National Cancer Institutes’ automated self-administered 24-hour (ASA24) dietary assessment tool (version: ASA24-2016) on 3 nonconsecutive days (including 1 weekend day). The ASA24-2016 is available on both computers and mobile devices and takes approximately 25 min to complete. All youth participants complete one ASA24 at their baseline orientation and at 6-month follow-up office visits to encourage compliance while allowing youths and caregivers to ask questions and gain comfort with using the system. The project coordinator contacts participants within 6 days (on a randomly selected day) following the office visits to inform participants that they should complete the second/third dietary recall and offers to conduct the recall over the phone if the youths need assistance (the ASA24 has been shown to perform equally well as a self-administered or interviewer-administered questionnaire) [, ]. A series of follow-up reminder messages and/or phone calls are made by the coordinator to encourage completion of the second/third of the two recalls if not completed within 24-hours following the first contact after the clinic visit. Dietary data are collected at baseline and 6-month follow-up.
Caregiver and Youth Measures: Psychosocial Variables, Sociodemographic Variables, and Weight Status
Family and individual (youth and caregiver) constructs are assessed to identify potential mediators or moderators of observed effects of the intervention; these are incorporated into a larger trial in the future. Brenner FIT uses the family systems theory as a guiding model to address child and parent behaviors within the context of their family  and presently uses a number of scales to assess families participating in Brenner FIT. Specifically, Brenner FIT families complete the Family Assessment Device General Functioning subscale (capturing family function) [ ], Olson’s Family Communication Scale [ ], perceived stress [ , ], self-efficacy for physical activity, impulsivity, and health behaviors of the family [ ]. In addition, the team administers scales to capture social cognitive theory and self-determination theory constructs targeted by the intervention that are not captured as part of the intake process. These include outcome expectations, autonomy, autonomy support, and relatedness [ ]. All psychosocial data are collected at baseline (before randomization), at 3 months, and at 6 months. Details regarding the variables collected, their theoretical rationale, and measurement instrument are presented in .
The caregiver and youth participants’ age, sex, race, and ethnicity are collected via a parental self-report upon enrollment in Brenner FIT. The youth participants will also self-report their gender, race, and ethnicity during baseline data collection. The weight status of caregivers and youths are quantified through the calculation of BMI derived from the measurement of height and weight at the intake and follow-up visits. Both height (SD 0.1 cm) and weight (SD 0.5 kg) are recorded twice, and the values are averaged to produce the final value. BMI is calculated as kg/m2. Height and weight are measured without shoes in normal clothing. The BMI z-score and percent of the 95th percentile BMI are calculated using the Centers for Disease Control and Prevention growth charts.
|Construct||C/Ya||Theory||Instrument or method|
|Weight status||Y||N/Ab||Measured height and weight: used to calculate the BMI (weight in kg/height in m2) and calculate the BMI z-score and percent over the 95th percentile|
|Physical activity||Y||N/A||Accelerometry (7 days of monitoring): used to estimate minutes of moderate-to-vigorous physical activity per day|
|Dietary intake||Y||N/A||Automated self-administered 24-hour (ASA24-2016) dietary assessment tool: used to estimate dietary composition|
|Perceived autonomy support||Y||SDTc||Perceived parental autonomy support scale: produces a continuous score|
|Autonomy support||C||SDT||Motivators’ Orientations Questionnaire: produces a continuous score|
|Impulsivity||C||SDT||Abbreviated impulsiveness scale: produces a continuous score|
|Autonomy||C/Y||SDT||Subscale of the basic needs satisfaction in general scale: produces a continuous score|
|Competence||C/Y||SDT||Subscale of the basic needs satisfaction in general scale: produces a continuous score|
|Relatedness||C/Y||SDT||Subscale of the basic needs satisfaction in general scale: produces a continuous score|
|Self-efficacy for physical activity||Y||SCTd||Self-efficacy for physical activity: produces a continuous score|
|Self-efficacy for healthy eating||Y||SCT||Self-efficacy to make healthy food choices: produces a continuous score|
bN/A: not applicable.
cSDT: self-determination theory.
dSCT: social cognitive theory.
Secondary Outcome: Establish Costs Associated With Implementation of Mobile Health Components When Delivered With the Brenner Families in Training Program
Economic costs of delivery (ie, resource use) associated with implementing the two conditions are collected over the duration of the program. These costs allow for calculation of the full economic cost of delivering each condition, which includes direct, indirect, and opportunity costs. Examples of these may include utilization of supplies and materials (eg, the printing of materials for participants), training costs (eg, hourly wages for employees), costs associated with the actual delivery of the mHealth components, and opportunity costs (eg, volunteer time, donated materials). Net costs associated with delivering the mHealth strategies will be calculated by subtracting the costs for Brenner FIT from the costs of Brenner mFIT. Costs related to the evaluation of these strategies/conditions are excluded to capture the true economic cost of replicating the strategies across other clinics. Of the ways to express cost, one is cost per child enrolled. The more money caregivers pay for enrollment, the lower the likelihood of participation, especially when patients are from lower socioeconomic categories. Willingness and the ability to pay are assessed, as demonstrated in previous work examining the cost-effectiveness of interventions in youth . However, for the proposed study, there are no additional costs for participants beyond those associated with the standard Brenner FIT program (eg, co-pays).
Analysis Plan for Pilot Data
To inform future effectiveness of the trial, a quantitative data analysis strategy is developed as part of the proposed study to provide parameter estimates for future power calculations. For the pilot data to be collected in this study, the analysis relies on a mixed linear model to accommodate repeated assessments of BMI. This approach is anticipated to be at least as powerful as the two-sample t test. At each follow-up visit, the change in BMI z-score is calculated as the difference between the current and baseline z-scores. However, as some studies suggest using variations of relative BMI [, ] or BMI for longitudinal data [ ], and there continues to be a debate about the best measure to use to detect change particularly in children greater than the 97th percentile for BMI [ , ], the study group assesses the BMI, BMI z-score, and percent over 95th percentile BMI for youths with obesity [ ] and secondary outcomes. These are modeled as the dependent variable, with the baseline value, assessment time point (in weeks), treatment group, and treatment by visit interaction modeled as fixed effects and subject as a random effect, with an unstructured variance-covariance matrix. Contrasts are used to test the difference between treatment groups at each visit, and the contrast for the 6-month visit forms the primary effectiveness test. Age, race, ethnicity, and sex are included in the model. Restricted maximum likelihood estimation is used to incorporate missing data under a missing at random assumption. Model assumptions are evaluated using standard diagnostics. Transformations and nonparametric alternatives are considered as needed. Sensitivity analyses to examine the impact of missing data mechanisms on our results are performed using a combination of multiple imputations, pattern mixture, and inverse probability weighting analyses, as appropriate.
Although sex as a biological variable is not believed to play a substantial role in the weight-related behaviors of adolescents, gender as a social variable is salient to this study, as girls, for example, display different age-related patterns of physical activity than boys , lower overall physical activity [ ], and greater declines in physical activity during early adolescence (8-14 years) [ ]. Thus, the team considers gender in the intervention components and in all analyses via the inclusion of gender as a dichotomous predictor and potential moderating variable.
Trial Sample Size
Sample size was determined relying on guidance from Eldridge et al  and Whitehead et al [ ]. Specifically, we based our sample on a feasibility outcome (retention) and the ability to estimate parameters that will inform future trial power calculations. Given a sample size of 40 (per group), there is an anticipated range of possible precision for the retention probability estimates (CIs) as follows: a true retention rate of 60% yields a 95% CI of 55% to 75%; for a retention rate of 90%, the CI is 81% to 99%. The observed CIs provide a plausible range for the true retention rate in our population and trial conditions. If the CIs exclude values <80%, this would be an acceptable retention rate to plan a large-scale trial of Brenner mFIT; regardless, these estimates (CIs) are weighed heavily and, together with many other components of the trial experience, are used to determine overall acceptability and feasibility, and along with estimates of effect size, these estimates will assist with the design aspects of any future trial.
This study will be informed by emerging literature on the scalability of health promotion programs [, ]. Specifically, the several scalability considerations identified by Milat et al [ ] are evaluated, such as (1) reach and adoption, (2) organizational resources required (including costs), (3) intervention delivery (eg, acceptability, fidelity), (4) contextual factors (eg, interaction of the intervention with organizational contexts), and (5) evaluation approach. For example, we will characterize the features of the clinic and its operations (eg, equipment, staffing, costs, reimbursement) to identify areas of potential variability to inform future rollout. The data collected provide answers to crucial questions suggested by Klingner et al [ ]: (1) Under what conditions and with whom does Brenner mFIT work? (2) What is necessary to support clinical staff implementation of Brenner mFIT? (3) What is necessary to enhance the capacity of clinics to support staff in implementing Brenner mFIT under different conditions? (4) What is necessary to support broad, deep, sustained implementation of Brenner mFIT? This information is crucial in helping us to scale the intervention.
This study was approved by the Institutional Review Board in July 2019, funded in August 2019, and will commence enrollment in April 2020. The results of the study are expected to be published in the fall/winter of 2021.
This study seeks to establish an effective way to boost adolescent weight loss by implementing a suite of mHealth tools in conjunction with an established pediatric weight loss clinic, Brenner FIT. The design is based on a strong theoretical background from the social cognitive theory and self-determination theory, which have been shown to be influential in adolescent weight loss. All the mobile materials are developed to be inclusive of adolescents/caregivers from different backgrounds and accessible through multiple ways. The study is designed to test the acceptability and feasibility of the mHealth intervention and compare it with the standard treatment of Brenner FIT alone. The study design attempts to minimize potential pitfalls and limitations that have plagued prior research in this realm. The results have the potential to change the current approach and clinical methodology to address adolescent weight loss through mobile technology and apps in a potentially cost-effective fashion.
Study Limitations and Addressing Potential Concerns
Although all efforts have been made to minimize threats to validity and other potential pitfalls, a few limitations still exist related to the reduction of bias and contamination. One of the limitations is the inability to mask the conditions from the clinical staff or their assignment from the participants as it represents a potential threat to internal validity. However, the independence of the research staff from the clinical staff should protect against any expectancy effects biasing the data. Steps to prevent bias are outlined next. First, all assessments and analyses are conducted by the research staff or clinical administrative staff who are not involved in patient care and who are blinded to participant allocation. Second, data that are not normally collected during routine clinical practice will not be shared with the clinical staff who are in direct contact with patients. For example, although the clinical staff working with dyads randomized to the Brenner mFIT condition receive personalized reports based on mobile self-reporting of food consumption and physical activity, they do not receive data from the 24-hour dietary recalls, research accelerometers, or any questionnaires not normally administered as these tools are rarely available to the clinical staff in standard practice. Lastly, we will monitor the number and duration of sessions to ensure that the clinical staff are not scheduling more or longer sessions with intervention participants.
In addition, the baseline data collection concludes before group assignment is made, which will help to ensure that reactivity (if any) to being assigned to the intervention group has time to dissipate before the 3-month follow-up assessments. Meeting recruitment goals is often a concern with any clinical trial involving a finite population. However, the Brenner FIT program sees a large number of families per year that should meet the criteria, and referrals are increasing from within the Family Medicine and Pediatrics clinics of the WFBMC through targeted advertising. This increases the number of people eligible to join the proposed study.
Although participants will be recruited from and treated within the same clinic, group activities or classes are separated based on group assignment. The mobile-enabled website is password-protected, making it unlikely that the control group could access it. As we cannot blind the clinical staff to group assignment, we assess contamination via the participant report (posttest) to control for potential contamination.
The ImPACT study attempts to improve on adolescent weight loss by supplementing a weight loss clinic curriculum with an mHealth curriculum. The study not only develops the extra curriculum but subsequently compares the combined treatment (Brenner FIT + mHealth) with the standard of care (Brenner FIT) in a randomized controlled trial to assess feasibility and acceptability of the intervention. The results can help inform future research and improve clinically meaningful weight loss in adolescents.
The authors would like to thank their Patient Advisory Panel, which provided valuable input into the design of the components of the study.
The research reported in this publication was supported by the National Institute of Diabetes and Digestive and Kidney Diseases of the National Institutes of Health under award number R34DK119815. The project was also supported by the National Center for Advancing Translational Sciences, National Institutes of Health, through grant award number UL1TR001420. The content is solely the responsibility of the authors. It does not necessarily represent the official views of the National Institutes of Health, which had no role in study design, in the collection, analysis, and interpretation of data, in the writing of the report, or in the decision to submit this paper for publication.
Conflicts of Interest
National Institutes of Health Peer Review Comments.PDF File (Adobe PDF File), 139 KB
- Iannotti RJ, Wang J. Trends in physical activity, sedentary behavior, diet, and BMI among US adolescents, 2001-2009. Pediatrics 2013 Oct;132(4):606-614 [FREE Full text] [CrossRef] [Medline]
- Drewnowski A, Rehm C. Consumption of added sugars among US children and adults by food purchase location and food source. Am J Clin Nutr 2014 Sep;100(3):901-907 [FREE Full text] [CrossRef] [Medline]
- Mendez MA, Sotres-Alvarez D, Miles D, Slining MM, Popkin BM. Shifts in the recent distribution of energy intake among US children aged 2-18 years reflect potential abatement of earlier declining trends. J Nutr 2014 Aug;144(8):1291-1297 [FREE Full text] [CrossRef] [Medline]
- Skinner AC, Skelton JA. Prevalence and trends in obesity and severe obesity among children in the United States, 1999-2012. JAMA Pediatr 2014 Jun;168(6):561-566. [CrossRef] [Medline]
- Wickham C, Carbone E. Who's calling for weight loss? A systematic review of mobile phone weight loss programs for adolescents. Nutr Rev 2015 Jun;73(6):386-398. [CrossRef] [Medline]
- Loveman E, Al-Khudairy L, Johnson R, Robertson W, Colquitt JL, Mead EL, et al. Parent-only interventions for childhood overweight or obesity in children aged 5 to 11 years. Cochrane Database Syst Rev 2015 Dec 21(12):CD012008. [CrossRef] [Medline]
- Whitlock EP, O'Connor EA, Williams SB, Beil TL, Lutz KW. Effectiveness of weight management interventions in children: a targeted systematic review for the USPSTF. Pediatrics 2010 Feb;125(2):e396-e418. [CrossRef] [Medline]
- Quelly SB, Norris AE, DiPietro JL. Impact of mobile apps to combat obesity in children and adolescents: A systematic literature review. J Spec Pediatr Nurs 2016 Jan;21(1):5-17. [CrossRef] [Medline]
- Shaw R, Bosworth H. Short message service (SMS) text messaging as an intervention medium for weight loss: A literature review. Health Informatics J 2012 Dec;18(4):235-250 [FREE Full text] [CrossRef] [Medline]
- Golan M, Weizman A. Familial approach to the treatment of childhood obesity: conceptual mode. J Nutr Educ 2001;33(2):102-107. [CrossRef] [Medline]
- Wing RR, Tate DF, Gorin AA, Raynor HA, Fava JL. A self-regulation program for maintenance of weight loss. N Engl J Med 2006 Oct 12;355(15):1563-1571. [CrossRef] [Medline]
- Warziski MT, Sereika SM, Styn MA, Music E, Burke LE. Changes in self-efficacy and dietary adherence: the impact on weight loss in the PREFER study. J Behav Med 2008 Feb;31(1):81-92. [CrossRef] [Medline]
- Turk MW, Elci OU, Wang J, Sereika SM, Ewing LJ, Acharya SD, et al. Self-monitoring as a mediator of weight loss in the SMART randomized clinical trial. Int J Behav Med 2013 Dec;20(4):556-561 [FREE Full text] [CrossRef] [Medline]
- Fox CS, Hwang S, Nieto K, Valentino M, Mutalik K, Massaro JM, et al. Digital connectedness in the Framingham Heart Study. J Am Heart Assoc 2016 Apr 13;5(4):e003193 [FREE Full text] [CrossRef] [Medline]
- Rideout V. Common Sense Media. 2011 Oct 25. Zero to Eight: Children's Media Use in America URL: https://www.commonsensemedia.org/research/zero-to-eight-childrens-media-use-in-america-2011 [accessed 2020-03-19]
- Skelton JA, Irby MB, Beech BM, Rhodes SD. Attrition and family participation in obesity treatment programs: clinicians' perceptions. Acad Pediatr 2012;12(5):420-428 [FREE Full text] [CrossRef] [Medline]
- Skelton JA, Beech BM. Attrition in paediatric weight management: a review of the literature and new directions. Obes Rev 2011 May;12(5):e273-e281 [FREE Full text] [CrossRef] [Medline]
- Brown CL, Irby MB, Houle TT, Skelton JA. Family-based obesity treatment in children with disabilities. Acad Pediatr 2015;15(2):197-203 [FREE Full text] [CrossRef] [Medline]
- Skelton JA, Irby MB, Guzman MA, Beech BM. Children's perceptions of obesity and health: a focus group study with Hispanic boys. Infant Child Adolesc Nutr 2012 Oct 1;4(5):289-296 [FREE Full text] [CrossRef] [Medline]
- Giannini C, Irby MB, Skelton JA. Caregiver expectations of family-based pediatric obesity treatment. Am J Health Behav 2015 Jul;39(4):451-460. [CrossRef] [Medline]
- Guzman A, Irby MB, Pulgar C, Skelton JA. Adapting a tertiary-care pediatric weight management clinic to better reach Spanish-speaking families. J Immigr Minor Health 2012 Jun;14(3):512-515 [FREE Full text] [CrossRef] [Medline]
- Anderson M, Jiang J. Pew Research Center. 2018 May 31. Teens, Social Media & Technology 2018 URL: https://www.pewresearch.org/internet/2018/05/31/teens-social-media-technology-2018/ [accessed 2019-11-21]
- Spear BA, Barlow SE, Ervin C, Ludwig DS, Saelens BE, Schetzina KE, et al. Recommendations for treatment of child and adolescent overweight and obesity. Pediatrics 2007 Dec;120(Suppl 4):S254-S288. [CrossRef] [Medline]
- Irby M, Kaplan S, Garner-Edwards D, Kolbash S, Skelton JA. Motivational interviewing in a family-based pediatric obesity program: a case study. Fam Syst Health 2010 Sep;28(3):236-246 [FREE Full text] [CrossRef] [Medline]
- Turner-McGrievy GM, Beets MW, Moore JB, Kaczynski AT, Barr-Anderson DJ, Tate DF. Comparison of traditional versus mobile app self-monitoring of physical activity and dietary intake among overweight adults participating in an mHealth weight loss program. J Am Med Inform Assoc 2013 May 1;20(3):513-518 [FREE Full text] [CrossRef] [Medline]
- Hales S, Turner-McGrievy GM, Wilcox S, Fahim A, Davis RE, Huhns M, et al. Social networks for improving healthy weight loss behaviors for overweight and obese adults: A randomized clinical trial of the social pounds off digitally (Social POD) mobile app. Int J Med Inform 2016 Oct;94:81-90. [CrossRef] [Medline]
- Turner-McGrievy G, Tate D. Tweets, Apps, and Pods: Results of the 6-month Mobile Pounds Off Digitally (Mobile POD) randomized weight-loss intervention among adults. J Med Internet Res 2011 Dec 20;13(4):e120 [FREE Full text] [CrossRef] [Medline]
- Turner-McGrievy GM, Boutté A, Crimarco A, Wilcox S, Hutto BE, Hoover A, et al. Byte by Bite: Use of a mobile Bite Counter and weekly behavioral challenges to promote weight loss. Smart Health (Amst) 2017 Sep;3-4:20-26 [FREE Full text] [CrossRef] [Medline]
- Turner-McGrievy GM, Campbell MK, Tate DF, Truesdale KP, Bowling JM, Crosby L. Pounds Off Digitally study: a randomized podcasting weight-loss intervention. Am J Prev Med 2009 Oct;37(4):263-269 [FREE Full text] [CrossRef] [Medline]
- Wilcox S, Liu J, Addy CL, Turner-McGrievy G, Burgis JT, Wingard E, et al. A randomized controlled trial to prevent excessive gestational weight gain and promote postpartum weight loss in overweight and obese women: Health In Pregnancy and Postpartum (HIPP). Contemp Clin Trials 2018 Mar;66:51-63 [FREE Full text] [CrossRef] [Medline]
- Turner-McGrievy GM, Tate DF. Weight loss social support in 140 characters or less: use of an online social network in a remotely delivered weight loss intervention. Transl Behav Med 2013 Sep;3(3):287-294 [FREE Full text] [CrossRef] [Medline]
- Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact 2008;24(6):574-594. [CrossRef]
- Leon AC, Davis LL, Kraemer HC. The role and interpretation of pilot studies in clinical research. J Psychiatr Res 2011 May;45(5):626-629 [FREE Full text] [CrossRef] [Medline]
- Jake-Schoffman DE, Turner-McGrievy G, Wilcox S, Moore JB, Hussey JR, Kaczynski AT. The mFIT (motivating families with interactive technology) study: a randomized pilot to promote physical activity and healthy eating through mobile technology. J Technol Behav Sci 2018;3(3):179-189. [CrossRef]
- Bailey RC, Olson J, Pepper SL, Porszasz J, Barstow TJ, Cooper DM. The level and tempo of children's physical activities: an observational study. Med Sci Sports Exerc 1995 Jul;27(7):1033-1041. [CrossRef] [Medline]
- Crouter SE, Flynn JI, Bassett DR. Estimating physical activity in youth using a wrist accelerometer. Med Sci Sports Exerc 2015 May;47(5):944-951 [FREE Full text] [CrossRef] [Medline]
- Chandler JL, Brazendale K, Beets MW, Mealing BA. Classification of physical activity intensities using a wrist-worn accelerometer in 8-12-year-old children. Pediatr Obes 2016 Apr;11(2):120-127. [CrossRef] [Medline]
- Troiano RP, McClain JJ, Brychta RJ, Chen KY. Evolution of accelerometer methods for physical activity research. Br J Sports Med 2014 Jul;48(13):1019-1023 [FREE Full text] [CrossRef] [Medline]
- Brazendale K, Beets MW, Bornstein DB, Moore JB, Pate RR, Weaver RG, International Children's Accelerometry Database (ICAD) Collaborators. Equating accelerometer estimates among youth: The Rosetta Stone 2. J Sci Med Sport 2016 Mar;19(3):242-249 [FREE Full text] [CrossRef] [Medline]
- Thompson FE, Dixit-Joshi S, Potischman N, Dodd KW, Kirkpatrick SI, Kushi LH, et al. Comparison of interviewer-administered and automated self-administered 24-hour dietary recalls in 3 diverse integrated health systems. Am J Epidemiol 2015 Jun 15;181(12):970-978 [FREE Full text] [CrossRef] [Medline]
- Kirkpatrick S, Subar A, Douglass D, Zimmerman TP, Thompson FE, Kahle LL, et al. Performance of the Automated Self-Administered 24-hour Recall relative to a measure of true intakes and to an interviewer-administered 24-h recall. Am J Clin Nutr 2014 Jul;100(1):233-240 [FREE Full text] [CrossRef] [Medline]
- Kaplan SG, Arnold EM, Irby MB, Boles KA, Skelton JA. Family systems theory and obesity treatment: applications for clinicians. Infant Child Adolesc Nutr 2014 Feb 1;6(1):24-29 [FREE Full text] [CrossRef] [Medline]
- Haines J, Rifas-Shiman SL, Horton NJ, Kleinman K, Bauer KW, Davison KK, et al. Family functioning and quality of parent-adolescent relationship: cross-sectional associations with adolescent weight-related behaviors and weight status. Int J Behav Nutr Phys Act 2016 Jun 14;13:68 [FREE Full text] [CrossRef] [Medline]
- Olson DH, Defrain JD. Marriage And The Family: Diversity And Strengths. California City, California: Mayfield Pub Co; 2000.
- Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav 1983 Dec;24(4):385-396. [Medline]
- Compas BE, Davis GE, Forsythe CJ, Wagner BM. Assessment of major and daily stressful events during adolescence: the Adolescent Perceived Events Scale. J Consult Clin Psychol 1987 Aug;55(4):534-541. [CrossRef] [Medline]
- Golan M. Fifteen years of the Family Eating and Activity Habits Questionnaire (FEAHQ): an update and review. Pediatr Obes 2014 Apr;9(2):92-101. [CrossRef] [Medline]
- Johnston MM, Finney SJ. Measuring basic needs satisfaction: Evaluating previous research and conducting new psychometric evaluations of the Basic Needs Satisfaction in General Scale. Contemp Educ Psychol 2010 Oct;35(4):280-296. [CrossRef]
- Beets MW, Brazendale K, Weaver RG, Turner-McGrievy GM, Huberty J, Moore JB, et al. Economic evaluation of a group randomized controlled trial on healthy eating and physical activity in afterschool programs. Prev Med 2018 Jan;106:60-65. [CrossRef] [Medline]
- Cole TJ, Faith MS, Pietrobelli A, Heo M. What is the best measure of adiposity change in growing children: BMI, BMI %, BMI z-score or BMI centile? Eur J Clin Nutr 2005 Mar;59(3):419-425. [CrossRef] [Medline]
- Paluch RA, Epstein LH, Roemmich JN. Comparison of methods to evaluate changes in relative body mass index in pediatric weight control. Am J Hum Biol 2007;19(4):487-494. [CrossRef] [Medline]
- Berkey CS, Colditz GA. Adiposity in adolescents: change in actual BMI works better than change in BMI z score for longitudinal studies. Ann Epidemiol 2007 Jan;17(1):44-50. [CrossRef] [Medline]
- Dietz WH. Time to adopt new measures of severe obesity in children and adolescents. Pediatrics 2017 Sep;140(3):pii: e20172148 [FREE Full text] [CrossRef] [Medline]
- Vanderwall C, Eickhoff J, Randall Clark R, Carrel AL. BMI z-score in obese children is a poor predictor of adiposity changes over time. BMC Pediatr 2018 Jun 8;18(1):187 [FREE Full text] [CrossRef] [Medline]
- Gulati AK, Kaplan DW, Daniels SR. Clinical tracking of severely obese children: a new growth chart. Pediatrics 2012 Dec;130(6):1136-1140 [FREE Full text] [CrossRef] [Medline]
- Moore JB, Beets MW, Morris SF, Kolbe MB. Comparison of objectively measured physical activity levels of rural, suburban, and urban youth. Am J Prev Med 2014 Mar;46(3):289-292. [CrossRef] [Medline]
- Troiano RP, Berrigan D, Dodd KW, Mâsse LC, Tilert T, McDowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc 2008 Jan;40(1):181-188. [CrossRef] [Medline]
- Garcia AW, Pender NJ, Antonakos CL, Ronis DL. Changes in physical activity beliefs and behaviors of boys and girls across the transition to junior high school. J Adolesc Health 1998 May;22(5):394-402. [CrossRef] [Medline]
- Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, PAFS consensus group. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. Pilot Feasibility Stud 2016;2:64 [FREE Full text] [CrossRef] [Medline]
- Whitehead AL, Julious SA, Cooper CL, Campbell MJ. Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Stat Methods Med Res 2016 Jun;25(3):1057-1073 [FREE Full text] [CrossRef] [Medline]
- Milat AJ, King L, Bauman AE, Redman S. The concept of scalability: increasing the scale and potential adoption of health promotion interventions into policy and practice. Health Promot Int 2013 Sep;28(3):285-298. [CrossRef] [Medline]
- Milat AJ, Bauman A, Redman S. Narrative review of models and success factors for scaling up public health interventions. Implement Sci 2015 Aug 12;10:113 [FREE Full text] [CrossRef] [Medline]
- Klingner JK, Boardman AG, McMaster KL. What does it take to scale up and sustain evidence-based practices? Except Child 2013 Jan;79(3):195-211. [CrossRef]
|ASA24: automated self-administered 24-hour|
|Brenner FIT: Brenner families in training|
|Brenner mFIT: Brenner FIT + mHealth|
|mHealth: mobile health|
|WFBMC: Wake Forest Baptist Medical Center|
Edited by G Eysenbach; submitted 03.02.20; peer-reviewed by S Lazorick, K Ng; comments to author 17.02.20; revised version received 27.02.20; accepted 29.02.20; published 05.06.20Copyright
©Justin B Moore, Joshua R Dilley, Camelia R Singletary, Joseph A Skelton, David P Miller Jr, Vahé Heboyan, Gianluca De Leo, Gabrielle Turner-McGrievy, Matthew McGrievy, Edward H Ip. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 05.06.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.