Published on in Vol 10, No 1 (2021): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/19506, first published .
Optimizing an Obesity Treatment Using the Multiphase Optimization Strategy Framework: Protocol for a Randomized Factorial Trial

Optimizing an Obesity Treatment Using the Multiphase Optimization Strategy Framework: Protocol for a Randomized Factorial Trial

Optimizing an Obesity Treatment Using the Multiphase Optimization Strategy Framework: Protocol for a Randomized Factorial Trial

Protocol

1Duke Global Digital Health Science Center, Duke University, Durham, NC, United States

2Department of Psychology and Neuroscience, Duke University, Durham, NC, United States

3Duke University School of Nursing, Duke University, Durham, NC, United States

4Duke Global Health Institute, Duke University, Durham, NC, United States

5Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, United States

6Cancer Control and Population Sciences, Duke Cancer Institute, Durham, NC, United States

7Department of Populations Health Sciences, Duke University, Durham, NC, United States

Corresponding Author:

Jamiyla Bolton, MS

Duke Global Health Institute

Duke University

310 Trent Drive, Room 236

Durham, NC, 27708

United States

Phone: 1 9193954119

Email: jamiyla.bolton@duke.edu


Background: Effective weight loss interventions exist, yet few can be scaled up for wide dissemination. Further, none has been fully delivered via text message. We used the multiphase optimization strategy (MOST) to develop multicomponent interventions that consist only of active components, those that have been experimentally determined to impact the chosen outcome.

Objective: The goal of this study is to optimize a standalone text messaging obesity intervention, Charge, using the MOST framework to experimentally determine which text messaging components produce a meaningful contribution to weight change at 6 months.

Methods: We designed a 6-month, weight loss texting intervention based on our interactive obesity treatment approach (iOTA). Participants are randomized to one of 32 experimental conditions to test which standalone text messaging intervention components produce a meaningful contribution to weight change at 6 months.

Results: The project was funded in February 2017; enrollment began in January 2018 and data collection was completed in June 2019. Data analysis is in progress and first results are expected to be submitted for publication in 2021.

Conclusions: Full factorial trials are particularly efficient in terms of cost and logistics when leveraged for standalone digital treatments. Accordingly, MOST has the potential to promote the rapid advancement of digital health treatments. Subject to positive findings, the intervention will be low cost, immediately scalable, and ready for dissemination. This will be of great potential use to the millions of Americans with obesity and the providers who treat them.

Trial Registration: ClinicalTrials.gov NCT03254940; https://clinicaltrials.gov/ct2/show/NCT03254940

International Registered Report Identifier (IRRID): RR1-10.2196/19506

JMIR Res Protoc 2021;10(1):e19506

doi:10.2196/19506

Keywords



The obesity epidemic continues, currently affecting more than one-third of all Americans [1,2], with dire consequences, including chronic disease, premature mortality, and significant costs to the US health care system. Efforts to reduce obesity include successful behavioral weight loss treatments with frequent interactions with a trained counselor and regular self-monitoring of diet and/or exercise [3-5]. These treatments produce 7% to 10% weight loss after 6 to 12 months [6,7]. However, the intensity of these treatments limits their widespread dissemination. A rapidly emerging evidence base supports the use of digital interventions for obesity treatment. Through a wide variety of intervention designs, digital interventions can produce clinically meaningful weight loss and reach a large range of populations [8].

Texting, one of the most long-standing mobile health (mHealth) approaches, is the most frequently performed activity on mobile phones and has nearly 90% population penetration, particularly among racial and ethnic minorities [9-11]. Despite these advantages, few studies have investigated the effectiveness of standalone texting interventions for weight loss and what components of text messaging enhance engagement. Rather, texting is often used as one of several intervention delivery channels in obesity treatments [12], combined with web and/or email delivery [13,14], paper materials and monthly coaching calls [15,16], mobile apps [17], social media support groups [18], and interactions with a dietitian or physician provider [19]. We know little about how to design texting interventions in a manner that maximizes both engagement and dissemination potential [20].

Moreover, texting has been used in a myriad of ways, making it challenging to extract best practices. For example, some interventions text participants bidirectionally [21] to facilitate self-monitoring, while others text unilaterally to deliver tips and/or feedback. Interventions use a variety of frequencies, sending texts weekly, daily, or even multiple times a day [13]. Similarly, when tailored feedback is provided via text, it has been variably designed as a summary score of participant progress, links to graphical figures, or as text describing weight loss progress. These design choices are not trivial and may differentially affect intervention engagement, the most important predictor of weight loss outcomes [20].

Standalone digital interventions (eg, without human counseling) have the potential for substantial population-level impact, given their broad reach and low marginal costs of operation [22]. However, relatively few trials have tested digital interventions that are deployed in a fully standalone manner; most evidence-based digital treatments include support from a human interventionist [8]. There is limited evidence detailing the efficacy of standalone digital treatments, but they most often suffer from low user engagement and high rates of nonuse attrition [23]. Thus, a key challenge for standalone digital interventions is designing technologies that people will use long enough to experience positive benefits. Standalone interventions do not benefit from the type of accountability that a human interventionist can produce [24,25].

We sought to design a standalone, 6-month texting intervention that would retain maximal dissemination potential. Given the limited consensus in the empirical literature regarding how to best design a texting intervention, we leveraged the multiphase optimization strategy (MOST) [26] to aid in developing an optimized digital treatment package. Behavioral interventions are usually packages of intervention components. However, traditional trial designs (eg, two-arm randomized controlled trials) cannot determine which intervention components contribute most to weight loss, which might have limited effects or even detrimental effects. This limits our ability to create lean, cost-efficient interventions that can optimally affect clinical outcomes.

MOST offers a framework to help build efficient multicomponent treatment packages that contain only meaningful intervention components. Its first phase involves using theory to identify tenable intervention components. While behavioral science theory can help us develop interventions that produce weight loss, it is less useful in informing the design of technologies that individuals will want to use daily for the months needed to produce weight loss. Thus, we leveraged the Technology Acceptance Model (TAM), a dominant information services theory [27,28], which argues that people will be more likely to use technologies that help them achieve their goals (ie, perceived usefulness) and are easy to use. One tenet of the TAM is that if these two conditions are met, people will have positive attitudes toward use, which can increase technology use intentions. TAM argues that when technologies are easy to use, people will have higher self-efficacy for their use. Though this model is widely studied, few studies have used it to inform mHealth intervention design. The second phase of the MOST framework—the basis of this study—involves implementing an experimental trial to identify active intervention components that might be included in an optimized treatment package. The third phase of the MOST framework involves testing the optimized treatment package in a fully powered randomized clinical trial.

The aim of this paper is to present the design of our MOST optimization trial, Charge. The goal of the trial is to identify intervention components and levels that might be included in a 6-month, standalone texting treatment aimed at physical activity and diet changes that result in clinically meaningful weight loss (ie, >5% from baseline) at 6 months and weight loss maintenance at 12 months. We will also explore associations of engagement and nonuse attrition with weight change. The following section describes the study design and intervention.


Overview

From our comprehensive review of intervention trials utilizing text messaging for weight loss, we abstracted intervention design details. There was great similarity in the core interventions utilized; most used social cognitive theoretical approaches with an emphasis on self-efficacy as a primary mediator [12,14,15,17-19]. From an intervention design perspective, most interventions involved sending texts bidirectionally, using texting for self-monitoring, and providing tailored feedback. Thus, we did not test these components experimentally, but built them into our core intervention. However, there was marked variability in most other design components: frequency of texting, whether self-monitoring data were collected, referent tracking day, timing of monitoring, feedback scheduling, and use of skills training. From this group of components and guided by the TAM, we identified components that would heighten the perceived usefulness and perceived ease of use of our texting intervention. MOST also recommends that we design our intervention for real-world implementation. For example, the ongoing MOST trial by Bonnie Spring and Linda Collins is designed to find the most effective weight loss intervention that can be delivered for US $500 per person [29]. They acknowledge that they might not be able to achieve maximal weight loss at this cost, but they view US $500 as an optimal target for dissemination.

In selecting experimental conditions, we did not include components that might maximize weight loss (eg, individual or group counseling) or components that cannot be delivered via texting (eg, web-based materials, email feedback, automated phone calls, and apps). We recognize that these design choices might limit the magnitude of our treatment outcomes, relative to gold-standard treatments. However, we think these concessions will help us achieve the goal of creating a standalone texting intervention that can be optimally disseminated. Based on preliminary data collected as part of Phase 1 of this trial, we identified five intervention components (see Table 1) that can enhance perceived usefulness or ease of use.

Table 1. Reference and comparator levels for intervention components.
Intervention componentReference levelComparator level
Motivational message sourceExpert-generatedSelf-generated
Texting frequencyWeeklyDaily
Reminder timingOneMultiple
Feedback levelIndividual goalSummary score
Performance comparisonSelfOthers (group)

Motivational Messaging Source: Self-Generated Versus Expert-Generated

Interventions frequently use text messages to enhance and sustain participant motivation. For these messages to enhance participant efficacy, they must be perceived as salient to the individual, be relevant to one’s personal circumstances, and incorporate familiar social norms, otherwise there is a risk of undermining efficacy [30]. Presently, most motivational messages are developed by content experts, who are guided by theory, evidence, and experience [14-19,31-34]. One possible way to increase the potency of motivational messaging is to change the source of the messages. Self-generated text messages may result in greater attitudinal and behavioral change because they (1) exemplify optimal tailoring (ie, one knows oneself best), (2) are seen as highly self-relevant, (3) are viewed as credible, (4) are more often remembered (ie, self-referring effect), and (5) generate less resistance to persuasive attempts than messages originated by others. This is consistent with Self-Determination Theory’s emphasis on increasing autonomous self-regulation and perceived competence [35]. Participants randomized to the self-generated condition will create text messages in two areas at baseline: reasons and competence for weight loss. The former will target autonomous self-regulation (ie, change stems from within), while the latter will target efficacy for weight-related behavior change. We will send texts from these pools randomly. We hypothesize that receipt of self-generated motivational messages, compared to expert-generated messages, will enhance intervention engagement, resulting in larger weight loss outcomes.

Texting Frequency: Daily Versus Weekly

There is substantial variability in the number of days that texting interventions request self-monitoring data. Some studies have participants self-monitor daily [13-16,33], 3 to 5 times per week [18,19], and weekly [32,33]. Regular self-monitoring is believed to activate self-regulatory processes that result in energy restriction and increased physical activity. For optimal self-regulation, self-monitoring should be routine and feedback should be provided. Although daily self-monitoring might appear to be optimal, if the texts are perceived as burdensome, there is potential for nonuse attrition. Indeed, in one of our previous texting interventions, we found that engagement with our daily self-monitoring texts was high through 6 weeks but subsequently decreased [13]. By trial end, 49% of the participants texted daily. A somewhat less regular, but still routine, frequency (eg, weekly) might minimize perceived burden. Ours will be the first study to look at this question experimentally. We hypothesize that daily self-monitoring will be superior to once-weekly self-monitoring for maximizing intervention engagement and weight loss.

One Reminder Versus Multiple Reminders

As noted, sustained intervention engagement is a key goal for standalone digital interventions. Thus, reminders might serve as a powerful aid to promote regular self-monitoring, the primary participant engagement in this study’s intervention. However, as with texting frequency, there may be concern that sending multiple self-monitoring reminders might promote user burden and intervention fatigue, thus negatively impacting engagement behaviors. The impact of reminder notifications on user behavior is largely unclear. There is limited empirical evidence that multiple reminders produce user burden; in fact, frequent notifications are often used in commercial digital interventions to enhance engagement. We randomized participants to receive either a single reminder or multiple reminders if they fail to self-monitor on their assigned day. We hypothesize that receiving multiple reminders will result in superior intervention engagement and weight loss outcomes.

Feedback From Summary Scores Versus Individual Goals

Weight loss interventions in general, and our intervention specifically, implicitly seek to promote change in multiple behaviors simultaneously. Accordingly, self-monitoring interfaces, like ours, are designed to allow participants to track multiple behaviors in a given self-monitoring session. A challenge emerges when deciding how to provide feedback in response to self-monitoring. Feedback might describe performance singly for each tracked goal. Doing so best allows feedback to be tailored to a specific goal, which might be important given the potential for variability in user adherence to their assigned goals. In contrast, one might leverage recommendations from the risk communication literature, which describes the potentially superior performance of a single summary score that collapses across the variability in an individual’s assigned goals. Such a summary score might minimize the literacy and numeracy challenges in interpreting feedback, perhaps at the expense of offering the detailed feedback that might be necessary to promote change in discrete behaviors. We randomized participants to either the summary score group or the individual goal feedback group. We hypothesize that the summary score approach will facilitate easier processing and comprehension, thus improving engagement and weight loss outcomes.

Self-Performance Versus Group Performance Comparison

Tailored feedback often benchmarks a participant’s performance against one’s own prior performance. An alternative is to use principles of gamification, comparing a user’s behavior change progress against that of other participants [36]. Such a leaderboard strategy can amplify competition and promote positive engagement and behavior change outcomes [37]. However, a potential risk of the leaderboard approach is that it seems to perform best when there are small relative differences between users; when users significantly underperform compared to their peers, the leaderboard approach might be demotivational [38]. We randomized participants to receive either comparison to themselves or comparison to their peers. We hypothesize that those who receive feedback benchmarked relative to their peers will have significantly better weight loss outcomes than those whose behaviors are compared to their own performance.

Intervention Design

All participants will receive a core, 6-month, weight loss texting intervention built on a theory-based approach. Participants will be assigned an individualized set of routine lifestyle behavior change goals and directed to make small behavioral changes to create an energy deficit sufficient to produce weight change. We developed this approach and named it the interactive obesity treatment approach (iOTA). We designed iOTA specifically for delivery via digital health methods, such as texting, where sustained intervention engagement is critical. Individuals expect their digital health experience to be straightforward and highly personalized with minimal effort. Accordingly, iOTA does not require expert knowledge or expensive resources [13,39]. From the participants’ perspective, they simply take a short survey and are immediately assigned a set of personally tailored behavior change goals. Participants use text messaging to self-monitor their adherence to these goals. They receive tailored feedback based on their progress, skills-training videos, and motivational texts.

All core iOTA intervention components are designed to target self-efficacy, which we selected from Social Cognitive Theory [40,41], given its consistent association with weight loss outcomes [42-44]. Bandura identified four primary factors [45] that influence self-efficacy: mastery experiences, social modeling, social persuasion, and somatic and emotional reactions. Our text messages will cover all of these domains. Social Cognitive Theory also indicates that behavior change can be facilitated through a number of self-regulatory processes, including self-monitoring [46-48], goal setting [24,44], and social support [49,50].

Obesogenic Behavior Change Goals

Each participant will track four behavior change goals that produce an energy deficit sufficient to produce weight loss. We have a library containing obesogenic behavior change goals that have been selected based on their (1) empirical support, (2) population relevance, and (3) ease of self-monitoring. We adapted the goal library that was deemed efficacious in our previous studies [22,31]. All participants take a short survey—the iOTA survey—and are immediately assigned a set of personally tailored behavior change goals. Our prescription algorithm assigns three tailored behavior change goals and one universal goal for each 8-week goal cycle (see Textbox 1). The prescription algorithm prioritizes behaviors based on highest need of change, those for which the participant has high self-efficacy and readiness, and those that achieve the intended caloric deficit.

Behavior change goals.

Universal goal assignment:

  • Cycle 1: no red zone foods
  • Cycle 2: portion control
  • Cycle 3: walk 10,000 steps per day

Goal list (in cycle date order):

  • Goal 1: no sugary drinks
  • Goal 2: no sweet snacks
  • Goal 3: no fast food
  • Goal 4: no fried food
  • Goal 5: 5+ fruits and vegetables
  • Goal 6: no salty snacks
  • Goal 7: fast between 7 PM and 7 AM
  • Goal 8: eat grains and starches <1× per day
  • Goal 9: no red meat
  • Goal 10: restaurants ≤1× per week
  • Goal 11: ≤2 hours of TV per day
  • Goal 12: ≤1 alcoholic drink per day
  • Goal 13: get brisk activity
  • Goal 14: do strength training 2× per week
  • Goal 15: no high-fat seasoning
Textbox 1. Behavior change goals.

Self-Monitoring and Tailored Feedback

Regular self-monitoring is a robust predictor of weight loss, although adherence typically wanes over time [46,48,51]. Disengagement likely results from usability limitations, cognitive complexity, and lack of immediate feedback. As a result, our trials have involved extensive testing to ensure that our texting self-monitoring tools are engaging. Our text messaging system is fully automated, currently operational, uses open source technologies, and is designed for scalability.

Depending on their randomization status, we will contact participants either daily or weekly. An outbound text will request self-monitoring data (ie, a prompt) based on a participant’s behavior change goals. For example, the system may ask if an individual walked 10,000 steps yesterday. Participants will then respond by text to the prompt with their self-monitoring data. We immediately provide tailored, real-time feedback on participants’ progress via text. The feedback an individual receives depends on their randomization: whether they are being compared to themselves or the group and whether they receive feedback from summary scores or from each individual goal. We will also provide skills-training tips, tailored to each participant’s assigned goals.

Tailored Skills-Training Videos

We have skills-training videos, 2 to 5 minutes in length, for each of the goals in our library. For example, for those assigned a fast food–reduction goal, we will provide skills-training materials on eating out, social eating, and lunch packing. We will also have a larger library of general behavior change skills (eg, stimulus control, problem solving, social cues, and stress management). Our materials include tailored narratives and information about cost and community resources. We sent links to videos at the beginning of each goal period that correspond to participants’ goals that are assigned as discussed in the Obesogenic Behavior Change Goals section above.

Participants

Participants are adult men and women, aged 18 to 65 years, who have English-language proficiency and a BMI above 25 kg/m2. We aim to recruit a sample of 448 participants that is 30% male and 40% racial or ethnic minority, similar to the demographics of Durham, North Carolina, United States. Participants are required to own a smartphone and be willing to receive multiple text messages daily. Exclusion criteria include the following: prior or planned bariatric surgery; psychiatric hospitalization in the past 12 months; pregnant, nursing, or planned pregnancy; history of a cardiovascular event; history of an eating disorder; history of a health condition (eg, end-stage renal disease, cancer, or schizophrenia) or use of medications (eg, lithium, steroids, or antipsychotics) that would affect weight measurement, for which weight loss is contraindicated, or might promote weight change; current participation in a weight loss trial and/or recent weight loss of more than 10%; and investigator discretion, for safety reasons.

Recruitment and Screening

Participants were recruited using the following multipronged strategy: (1) direct marketing, (2) local media, (3) social media, (4) snowball recruitment, and (5) community organizations. We have used these methods successfully in many of our team’s previous studies. The geographically targeted postings were placed on Nextdoor, Facebook, and Reddit.

Those who responded to initial study marketing were directed to a preliminary eligibility screening assessment via a Qualtrics online survey. If deemed eligible via the screening assessment, participants were then invited to complete the study’s online informed consent process and baseline surveys. Those who completed all surveys were then invited for an in-person visit to confirm participant eligibility. At the baseline visit, study staff collected written informed consent and confirmed participant eligibility by taking anthropometric measurements. After randomization, each participant received an individual orientation to the intervention.

Procedures

All study procedures were registered at ClinicalTrials.gov (NCT03254940). After confirming eligibility, participants were randomized to one of 32 experimental conditions (see Multimedia Appendix 1) to test the intervention components, including frequency (weekly vs daily), motivational messaging (self- vs expert-generated), reminders (one vs multiple), feedback type (summary score vs individual score), and comparison unit (self vs group). We randomized participants using a permuted block method with stratification for gender. A computer algorithm sorted each participant into three self-reported gender categories—male, female, or any other self-description—and then assigned them accordingly into blocks of the 32 groups, randomly ordered by the computer. The computer algorithm, developed by a software engineer as directed by a biostatistician, minimized selection bias by generating the blocks ad hoc, thereby preventing prediction of the assignment order. Due to the logistics of enrollment and quality control of the intervention, it was impossible to completely blind the data collection staff to treatment assignment. However, all possible steps were taken to reduce unnecessary awareness of treatment assignment and to limit opportunities for the introduction of bias into the data by our data collection staff. We will analyze outcomes while blinded to allocation status.

Data Collection

Survey Data

Data were collected at four study visits: baseline and 3, 6, and 12 months postbaseline. A protocol window for follow-up assessments was defined as 2 weeks before to 4 weeks after the 3-, 6-, and 12-month dates, relative to the baseline visit. Every reasonable effort was made to complete an in-person follow-up visit within the protocol window, including multiple rescheduling attempts and reminders. During the last week of the protocol window, we approached participants who refused or were unable to attend an in-person follow-up visit using a secondary data collection protocol. We emailed participants a link allowing them to access the online survey assessments on their own and asked them to provide a weight photograph or self-reported weight.

Surveys were administered in English via computer using an online survey tool where questions required responses to ensure completeness. Demographic variables collected at baseline included age, gender, race or ethnicity, marital status, parity, height and weight, socioeconomic status, insurance status, occupational status, and educational attainment.

Primary Outcome

The primary outcome is weight in kilograms. During in-person visits, participants removed shoes and items from pockets prior to height and weight measurements. Height was measured to the nearest 0.1 cm using a calibrated wall-mounted stadiometer [52]. Body weight was measured to the nearest 0.1 kg using a portable electronic scale [52]. BMI was calculated using participant height collected at baseline and weights collected at sequential in-person visits or self-reported weights if the participant was unable to come in person.

Secondary Outcomes
Physical Activity Outcomes

Physical activity was measured using the Global Physical Activity Questionnaire version 2 (GPAQ 2) at baseline and at 6 months postrandomization [53]. The GPAQ 2 was developed by the World Health Organization to measure physical activity participation as well as sedentary behavior. Participants were asked to report the frequency and duration of moderate to vigorous physical activity participation at work, travel to and from places and recreational activities, as well as the time spent being sedentary, in a typical week.

12-Item Short Form Health Survey Outcomes

Adapted from the 36-item Short Form Health Survey (SF-36) [54], the 12-item Short Form Health Survey (SF-12) [55] has been operationalized for large-scale health measurement and monitoring efforts for all age groups. Participants were asked to complete the survey at baseline and at 6 and 12 months postrandomization to understand mental (ie, mental health, role emotional, and social functioning scales) and physical (ie, physical functioning, role physical, or bodily pain scales) performance and overall health-related quality of life. The age-specific mean difference score will be calculated from a participant’s physical and mental health composite score to compare participants to their age group’s mean score.

Engagement Outcomes

Intervention engagement is defined as successful self-monitoring during an expected window of time after a self-monitoring prompt was sent to the participant via text message. The window of time and frequency of the prompts delivered is determined by participant allocation to the five components of the intervention across the 6-month intervention period. Self-monitoring is considered complete if the participant texted back a properly formatted response with self-monitoring data for their four behavior change goals. For each participant, we will calculate a rate of completed responses out of the number expected.

Statistics

Overview

Using the FactorialPowerPlan macro from SAS 9.4 (SAS Institute) [56], developed by the Penn State Methodology Center, University Park, Pennsylvania, we computed the sample size needed for a full 25 factorial design. We determined that a total sample size of 282 participants would be required to achieve an overall power of 80% to detect a 0.75-kg difference in weight loss. We conservatively assumed 30% dropout at 6 months, so we inflated the sample size to 403. To obtain an equal number of participants in each treatment combination (ie, condition), we further inflated this sample size to 448, which would give a final sample of 14 participants in each of the 32 conditions. To achieve greater gender and racial diversity consistent with our recruitment goals, enrollment may be amended to perform additional targeted recruitment.

Statistical Analysis

For each of the five components, participants’ weights and demographics will be summarized by levels of the component. Continuous variables will be summarized using means, standard deviations, medians, quartiles, and ranges, and categorical variables will be summarized using counts and percentages.

In the primary analysis, those whose data were collected outside of the study window or who sent in weight measured at home, rather than having weight measured in person, will be treated as missing for that time point. Sensitivity analyses will be performed including such data.

The primary outcome is absolute change in weight from baseline to 6 months. We will estimate the main effects of each intervention component on the primary outcome and of all pairwise, three-way, four-way, and five-way interactions of those components at each follow-up time point using a linear mixed-effects model. In order to estimate effects on weight change, we will model all four weights for each individual (ie, baseline and 3-, 6-, and 12-month follow-ups) in the same model. The model will include fixed effects for time point (ie, 3 months, 6 months, and 12 months); the time × component, time × pairwise, time × three-way, time × four-way, and time × five-way interactions; up to five-way interactions; and gender, the variable by which the randomization was stratified. We will not include the effects of the components and their interactions at baseline. This constrains the baseline comparisons to be equal, which is appropriate in a randomized trial and increases power [57,58]. We will model the correlation between repeated measures on the same individual using an unstructured residual covariance matrix. The model will allow us to estimate weight change and percentage weight change at the interim time point (ie, month 3) and final follow-up time point (ie, month 12), but the main estimates of interest will be the interaction of the five treatment indicators by month 6.

After examining the model, we will assemble a multicomponent intervention package. If a component has a main effect on weight loss at 6 months that is greater than or equal to 0.7 kg (1.5 lbs) and no significant interaction with another component, then the superior level of the component will be retained for the intervention package. Otherwise, if there is no significant main effect or interaction, the default (ie, reference) level of the component will be retained (see Table 1). We will reconsider inclusions based on the presence of large (ie, effect ≥0.7 kg) interactions. This decision making is based on the approach outlined in an article by Collins et al [59]. Although the 3- and 12-month weight will not be used in the primary decision-making process, we may reconsider our inclusions if there is a large change in effect between 6 and 12 months, or if there are larger effects at 3 months. Given the factorial design, we will use effect coding, rather than dummy coding, for analyzing the effects of the intervention components. If the sample size is equal per condition, all of the tests of main effects and interactions are uncorrelated; that is, the main effect of a condition is the same even if other treatment conditions and interactions are included in the statistical model. Even with unequal sample sizes across conditions, as may occur with differential dropout by condition, if the imbalance is minor, the correlations between effects should be small [26].

Missing outcome data due to dropout or missing intermediate visits are expected to be, at most, 30%. Since the mixed model will be fit using a full maximum likelihood method, we will be able to account for predictors of missingness in the model in order to obtain valid estimates of the main component effects, thanks to the property that the response can be missing at random [60]. In practice, we will compare baseline characteristics of completers and noncompleters. If we find that any covariates predict missingness, we will adjust for these variables in a sensitivity analysis model.

In addition, we will examine gender as a potential moderator of the intervention effects. We acknowledge that the study is not powered to detect moderators, but these results may be used to guide future studies.


The project was funded in February 2017; enrollment began in January 2018 and data collection was completed in June 2019. Data analysis is in progress and first results are expected to be submitted for publication in 2021.


Overview

The intensive nature of most traditional weight loss interventions constrains their dissemination. To make a population-level impact in addressing the obesity epidemic, we need treatments that are novel, easy to disseminate, and sustainable. The overarching goal of Charge is to develop an efficacious, standalone, text messaging obesity intervention. We focus on standalone approaches—treatments that can be delivered solely via text messaging—because of their dissemination potential. Standalone treatments are scalable, affordable, and can achieve population reach. They can reach into broad, diverse, and geographically dispersed populations that do not have stable access to other approaches (eg, counseling, web, email, and video) frequently employed in digital weight loss trials. However, these interventions are also modular; they can be delivered independently to maximize cost-effectiveness or combined with other approaches (eg, provider counseling) to maximize outcomes.

Comparison to Prior Work

Despite their translational potential, few trials have tested a standalone texting intervention for weight loss [8]. While the widespread availability of mHealth apps has been an undeniable boon for Americans who are seeking easy access to strategies to help them manage their health, very few of the commercially available digital solutions have any evidentiary basis. Further, engagement with apps wanes over time, making them a potentially less appealing approach [25,61]. Also, apps require data plans that are prohibitive for those on limited incomes [39]. In contrast, it has been extremely difficult to promote the translation of evidence-based treatments, both because of the latency in the process and because few research-tested digital treatments match the needs of the broader marketplace. Our interest is in developing an intervention solution that would be suitable for population distribution; accordingly, we designed it to match the conventions of the most widely accessible digital tools.

Charge is one of the first trials to apply the MOST framework to the development of a digital health intervention. For several reasons, MOST is particularly well suited to this task. There are myriad ways to design digital treatments, particularly those that are standalone. Indeed, design considerations and their impact on user behavior receive considerable attention in commercial software design. In contrast, the empirical literature provides little guidance on optimal intervention designs, and the extant evidence is replete with interventions with designs that vary considerably. This is problematic because even minor changes to the design of digital components can markedly impact user engagement, the most important predictor of weight loss outcomes. MOST allows us to isolate the weight loss effects of discrete texting intervention components and to then assemble an efficacious standalone texting treatment package. Of note, MOST encourages optimization for a specific purpose. Here we have chosen to optimize a standalone treatment for broad public health delivery, similar to the text4baby intervention [62]. What MOST describes as the continuous optimization principle could also be described as iteration, a concept that is fundamental to modern software design. In principle, when Charge is complete, one might continue the optimization process to continue refining our interventions for optimal effectiveness. Indeed, our group has plans to do this at the conclusion of the Charge trial.

Limitations

There are some study limitations. One limitation is whether we selected the appropriate components, component levels, and number of components. As mentioned previously, we understand that these design choices might constrain the magnitude of our treatment outcomes, relative to gold-standard treatments. However, our goal is to create a standalone texting intervention that can be optimally disseminated. Additionally, lack of diversity in sampling could be a limitation. It is important for our sample to be diverse, particularly considering evidence that racial and ethnic minorities both experience the health effects of obesity at disproportionately high rates, and that the use of text messaging in these groups is almost ubiquitous [10]. We also acknowledge that we have made design decisions that may constrain efficacy and retention, including the lack of human contact with study participants. It is a common observation that standalone treatments have tremendous challenges with nonuse and trial attrition [25,61].

Conclusions

Although many MOST screening experiments utilize factorial experimental designs, full factorial trials are particularly efficient in terms of cost and logistics when leveraged for standalone digital treatments. The marginal costs of adding users accrue primarily due to research costs and quite minimally due to intervention expenses. Accordingly, MOST has the potential to promote the rapid advancement of digital health treatments. This is particularly important for standalone treatments; despite mounting feasibility evidence, such interventions frequently report suboptimal weight loss outcomes. For these interventions to have population-level impact, we must make their outcomes more robust. Charge is designed to address this goal. Subject to positive findings here and in a future efficacy trial, the intervention will be low cost, immediately scalable, and ready for dissemination. This will be of great potential use to the millions of Americans with obesity and the providers who treat them.

Acknowledgments

Financial support for this project is provided by a National Institutes of Health grant (5R01DK109696).

Conflicts of Interest

GGB holds equity in Coeus Health and serves on the scientific advisory board of WW (formerly Weight Watchers). DS serves on the clinical advisory board of Omada Health. These organizations had no role in the study design, data collection, data analysis, interpretation of data, writing of the report, or the decision to submit the article for publication.

Multimedia Appendix 1

Randomization conditions by group.

DOCX File , 17 KB

  1. Ogden CL, Carroll MD, Flegal KM. Prevalence of obesity in the United States. JAMA 2014 Jul;312(2):189-190. [CrossRef] [Medline]
  2. Flegal KM, Carroll MD, Kit BK, Ogden CL. Prevalence of obesity and trends in the distribution of body mass index among US adults, 1999-2010. JAMA 2012 Feb 1;307(5):491-497. [CrossRef] [Medline]
  3. Finkelstein EA, Brown DS, Wrage LA, Allaire BT, Hoerger TJ. Individual and aggregate years-of-life-lost associated with overweight and obesity. Obesity (Silver Spring) 2010 Feb;18(2):333-339 [FREE Full text] [CrossRef] [Medline]
  4. Fontaine KR, Redden DT, Wang C, Westfall AO, Allison DB. Years of life lost due to obesity. JAMA 2003 Jan 08;289(2):187-193. [Medline]
  5. Han X, Stevens J, Truesdale KP, Bradshaw PT, Kucharska-Newton A, Prizment AE, et al. Body mass index at early adulthood, subsequent weight change and cancer incidence and mortality. Int J Cancer 2014 Dec 15;135(12):2900-2909. [CrossRef] [Medline]
  6. Wadden TA, Stunkard AJ. Handbook of Obesity Treatment. New York, NY: The Guilford Press; 2002.
  7. Osei-Assibey G, Kyrou I, Adi Y, Kumar S, Matyka K. Dietary and lifestyle interventions for weight management in adults from minority ethnic/non-White groups: A systematic review. Obes Rev 2010 Nov;11(11):769-776. [CrossRef] [Medline]
  8. Bennett GG, Steinberg D, Askew S, Levine E, Foley P, Batch BC, et al. Effectiveness of an app and provider counseling for obesity treatment in primary care. Am J Prev Med 2018 Dec;55(6):777-786 [FREE Full text] [CrossRef] [Medline]
  9. Smith A. US smartphone use in 2015. Pew Research Center. Washington, DC: Pew Research Center; 2015 Apr 01.   URL: http://www.pewinternet.org/2015/04/01/us-smartphone-use-in-2015/ [accessed 2020-03-30]
  10. Smith A. Smartphone ownership 2013. Pew Research Center. Washington, DC: Pew Research Center; 2013 Jun 05.   URL: https://www.pewresearch.org/internet/2013/06/05/smartphone-ownership-2013/ [accessed 2020-03-30]
  11. Smith A. Technology trends among people of color. Pew Research Center. Washington, DC: Pew Research Center; 2010 Sep 17.   URL: https://www.pewresearch.org/internet/2010/09/17/technology-trends-among-people-of-color/ [accessed 2020-04-01]
  12. Donaldson EL, Fallows S, Morris M. A text message based weight management intervention for overweight adults. J Hum Nutr Diet 2014 Apr;27 Suppl 2:90-97. [CrossRef] [Medline]
  13. Steinberg DM, Levine EL, Askew S, Foley P, Bennett GG. Daily text messaging for weight control among racial and ethnic minority women: Randomized controlled pilot study. J Med Internet Res 2013;15(11):e244 [FREE Full text] [CrossRef] [Medline]
  14. Haapala I, Barengo NC, Biggs S, Surakka L, Manninen P. Weight loss by mobile phone: A 1-year effectiveness study. Public Health Nutr 2009 Dec;12(12):2382-2391. [CrossRef] [Medline]
  15. Shapiro JR, Koro T, Doran N, Thompson S, Sallis JF, Calfas K, et al. Text4Diet: A randomized controlled study using text messaging for weight loss behaviors. Prev Med 2012 Nov;55(5):412-417. [CrossRef] [Medline]
  16. Lin P, Wang Y, Levine E, Askew S, Lin S, Chang C, et al. A text messaging-assisted randomized lifestyle weight loss clinical trial among overweight adults in Beijing. Obesity (Silver Spring) 2014 May;22(5):E29-E37. [CrossRef] [Medline]
  17. Carter MC, Burley VJ, Nykjaer C, Cade JE. Adherence to a smartphone application for weight loss compared to website and paper diary: Pilot randomized controlled trial. J Med Internet Res 2013;15(4):e32 [FREE Full text] [CrossRef] [Medline]
  18. Napolitano MA, Hayes S, Bennett GG, Ives AK, Foster GD. Using Facebook and text messaging to deliver a weight loss program to college students. Obesity (Silver Spring) 2013 Jan;21(1):25-31. [CrossRef] [Medline]
  19. Lin M, Mahmooth Z, Dedhia N, Frutchey R, Mercado CE, Epstein DH, et al. Tailored, interactive text messages for enhancing weight loss among African American adults: The TRIMM randomized controlled trial. Am J Med 2015 Aug;128(8):896-904. [CrossRef] [Medline]
  20. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [Medline]
  21. Mehta SJ, Volpp KG, Troxel AB, Day SC, Lim R, Marcus N, et al. Electronic pill bottles or bidirectional text messaging to improve hypertension medication adherence (Way 2 Text): A randomized clinical trial. J Gen Intern Med 2019 Nov;34(11):2397-2404. [CrossRef] [Medline]
  22. Foley P, Steinberg D, Levine E, Askew S, Batch BC, Puleo EM, et al. Track: A randomized controlled trial of a digital health obesity treatment intervention for medically vulnerable primary care patients. Contemp Clin Trials 2016 Dec;48:12-20 [FREE Full text] [CrossRef] [Medline]
  23. Patel ML, Hopkins CM, Bennett GG. Early weight loss in a standalone mHealth intervention predicting treatment success. Obes Sci Pract 2019 Jun;5(3):231-237 [FREE Full text] [CrossRef] [Medline]
  24. Strecher V. Internet methods for delivering behavioral and health-related interventions (eHealth). Annu Rev Clin Psychol 2007;3:53-76. [CrossRef] [Medline]
  25. Bennett GG, Glasgow RE. The delivery of public health interventions via the internet: Actualizing their potential. Annu Rev Public Health 2009;30:273-292. [CrossRef] [Medline]
  26. Collins LM. Optimization of Behavioral, Biobehavioral, and Biomedical Interventions: The Multiphase Optimization Strategy (MOST). Cham, Switzerland: Springer International Publishing; 2018.
  27. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 1989 Sep;13(3):319. [CrossRef]
  28. Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: A comparison of two theoretical models. Manage Sci 1989 Aug;35(8):982-1003. [CrossRef]
  29. Pellegrini CA, Hoffman SA, Collins LM, Spring B. Optimization of remotely delivered intensive lifestyle treatment for obesity using the Multiphase Optimization Strategy: Opt-IN study protocol. Contemp Clin Trials 2014 Jul;38(2):251-259 [FREE Full text] [CrossRef] [Medline]
  30. Yap TL, Davis LS. Physical activity: The science of health promotion through tailored messages. Rehabil Nurs 2008;33(2):55-62. [CrossRef] [Medline]
  31. Foley P, Levine E, Askew S, Puleo E, Whiteley J, Batch B, et al. Weight gain prevention among Black women in the rural community health center setting: The Shape Program. BMC Public Health 2012 Jun 15;12:305 [FREE Full text] [CrossRef] [Medline]
  32. Patrick K, Raab F, Adams MA, Dillon L, Zabinski M, Rock CL, et al. A text message-based intervention for weight loss: Randomized controlled trial. J Med Internet Res 2009;11(1):e1 [FREE Full text] [CrossRef] [Medline]
  33. Yoo HJ, Park MS, Kim TN, Yang SJ, Cho GJ, Hwang TG, et al. A ubiquitous chronic disease care system using cellular phones and the internet. Diabet Med 2009 Jun;26(6):628-635. [CrossRef] [Medline]
  34. Hebden L, Balestracci K, McGeechan K, Denney-Wilson E, Harris M, Bauman A, et al. 'TXT2BFiT' a mobile phone-based healthy lifestyle program for preventing unhealthy weight gain in young adults: Study protocol for a randomized controlled trial. Trials 2013;14:75 [FREE Full text] [CrossRef] [Medline]
  35. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol 2000 Jan;55(1):68-78. [Medline]
  36. Costa J, Wehbe R, Robb J, Nacke L. Time’s up: Studying leaderboards for engaging punctual behaviour. In: Proceedings of the First International Conference on Gameful Design, Research, and Applications. New York, NY: Association for Computing Machinery; 2013 Presented at: First International Conference on Gameful Design, Research, and Applications; October 2-4, 2013; Toronto, ON p. 26-33. [CrossRef]
  37. Burguillo JC. Using game theory and competition-based learning to stimulate student motivation and performance. Comput Educ 2010 Sep;55(2):566-575. [CrossRef]
  38. Landers RN, Landers AK. An empirical test of the theory of gamified learning. Simul Gaming 2015 Jan 26;45(6):769-785. [CrossRef]
  39. Tabak RG, Strickland JR, Stein RI, Dart H, Colditz GA, Kirk B, et al. Development of a scalable weight loss intervention for low-income workers through adaptation of interactive obesity treatment approach (iOTA). BMC Public Health 2018 Nov 16;18(1):1265 [FREE Full text] [CrossRef] [Medline]
  40. Bandura A. Self-Efficacy: The Exercise of Control. New York, NY: WH Freeman; 1997.
  41. Bandura A. Self-efficacy: Toward a unifying theory of behavioral change. Psychol Rev 1977 Mar;84(2):191-215. [Medline]
  42. Linde JA, Rothman AJ, Baldwin AS, Jeffery RW. The impact of self-efficacy on behavior change and weight change among overweight participants in a weight loss trial. Health Psychol 2006 May;25(3):282-291. [CrossRef] [Medline]
  43. Richman RM, Loughnan GT, Droulers AM, Steinbeck KS, Caterson ID. Self-efficacy in relation to eating behaviour among obese and non-obese women. Int J Obes Relat Metab Disord 2001 Jun;25(6):907-913. [CrossRef] [Medline]
  44. Elfhag K, Rössner S. Who succeeds in maintaining weight loss? A conceptual review of factors associated with weight loss maintenance and weight regain. Obes Rev 2005 Feb;6(1):67-85. [CrossRef] [Medline]
  45. Bandura A. Health promotion by social cognitive means. Health Educ Behav 2004 Apr;31(2):143-164. [CrossRef] [Medline]
  46. Levitsky DA, Garay J, Nausbaum M, Neighbors L, Dellavalle DM. Monitoring weight daily blocks the freshman weight gain: A model for combating the epidemic of obesity. Int J Obes (Lond) 2006 Jun;30(6):1003-1010. [CrossRef] [Medline]
  47. Klem ML, Wing RR, McGuire MT, Seagle HM, Hill JO. A descriptive study of individuals successful at long-term maintenance of substantial weight loss. Am J Clin Nutr 1997 Aug;66(2):239-246 [FREE Full text] [Medline]
  48. Boutelle KN, Kirschenbaum DS, Baker RC, Mitchell ME. How can obese weight controllers minimize weight gain during the high risk holiday season? By self-monitoring very consistently. Health Psychol 1999 Jul;18(4):364-368. [CrossRef] [Medline]
  49. Stolley MR, Fitzgibbon ML, Schiffer L, Sharp LK, Singh V, Van Horn L, et al. Obesity reduction black intervention trial (ORBIT): Six-month results. Obesity (Silver Spring) 2009 Jan;17(1):100-106 [FREE Full text] [CrossRef] [Medline]
  50. Wing RR, Jeffery RW. Benefits of recruiting participants with friends and increasing social support for weight loss and maintenance. J Consult Clin Psychol 1999 Feb;67(1):132-138. [Medline]
  51. Hardeman W, Griffin S, Johnston M, Kinmonth AL, Wareham NJ. Interventions to prevent weight gain: A systematic review of psychological models and behaviour change methods. Int J Obes Relat Metab Disord 2000 Feb;24(2):131-143. [CrossRef] [Medline]
  52. Bennett GG, Herring SJ, Puleo E, Stein EK, Emmons KM, Gillman MW. Web-based weight loss in primary care: A randomized controlled trial. Obesity (Silver Spring) 2010 Feb;18(2):308-313 [FREE Full text] [CrossRef] [Medline]
  53. Armstrong T, Bull F. Development of the World Health Organization Global Physical Activity Questionnaire (GPAQ). J Public Health 2006 Mar 2;14(2):66-70. [CrossRef]
  54. Ware JE, Kosinski M, Keller SD. SF-36 Physical and Mental Health Summary Scales: A User's Manual. 5th edition. Boston, MA: Health Assessment Lab; 1994.
  55. Ware JE, Kosinski M, Keller SD. SF-12: How to Score the SF-12 Physical & Mental Health Summary Scales. 2nd edition. Boston, MA: The Health Institute, New England Medical Center; 1995.
  56. Dziak JJ, Collins LM, Wagner AT. FactorialPowerPlan SAS Macro Users’ Guide. Version 1.0. State College, PA: University Park: The Methodology Center, Penn State; 2013.   URL: https://www.methodology.psu.edu/files/2019/03/factorial_power_plan_ug-1du7v00.pdf [accessed 2020-01-30]
  57. Fitzmaurice GM, Laird NM, Ware JH. Applied Longitudinal Analysis. 2nd edition. Hoboken, NJ: Wiley; 2011.
  58. Lu K. On efficiency of constrained longitudinal data analysis versus longitudinal analysis of covariance. Biometrics 2010 Sep;66(3):891-896. [CrossRef] [Medline]
  59. Collins LM, Trail JB, Kugler KC, Baker TB, Piper ME, Mermelstein RJ. Evaluating individual intervention components: Making decisions based on the results of a factorial screening experiment. Transl Behav Med 2014 Sep;4(3):238-251 [FREE Full text] [CrossRef] [Medline]
  60. Little RJA, Rubin DB. Statistical Analysis With Missing Data. 2nd edition. New York, NY: John Wiley & Sons; 2002.
  61. Lanpher MG, Askew S, Bennett GG. Health literacy and weight change in a digital health intervention for women: A randomized controlled trial in primary care practice. J Health Commun 2016;21 Suppl 1:34-42 [FREE Full text] [CrossRef] [Medline]
  62. Whittaker R, Matoff-Stepp S, Meehan J, Kendrick J, Jordan E, Stange P, et al. Text4baby: Development and implementation of a national text messaging health information service. Am J Public Health 2012 Dec;102(12):2207-2213. [CrossRef] [Medline]


GPAQ 2: Global Physical Activity Questionnaire version 2
iOTA: interactive obesity treatment approach
mHealth: mobile health
MOST: multiphase optimization strategy
SF-12: 12-item Short Form Health Survey
SF-36: 36-item Short Form Health Survey
TAM: Technology Acceptance Model


Edited by G Eysenbach; submitted 22.04.20; peer-reviewed by R Shaw, S Schembre; comments to author 11.05.20; revised version received 06.10.20; accepted 01.12.20; published 18.01.21

Copyright

©Gary G Bennett, Dori Steinberg, Jamiyla Bolton, John A Gallis, Cayla Treadway, Sandy Askew, Melissa C Kay, Kathryn I Pollak, Elizabeth L Turner. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 18.01.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.