ResProt JMIR Res Protoc JMIR Research Protocols 1929-0748 JMIR Publications Toronto, Canada v7i4e84 29643053 10.2196/resprot.8771 Protocol Protocol A Novel Mobile App and Population Management System to Manage Rheumatoid Arthritis Flares: Protocol for a Randomized Controlled Trial Eysenbach Gunther Grainger Rebecca Krebs Paul Okamoto Kazuya Wang Penny BA 1 http://orcid.org/0000-0003-0407-3648 Luo Dee BA 1 http://orcid.org/0000-0002-0796-4334 Lu Fengxin MD 1 http://orcid.org/0000-0002-9357-311X Elias Josephine S MPH, MBA 2 http://orcid.org/0000-0002-3398-1090 Landman Adam B MS, MIS, MHS, MD 2 http://orcid.org/0000-0002-2166-0521 Michaud Kaleb D PhD 3 4 http://orcid.org/0000-0002-5350-3934 Lee Yvonne C MMSc, MD 1 5
Division of Rheumatology Department of Medicine Northwestern University Feinberg School of Medicine Suite M-300 240 East Huron Street Chicago, IL, 60611 United States 1 312 503 1960 yvonne.lee@northwestern.edu
http://orcid.org/0000-0002-2105-3393 1 Division of Rheumatology, Immunology and Allergy Department of Medicine Brigham and Women's Hospital Boston, MA United States 2 Digital Health Innovation Group Brigham and Women's Hospital Boston, MA United States 3 Division of Rheumatology Department of Internal Medicine University of Nebraska Medical Center Omaha, NE United States 4 National Data Bank for Rheumatic Diseases Wichita, KS United States 5 Division of Rheumatology Department of Medicine Northwestern University Feinberg School of Medicine Chicago, IL United States Corresponding Author: Yvonne C Lee yvonne.lee@northwestern.edu 042018 11 04 2018 7 4 e84 17 8 2017 19 11 2017 14 1 2018 21 1 2018 ©Penny Wang, Dee Luo, Fengxin Lu, Josephine S Elias, Adam B Landman, Kaleb D Michaud, Yvonne C Lee. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 11.04.2018. 2018

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.

 Background

Rheumatoid arthritis flares have a profound effect on patients, causing pain and disability. However, flares often occur between regularly scheduled health care provider visits and are, therefore, difficult to monitor and manage. We sought to develop a mobile phone app combined with a population management system to help track RA flares between visits.

 Objective

The objective of this study is to implement the mobile app plus the population management system to monitor rheumatoid arthritis disease activity between scheduled health care provider visits over a period of 6 months.

 Methods

This is a randomized controlled trial that lasts for 6 months for each participant. We aim to recruit 190 patients, randomized 50:50 to the intervention group versus the control group. The intervention group will be assigned the mobile app and be prompted to answer daily questionnaires sent to their mobile devices. Both groups will be assigned a population manager, who will communicate with the participants via telephone at 6 weeks and 18 weeks. The population manager will also communicate with the participants in the intervention group if their responses indicate a sustained increase in rheumatoid arthritis disease activity. To assess patient satisfaction, the primary outcomes will be scores on the Treatment Satisfaction Questionnaire for Medication as well as the Perceived Efficacy in Patient-Physician Interactions questionnaire at 6 months. To determine the effect of the mobile app on rheumatoid arthritis disease activity, the primary outcome will be the Clinical Disease Activity Index at 6 months.

 Results

The trial started in November 2016, and an estimated 2.5 years will be necessary to complete the study. Study results are expected to be published by the end of 2019.

 Conclusions

The completion of this study will provide important data regarding the following: (1) the assessment of validated outcome measures to assess rheumatoid arthritis disease activity with a mobile app between routinely scheduled health care provider visits, (2) patient engagement in monitoring their condition, and (3) communication between patients and health care providers through the population management system.

 Trial Registration

ClinicalTrials.gov NCT02822521, http://clinicaltrials.gov/ct2/show/NCT02822521 (Archived by WebCite at http://www.webcitation.org/6xed3kGPd)

 arthritis, rheumatoid symptom flare up telemedicine mobile applications Introduction

Rheumatoid arthritis (RA) is a systemic autoimmune disease that causes stiffness, swelling, and pain, resulting from inflammation in the joints [1]. Individuals with RA may experience occasional increases in inflammation that are associated with worsening symptoms called flares [2]. In focus groups, RA patients characterized flares as unpredictable, intense episodes that render them feeling helpless [3].

It is important for health care providers (HCPs) to monitor flares because frequent, long-lasting increases in inflammation can result in a permanent damage to joints and negatively impact quality of life [4,5]. The assessment of flares, however, is complicated. Flares are often unreported or inaccurately reported as RA patients may no longer recall flares that occurred between HCP visits. A study reported that 65% of RA patients who experienced flares were no longer facing issues by the time of their routine clinic visit [2]. In addition, patients and their HCPs frequently differ in what they call a flare. A qualitative research study, involving semistructured interviews and a Delphi exercise, revealed that, of the 10 domains identified as important by patients in the assessment of flare, only 4 overlapped with the domains considered important by their HCPs [6]. Although several research groups are working on the development of validated RA flare criteria, additional work is needed to develop appropriate scoring criteria and thresholds for flare severity and change [7,8].

To help HCPs and their patients better manage flares, better methods of tracking RA symptoms are needed. One potential method is through the use of mobile app. Nearly 64% of adults in the United States owned mobile phones in 2015, and 58.23% of mobile phone owners downloaded at least 1 health app [9,10]. Many types of apps have been developed to explore ways of helping people with chronic illnesses, such as diabetes and heart disease, and to monitor, understand, and manage symptoms [11]. Fewer apps have focused on the management of chronic autoimmune conditions, such as RA.

A research group in Japan recently created an app that enables RA patients to measure disease activity through patient-reported tender joints, a modified health assessment questionnaire, and measurement of gait balance using an accelerometer. In a pilot study of 65 RA patients, Nishiguchi et al demonstrated that patient-reported assessment of disease activity, via the mobile app, correlated with a validated measure of disease activity, the Disease Activity Score in 28 Joints, which includes physician-assessed joint counts and C-reactive protein, a serum inflammatory disease marker [12]. In a follow-up study in 2016 conducted by the same group, participants were surveyed about their opinions using the app. Overall, participants were favorable, stating that they had no or little difficulty recording their self-assessments [13]. Limitations, however, included the small sample size (N=9) and the limited length of follow-up (3 months). In addition, no information was provided regarding the use of these data by HCPs in medical decision making.

The overall objective of this proposal is to implement a mobile app plus a population management system to monitor RA disease activity between scheduled HCP visits over 6 months. The essential components in this system are as follows: (1) the mobile app, (2) the Web-based dashboard, and (3) the population manager. The Web-based dashboard consolidates incoming patient-reported data using preprogrammed algorithms to identify increases in disease activity, and the population manager is a trained individual who monitors the Web-based dashboard and connects patients with their HCPs. Our hypothesis is that the combination of mobile app and the population management system will improve patient satisfaction and management of RA disease activity by identifying RA flares as they occur and providing this information to the HCP through a trained population manager. The rationale is that the mobile app will increase patient involvement in disease assessment, whereas the population management system will support the integration of patient-reported data into the workflow of a busy clinical practice, enabling improved disease activity management between scheduled clinic visits.

 Methods Infrastructure

The setting for this study is the outpatient rheumatology clinic of an academic medical center in Boston, MA. This site was chosen because it is the home institution of the researchers involved in this study. The institution supports the development of mobile interventions through the Digital Health Innovation Group, which offers advice and assistance to ensure that the important standards for mHealth research (eg, cybersecurity, software design, and software maintenance) are met. The city of Boston, MA, is an ideal location for this study because it is one of the top 50 mobile-friendly cities in the United States [14]. In 2016, the availability of carrier networks in Boston was 51% above the national average of 81%. Upload and download speeds were 6.26 mbps and 8.74 mbps, respectively, and there were 2.12 mobile phone stores per 10,000 residents, enabling in-person customer service for mobile devices.

 Study Visit Design General Schematic

This is a randomized controlled trial (RCT) of a mobile app plus the population management system. All participants will be assigned a population manager to serve as a contact person with whom participants can communicate regarding their flares. Participants randomized to receive the app will answer daily questions about their RA disease activity, using a validated self-report measure, Rheumatoid Arthritis Disease Activity Index-5 (RADAI-5), and the Patient-Reported Outcomes Measurement Information System (PROMIS) depression, fatigue, pain interference, physical function, and sleep impairment short forms [15,16]. The RADAI-5 was chosen because it is a short, 5-item questionnaire based only on patient-reported measures, whereas other common disease activity measures, such as the Clinical Disease Activity Index (CDAI) and Simplified Disease Activity Index, require in-person assessment of joints by a health care professional [17,18]. Studies have shown that patient-reported measures have similar, possibly greater, sensitivity in detecting treatment effects in RA [19].

The app will record the answers and summarize them in a graphical form to enable the visualization of trends. Population managers will have access to this information in real-time via a secure Web-based dashboard.

 Inclusion and Exclusion Criteria

To be included in this study, participants must: (1) be diagnosed with RA by a board-certified rheumatologist, (2) be taking a disease-modifying antirheumatic drug (DMARD), (3) own a mobile device with an Android or iOS operating system, (4) be at least 18 years old, and (5) be able to speak English. Participants who do not plan on receiving follow-up care at this academic medical center will be excluded.

 Randomization (Disease Activity Levels)

Participants will be randomized 1:1 using a publicly available Web-based randomization tool. Randomization will occur within categories stratified by disease activity, assessed by the CDAI: remission (≤2.8), low (>2.8-10), moderate (>10-22), and high (>22) [17].

 Study Visits

Study visits will occur at baseline, 3 months, and 6 months and will coincide with regularly scheduled visits to the participants’ rheumatology HCP. A trained research assistant will perform all assessments, including the joint examinations and tender point counts. Participants will also complete self-administered questionnaires to assess disease activity, flares, treatment satisfaction, and perceived efficacy of the patient-physician relationship. Specific data collection instruments are outlined in the section Data Collection. The research assistant will be blinded to the study arms to which the participants are assigned. This role is distinct from that of the population manager described in the section Population Management and Web-Based Dashboard (Figure 1).

 Rheumatoid Arthritis Flare Study App

The mobile app was designed by the principal investigator and coinvestigators and custom developed by the ADK Group (Boston, MA), with guidance on the visual display from experienced app developers. Although RA patients were not involved in the design of this specific study or app, we incorporated information obtained from another study of a mobile phone app for RA patients, which was designed and led by one of the study co-investigators [20].

Study schematic showing the roles of research assistants at study visits versus the roles of population managers who communicate with subjects between study visits. Research assistants are blinded to the randomization, whereas population managers are not blinded. Pt = patient.

Screenshots of interface of RA Flare Mobile App.

All questionnaires used in the app have been validated and used in other studies including RA patients [15,16]. The app was designed to function on both the Android and iOS systems and met all guidelines for submission to the US Google Play and Apple App stores. Screenshots of the app are provided to show the visual interface (Figure 2).

At the first study visit, all study participants will be informed that, if they are randomized to receive the app, they will receive an email containing links to download the app from Google Play or the Apple App store. They will also receive a phone call from a trained study staff member, acting as a population manager, who will confirm that they were randomized to the intervention arm and take the participant through the process of downloading and using the app. Participants will register their account using a username, a password, and 5-digit pin number. After the app is downloaded, participants will be guided through a short interactive tutorial outlining important features of the app.

The app will send users a notification at 9:00 AM every day, prompting them to login using their username and 5-digit pin number to answer questions related to RA. If users have not answered their daily questions by 9:00 PM, they will receive another notification to remind them to complete the questions by 9:00 AM the next day. Once logged in, an option on the home screen will enable participants to select the daily survey. A table listing the surveys is provided in the section Data collection. Study participants will be able to view their responses in a graphic form on their apps if they are connected to the internet. However, no data will be stored on the app itself. Data will be transmitted securely and stored on secure servers at the study site. Data will be viewable by study staff on a password-protected Web-based dashboard, which includes graphs of all survey scores, as well as a table that shows the numerical scores. Additionally, the app will include a “Contact Us” button, which sends an email to the population manager, requesting further contact.

 Population Management and Web-Based Dashboard

Each participant, regardless of study arm assignment, will be assigned to a population manager. The population manager is a trained study staff member who, unlike the research assistant performing visits, is not blinded to study group assignment. The population manager is responsible for communicating with participants during the course of the study. The initial call will occur immediately after the first study visit. The population manager will call to introduce him or herself and offer to assist participants with troubleshooting procedures to successfully download and register the app on the mobile device. The population manager will also call participants at weeks 6 and 18 to check in on participants and ask if they are experiencing an RA flare. These calls also serve to encourage participants to stay engaged in the study. If participants endorse a flare, an additional set of structured questions will be asked to assess the specific joints involved, as well as other symptoms and medication adherence.

For participants randomized to receive the mobile app, the population manager will also monitor responses to the daily questionnaires on the Web-based dashboard (Figure 3). An algorithm will be used to identify potential RA flares by comparing the mean RADAI-5 score over the past 2 weeks to the mean RADAI-5 score over the previous 2 weeks.

If the participants’ RADAI-5 score increases by more than 30% from the previous 2 weeks’ reading and their current RADAI-5 score is >3, the dashboard will generate an alert to the population manager (Figure 4). The study team decided on this threshold after 1:1 conversations with board-certified rheumatologists at the study site. The appropriateness of this threshold will be evaluated as a part of this study.

Web-based dashboard interface used by population managers to monitor participants’ responses to the app.

The flare algorithm compares Rheumatoid Arthritis Disease Activity Index-5 (RADAI-5) responses over a period of 2 weeks compared with the previous 2 weeks’ average. If the participant’s RADAI-5 score increases by more than 30% from the previous 2 weeks’ reading, the dashboard will generate an alert to the population manager.

The population manager will be responsible for communicating with study participants when the app algorithm identifies possible flares. The participant will be contacted and asked a structured set of follow-up questions about the possible flare, associated symptoms, and medication adherence. A 1-page summary will be compiled to send to the referring rheumatology HCP. Population managers will remind participants that their HCP is not required to respond to the summary, and it is up to their HCP to decide on appropriate follow-up procedures.

Although we considered prescribing a specific algorithm for HCPs to follow to address RA flares, we ultimately decided to allow each rheumatology HCP to respond to the notifications according to his or her own practice patterns. Our decision was based on 3 considerations: (1) there are no accepted guidelines regarding the treatment of RA flares, (2) surveys with the site’s HCPs indicated that physician participation would be negatively impacted by a rigid paradigm, and (3) we believe the mobile app plus the population management system will have broad applicability, independent of the specific management paradigm.

If participants do not answer any survey questions for 7 consecutive days, the population manager will contact the participant after the 7th day. Participants will be asked a set of questions to better understand the reasons underlying their lack of responses for the past week.

 Data Collection

Data will be collected using the following methods: (1) all participants in the study will complete validated, self-reported questionnaires at study visits using paper forms (Table 1) and (2) participants in the intervention arm will also provide data daily through the app (Table 2). Rheumatology HCPs will also complete questionnaires at every study visit. Specifically, they will provide the physician global assessment of disease activity by answering the question, “Please rate your patient’s disease activity on a scale of 0-10 with 0 being very good and 10 being very bad” at every visit. At every visit following the baseline visit, HCPs will also be asked to complete the Physician Flare Questionnaire, which assesses their responses to flare notifications (eg, called patient, saw patient in person, changed medications; Multimedia Appendix 1). After the subject’s final study visit, his or her HCP will complete a Physician Exit Survey to provide feedback regarding his or her experiences with the mobile app and the population management system, including questions about its impact on patient-physician communication, overall management of RA disease activity, and physician workload (Multimedia Appendix 2).

Evaluations occurring at all study visits among all study participants.

Type of assessment and instrument Description
Self-administered questionnaires
Basic demographics (only during baseline visit) Gender, age, ethnicity, race, education, and marital status
Treatment Satisfaction Questionnaire for Medication (TSQM) The TSQM asks participants about their level of satisfaction with their medications [21]
Perceived Efficacy in Patient-Physician Interactions Questionnaire (PEPPI) The PEPPI consists of 10 items asking participants about their self-efficacy in interacting with their health care providers [22]
Patient global assessment of disease activity Participants will be asked, “Considering all the ways in which illness and health conditions may affect you at this time, please rate how you are doing on a scale of 0-100 with 0 being very well and 100 being very poorly.”
Brigham Rheumatoid Arthritis Sequential Study flare questions Participants will be asked “During the past 3 months, have you had a flare in your rheumatoid arthritis (RA)?” If a participant answers yes, the participant will be queried about flare frequency, and how he or she treated the flare(s) [2]
Flare Assessment of Rheumatoid Arthritis Questionnaire This 13-item questionnaire was developed through a Delphi exercise to detect RA flares between medical visits [6]
Patient Activity Scale II (PAS-II) This is a validated index that assesses 3 American College of Rheumatology (ACR) Core Data Set patient-reported outcomes—physical function, pain, and global health [23]
Assessments by trained study staff members
Clinical Disease Activity Index (CDAI) The CDAI is a measurement of RA disease activity calculated from the 28 joint count examination in addition to the physician global assessment and patient global assessment scores [17]
Tender point examination The tender point examination assesses tenderness at 18 sites and is used in the 1990 ACR Criteria for the Classification of Fibromyalgia [24]

Self-administered questionnaires delivered through the mobile app between study visits among participants in the intervention group.

Instruments Description Frequency of administration
Mobile Entry Questionnaire This module includes 4 items about how subjects feel about their connection with their health care team Once at the beginning of the study
Modified Rheumatoid Arthritis Disease Activity Index (RADAI-5) The RADAI-5 is a validated survey consisting of 5 items in a Likert format from 0 to 10 [15]: (1) How active was your arthritis in the last 6 months?; (2) How active is your arthritis today with respect to joint tenderness and swelling?; (3) How severe is your arthritis pain today?; (4) How would you describe your general health today?; and (5) Did you experience joint (hand) stiffness on awaking yesterday morning? If yes, how long was this stiffness? The first question regarding arthritis activity in the last 6 months will be asked once a month. The last 4 questions regarding joint tenderness and swelling, pain severity, global health, and joint stiffness will be asked 3 times during an 8-day rotation
PROMISa Pain Interference Short Form 4 questions about the extent to which pain hinders engagement with activities [25] Once every 8 days
PROMIS Physical Function Short Form 4 questions about the ability to perform basic activities [26] Once every 8 days
PROMIS Fatigue Short Form 4 questions about tiredness and exhaustion [27] Once every 8 days
PROMIS Depression Short Form 4 questions about negative mood and views of self [28] Once every 8 days
PROMIS Sleep Disturbance Short Form 4 questions about sleep quality and restoration associated with sleep [29] Once every 8 days
Flare treatment strategies This module is based on questions asked in the Brigham Rheumatoid Arthritis Sequential Study preliminary study of flares in rheumatoid arthritis (RA). Specifically, this module will ask participants whether they had an RA flare in the 14 days and how they treated this flare [2] Monthly

aPROMIS: Patient-Reported Outcomes Measurement Information System.

 Recruitment

The recruitment goal is 190 participants. Potential participants will be identified by searching for ICD-9 diagnosis codes for RA (714.x) in the Brigham Integrated Computing System scheduling database. Every week, study staff will generate lists of potential participants and prescreen patients via medical record review. Study staff will provide weekly lists to clinicians for their approval to contact the patients. Study staff will also be present in clinic during the busiest clinic sessions to remind HCPs of potential participants and to facilitate referrals. Every eligible participant will review the informed consent document approved by Partners Institutional Review Board, and written informed consent will be obtained by a trained research assistant. All study staff will complete training in HIPAA and Ethics in Human Subjects Research. Approximately 50.0% (95/190) will be randomized to receive the mobile app (intervention group). On the basis of attrition rates from previous studies, we expect ≥61.0% (122/190) of subjects to complete the study.

 Outcome Measures

To assess patient satisfaction, the primary outcomes will be scores on the TSQM and PEPPI questionnaire at 6 months [21,22]. To determine the effect of the mobile app on RA disease activity, the primary outcome will be CDAI at 6 months [17].

The TSQM is a validated questionnaire that assesses medication satisfaction [21]. The different components of medication satisfaction are the following: side effects, effectiveness, convenience, and overall satisfaction. There are 14 questions, scored on a 5- or 7-point Likert scale. Responses to each question are assigned a score between 0 and 100, with 0 being extremely dissatisfied to 100 being extremely satisfied. The TSQM was initially validated in a national study of chronic disease, including patients with arthritis, asthma, depression, hyperlipidemia, hypertension, migraine, and psoriasis. It was subsequently validated in separate populations of patients with multiple sclerosis, cystic fibrosis, and coronary disease [30-32]. In one study, ceiling and floor effects were observed in the side effects domain [32]. Of note, if these effects are a problem, a separate score (TSQM-9) can be calculated, removing the 5 items in the side effects domain. This abbreviated score was shown to have good construct and convergent validity, along with high internal consistency and good test-retest reliability [33]. In a study of individuals with chronic illnesses including 25.6% (44/172) RA patients, representative scores on the TSQM were 77.1 (SD 25.2) for side effects, 61.6 (SD 24.16) for effectiveness, 66.1 (SD 17.1) for convenience, and 68.8 (SD 20.6) for overall satisfaction [34]. Although no studies have specifically examined the responsiveness of the TSQM in RA, a study of osteoarthritis patients revealed that perceptions of convenience, effectiveness, and overall satisfaction increased with treatment with a nonsteroidal anti-inflammatory drug [35]. The TSQM has also been used in clinical trials of RA patients to compare patient satisfaction with the effects of different DMARDs [36].

The PEPPI is a validated questionnaire that assesses self-efficacy in the patient-physician interaction [22]. It consists of 10 questions, scored on 5-point Likert scales, reflecting very confident to not confident at all. In multiple studies of elderly individuals and patients with osteoarthritis, the PEPPI showed construct, convergent, discriminant, and structural validity [22,37,38]. Although a ceiling effect was noted in the PEPPI 10-item scale, no ceiling effects were noted using the abbreviated 5-item scale, and no floor effects were noted for either scale [37-39]. Of note, the PEPPI was recently used in a 12-month RCT of an eHealth interactive self-assessment website (Sanoia) in RA [40]. The 320 participants in this study were similar in age, sex, and disease duration to the population we are recruiting. The mean baseline PEPPI score was 39.2 (SD 7.8). Participants randomized to receive the active intervention had small increases in their PEPPI score (mean 0.6, SD 5.2), whereas participants randomized to the control arm had concurrent decreases in their PEPPI score (mean ‒-0.91, SD 6.08). Although the magnitude of change was small, the difference between the 2 groups was statistically significant (P=.01), indicating that this instrument is able to detect differences between an active self-monitoring intervention and control.

 Statistical Analysis

The primary analysis will be a completer analysis. Summary statistics (eg, frequencies, means, and medians) of the baseline variables will be calculated to assess the effectiveness of randomization. Treatment effects (mean differences in outcomes between the 2 groups at 3 and 6 months) will be estimated with mixed models. This model includes the interaction of treatment and time and allows adjustment for baseline scores. For each outcome measure, we will also adjust for age, sex, race, disease duration, and any variables that are statistically different from each other in unadjusted analyses (P<.10). A 2-tailed P value of .05 will be considered significant. All analyses will be conducted by a blinded statistician using SAS 9.3 (SAS Institute).

On the basis of previous studies performed by this research group within this population, we do not expect a large amount of missing data in the primary outcome measures and covariates. These data are obtained during in-person study visits. A research assistant is present during all study visits and checks forms for completion. When necessary, multiple imputation by chained equations will be used to impute missing variables.

 Sample Size Calculation

A total of 2920 RA patients were seen at the site of recruitment between April 30, 2013, and May 1, 2014. Of these patients, 1980 were prescribed at least one DMARD between April 30, 2013, and May 1, 2014, and approximately 60.00% (1188/1980) had moderate-to-high disease activity. From the 2013 Pew Internet Tracking Survey, we estimate that 50% of these patients (594/1980) own mobile phones [41]. Of these 594 individuals, we expect 80.1% (476/594) to meet the remainder of the inclusion criteria (≥18 years old, English speaking), and 40.0% (190/476) to agree to participate.

On the basis of previous studies examining differences in patient satisfaction, the expected difference between groups is 9.4 (SD 18.4) in TSQM scores [42,43]. No data exist regarding the expected difference in CDAI scores for this intervention. However, the minimal clinically important difference in CDAI scores is 12 [44,45]. On the basis of attrition rates from previous studies, we expect ≥61% (122/190, 64.2%) subjects to complete the study. Given a sample size of 122 subjects and an alpha level of .05, we will be able to reject the null hypothesis that the population means of the experimental and control groups are equal with probability (power) 0.80 to 0.99.

 Fidelity of the Intervention

In addition to the assessments of satisfaction and efficacy described above, we will also assess the fidelity of the intervention. Systems are in place to monitor survey completion rates, and an alert is issued to the population manager if participants have not answered a survey in the past 7 days. Information is also obtained on the exit survey to determine whether participants were able to download the app.

 Results

Recruitment is currently underway. We started patient recruitment in November 2016 and will continue until the recruitment goal of 190 participants has been achieved. Findings on the study’s primary outcomes are expected to be finalized by September 2019. Thus far, user feedback from both RA patients and HCPs has been positive. RA patients have particularly enjoyed the ability to track their disease activity and symptoms and to share these results, using the app’s graphic interface, with their family members. HCPs have appreciated receiving information about their patients between regularly scheduled clinic visits.

 Discussion Summary and Strengths

The findings from this study will represent the first randomized trial to test the effects of a combined mobile app and the population management system on a patient population with RA. Although several mobile apps exist to monitor symptoms of chronic disease, none have incorporated the use of a population management system for the management of disease activity in RA. This manuscript was written meeting the checklist to report health interventions using mobile phones [46].

In a systematic review of mobile apps to assist RA patients in disease management, Grainger et al reported that high-quality apps, including monitoring tools that assess disease activity using validated instruments, are lacking [47]. They also noted the importance of delivering the tools via a user-friendly interface. Our medical team collaborated with the local app developer, as well as other experienced developers, to address these 2 issues. First, we worked with the local app developer to incorporate a validated measure of self-reported RA, the RADAI-5, and PROMIS assessments of pain interference, physical function, fatigue, depression, and sleep disturbance. Second, we met experienced app developers to get advice regarding the user interface during the development stages. The developers provided valuable feedback, including suggestions to create large menu buttons at the bottom of the screen rather than to rely on a list of menu options as a dropdown box along the side. As a result, we were able to develop a mobile app that incorporates useful information for physicians, while also being easy for patients to enter and visualize data.

We foresee tangible benefits to both patients and HCPs. For patients, an app can be beneficial by providing tools to easily track and record their disease trajectories. If successful, this system may spark greater patient engagement in self-management of RA. People with chronic diseases have been more engaged in using mobile apps in managing their diseases than people managing other aspects of their health [48]. For HCPs, an app and a population management system may be beneficial by providing a more complete picture of their patients, beyond the snapshots they currently see during scheduled clinic visits. We specifically created the combined app and population management system so that it does not create a large amount of work for busy HCPs. Instead, we maximize the use of other trained staff members (eg, population managers) and only involve HCPs when clinically significant events are identified by flare alerts. This increased reservoir of information may then serve as a catalyst for more effective patient-HCP communication. A formal cost assessment was not performed as this is a research study designed to assess feasibility and efficacy, and the costs involved in this endeavor will likely differ from actual implementation in the clinic setting.

 Barriers and Limitations

Many barriers have occurred during app development and study implementation. Specifically, beta-testing took more time than we planned, and, as a result of beta-testing, additional revisions were required. After the app was developed, regular maintenance and updates were required. These included testing and updates for new releases of the iOS and Android operating systems and cross-device and browser testing for new device and browser versions. In addition, implementation of the study was disrupted for a period of 2-6 days when surveys were not sent to participants due to disruptions in server access. These difficulties highlight the importance of ensuring that timelines include appropriate consideration for beta-testing, and budgets include appropriate resources for support and maintenance activities.

A major limitation is that this system is not integrated with the existing electronic medical record (EMR). Although we originally sought to integrate this system, multiple factors intervened. Specifically, the hospital system changed EMRs during the planning phase of this study. Thus, the institution’s information technology priorities were focused on the clinical implementation of the new EMR, not on research endeavors. In addition, as a result of the transition in EMRs, HCPs were required to complete multiple training sessions and change their workflow to accommodate the new EMR. As a result, additional meetings with HCPs to discuss the best strategies for integration into the EMR were not possible at this time. The ability to translate this pilot study to a large-scale clinical implementation will depend on integration with the EMR. Although technically possible, integration with the EMR will require much negotiation with hospital administration and HCP groups, as well as an appropriate budget to fund the processes to support this integration.

In addition, we expect a fair amount of missing data from the app due to varying engagement from participants. However, our primary objective is not to use these data in statistical analyses; rather, our intention is that these data be useful to patients in monitoring and understanding their disease. Even if patients do not enter 50% of the data, they will still, on average, have at least 1 data point for disease activity per week and at least 1 data point for each of the other symptoms every 2 weeks. These data, in themselves, can be helpful and are more than is normally obtained without the aid of a disease activity and/or symptom tracker. We will also analyze the completion rates of daily surveys as proxies for patient engagement and overall feasibility.

Other limitations include the following: (1) the possibility of a ceiling effect if most participants have low disease activity and score well on the primary outcome measures, even at baseline; (2) the study being available only to English speakers, as not all of the surveys have been validated in other languages; and (3) limited generalizability, as we are only enrolling individuals who own a mobile device and, therefore, are likely receptive to mobile technology. In a study of 9183 participants in the Arthritis Internet Registry, older age and lower income were significantly associated with lower rates of mobile phone ownership [20]. However, recent studies suggest that mobile phone ownership is growing at a rapid rate, even among individuals over 50 years. On the basis of a 2016 report by the Pew Research Center, 74% of individuals between 50 and 64 years of age now own a mobile phone, a number which is up from approximately 50% in 2013 [49,50]. Similarly, mobile phone ownership in low-income households (<US $30,000/year) now exceeds 50% and continues to rise [51].

 Conclusions

The successful implementation of a mobile device and population management system may help integrate patient-reported data into the workflow of a busy clinical practice. We expect this model to be easily adaptable to other rheumatic conditions, as well as nonrheumatic chronic illnesses. The PROMIS questionnaires used in this study were specifically developed to be relevant across different conditions for the assessment of symptoms and functions, and we anticipate that a mobile app combined with a population management system will have broad applicability in helping patients better understand their disease, improving patient-HCP communication and, ultimately, improving disease management and overall satisfaction in their care.

 Multimedia Appendix 1

Physician exit form.

 Multimedia Appendix 2

Physician study visit follow-up questions.

 Abbreviations CDAI

Clinical Disease Activity Index

 DMARD

disease-modifying antirheumatic drug

 EMR

electronic medical record

 HCP

health care provider

 PEPPI

Perceived Efficacy in Patient-Physician Interactions

 PROMIS

Patient-Reported Outcomes Measurement Information System

 RA

rheumatoid arthritis

 RADAI-5

Rheumatoid Arthritis Disease Activity Index-5

 RCT

randomized controlled trial

 TSQM

Treatment Satisfaction Questionnaire for Medication

The authors would like to thank the Brigham Digital Innovation Hub for supporting the implementation of this project. The authors would also like to acknowledge the contributions of Alyssa Wohlfahrt, Cassandra Corrigan, Jessica Darfoor, Joshua Colls, Gabrielle Cremone, Ethan Lam, and Kathleen Vanni who assisted in the recruitment of participants for this study.

This project was funded by an Independent Grant for Learning and Change from Pfizer, Inc. YLC has stock in Express Scripts. ABL is a Senior Advisor for Ranked Health, a nonprofit organization that evaluates digital health apps.

 Tanaka Y Current concepts in the management of rheumatoid arthritis Korean J Intern Med 2016 03 31 2 210 8 10.3904/kjim.2015.137 26932398 kjim-2015-137 PMC4773729 Bykerk VP Shadick N Frits M Bingham CO Jeffery I Iannaccone C Weinblatt M Solomon DH Flares in rheumatoid arthritis: frequency and management. A report from the BRASS registry J Rheumatol 2014 02 41 2 227 34 10.3899/jrheum.121521 24334643 jrheum.121521 Hewlett S Sanderson T May J Alten R Bingham CO Cross M March L Pohl C Woodworth T Bartlett SJ 'I'm hurting, I want to kill myself': rheumatoid arthritis flare is more than a high joint count--an international patient perspective on flare where medical help is sought Rheumatology (Oxford) 2012 01 51 1 69 76 10.1093/rheumatology/keq455 21565901 keq455 Sanderson T Kirwan J Patient-reported outcomes for arthritis: time to focus on personal life impact measures? Arthritis Rheum 2009 01 15 61 1 1 3 10.1002/art.24270 19116964 Sanderson T Morris M Calnan M Richards P Hewlett S What outcomes from pharmacologic treatments are important to people with rheumatoid arthritis? Creating the basis of a patient core set Arthritis Care Res (Hoboken) 2010 05 62 5 640 6 10.1002/acr.20034 20461785 PMC2887082 Berthelot JM De Bandt M Morel J Benatig F Constantin A Gaudin P Le Loet X Maillefert JF Meyer O Pham T Saraux A Solau-Gervais E Spitz E Wendling D Fautrel B Guillemin F STPR group of French Society of Rheumatology A tool to identify recent or present rheumatoid arthritis flare from both patient and physician perspectives: the 'FLARE' instrument Ann Rheum Dis 2012 07 71 7 1110 6 10.1136/ard.2011.150656 22072015 ard.2011.150656 Bykerk VP Bingham CO Choy EH Lin D Alten R Christensen R Furst DE Hewlett S Leong A March L Woodworth T Boire G Haraoui B Hitchon C Jamal S Keystone EC Pope J Tin D Thorne JC Bartlett SJ Identifying flares in rheumatoid arthritis: reliability and construct validation of the OMERACT RA Flare Core Domain Set RMD Open 2016 2 1 e000225 10.1136/rmdopen-2015-000225 27252895 rmdopen-2015-000225 PMC4885442 Fautrel B Morel J Berthelot JM Constantin A De Bandt M Gaudin P Maillefert JF Meyer O Pham T Saraux A Solau-Gervais E Vittecoq O Wendling D Erpelding ML Guillemin F STPR Group of the French Society of Rheumatology Validation of FLARE-RA, a self-administered tool to detect recent or current rheumatoid arthritis flare Arthritis Rheumatol 2017 02 69 2 309 319 10.1002/art.39850 27636400 Krebs P Duncan DT Health app use among US mobile phone owners: a national survey JMIR Mhealth Uhealth 2015 3 4 e101 10.2196/mhealth.4924 26537656 v3i4e101 PMC4704953 Smith A Pew Research Center 2015 U.S. Smartphone Use in 2015 http://www.pewinternet.org/files/2015/03/PI_Smartphones_0401151.pdf Singh K Drouin K Newmark LP Filkins M Silvers E Bain PA Zulman DM Lee JH Rozenblum R Pabo E Landman A Klinger EV Bates DW Patient-Facing Mobile Apps to Treat High-Need, High-Cost Populations: A Scoping Review JMIR Mhealth Uhealth 2016 12 19 4 4 e136 10.2196/mhealth.6445 27993761 v4i4e136 PMC5206484 Nishiguchi S Ito H Yamada M Yoshitomi H Furu M Ito T Shinohara A Ura T Okamoto K Aoyama T Tsuboyama T Self-assessment of rheumatoid arthritis disease activity using a smartphone application. Development and 3-month feasibility study Methods Inf Med 2016 55 1 65 9 10.3414/ME14-01-0106 26391694 14-01-0106 Nishiguchi S Ito H Yamada M Yoshitomi H Furu M Ito T Shinohara A Ura T Okamoto K Aoyama T Self-assessment tool of disease activity of rheumatoid arthritis by using a smartphone application Telemed J E Health 2014 03 20 3 235 40 10.1089/tmj.2013.0162 24404820 Ramirez V Todd J Nerdwallet 2016 2018-03-03 Top mobile-friendly U.S. Cities https://www.nerdwallet.com/blog/utilities/top-mobile-friendly-cities-2016/ Leeb BF Haindl PM Maktari A Nothnagl T Rintelen B Patient-centered rheumatoid arthritis disease activity assessment by a modified RADAI J Rheumatol 2008 07 35 7 1294 9 18484698 08/13/0517 Witter JP Introduction: PROMIS a first look across diseases J Clin Epidemiol 2016 05 73 87 8 10.1016/j.jclinepi.2016.02.014 26931294 S0895-4356(16)00150-5 Aletaha D Nell VP Stamm T Uffmann M Pflugbeil S Machold K Smolen JS Acute phase reactants add little to composite disease activity indices for rheumatoid arthritis: validation of a clinical activity score Arthritis Res Ther 2005 7 4 R796 806 10.1186/ar1740 15987481 ar1740 PMC1175030 Smolen JS Breedveld FC Schiff MH Kalden JR Emery P Eberl G van Riel PL Tugwell P A simplified disease activity index for rheumatoid arthritis for use in clinical practice Rheumatology (Oxford) 2003 02 42 2 244 57 12595618 Pincus T Amara I Segurado OG Bergman M Koch GG Relative efficiencies of physician/assessor global estimates and patient questionnaire measures are similar to or greater than joint counts to distinguish adalimumab from control treatments in rheumatoid arthritis clinical trials J Rheumatol 2008 02 35 2 201 5 18050378 07/13/1122 Michaud K Schumacher R Wahba K Moturu S Are rheumatic disease patient reported outcomes collected passively and directly through smart phones feasible? Early results from a nation-wide pilot study Ann Rheum Dis 2014 06 10 73 Suppl 2 455 456 10.1136/annrheumdis-2014-eular.4581 Atkinson MJ Sinha A Hass SL Colman SS Kumar RN Brod M Rowland CR Validation of a general measure of treatment satisfaction, the Treatment Satisfaction Questionnaire for Medication (TSQM), using a national panel study of chronic disease Health Qual Life Outcomes 2004 02 26 2 12 10.1186/1477-7525-2-12 14987333 1477-7525-2-12 PMC398419 Maly RC Frank JC Marshall GN DiMatteo MR Reuben DB Perceived efficacy in patient-physician interactions (PEPPI): validation of an instrument in older persons J Am Geriatr Soc 1998 07 46 7 889 94 9670878 Wolfe F Michaud K Pincus T A composite disease activity scale for clinical practice, observational studies, and clinical trials: the patient activity scale (PAS/PAS-II) J Rheumatol 2005 12 32 12 2410 5 16331773 0315162X-32-2410 Wolfe F Smythe HA Yunus MB Bennett RM Bombardier C Goldenberg DL Tugwell P Campbell SM Abeles M Clark P The American College of Rheumatology 1990 criteria for the classification of fibromyalgia. Report of the multicenter criteria committee Arthritis Rheum 1990 02 33 2 160 72 2306288 Amtmann D Cook KF Jensen MP Chen W Choi S Revicki D Cella D Rothrock N Keefe F Callahan L Lai JS Development of a PROMIS item bank to measure pain interference Pain 2010 07 150 1 173 82 10.1016/j.pain.2010.04.025 20554116 S0304-3959(10)00263-0 PMC2916053 Fries JF Cella D Rose M Krishnan E Bruce B Progress in assessing physical function in arthritis: PROMIS short forms and computerized adaptive testing J Rheumatol 2009 09 36 9 2061 6 10.3899/jrheum.090358 19738214 36/9/2061 Reeve BB Hays RD Bjorner JB Cook KF Crane PK Teresi JA Thissen D Revicki DA Weiss DJ Hambleton RK Liu H Gershon R Reise SP Lai J Cella D PROMIS Cooperative Group Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS) Med Care 2007 05 45 5 Suppl 1 S22 31 10.1097/01.mlr.0000250483.85507.04 17443115 00005650-200705001-00004 Pilkonis PA Choi SW Reise SP Stover AM Riley WT Cella D PROMIS Cooperative Group Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): depression, anxiety, and anger Assessment 2011 09 18 3 263 83 10.1177/1073191111411667 21697139 1073191111411667 PMC3153635 Buysse DJ Yu L Moul DE Germain A Stover A Dodds NE Johnston KL Shablesky-Cade MA Pilkonis PA Development and validation of patient-reported outcome measures for sleep disturbance and sleep-related impairments Sleep 2010 06 33 6 781 92 20550019 PMC2880437 Vermersch P Hobart J Dive-Pouletty C Bozzi S Hass S Coyle PK Measuring treatment satisfaction in MS: Is the Treatment Satisfaction Questionnaire for Medication fit for purpose? Mult Scler 2017 04 23 4 604 613 10.1177/1352458516657441 27364322 1352458516657441 PMC5407510 Regnault A Balp M Kulich K Viala-Danten M Validation of the Treatment Satisfaction Questionnaire for Medication in patients with cystic fibrosis J Cyst Fibros 2012 12 11 6 494 501 10.1016/j.jcf.2012.04.007 22583743 S1569-1993(12)00057-4 Liberato AC Rodrigues RC São-João TM Alexandre NM Gallani MC Satisfaction with medication in coronary disease treatment: psychometrics of the Treatment Satisfaction Questionnaire for Medication Rev Lat Am Enfermagem 2016 06 07 24 e2705 10.1590/1518-8345.0745.2705 27276018 S0104-11692016000100334 PMC4915802 Bharmal M Payne K Atkinson MJ Desrosiers M Morisky DE Gemmen E Validation of an abbreviated Treatment Satisfaction Questionnaire for Medication (TSQM-9) among patients on antihypertensive medications Health Qual Life Outcomes 2009 7 36 10.1186/1477-7525-7-36 19397800 1477-7525-7-36 PMC2678998 Delestras S Roustit M Bedouch P Minoves M Dobremez V Mazet R Lehmann A Baudrant M Allenet B Comparison between two generic questionnaires to assess satisfaction with medication in chronic diseases PLoS One 2013 8 2 e56247 10.1371/journal.pone.0056247 23437104 PONE-D-12-31215 PMC3577836 Lin HY Cheng TT Wang JH Lee CS Chen MH Lei V Lac C Gammaitoni AR Smugar SS Chen WJ Etoricoxib improves pain, function and quality of life: results of a real-world effectiveness trial Int J Rheum Dis 2010 05 13 2 144 50 10.1111/j.1756-185X.2010.01468.x 20536599 APL1468 Jobanputra P Maggs F Deeming A Carruthers D Rankin E Jordan AC Faizal A Goddard C Pugh M Bowman SJ Brailsford S Nightingale P A randomised efficacy and discontinuation study of etanercept versus adalimumab (RED SEA) for rheumatoid arthritis: a pragmatic, unblinded, non-inferiority study of first TNF inhibitor use: outcomes over 2 years Br Med J Open 2012 2 6 10.1136/bmjopen-2012-001395 23148339 bmjopen-2012-001395 PMC3532970 ten Klooster PM Oostveen JC Zandbelt LC Taal E Drossaert CH Harmsen EJ van de Laar MA Further validation of the 5-item Perceived Efficacy in Patient-Physician Interactions (PEPPI-5) scale in patients with osteoarthritis Patient Educ Couns 2012 04 87 1 125 30 10.1016/j.pec.2011.07.017 21889864 S0738-3991(11)00384-3 Zhao H Luo W Maly RC Liu J Lee J Cui Y Validation of the Chinese version 10-item Perceived Efficacy in Patient-Physician Interactions scale in patients with osteoarthritis Patient Prefer Adherence 2016 10 2189 2195 10.2147/PPA.S110883 27822020 ppa-10-2189 PMC5094620 Eyles JP Hunter DJ Meneses SR Collins NJ Dobson F Lucas BR Mills K Instruments assessing attitudes toward or capability regarding self-management of osteoarthritis: a systematic review of measurement properties Osteoarthritis Cartilage 2017 25 8 1210 22 28263899 Gossec L Cantagrel A Soubrier M Berthelot JM Joubert JM Combe B Czarlewski W Wendling D Dernis E Grange L Beauvais C An e-health interactive self-assessment website (Sanoia®) in rheumatoid arthritis A 12-month randomized controlled trial in 320 patients. Joint Bone Spine Dec 2017 29246532 Smith A Wall Street Journal 2013 Smartphone Ownership - 2013 Update https://www.wsj.com/articles/how-apps-can-help-manage-chronic-diseases-1498443120 Regnault A Balp MM Kulich K Viala-Danten M Validation of the Treatment Satisfaction Questionnaire for Medication in patients with cystic fibrosis J Cyst Fibros 2012 12 11 6 494 501 10.1016/j.jcf.2012.04.007 22583743 S1569-1993(12)00057-4 Hanson KA Agashivala N Stringer SM Balantac Z Brandes DW A cross-sectional survey of patient satisfaction and subjective experiences of treatment with fingolimod Patient Prefer Adherence 2013 04 16 7 309 18 23620662 Ward MM Guthrie LC Alba MI Clinically important changes in individual and composite measures of rheumatoid arthritis activity: thresholds applicable in clinical trials Ann Rheum Dis 2015 09 74 9 1691 6 24794149 Curtis JR Yang S Chen L Pope JE Keystone EC Haraoui B Boire G Thorne JC Tin D Hitchon CA Bingham 3rd CO Bykerk VP Determining the minimally important difference in the clinical disease activity index for improvement and worsening in early rheumatoid arthritis patients Arthritis Care Res (Hoboken) 2015 10 67 10 1345 53 10.1002/acr.22606 25988705 PMC4580563 Agarwal S LeFevre AE Lee J L'Engle K Mehl G Sinha C Labrique A Guidelines for reporting of health interventions using mobile phones: mobile health (mHealth) evidence reporting and assessment (mERA) checklist Br Med J 2016 352 i1174 26988021 Grainger R Townsley H White B Langlotz T Taylor WJ Apps for people with rheumatoid arthritis to monitor their disease activity: a review of apps for best practice and quality JMIR Mhealth Uhealth 2017 02 21 5 2 e7 10.2196/mhealth.6956 28223263 v5i2e7 PMC5340922 Landro L WSJ 2017 2018-01-14 How Apps Can Help Manage Chronic Diseases https://www.wsj.com/articles/how-apps-can-help-manage-chronic-diseases-1498443120 Pewinternet 2017-08-15 Mobile Fact Sheet http://www.pewinternet.org/fact-sheet/social-media/ Deloitte 2014 The smartphone generation gap: over-55? There’s no app for that https://www2.deloitte.com/content/dam/Deloitte/au/Documents/technology-media-telecommunications/deloitte-au-tmt-smartphone-generation-gap-011014.pdf Anderson M Pewinternet 2015 The Demographics of Device Ownership http://www.pewinternet.org/2015/10/29/the-demographics-of-device-ownership/