This paper is in the following e-collection/theme issue:

RCTs - Protocols/Proposals (funded, already peer-reviewed, eHealth) (351) Chronic Conditions (253) Mobile Health (mhealth) (2883) mHealth for Symptom and Disease Monitoring, Chronic Disease Management (1379) Aging with Chronic Disease (101) Mobile Devices and Apps for Seniors and Healthy Aging (159) Consumer & Patient Education and Shared-Decision Making (664) Clinical Information and Decision Making (1371) Geroinformatics and Electronic Clinical Information/Decision Making in Geriatrics (19)

Published on in Vol 11, No 5 (2022): May

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/37522, first published .
Using Smart Displays to Implement an eHealth System for Older Adults With Multiple Chronic Conditions: Protocol for a Randomized Controlled Trial

Using Smart Displays to Implement an eHealth System for Older Adults With Multiple Chronic Conditions: Protocol for a Randomized Controlled Trial

Using Smart Displays to Implement an eHealth System for Older Adults With Multiple Chronic Conditions: Protocol for a Randomized Controlled Trial

Authors of this article:

David H Gustafson1, 2 Author Orcid Image ;   Marie-Louise Mares3 Author Orcid Image ;   Darcie C Johnston1 Author Orcid Image ;   Gina Landucci1 Author Orcid Image ;   Klaren Pe-Romashko1 Author Orcid Image ;   Olivia J Vjorn1 Author Orcid Image ;   Yaxin Hu4 Author Orcid Image ;   David H Gustafson1 Author Orcid Image ;   Adam Maus1 Author Orcid Image ;   Jane E Mahoney5 Author Orcid Image ;   Bilge Mutlu4 Author Orcid Image
Article Authors Cited by (2) Tweetations (4) Metrics

    Protocol

    1Center for Health Enhancement Systems Studies, University of Wisconsin–Madison, Madison, WI, United States

    2Department of Industrial and Systems Engineering, University of Wisconsin–Madison, Madison, WI, United States

    3Department of Communication Arts, University of Wisconsin–Madison, Madison, WI, United States

    4Department of Computer Sciences, University of Wisconsin–Madison, Madison, WI, United States

    5Department of Medicine, School of Medicine and Public Health, University of Wisconsin, Madison, WI, United States

    Corresponding Author:

    Darcie C Johnston, MLIS

    Center for Health Enhancement Systems Studies

    University of Wisconsin–Madison

    Mechanical Engineering Bldg, 4th Fl.

    1513 University Ave

    Madison, WI, 53706

    United States

    Phone: 1 608 890 2615

    Email: dcjohnston@wisc.edu


    Background: Voice-controlled smart speakers and displays have a unique but unproven potential for delivering eHealth interventions. Many laptop- and smartphone-based interventions have been shown to improve multiple outcomes, but voice-controlled platforms have not been tested in large-scale rigorous trials. Older adults with multiple chronic health conditions, who need tools to help with their daily management, may be especially good candidates for interventions on voice-controlled devices because these patients often have physical limitations, such as tremors or vision problems, that make the use of laptops and smartphones challenging.

    Objective: The aim of this study is to assess whether participants using an evidence-based intervention (ElderTree) on a smart display will experience decreased pain interference and improved quality of life and related measures in comparison with participants using ElderTree on a laptop and control participants who are given no device or access to ElderTree.

    Methods: A total of 291 adults aged ≥60 years with chronic pain and ≥3 additional chronic conditions will be recruited from primary care clinics and community organizations and randomized 1:1:1 to ElderTree access on a smart display along with their usual care, ElderTree access on a touch screen laptop along with usual care, or usual care alone. All patients will be followed for 8 months. The primary outcomes are differences between groups in measures of pain interference and psychosocial quality of life. The secondary outcomes are between-group differences in system use at 8 months, physical quality of life, pain intensity, hospital readmissions, communication with medical providers, health distress, well-being, loneliness, and irritability. We will also examine mediators and moderators of the effects of ElderTree on both platforms. At baseline, 4 months, and 8 months, patients will complete written surveys comprising validated scales selected for good psychometric properties with similar populations. ElderTree use data will be collected continuously in system logs. We will use linear mixed-effects models to evaluate outcomes over time, with treatment condition and time acting as between-participant factors. Separate analyses will be conducted for each outcome.

    Results: Recruitment began in August 2021 and will run through April 2023. The intervention period will end in December 2023. The findings will be disseminated via peer-reviewed publications.

    Conclusions: To our knowledge, this is the first study with a large sample and long time frame to examine whether a voice-controlled smart device can perform as well as or better than a laptop in implementing a health intervention for older patients with multiple chronic health conditions. As patients with multiple conditions are such a large cohort, the implications for cost as well as patient well-being are significant. Making the best use of current and developing technologies is a critical part of this effort.

    Trial Registration: ClinicalTrials.gov NCT04798196; https://clinicaltrials.gov/ct2/show/NCT04798196

    International Registered Report Identifier (IRRID): PRR1-10.2196/37522

    JMIR Res Protoc 2022;11(5):e37522

    doi:10.2196/37522

    Keywords

    eHealth; aged; geriatrics; multiple chronic conditions; chronic pain; smart displays; smart speakers; quality of life; primary care; health expenditures; mobile phone 


    Background

    The central question of this project concerns the effectiveness of different media platforms in delivering an eHealth intervention for older adults with multiple chronic conditions (MCCs), including pain. Thus far, eHealth interventions for chronic conditions have generally been delivered through computer websites or smartphone apps. It is unknown whether such interventions could be even more effective for older adults if delivered on emerging smart speakers and display platforms.

    Smart speakers, such as Amazon Echo, are voice-controlled devices connected to the internet. Users talk to the device and listen to the results rather than typing and reading. Smart displays, such as Google Nest Hub, offer the same voice interactivity but add a screen to allow for viewing of videos, visual navigation of menu options, and touch selection of options. Both smart speakers and smart displays are increasingly designed to move beyond simple voice commands and responses to offer more conversational interactions via chatbots.

    Various authors have speculated about the potential of these devices to transform self-management and treatment of chronic diseases such as diabetes [1-3]. For older adults with ongoing pain, limited mobility, limited vision, or hand tremors, interacting via voice may enhance accessibility. In theory, users could ask questions and have answers immediately spoken back to them. They could hear and respond to messages, request audio services such as guided meditation, record health data, and more just by talking or simple taps on the screen. At the same time, the chatbot interactivity could potentially enhance feelings of relationship and support offered by the device and by the specific eHealth intervention on the device. When asked to predict the near future of voice-activated devices in health care, a Delphi panel of 35 physicians, academics, and information technology specialists predicted that such devices would show notable gains in acceptance and use, particularly among older patients, because of their simplicity of use [4].

    Indeed, media reports indicate increasing use of speakers among older adults and people with vision loss, tremors, lack of mobility, and dementia [5-9]. Thus far, a handful of studies, primarily conducted with samples of ≤20, suggest that older adults given smart devices generally report liking them, using them mostly for music and simple information requests such as the weather [10-15]. In a study of 12 older adults given a smart display for 16 weeks, the participants reported finding the device easier to use than a computer [12]. However, they also reported forgetting how to wake up the device, control the volume, or turn it off when it was activated unexpectedly, and device log data showed that one-third of attempted interactions were unsuccessful because the device did not understand the request. However, over time, users showed an increasing ability to rephrase unsuccessful requests, and transcriptions of interactions suggested companionable exchanges between the user and the device.

    Thus far, only a couple of pilot studies have focused on health-related uses of smart speakers. In one, 58 patients with chronic conditions were given an Amazon Alexa device for 2 months, and a number of them reported using it to remind them to take their medications and to record when they had done so [16]. In a very similar study, 44 adults aged 50 to 90 years with chronic conditions were given Amazon’s Echo Show for 2 months [17]. They too reported using the device for medication and appointment reminders, with additional anecdotes of using it to find recipes tailored to dietary requirements, medication information, exercise videos, guided meditation, or soothing sounds to help with falling asleep. An unspecified subset of users felt that their health and quality of life had improved over the 2 months as a result of the device. Neither study involved a comparison group, reported on actual log data rather than self-reports of use, or systematically assessed health outcomes.

    Given these promising small-scale findings, rigorous research seems warranted to examine whether smart displays can facilitate the self-management of chronic conditions. Chronic conditions are prevalent among older adults. Approximately two-thirds of Medicare beneficiaries have ≥3 ongoing conditions such as diabetes or arthritis, and nearly one-fourth have ≥5 [18,19]. The complexity of patients’ comorbidities makes them challenging to serve well in primary care, where time pressures and patient loads necessitate a focus on medication and laboratory results rather than well-being and skills for self-management, treatment adherence, and health tracking [20]. Patients with MCCs are also the most expensive, accounting for 90% of Medicare spending [18]. Most important for the individual patient, having multiple conditions is associated with reductions in physical and psychosocial quality of life [21-23] and increased risk of chronic pain [24].

    Chronic pain, generally defined as pain lasting ≥3 months, is reciprocally intertwined with a number of variables [25] such as anxiety and depression [26,27], sleep [28], and daily functioning [29]. Chronic pain also intersects with issues of social justice; a recent review noted that those with lower socioeconomic status are more likely to report chronic pain, more severe pain, and more pain-related disability [24]. Various meta-analyses have indicated ongoing racial disparities, such that African Americans and other patients of color tend to be undertreated for pain [30,31]. Increased self-management of chronic pain is a national objective established by the US Department of Health and Human Services in Healthy People 2030 for the next decade [32], and there is evidence that internet-based interventions can improve pain-related outcomes [33-35]. However, no research thus far has examined self-management interventions for chronic pain within the context of MCCs. Furthermore, there is no research on the relative effectiveness of different platforms for delivering such an intervention for this complex patient population.

    Need for a Trial

    Large-scale, long-term trials of the effectiveness of delivery platforms may help advance the objective outlined in Healthy People 2030. This paper reports on the study design and methods of a randomized controlled trial of the effectiveness of an evidence-based eHealth intervention for older adults with MCCs, including pain, when delivered on a smart display versus a laptop platform.

    The system, ElderTree, was developed by our Agency for Healthcare Research and Quality Center of Excellence in Active Aging to improve quality of life and socioemotional outcomes among older adults and was first tested in a randomized controlled trial involving 390 older adults who were followed for 12 months. In that intention-to-treat trial, patients in the ElderTree group who had had ≥3 primary care visits in the 6 months before baseline showed significantly better results on measures of mental quality of life, social support, and depression compared with control patients who had received a laptop but no ElderTree access [36].

    Given that primary care use is relatively high among patients with MCCs, the results suggest that ElderTree may most benefit such patients and may be most effective if integrated into primary care. A subsequent randomized controlled trial, funded by the National Heart, Lung and Blood Institute, is currently testing ElderTree among patients with MCCs, with an added report to primary care clinicians documenting changes in health status. That ongoing trial is testing whether patients assigned to a laptop-based ElderTree versus an attention control will have better quality of life, fewer symptoms, and better condition-specific laboratory scores [37].

    The trial described in this protocol is designed to test whether the delivery platform of the intervention affects its effectiveness. Specifically, the study aims to assess whether participants using ElderTree on a smart display will experience decreased pain interference and improved quality of life and related measures in comparison with participants using ElderTree on a laptop and control participants given no device or access to ElderTree.


    Trial Design

    The trial has a randomized controlled design with 3 groups with 1:1:1 allocation. Participants will be randomized to receive (1) a smart display plus internet access plus ElderTree along with their usual care, (2) a touch screen laptop plus internet access plus ElderTree along with their usual care, or (3) usual care alone. All participants will be followed for 8 months.

    Sample Size and Study Setting

    A total of 291 older adults will be recruited from the University of Wisconsin–Madison Department of Family Medicine and General Internal Medicine system (UW Health), Access Community Health Centers, and community organizations in the Madison and Beloit, Wisconsin, areas.

    Intervention Groups

    Control

    Participants in the control arm will continue with their usual care and receive no device or intervention from the study.

    ElderTree on a Smart Display Platform

    In addition to continuing with their usual care, participants in the ElderTree on a smart display platform (ET-SD) arm will receive access to ElderTree for 8 months plus a Google Nest Hub Max smart device and internet access. The device consists of a voice-activated smart speaker and a 10-inch visual display that is optionally touch-activated.

    ElderTree on a Laptop Platform

    In addition to continuing their usual care, participants in the ElderTree on a laptop platform (ET-LT) arm will receive access to ElderTree for 8 months plus a touch screen laptop computer and internet access.

    Eligibility Criteria

    Eligible participants will (1) be aged ≥60 years and (2) have chronic pain as indicated by having received a chronic pain diagnosis or reporting pain on some or most days that has lasted for ≥12 weeks (duration); reporting pain in the last 3 months on some, most, or all days (frequency); and reporting a pain intensity of ≥3 on a scale of 0 (no pain) to 10 (worst imaginable pain) in the last 7 days. They will also (3) have at least 3 of the most prevalent chronic conditions among older adults as reported by the Centers for Medicare and Medicaid Services [18]: chronic obstructive pulmonary disease, asthma, diabetes, hyperlipidemia, hypertension, ischemic heart disease, atrial fibrillation, heart failure, stroke, cancer, chronic kidney disease, depression, osteoporosis, and arthritis; we have modified the list by adding obesity (BMI≥30) and dizziness, falls, and loss of vestibular function. In addition, patients (4) will allow reports to their primary care provider about their health tracking and (5) should have no plans to leave during the study period. Patients are not eligible if they require an interpreter or if they have a medical diagnosis of Alzheimer disease, dementia, schizophrenia or other psychotic disorder, autism spectrum disorder, known terminal illness with <6 months to live, or an acute medical problem requiring immediate hospitalization.

    Recruitment

    For UW Health recruitment, the university’s Clinical and Health Informatics Institute will use clinic records to identify patients meeting the aforementioned eligibility criteria and send their name, address, birthdate, age, UW Health clinic location, and primary care physician to the university’s Office of Clinical Trials via REDCap (Research Electronic Data Capture; Vanderbilt University). Potential participants will receive an opt-in letter describing the study and consent form from the Office of Clinical Trials plus a stamped return letter inviting contact from the study team.

    We will supplement recruitment at UW Health with community efforts to increase the racial diversity of our patient population. The selection of and engagement with community organizations will be led by a senior advisor on our team with extensive experience in local health campaigns and deep roots in the local African American health care and patient communities. Through collaborations with the African American Health Network, Rebalanced-Life Wellness Association, African American Opioid Coalition, and the Community-Academic Aging Research Network, we will reach out to Black churches, community centers, fraternity and sorority health service programs, and other organizations as selected by our advisor in the Madison and Beloit areas of Wisconsin. We will distribute a recruitment flyer and consent form with a return card or opt-in and conduct video chat and in-person community sessions when possible to introduce the study and invite participation.

    Through Access Community Health Centers, we expect to reach a larger number of African Americans and other participants of color as well as expand our reach to underserved patients. We will work directly with Access Centers staff to disseminate the recruitment flyer, consent form, and return card or opt-in to potential patients.

    Regardless of the recruitment method, when a return card or opt-in is received, study staff will call and assess eligibility; provide a study overview that includes potential benefits and risks, study procedures, and compensation; thoroughly walk through informed consent; and address questions. The baseline survey will be mailed. Patients will be given adequate time to decide whether to participate and, in some cases, a follow-up phone call will be scheduled after the patient has had time to review the survey and consent form.

    Once a patient verbally confirms that they want to participate, a home visit will be scheduled to collect the baseline survey, randomize, set up the equipment, and train. All study staff who conduct home visits will be fully vaccinated against COVID-19, wear face masks, and socially distance as much as possible while in the patient’s home. If no visit is desired, the equipment will be shipped once the study staff receives the completed baseline survey via mail, and technology setup and training will be conducted by phone. The baseline survey should take 20 to 30 minutes. The measures will be the same in all 3 arms to avoid differential dropout. We will document those who choose not to participate and why following the CONSORT (Consolidated Standards of Reporting Trials) guidelines.

    Randomization

    Once informed consent and the baseline survey have been obtained from patients, the project manager will use a computer-generated allocation sequence to randomize on a 1:1:1 ratio to the ET-SD, ET-LT, or control group stratified by sex (male or female), site (UW Health, Access Centers, or the community), and number of chronic conditions (≤5 or ≥6). A research staff member will then conduct equipment setup and training for patients based on group assignment, which is provided in a sealed opaque envelope. Obviously, once an assignment is made and a device has been set up, participants cannot be blinded to their condition. To set up participants on their assigned system (ET-SD or ET-LT), the researcher conducting the training cannot be blinded to the condition after assignment. Figure 1 shows the flow of participants during the trial.

    ‎
    Figure 1. CONSORT (Consolidated Standards of Reporting Trials) flow diagram.
    View this figure

    Timeline

    Textbox 1 shows the timeline by year of the study, with year 1 beginning in August 2020 and year 5 ending in July 2025.

    Timeline of project activities.

    Timeline and activities

    • Year 1, months 1 to 9: pilot-test smart display and complete development, develop content plan for laptop and smart display, prepare and finalize study and data collection materials
    • Year 1, months 6 to 9: data quality monitor plan
    • Year 1, months 7 to 9: receive institutional review board approvals, train research staff
    • Year 1, month 7, to year 4, month 5: create and refresh content
    • Year 2, month 1, to year 3, month 9: recruit, pretest, and randomize patients
    • Year 2, month 1, to year 4, month 5: collect quantitative and qualitative data
    • Year 2, month 9, to year 4, month 12: clean and prepare data
    • Year 2, month 9, to year 5, month 12: analyze results
    • Year 3, month 12, to year 5, month 12: publish
    Textbox 1. Timeline of project activities.

    Intervention

    Background

    For more than 30 years, our center has been developing and testing an evolving suite of eHealth systems collectively known as the Comprehensive Health Enhancement Support System (CHESS). ElderTree is one of these systems. All CHESS systems are built on principles of continuing care and self-management: long duration [38]; assertive outreach [39]; tracking [40]; prompts [41]; action planning [42]; problem solving and self-tailoring [43]; peer, family, and clinical support [44]; and care coordination [45]. In randomized trials, CHESS systems have significantly improved asthma control [46]; quality of life and cost of care in patients with HIV [47]; quality of life and self-efficacy in patients with breast cancer, including older women [48], compared with control [49] and internet [50] groups; risky drinking [51]; and caregiver burden, symptom distress, and median length of survival in patients with lung cancer [52].

    System Overview

    ElderTree is designed for older adults and with their input to offer tools, motivation, and social support for helping patients manage chronic pain and other chronic conditions. As reported in previous and ongoing studies of ElderTree [36,37], the laptop system is a members-only website free of advertisements with design features based on older users’ feedback as well as best practices for older populations, such as larger fonts, fewer options, and uncluttered screens for better comprehension, navigation, and usability [53]. The newly developed ET-SD version adheres to the same principles of effective interventions and system design (eg, uncluttered screens and fewer options) for older adults. Both systems substantially replicate ElderTree as described in our ongoing study comparing ET-LT with an attention control [37], with modifications and enhancements to focus on chronic pain and align with the technical capabilities of the smart platform.

    Theoretical Foundation

    ElderTree and other CHESS systems are consistent with self-determination theory, which asserts that satisfying 3 basic psychological needs contributes to adaptive functioning: competence (feeling effective, not overwhelmed), social relatedness (feeling connected to others, not isolated), and intrinsic motivation (feeling autonomous, not coerced) [54].

    Interface and Features

    The key features of the site and how they align with self-determination theory are described in Table 1.

    Table 1. Key features and theoretical basis of the ElderTree eHealth intervention.
    Feature or functionDescriptionSelf-determination theory construct
    Living Well with Chronic Pain courseEight 20-minute learning modules with the latest findings on pain and evidence-based coping strategiesHealth-related coping competence; motivation
    Health library and wellness activitiesRelaxation, meditation, physical exercise (eg, chair yoga), activity, and informational videos in relevant topic areasHealth-related coping competence; motivation
    Weekly survey and clinician reportTracking of self-reported general health measures (eg, sleep, mood, and exercise), graphed over time available for patients and their primary care cliniciansHealth-related coping competence; motivation
    Discussion groups (all)Monitored support and chat forums [55,56]Social relatedness and support
    Chronic pain discussion groupParticipants’ shared tips, experiences, and resources for managing chronic pain [57]Health-related coping competence; social relatedness and support; motivation
    JournalInteractive function with prompts based on positive psychology principles [58]Health-related coping competence; motivation
    Thought of the dayDaily motivational and inspirational promptsMotivation
    Comment functionalityPosting function to promote engagement and relationship building on all information and activity pagesSocial relatedness and support
    Notifications and remindersCustom reminders to take the weekly survey of health indicators; email and system notifications of responses to the user’s postsHealth-related coping competence

    Outcomes and Variables

    Primary Outcomes

    Figure 2 illustrates the study logic. Our primary outcome is the differences between patients in the ET-SD arm, patients in the ET-LT arm, and control patients in pain interference and psychosocial quality of life.

    ‎
    Figure 2. Study logic.
    View this figure
    Secondary Outcomes

    There are several secondary outcomes. First, we will determine whether ET-SD, relative to ET-LT, increases participants’ use of the intervention at 8 months. The original trial of ElderTree found high and sustained engagement relative to reports for other health apps [36]. Nonetheless, many participants did not use it extensively, a problem shared by all digital apps [59-62]. Thus, overcoming barriers to sustained, in-depth use is a critical challenge. This study is designed to investigate whether the voice-controlled interface, relative to the laptop, increases adoption and sustains the use of the intervention, thereby improving its effects on quality of life and health outcomes.

    Outcomes also include differences between all 3 groups on measures of physical quality of life, well-being, communication with health care providers, pain intensity and duration, 30-day hospital readmission rates, health distress, loneliness, and irritability. In addition, we will compare ET-LT with the control group, given the unique focus on chronic pain in this study.

    Exploratory Questions

    We will measure the level of use of each ElderTree feature in both platforms and assess use differences between the 2 ElderTree arms as well as participants’ perceptions of the intervention. Differences between the ET-SD, ET-LT, and control groups on alcohol use, smoking, and falls will also be explored.

    Mediation

    For the 2 ElderTree arms, we will investigate whether the effects of study arm on changes from baseline to end point in primary and secondary outcomes are mediated by use of the intervention at the 4-month midpoint. For all study arms, we will also investigate whether feelings of competence, social relatedness, and intrinsic motivation as well as exercise and pain anxiety mediate the effects of the arm on all outcomes.

    Moderation

    We will investigate whether the effects of study arm on changes from baseline to end point in primary and secondary outcomes are moderated. That is, analyses will test whether the benefits of smart displays (vs laptops) vary by participant sex (women will show more benefit than men), number of chronic conditions (patients with more conditions will show more benefit), and number of barriers to using technology (those with fewer barriers will show more benefit).

    Potential Covariates

    We will consider a number of covariates: age, sex, race and ethnicity, education, living arrangement, life stresses, health service use, and technology use. Of this list, those variables that significantly predict our primary outcomes and improve the overall model’s Akaike information criterion will be included in the final analysis.

    Measures

    Overview

    Table 2 lists all planned variables and their measures. Scales have been selected to have good psychometric properties with similar populations. Patient-reported measures, including modifications to validated scales, are described following the table.

    Table 2. Measures used to evaluate ElderTree on a smart display platform versus ElderTree on a laptop platform versus control.
    VariableMeasureSurvey questions, NSourcePsychometrics
    Primaryoutcomes

    		Pain interferencePROMIS-29a4Patientα range ≥.88 [63]

    		Psychosocial quality of lifePROMIS-2912Patientα range ≥.90 [64]
    Secondary outcomes

    		ElderTree use at 8 monthsNumber of log-onsN/AbElderTreeN/A

    		Physical quality of lifePROMIS-2912Patientα range ≥.90 [64]

    		Pain intensityPROMIS-293Patientα range ≥.90 [64]

    		30-day readmissionsNumber of admissions1PatientN/A

    		Health distressLorig Health Distress Scale4Patientα=.87 [65]

    		Well-beingWHOc Well-Being Index5Patientα=.93 [66]

    		LonelinessNIHd Toolbox5Patientα=.93 [67]

    		IrritabilityBrief Irritability Test5Patientα range ≥.88 [68]

    		Communication with physiciansLorig Communication with Physicians3Patientα=.89 [65]
    Exploratory questions

    		ElderTree feature useNumber of page views per featureN/AElderTreeN/A

    		ElderTree perceptionsCreated for study; Lund12Patientα=.91 [69,70]

    		Alcohol useAlcohol Use Disorders Identification Test3Patientα=.69-.91 [71]

    		SmokingNumber of cigarettes per day1PatientN/A

    		FallsNumber of falls in last 6 months2PatientN/A
    Mediator candidates

    		ElderTree use at 4 monthsNumber of page viewsN/AElderTreeN/A

    		CompetenceSelf-Efficacy for Managing Chronic Disease6Patientα=.91 [72]

    		RelatednessMcTavish Bonding Scale5Patientα=.85 [50]

    		MotivationTreatment Self-Regulation Questionnaire4Patientα=.85 [73]

    		ExerciseCreated for study4PatientN/A

    		Pain anxietyPain Catastrophizing Scale13Patientα=.87 [74]
    Moderator candidates

    		SexSex1PatientN/A

    		Chronic conditionsTotal number of conditions16PatientN/A

    		Barriers to technology useCreated for study2PatientN/A
    Potential covariates

    		DemographicsAge, sex, race and ethnicity, education, and living arrangement6PatientN/A

    		OtherLife stresses, health service use, and technology use3PatientN/A

    aPROMIS-29: Patient-Reported Outcomes Measurement Information System–29.

    bN/A: not applicable.

    cWHO: World Health Organization.

    dNIH: National Institutes of Health.

    Primary and Secondary Outcomes

    Pain interference will be assessed using 4 items from the Patient-Reported Outcomes Measurement Information System (PROMIS-29) global health measure (version 2.1) [63,64] asking how much the patients’ pain has interfered with day-to-day activities, work around the home, ability to participate in social activities, and household chores. Psychosocial quality of life will be assessed using 12 PROMIS-29 items asking about anxiety, depression, and the ability to participate in various roles and activities.

    ElderTree use at 8 months will be measured by the number of log-ons to the system. Physical quality of life will be assessed using PROMIS-29 items asking patients to rate physical functions such as ability to do chores and use stairs, fatigue, and sleep quality over the last 7 days. Pain intensity will be measured using a PROMIS-29 item on average intensity of pain in the last week and an item from Lorig on intensity of pain at its worst over the last 7 days. An additional item from Lorig will ask about the duration of pain over the last 7 days [65]. Participants will report 30-day hospital readmissions for or as a consequence of the same problem within the last 4 months. Health distress (discouragement, fear, worry, and frustration regarding health and health problems) will be measured using the Lorig Health Distress Scale [75]. Well-being in the last 7 days will be measured using 5 items from the World Health Organization Well-Being Index [66]; loneliness will be measured using 5 items from the National Institutes of Health Toolbox Social Relationship Scale, Loneliness subscale [76]; and irritability in the last 7 days will be measured using the 5-item Brief Irritability Test [68]. Finally, communication with health care providers will be assessed using the Lorig Communication with Physicians measure [75].

    Exploratory Questions

    ElderTree use data, including features used and duration of use, will be collected automatically. At baseline, 4 months, and 8 months, patients will report on alcohol use in the last 4 months with 3 consumption items from the Alcohol Use Disorders Identification Test [71] and on smoking with average number of cigarettes per day. At baseline and 8 months, falls will be assessed with 2 items asking how often the participant has fallen in the last 6 months and how many falls required medical attention. A fall is defined in the survey as “the body going to the ground without being pushed.” Finally, for the purposes of future development, participants in the 2 ElderTree groups and clinicians will be asked about their perceptions of the system.

    Mediation

    ElderTree use at 4 months will be measured as the number of page views per service. Feelings of competence will be assessed using the 6-item Self-Efficacy for Managing Chronic Disease scale, which asks about patients’ confidence in, for example, keeping “fatigue caused by your conditions from interfering with the things you want to do.” The time frame and ranking scale of the questions will be modified to align with our other ranked measures and the timing of the patient surveys [72,77]. Relatedness will be assessed with the 5-item McTavish Bonding Scale, in which patients indicate the frequency of particular types of support such as “someone you can count on to listen to you when you need to talk” [78]. Motivation will be assessed using 2 items from the autonomous subscale and 2 items from the external regulation subscale of the Treatment Self-Regulation Questionnaire (eg, “I tried to manage my health conditions because I feel pressure from others to do so”) [79]. Participants will respond to 4 items asking about the amount of aerobic, stretching and flexibility, strength, and balance exercises performed per week. For pain anxiety, patients will rank 13 items from the Pain Catastrophizing Scale [74].

    Moderation

    The patients will indicate their sex. For barriers to technology use, they will indicate the degree of difficulty they have with computers, tablets, and smart speakers as a result of poor vision, poor hearing, problems vocalizing, lack of knowledge, memory problems, and a custom other. The total number of chronic conditions will be determined by the participants responding yes or no to a list of common conditions [18] during eligibility screening and on the 4- and 8-month surveys. Each time point’s count will be used as the moderator for the effect of study arm at that time point.

    Potential Covariates

    Participants will report their age, sex, race and ethnicity, education level, and living arrangement at baseline. At baseline, 4 months, and 8 months, they will complete checklists of life stresses in the last 4 months, health services used in the last 4 months, and technology use in the last 4 months.

    Data Analysis

    Our primary outcome used to power the study is reduction in pain interference. On the basis of PROMIS validation studies with chronic pain samples, a difference of ≥3 points between study arms was considered to indicate a clinically meaningful difference [80]. The PROMIS website also provides the mean and SD of the T-score metric (mean 50, SD 10). We powered the analysis to be able to detect a 3-point difference (an effect size of d=0.30) between the control and ET-LT groups, and then the same magnitude of effect between the ET-LT and ET-SD groups (an effect size of d=0.60 for control vs ET-SD). Across 10,000 linear mixed model simulations, a postattrition N=255, we would have power of >80% to detect the study arm × time interaction. In a previous ElderTree trial, 353 (90.5%) of 390 participants completed the 6-month survey, and 310 (79.5%) of 390 completed the 12-month survey [36]. In the completed surveys, data were missing for approximately 2% of the core items. We expect similar rates in this study, or approximately 87% survey completion at 8 months. Thus, we increased the total sample size after attrition to 291 to increase the likelihood of detecting effects on the outcomes with 2 moderators: sex and number of chronic conditions.

    Data Collection Methods

    Patient Surveys

    The following patient-reported measures will be gathered via participant surveys at baseline, 4 months, and 8 months: psychosocial quality of life, physical quality of life, pain, 30-day hospital readmissions, health distress, well-being, loneliness, irritability, communication with physicians, alcohol use, smoking, falls, barriers to technology use, life stresses, health service use, technology use, competence, relatedness, motivation, exercise, and pain anxiety. At 4 and 8 months, participants will respond to the same checklist of common chronic conditions, including pain, that they answered at eligibility screening. Demographics will be gathered only at baseline. The baseline, 4-month, and 8-month surveys containing all questions posed to participants are provided in Multimedia Appendix 1.

    Surveys will be mailed to patients in all groups with a self-addressed stamped envelope and will take 20 to 30 minutes to complete. Patients will be phoned if they do not respond after 2 weeks. Patients can contact the study staff for more details if questions arise. Contact with patients can be requested by the staff if data integrity or compliance issues are detected in the ongoing data review. Survey data will be entered into REDCap. Participants in the 2 ElderTree arms will be paid US $10 to complete each of the 3 surveys (US $30 in total), and those in the control group will be paid US $30 to complete each of the 3 surveys (US $90 in total).

    ElderTree System Data

    Data from the ElderTree weekly survey will be used to assess medication adherence; falls; thinking and memory; mood; healthy meals, snacks, and drinks; physical activity; quality time with others; sleep; pain; and balance. For the ElderTree system use outcomes, keystrokes for ET-LT, voice commands for ET-SD, and time on the system will be collected continuously. Data on ElderTree use in both arms will be collected in time-stamped log files. The primary measure of use will be log-ons per week. Additional use measures will be number of ElderTree features used, pages viewed, messages posted, and weekly surveys completed.

    Qualitative Interviews

    Interviews will be conducted using prepared scripts by people unaffiliated with the study, trained and monitored by one of the co–principal investigators (MLM). Data will be gathered from 32 patients, 16 (50%) in each of the 2 ElderTree arms, balanced by clinic versus community recruitment site and by number of chronic conditions (≤5 vs ≥6). Half of each group will be interviewed at 4 months, and the other half will be interviewed at 8 months. This balances the need for insight into patient experience with the need to avoid confounding interview effects with ElderTree effects. They will be asked about insights critical to the ultimate dissemination of interventions such as ElderTree: barriers to use, technical issues that arose, whether and how ElderTree fit into their day, what could be done to make ElderTree better, reactions to the device, and whether and how ElderTree came up in appointments with their physician.

    Interviews are expected to last 30 to 60 minutes and are based on a standard set of questions, although clarification questions may vary. Potential participants will be contacted by ElderTree system messaging or by phone. All interviews will be transcribed for more detailed coding, including quantitative tagging of key concepts.

    Clinicians will encounter ElderTree only through the clinician report. We will record and analyze clinicians’ comments and questions during meetings where we introduce the study and the clinician report to the clinics, and we will ask about anticipated barriers and benefits. We will document the protocols that clinics use to receive and disseminate the report to clinicians. We will interview 5 clinicians at the end of data collection about their experiences with and perceptions of the report. Interviews are expected to last 10 to 20 minutes and are based on a standard set of questions, although clarification questions may vary.

    Retention

    We will promote retention by providing ready access to support for patients’ use of the technologies and by actively following up with patients to encourage them to return surveys. If a survey is not returned within 2 weeks, a research team member will call to check that the survey was received and encourage the patient to complete and return it in the addressed stamped envelope. The date and time of the phone call will be recorded in REDCap along with whether the researcher talked to the participant directly or left a message and any information gathered during the phone conversation. If we cannot reach the participant, another copy of the survey will be sent with a personal note asking them to complete it or call us on our toll-free number if they have questions or are no longer interested. In our study of older adults with MCCs, for which we have recently completed data collection, survey response rates were 94.7% at 6 months, 93.6% at 12 months, and 92.3% at 18 months [37].

    Data Management

    To mitigate the risk of breaches of patient confidentiality, all participants are assigned a unique code number. All contact information and survey data are housed electronically in REDCap. Survey data are double-entered by 2 different individuals to ensure accuracy. Paper-based files are stored in a locked room in locked file cabinets and can be accessed only by authorized personnel. The database administrator provides access to study data at appropriate levels for various members of the research team. Members of the research team are able to view deidentified individual and clinic-level aggregations of the variables.

    Statistical Methods

    Predictor Assumptions

    Successful randomization of participants will be tested based on sex, recruitment site (UW Health, Access Centers, and the community), and number of chronic conditions. If randomization fails for any of these variables, it will be added as a covariate in subsequent analyses. We will test to see if the nesting structure of recruitment site significantly influences our findings. If data cannot be pooled across sites, site will be addressed either by multilevel modeling or by treating recruitment site as a moderator, depending on the analyses being run.

    Outcome Assumptions

    Normality, linearity, and homoscedasticity and homogeneity of variance for the outcome data will be assessed using descriptive statistics and graphical representations. Data transformation, linear mixed models, or nonparametric tests will be used to deal with assumption failures of the outcome data.

    Missing Data

    In previous work with older adults using ElderTree, we kept the missing data on core interview items to approximately 2%; we expect similar rates in this study. In primary care, data are not likely to be missing at random; that is, the probability that data are missing relates to what the data would have been had the data been observed. We will conduct a sensitivity analysis on missing data using logistic regression to examine whether dropout at follow-up is associated with observed or assigned factors, covariates, or outcomes at baseline [81]. If missing data affect power or are significantly not missing at random, linear mixed models or multiple imputation will be used [82]. If patients drop out, we will not use any of their data beyond their withdrawal date. Data before the withdrawal date will be included in the intention-to-treat analysis.

    Effectiveness of Control Versus ET-LT Versus ET-SD

    Linear mixed-effects models, which account for dependence among successive observations for the same participant and can address incomplete data, will be used to examine the effects of study arm (ET-SD vs ET-LT vs control, a between-participant factor) on our outcomes over time. We will conduct specific treatment×time contrasts both between and within groups to test time-based effects. For binary, count, and other nonnormal data, generalized mixed-effects models will be used.

    Mediation and Moderation Effects

    Structural equation modeling will explore the effects of mediation on the relationship between study arms and our 2 primary outcomes. We anticipate that the impact of study arm on pain interference and psychological quality of life will be mediated by our theoretical constructs of competence, relatedness, and motivation; exercise; and pain anxiety at 4 months. Structural equation models involving ElderTree use will be run separately only for the ET-SD and ET-LT arms. We anticipate that sex, number of chronic conditions, and barriers to technology use will moderate the indirect paths of the mediation models.

    Impact of Interim Analyses on Type 1 Error for Whole-Sample Analysis

    Findings that are significant in the interim but not the final analyses will be treated as nonsignificant. The final analysis will examine all data over time. For analyses that address the same hypothesis, a Holm–Bonferroni correction will be applied.

    Qualitative Analysis

    For data sets of patient and physician interviews, a coding scheme of key themes will be constructed based on the research questions of perceived benefits and barriers to use and examination of the data. Each scheme will be pilot-tested, and then 2 trained coders will code an overlapping subsample of 20% of content. Once reliability is established with a minimum Krippendorff α of .80 per category, the coders will work independently to code the rest of the material.

    Ethics Approval

    This study protocol received ethical approval from the University of Wisconsin Health Sciences and Minimal Risk Research Institutional Review Board (reference 2020-0868). All amendments to the protocol have been submitted to the institutional review board and approved. This study complies with the Declaration of Helsinki and its later amendments.


    Recruitment began in August 2021 and will run through April 2023. The intervention period will end in December 2023. As of March 21, 2022, a total of 109 participants have been recruited. The findings will be disseminated via peer-reviewed publications.


    Study Overview

    To our knowledge, this is the first study to examine with a large sample and a long time frame whether a smart device can, in reality, perform as well as or better than a laptop in implementing a health intervention. To assess this, we will examine group differences in pain and quality of life measures among patients in high need of resources to help manage their chronic conditions. A 2021 systematic review of research on the use of “voice-based conversational agents for the prevention and management of chronic conditions” concluded that the field is “in its infancy” [83].

    Comparison With Prior Work

    Our center is well-positioned to pursue this question as we have an evidence-based laptop system available for adaptation and comparison. The results of our first trial of ElderTree indicated that older patients coping with multiple comorbidities were most likely to benefit from such an intervention [36], and our subsequent study is testing that hypothesis [37]. The study described in this protocol, targeting similar patients, is designed to test and compare how delivery platform affects pain and psychosocial variables that have shown improvement with the laptop version [36]. Comparing platforms with this highly challenged population may highlight more starkly the relative advantages and pitfalls of voice-controlled platforms for eHealth delivery.

    Future Directions

    Applications for voice-controlled devices are in the early stages of development. Some known limitations, such as problems with dictation and word recognition, are certain to improve. Others, including the lack of ability to review longer lists of results or read larger amounts of text, may be endemic. Still other limitations, as yet unknown and coming to light as developers stumble upon them, may or may not be resolved. Whether the advantages of the technology outweigh the disadvantages and how its unique capabilities may be optimized, if at all, are empirical questions to be explored in this and future studies.

    A specific question is whether smart devices for eHealth may be more effective depending on the health context. For example, this protocol describes an intervention targeting chronic pain. We are also in the system development stage of a trial of smart devices funded by the National Heart, Lung and Blood Institute in which the primary outcome is functional health, a variable that includes multiple physical and psychoemotional factors.

    Conclusions

    The goal of ElderTree, regardless of delivery platform, is to improve patient self-management and provide convenient, ongoing support as a means to improve health and quality of life. At the same time, and as a result, interventions such as ElderTree may help relieve some of the burden on the primary health care system. As older patients with MCCs are such a large and growing cohort, the implications for access and cost as well as patient well-being are significant. Making the best use of current and developing technologies is a critical part of this effort.

    Acknowledgments

    The authors would like to express their deep appreciation to the team's recruitment advisor, Ms Charlie Daniel. This study is funded by the Agency for Healthcare Research and Quality, US Department of Health and Human Services (grant 1R18HS026853-01A1).

    Conflicts of Interest

    DHG Sr has a small shareholder interest in CHESS Health, a corporation that develops health care technology for patients and family members struggling with addiction. This relationship is managed by DHG Sr and the Conflict of Interest Committee of the University of Wisconsin–Madison.

    ‎
    Multimedia Appendix 1

    Baseline, 4-month, and 8-month patient surveys.

    PDF File (Adobe PDF File), 913 KB
    ‎
    Multimedia Appendix 2

    Peer review from NCI-J - Healthcare Information Technology Research [HITR] Study Section, Agency for Healthcare Research and Quality (Agency for Healthcare Research and Quality, USA).

    PDF File (Adobe PDF File), 91 KB
    1. Chambers R, Beaney P. The potential of placing a digital assistant in patients' homes. Br J Gen Pract 2020 Jan;70(690):8-9 [FREE Full text] [CrossRef] [Medline]
    2. Weatherburn CJ. Potential for placing voice-activated devices to improve patient care in general practices as well as patients' homes. Br J Gen Pract 2020 Mar;70(692):111 [FREE Full text] [CrossRef] [Medline]
    3. Wei J, Dingler T, Gong E, Oldenburg B, Kostakos V. Proactive smart speakers for chronic disease management: challenges and opportunities. 2020 CHI Conference on Human Factors in Computing Systems. 2020.   URL: http:/​/www.​speechinteraction.org/​CHI2020/​papers/​Proactive%20Smart%20Speakers%20for%20Chronic%20Disease%20Management(2).​pdf [accessed 2022-02-15]
    4. Ermolina A, Tiberius V. Voice-controlled intelligent personal assistants in health care: International Delphi Study. J Med Internet Res 2021 Apr 09;23(4):e25312 [FREE Full text] [CrossRef] [Medline]
    5. Capan F. Why Amazon device is a gift for healthcare. MedMark Media. 2016.   URL: https://media.mmm-online.com/documents/188/january_2016_viewpoint_46793.pdf [accessed 2022-01-30]
    6. St John A. Amazon Echo Voice Commands Offer Big Benefits to Users with Disabilities. Consumer Reports. 2017 Jan 20.   URL: https:/​/www.​consumerreports.org/​amazon/​amazon-echo-voice-commands-offer-big-benefits-to-users-with-disabilities/​ [accessed 2022-02-15]
    7. Thompson AC. Persuading your older parents to take the smart home leap. CNET. 2017 Apr 11.   URL: https://www.cnet.com/news/how-to-have-the-tech-talk-with-your-aging-parents/ [accessed 2022-02-15]
    8. Woyke E. The octogenarians who love Amazon's Alexa. MIT Technology Review. 2017 Jun 9.   URL: https://www.technologyreview.com/s/608047/the-octogenarians-who-love-amazons-alexa/ [accessed 2022-02-15]
    9. Amazon Echo for dementia: technology for seniors. DailyCaring. 2018.   URL: https://dailycaring.com/amazon-echo-for-dementia-technology-for-seniors/ [accessed 2022-02-15]
    10. F Corbett C, M Combs E, J Wright P, L Owens O, Stringfellow I, Nguyen T, et al. Virtual home assistant use and perceptions of usefulness by older adults and support person dyads. Int J Environ Res Public Health 2021 Jan 27;18(3):1113 [FREE Full text] [CrossRef] [Medline]
    11. Edwards KJ, Jones RB, Shenton D, Page T, Maramba I, Warren A, et al. The use of smart speakers in care home residents: implementation study. J Med Internet Res 2021 Dec 20;23(12):e26767 [FREE Full text] [CrossRef] [Medline]
    12. Kim S, Choudhury A. Exploring older adults' perception and use of smart speaker-based voice assistants: a longitudinal study. Comput Hum Behav 2021 Nov;124:106914. [CrossRef]
    13. Bentley F, Luvogt C, Silverman M, Wirasinghe R, White B, Lottridge D. Understanding the long-term use of smart speaker assistants. Proc ACM Interact Mob Wearable Ubiquitous Technol 2018 Sep 18;2(3):1-24. [CrossRef]
    14. Budd B. Smart speaker use and psychological well-being among older adults. University of Cambridge, Newnham College. 2020 Nov.   URL: http://fpciw.org/wp-content/uploads/sites/15/2020/11/BB-Thesis.pdf [accessed 2022-01-30]
    15. Wallace T, Morris JT. Smart speaker usability by military service members with mTBI and PTSD. J Technol Pers Disabil 2018:127-139 [FREE Full text]
    16. Beaney P, Kalirai HS, Chambers R. “Alexa… what pills do I need to take today?”. Prescriber 2020 Jun 26;31(6):20-23. [CrossRef]
    17. Balasubramanian GV, Beaney P, Chambers R. Digital personal assistants are smart ways for assistive technology to aid the health and wellbeing of patients and carers. BMC Geriatr 2021 Nov 15;21(1):643 [FREE Full text] [CrossRef] [Medline]
    18. Chronic conditions charts. Centers for Medicare & Medicaid Services. Baltimore, MD: U.S. Centers for Medicare & Medicaid Services; 2018.   URL: https:/​/www.​cms.gov/​Research-Statistics-Data-and-Systems/​Statistics-Trends-and-Reports/​Chronic-Conditions/​Chartbook_Charts [accessed 2022-02-10]
    19. Wolff JL, Starfield B, Anderson G. Prevalence, expenditures, and complications of multiple chronic conditions in the elderly. Arch Intern Med 2002 Nov 11;162(20):2269-2276. [CrossRef] [Medline]
    20. Snoek FJ, Pouwer F, Welch GW, Polonsky WH. Diabetes-related emotional distress in Dutch and U.S. diabetic patients: cross-cultural validity of the problem areas in diabetes scale. Diabetes Care 2000 Sep;23(9):1305-1309. [CrossRef] [Medline]
    21. Burholt V, Scharf T. Poor health and loneliness in later life: the role of depressive symptoms, social resources, and rural environments. J Gerontol B Psychol Sci Soc Sci 2014 Mar;69(2):311-324 [FREE Full text] [CrossRef] [Medline]
    22. Luo Y, Hawkley LC, Waite LJ, Cacioppo JT. Loneliness, health, and mortality in old age: a national longitudinal study. Soc Sci Med 2012 Mar;74(6):907-914 [FREE Full text] [CrossRef] [Medline]
    23. Perissinotto CM, Stijacic Cenzer I, Covinsky KE. Loneliness in older persons: a predictor of functional decline and death. Arch Intern Med 2012 Jul 23;172(14):1078-1083 [FREE Full text] [CrossRef] [Medline]
    24. Mills SE, Nicolson KP, Smith BH. Chronic pain: a review of its epidemiology and associated factors in population-based studies. Br J Anaesth 2019 Aug;123(2):e273-e283 [FREE Full text] [CrossRef] [Medline]
    25. Dueñas M, Ojeda B, Salazar A, Mico JA, Failde I. A review of chronic pain impact on patients, their social environment and the health care system. J Pain Res 2016 Jun 28;9:457-467 [FREE Full text] [CrossRef] [Medline]
    26. Breivik H, Collett B, Ventafridda V, Cohen R, Gallacher D. Survey of chronic pain in Europe: prevalence, impact on daily life, and treatment. Eur J Pain 2006 May;10(4):287-333. [CrossRef] [Medline]
    27. Ohayon MM, Schatzberg AF. Chronic pain and major depressive disorder in the general population. J Psychiatr Res 2010 May;44(7):454-461. [CrossRef] [Medline]
    28. McCracken LM, Iverson GL. Disrupted sleep patterns and daily functioning in patients with chronic pain. Pain Res Manag 2002;7(2):75-79. [CrossRef] [Medline]
    29. Turk DC, Fillingim RB, Ohrbach R, Patel KV. Assessment of psychosocial and functional impact of chronic pain. J Pain 2016 Sep;17(9 Suppl):T21-T49. [CrossRef] [Medline]
    30. Lee P, Le Saux M, Siegel R, Goyal M, Chen C, Ma Y, et al. Racial and ethnic disparities in the management of acute pain in US emergency departments: meta-analysis and systematic review. Am J Emerg Med 2019 Sep;37(9):1770-1777. [CrossRef] [Medline]
    31. Lin J, Drain A, Goharzad A, Mende-Siedlecki P. What factors fuel racial bias in pain perception and treatment?: a meta-analysis across 40 experimental studies. PsyArXiv (forthcoming) 2020 Dec 4 [FREE Full text] [CrossRef]
    32. Healthy people 2030: building a healthier future for all. Office of Disease Prevention and Health Promotion (ODPHP). 2021.   URL: https://health.gov/healthypeople [accessed 2022-02-15]
    33. Arthritis pain management. Arthritis Foundation.   URL: https://www.arthritis.org/living-with-arthritis/pain-management/ [accessed 2022-02-15]
    34. Macea DD, Gajos K, Daglia Calil YA, Fregni F. The efficacy of Web-based cognitive behavioral interventions for chronic pain: a systematic review and meta-analysis. J Pain 2010 Oct;11(10):917-929. [CrossRef] [Medline]
    35. Lorig KR, Ritter PL, Laurent DD, Plant K. The Internet-based arthritis self-management program: a one-year randomized trial for patients with arthritis or fibromyalgia. Arthritis Rheum 2008 Jul 15;59(7):1009-1017 [FREE Full text] [CrossRef] [Medline]
    36. Gustafson DH, Kornfield R, Mares ML, Johnston DC, Cody OJ, Yang EF, et al. Effect of an eHealth intervention on older adults' quality of life and health-related outcomes: a randomized clinical trial. J Gen Intern Med 2022 Feb;37(3):521-530 [FREE Full text] [CrossRef] [Medline]
    37. Gustafson Sr DH, Mares ML, Johnston DC, Mahoney JE, Brown RT, Landucci G, et al. A Web-based eHealth intervention to improve the quality of life of older adults with multiple chronic conditions: protocol for a randomized controlled trial. JMIR Res Protoc 2021 Feb 19;10(2):e25175 [FREE Full text] [CrossRef] [Medline]
    38. Maisto SA, Zywiak WH, Connors GJ. Course of functioning 1 year following admission for treatment of alcohol use disorders. Addict Behav 2006 Jan;31(1):69-79. [CrossRef] [Medline]
    39. Godley MD, Godley SH, Dennis ML, Funk R, Passetti LL. Preliminary outcomes from the assertive continuing care experiment for adolescents discharged from residential treatment. J Subst Abuse Treat 2002 Jul;23(1):21-32. [CrossRef] [Medline]
    40. Scherr D, Kastner P, Kollmann A, Hallas A, Auer J, Krappinger H, MOBITEL Investigators. Effect of home-based telemonitoring using mobile phone technology on the outcome of heart failure patients after an episode of acute decompensation: randomized controlled trial. J Med Internet Res 2009 Aug 17;11(3):e34 [FREE Full text] [CrossRef] [Medline]
    41. Davis JR, Glaros AG. Relapse prevention and smoking cessation. Addict Behav 1986;11(2):105-114. [CrossRef] [Medline]
    42. van Osch L, Lechner L, Reubsaet A, Wigger S, de Vries H. Relapse prevention in a national smoking cessation contest: effects of coping planning. Br J Health Psychol 2008 Sep;13(Pt 3):525-535. [CrossRef] [Medline]
    43. Lorig KR, Holman H. Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med 2003 Aug;26(1):1-7. [CrossRef] [Medline]
    44. Shaw BR, Han JY, Hawkins RP, McTavish FM, Gustafson DH. Communicating about self and others within an online support group for women with breast cancer and subsequent outcomes. J Health Psychol 2008 Oct;13(7):930-939 [FREE Full text] [CrossRef] [Medline]
    45. Peikes D, Chen A, Schore J, Brown R. Effects of care coordination on hospitalization, quality of care, and health care expenditures among Medicare beneficiaries: 15 randomized trials. JAMA 2009 Feb 11;301(6):603-618. [CrossRef] [Medline]
    46. Gustafson D, Wise M, Bhattacharya A, Pulvermacher A, Shanovich K, Phillips B, et al. The effects of combining web-based eHealth with telephone nurse case management for pediatric asthma control: a randomized controlled trial. J Med Internet Res 2012 Jul 26;14(4):e101 [FREE Full text] [CrossRef] [Medline]
    47. Gustafson DH, Hawkins R, Boberg E, Pingree S, Serlin RE, Graziano F, et al. Impact of a patient-centered, computer-based health information/support system. Am J Prev Med 1999 Jan;16(1):1-9. [CrossRef] [Medline]
    48. Gustafson DH, McTavish F, Hawkins R, Pingree S, Arora N, Mendenhall J, et al. Computer support for elderly women with breast cancer. JAMA 1998 Oct 21;280(15):1305. [CrossRef] [Medline]
    49. Gustafson DH, Hawkins R, Pingree S, McTavish F, Arora NK, Mendenhall J, et al. Effect of computer support on younger women with breast cancer. J Gen Intern Med 2001 Jul;16(7):435-445 [FREE Full text] [CrossRef] [Medline]
    50. Gustafson DH, Hawkins R, McTavish F, Pingree S, Chen WC, Volrathongchai K, et al. Internet-based interactive support for cancer patients: are integrated systems better? J Commun 2008 Jun;58(2):238-257 [FREE Full text] [CrossRef] [Medline]
    51. Gustafson DH, McTavish FM, Chih MY, Atwood AK, Johnson RA, Boyle MG, et al. A smartphone application to support recovery from alcoholism: a randomized clinical trial. JAMA Psychiatry 2014 May;71(5):566-572 [FREE Full text] [CrossRef] [Medline]
    52. Gustafson DH, DuBenske LL, Namkoong K, Hawkins R, Chih MY, Atwood AK, et al. An eHealth system supporting palliative care for patients with non-small cell lung cancer: a randomized trial. Cancer 2013 May 01;119(9):1744-1751 [FREE Full text] [CrossRef] [Medline]
    53. Gustafson Jr DH, Maus A, Judkins J, Dinauer S, Isham A, Johnson R, et al. Using the NIATx Model to implement user-centered design of technology for older adults. JMIR Hum Factors 2016 Jan 14;3(1):e2 [FREE Full text] [CrossRef] [Medline]
    54. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol 2000 Jan;55(1):68-78. [CrossRef] [Medline]
    55. Namkoong K, Shah DV, Han JY, Kim SC, Yoo W, Fan D, et al. Expression and reception of treatment information in breast cancer support groups: how health self-efficacy moderates effects on emotional well-being. Patient Educ Couns 2010 Dec;81 Suppl:S41-S47 [FREE Full text] [CrossRef] [Medline]
    56. Han JY, Shah DV, Kim E, Namkoong K, Lee SY, Moon TJ, et al. Empathic exchanges in online cancer support groups: distinguishing message expression and reception effects. Health Commun 2011 Mar;26(2):185-197 [FREE Full text] [CrossRef] [Medline]
    57. Lorig K, Holman H, Sobel D, Laurent D, Minor M, Sobel D. Living a Healthy Life with Chronic Conditions: Self Management of Heart Disease, Arthritis, Diabetes, Asthma, Bronchitis, Emphysema and Others. 3rd edition. Boulder, CO, USA: Bull Publishing Company; 2006.
    58. Seligman ME, Csikszentmihalyi M. Positive psychology: an introduction. In: Csikszentmihalyi M, editor. Flow and the foundations of positive psychology: the collected works of Mihaly Csikszentmihalyi. Dordrecht, The Netherlands: Springer; 2014:279-298.
    59. Krebs P, Duncan DT. Health app use among US mobile phone owners: a national survey. JMIR Mhealth Uhealth 2015 Nov 04;3(4):e101 [FREE Full text] [CrossRef] [Medline]
    60. Perez S. Nearly 1 in 4 people abandon mobile apps after only one use. TechCrunch. 2016 May 31.   URL: https://techcrunch.com/2016/05/31/nearly-1-in-4-people-abandon-mobile-apps-after-only-one-use/ [accessed 2022-02-15]
    61. Team Localytics. Mobile app retention rate: what’s a good retention rate? Localytics. 2018 Mar 22.   URL: http://info.localytics.com/blog/mobile-apps-whats-a-good-retention-rate [accessed 2022-02-15]
    62. Inside Wearables Part 1: how behavior change unlocks long-term engagement. Endeavor Partners. 2014.   URL: https:/​/blog.​endeavour.partners/​inside-wearable-how-the-science-of-human-behavior-change-offers-the-secret-to-long-term-engagement-a15b3c7d4cf3 [accessed 2022-02-15]
    63. Amtmann D, Cook KF, Jensen MP, Chen WH, Choi S, Revicki D, et al. Development of a PROMIS item bank to measure pain interference. Pain 2010 Jul;150(1):173-182 [FREE Full text] [CrossRef] [Medline]
    64. Cella D, Choi SW, Condon DM, Schalet B, Hays RD, Rothrock NE, et al. PROMIS(®) adult health profiles: efficient short-form measures of seven health domains. Value Health 2019 May;22(5):537-544 [FREE Full text] [CrossRef] [Medline]
    65. Lorig K, Stewart A, Ritter P, Gonzalez V, Laurent D, Lynch J. Stanford chronic disease self-management study. In: Lorig K, Stewart A, Ritter P, Gonzalez V, Laurent D, Lynch J, editors. Outcome Measures for Health Education and Other Health Care Interventions. Thousand Oaks, CA, USA: Sage Publications; 1996:24-25.
    66. Allgaier AK, Kramer D, Saravo B, Mergl R, Fejtkova S, Hegerl U. Beside the Geriatric Depression Scale: the WHO-Five Well-being Index as a valid screening tool for depression in nursing homes. Int J Geriatr Psychiatry 2013 Nov;28(11):1197-1204. [CrossRef] [Medline]
    67. Cyranowski JM, Zill N, Bode R, Butt Z, Kelly MA, Pilkonis PA, et al. Assessing social support, companionship, and distress: National Institute of Health (NIH) Toolbox Adult Social Relationship Scales. Health Psychol 2013 Mar;32(3):293-301 [FREE Full text] [CrossRef] [Medline]
    68. Holtzman S, O'Connor BP, Barata PC, Stewart DE. The Brief Irritability Test (BITe): a measure of irritability for use among men and women. Assessment 2015 Feb;22(1):101-115 [FREE Full text] [CrossRef] [Medline]
    69. Lewis JR. Measuring perceived usability: the CSUQ, SUS, and UMUX. Int J Hum Comput Interact 2018 Jan 09;34(12):1148-1156. [CrossRef]
    70. Lund AM. Measuring usability with the USE questionnaire. Usability Interface 2001;8(2):3-6.
    71. Reinert DF, Allen JP. The alcohol use disorders identification test: an update of research findings. Alcohol Clin Exp Res 2007 Feb;31(2):185-199. [CrossRef] [Medline]
    72. Lorig KR, Sobel DS, Ritter PL, Laurent D, Hobbs M. Effect of a self-management program on patients with chronic disease. Eff Clin Pract 2001;4(6):256-262. [Medline]
    73. Neal DJ, Carey KB. A follow-up psychometric analysis of the self-regulation questionnaire. Psychol Addict Behav 2005 Dec;19(4):414-422 [FREE Full text] [CrossRef] [Medline]
    74. Sullivan MJ. The pain catastrophizing scale: user manual. Aspect Health. 2009.   URL: https://aspecthealth.ca/wp-content/uploads/2017/03/PCSManual_English1.pdf [accessed 2022-01-30]
    75. Lorig K, Stewart A, Ritter P, Gonzalez V, Lynch J, Laurent D. Outcome Measures for Health Education and Other Health Care Interventions. Thousand Oaks, CA, USA: Sage Publications; 1996.
    76. NIH toolbox social relationship scales: loneliness. National Institutes of Health (NIH), Northwestern University. 2016.   URL: http:/​/www.​healthmeasures.net/​administrator/​components/​com_instruments/​uploads/​TOOLBOX%20FF%20v2.​0%20-%20Loneliness%2018%20plus_11-17-2016.​pdf [accessed 2022-01-30]
    77. Ritter PL, Lorig K. The English and Spanish Self-Efficacy to Manage Chronic Disease Scale measures were validated using multiple studies. J Clin Epidemiol 2014 Nov;67(11):1265-1273. [CrossRef] [Medline]
    78. Namkoong K, DuBenske LL, Shaw BR, Gustafson DH, Hawkins RP, Shah DV, et al. Creating a bond between caregivers online: effect on caregivers' coping strategies. J Health Commun 2012;17(2):125-140 [FREE Full text] [CrossRef] [Medline]
    79. Levesque CS, Williams GC, Elliot D, Pickering MA, Bodenhamer B, Finley PJ. Validating the theoretical structure of the Treatment Self-Regulation Questionnaire (TSRQ) across three different health behaviors. Health Educ Res 2007 Oct;22(5):691-702. [CrossRef] [Medline]
    80. Meaningful Change for PROMIS®: estimates for the magnitude of change that corresponds to “important” change are published. HealthMeasures. 2022.   URL: https://www.healthmeasures.net/score-and-interpret/interpret-scores/promis/meaningful-change [accessed 2022-02-15]
    81. Faria R, Gomes M, Epstein D, White IR. A guide to handling missing data in cost-effectiveness analysis conducted within randomised controlled trials. Pharmacoeconomics 2014 Dec;32(12):1157-1170 [FREE Full text] [CrossRef] [Medline]
    82. White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med 2011 Feb 20;30(4):377-399. [CrossRef] [Medline]
    83. Bérubé C, Schachner T, Keller R, Fleisch E, V Wangenheim F, Barata F, et al. Voice-based conversational agents for the prevention and management of chronic and mental health conditions: systematic literature review. J Med Internet Res 2021 Mar 29;23(3):e25933 [FREE Full text] [CrossRef] [Medline]

    ‎
    CHESS: Comprehensive Health Enhancement Support System
    CONSORT: Consolidated Standards of Reporting Trials
    ET-LT: ElderTree on a laptop platform
    ET-SD: ElderTree on a smart display platform
    MCCs: multiple chronic conditions
    PROMIS-29: Patient-Reported Outcomes Measurement Information System–29
    REDCap: Research Electronic Data Capture
    UW Health: University of Wisconsin–Madison Department of Family Medicine and General Internal Medicine system

    Edited by T Leung; Externally reviewed by: NCI-J - Healthcare Information Technology Research [HITR] Study Section, Agency for Healthcare Research and Quality (Agency for Healthcare Research and Quality, USA). See the Multimedia Appendix 2 for the peer-review report; submitted 23.02.22; accepted 24.03.22; published 05.05.22

    Copyright

    ©David H Gustafson, Marie-Louise Mares, Darcie C Johnston, Gina Landucci, Klaren Pe-Romashko, Olivia J Vjorn, Yaxin Hu, David H Gustafson, Adam Maus, Jane E Mahoney, Bilge Mutlu. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 05.05.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.