Protocol
Abstract
Background: Although positive airway pressure (PAP) therapy is considered first-line treatment for obstructive sleep apnea (OSA), nonadherence is common. Numerous factors influence PAP use, including a belief that the therapy is important and effective. In theory, providing information to patients about their blood oxygen levels during sleep (which may be low when PAP is not used), juxtaposed to information about their PAP use, may influence a patient’s beliefs about therapy and increase PAP use. With the advent of consumer wearable smartwatches’ blood oxygen saturation monitoring capability (and the existing routine availability of PAP use data transmitted via modem to clinical dashboards), there is an opportunity to provide this combination of information to patients.
Objective: This study aims to test the feasibility, acceptability, and preliminary efficacy of the Chronic Care Management With Wearable Devices in Patients Prescribed Positive Airway Pressure Therapy (mPAP), a program that augments current PAP therapy data with consumer-grade wearable device to promote self-management of PAP therapy for OSA in a pilot randomized waitlist-controlled clinical trial.
Methods: This is a single-blinded randomized controlled trial. We will randomize 50 individuals with a history of OSA, who receive care from a Department of Veterans Affairs medical center in the Los Angeles area and are nonadherent to prescribed PAP therapy, into either an immediate intervention group or a waitlist control group. During a 28-day intervention, the participants will wear a study-provided consumer wearable device and complete a weekly survey about their OSA symptoms. A report that summarizes consumer wearable–provided oxygen saturation values, PAP use derived from modem data, and patient-reported OSA symptoms will be prepared weekly and shared with the patient. The immediate intervention group will begin intervention immediately after randomization (T1). Assessments will occur at week 5 (T3; 1 week after treatment for the immediate intervention group and repeat baseline for the waitlist control group) and week 11 (T5; follow-up for the immediate intervention group and 1 week after treatment for the waitlist control group). The primary outcome will be the change in 7-day PAP adherence (average minutes per night) from T1 to T3. The primary analysis will be a comparison of the primary outcome between the immediate intervention and the waitlist control groups (intention-to-treat design), using a 2-sample, 2-sided t test on change scores (unadjusted).
Results: Recruitment began in October 2023. Data analysis is expected to begin in October 2024 when all follow-ups are complete, and a manuscript summarizing trial results will be submitted following completion of data analysis.
Conclusions: Findings from the study may provide additional insights on how patients with OSA might use patient-generated health data collected by consumer wearables to inform self-management of OSA and possibly increase their use of PAP therapy.
Trial Registration: ClinicalTrials.gov NCT06039865; https://clinicaltrials.gov/study/NCT06039865
International Registered Report Identifier (IRRID): DERR1-10.2196/60769
doi:10.2196/60769
Keywords
Introduction
Background
Obstructive sleep apnea (OSA) is prevalent and affects more veterans who obtain care in Veterans Health Administration facilities than any other sleep disorder (20%) [
]. Characterized by repetitive blockage in the airway during sleep that causes breathing to stop or get very shallow and that may cause transient hypoxemia, OSA disrupts sleep and contributes to symptoms of excessive daytime sleepiness; decreased quality of life; and increased risk of health conditions such as depression, cardiovascular disease, erectile dysfunction, and dementia [ ]. OSA is also associated with work disability [ ] and increased risk of motor vehicle crashes [ ].OSA is a chronic disease that requires long-term management [
]. Positive airway pressure (PAP) devices, which deliver air under pressure into the airway to stent the airways open, are considered the gold standard treatment for OSA. The success of this treatment is quantified by hourly and nightly adherence plus changes to symptoms (eg, daytime sleepiness) and reduction in the number of times per hour airflow ceases or is reduced, as well as improvement in sleep-related oxygen levels [ , ]. Adherence to treatment can improve sleep quality, reduce the risk of OSA-related comorbidities, and improve quality of life [ ]. However, low PAP adherence is a common issue [ ].Among a number of important factors that influence whether a patient uses prescribed therapy is the belief that the therapy is important and effective [
]. Through clinical experience and a prior project that have focused on patients’ decision-making about their OSA and treatment, we found that providing information to patients about their blood oxygen levels (eg, lowest blood oxygen level) during sleep is very powerful as a tool for engaging them in their OSA management. Studies have shown that data visualizations may be associated with positive effects on decision-making due to the decreased cognitive and intellectual burden of interpreting data [ , ]. With the advent of consumer wearable smartwatches’ (hereafter smartwatch) blood oxygen saturation (SpO2) monitoring capability, there is both an opportunity and an impending need to optimize the manner in which this information is used in patients’ daily lives and in routine sleep clinic care so that the information enhances patients’ experience with care.Increased affordability and relative convenience of putting a device on the wrist to continuously collect physiological data (eg, steps and heart rate) have popularized smartwatches for everyday use. Manufacturers have also developed proprietary algorithms using data collected with various sensors to estimate sleep-related metrics such as sleep time, wake time, and sleep stages. The result is a great deal of data available to the consumer that may appear medically relevant, particularly against the backdrop of beautifully designed interfaces and eye-catching graphics. However, these watches are designed to be consumer-facing products, such that the data presented should not be used to replace clinical screening or diagnosis of sleep disorders such as OSA, even if they have features to detect signs of moderate to severe OSA [
]. While there is limited evidence to the reliability [ ] and validity [ - ] of the data for clinical purposes, there may be benefits to tracking health behaviors for self-monitoring purposes [ ].Newer models of consumer-facing smartwatches (eg, Fitbit) are providing SpO2 measurements in minute-by-minute intervals [
]. Although these wearables are not intended for medical purposes such as diagnosing OSA, they are currently used by patients for self-monitoring oxygen levels, which can drop to low levels in some patients when they are not using PAP therapy. Theoretically, patients who use their PAP therapy inconsistently may have patterns in consumer wearable data that correlate with PAP use. Given the high prevalence of OSA and the growing use of smartwatches, inevitably a subset of patients with OSA will use smartwatches for self-monitoring their oxygen levels during sleep and will present to their sleep clinicians with questions about their wearable oxygen levels. A conundrum is how best to incorporate the vast amount of sleep data from consumer technology into the chronic care management of patients with sleep disorders such as OSA.Although the PAP devices include airflow sensors that can provide physiologic data feedback [
], additional feedback about oxygen levels may influence behavior. The proposed research study will incorporate the use of a wearable collecting SpO2 data during sleep and provide a weekly report that will not only depict the physiological consequences of nonadherence as a timely behavioral reinforcement strategy, but also highlight day-to-day relationships of adherence and possible barriers (eg, lower adherence on nights of greater pain). In conjunction with PAP device data and patient-reported outcomes (eg, daytime sleepiness and alertness), the wearable data represent an opportunity to augment current strategies for increasing use of PAP therapy.The Health Beliefs Model provides a framework for incorporating wearable data (specifically oxygen saturation data) in a PAP therapy program [
]. The model suggests that the desire to get well if already ill (eg, improve OSA) and the belief that a specific health action will cure illness, together, influence health behavior (eg, use PAP for OSA), and the patient’s course of action often depends upon the patient’s perceptions of the benefits and barriers related to that health behavior (eg, PAP use). The perceptions influencing PAP use may include (1) perceived susceptibility—if levels of oxygen saturation collected during sleep are intermittently low, (2) perceived severity—if oxygen levels are lower than normal values, and (3) perceived benefits—if oxygen levels during sleep are different on days PAP used versus not used. Cues to action (eg, PAP use) may be feedback showing wearable oxygen saturation data combined with PAP use and patient-reported outcomes.The goal of the Chronic Care Management With Wearable Devices in Patients Prescribed Positive Airway Pressure Therapy (mPAP) project is to assess the impact and acceptability of augmenting current PAP therapy data with consumer-grade wearable device data to promote self-management of PAP therapy for OSA. To isolate the impact of the augmentation by the wearable device, the comparator intervention is receiving current PAP therapy data while on a waitlist to add the wearable device data.
Study Aims and Hypotheses
The specific aims and hypotheses are as follows:
- Specific aim 1: to measure the effect of the consumer grade wearable–augmented program on PAP use.
- Primary hypothesis: compared to participants in the waitlist control group, participants in the immediate intervention group will have greater improvement in PAP adherence (change in average minutes per night from baseline [T1] to posttreatment assessment [T3]).
- Secondary hypothesis: PAP adherence (average minutes per night) from delayed baseline (T4) to delayed posttreatment assessment (T5) will improve among participants in the waitlist control group after receiving the delayed wearable intervention.
- Exploratory hypotheses: the effect of the program will be maintained at T5 for the immediate intervention group.
- Specific aim 2: to assess the acceptability of the program.
Methods
Study Design
This study is a randomized parallel 2-group waitlist-controlled trial with 1:1 allocation evaluating the efficacy of a consumer wearable–augmented self-monitoring program on PAP adherence compared to a standard self-monitoring program on PAP adherence among patients with OSA prescribed PAP therapy. In addition, following the primary end point, the control group will crossover to the intervention condition and be compared to their time in the control condition (ie, single-group nonrandomized crossover design). The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) 2013 statement was used to report standard protocol items for clinical trials [
].Study Site
The study will be conducted at Veterans Affairs Greater Los Angeles Healthcare System in Los Angeles, California.
Participants: Inclusion and Exclusion Criteria
Inclusion criteria were as follows: aged ≥21 years, prescribed PAP therapy from the sleep center for >1 week, have an active profile in our Center’s ResMed AirView (ResMed) or Respironics Care Orchestrator (Philips Respironics) accounts for >1 week, willing to continue using current PAP device for 28 days continuously, nonadherent to PAP therapy (ie, not using their PAP for 4 or more hours per night on 70% of nights during a consecutive 30-day period) [
], and have a smartphone compatible with the wearable app.Exclusion criteria were as follows: conditions that may cause nocturnal hypoxemia unrelated to OSA (ie, heart failure, chronic lung disease, and home oxygen use); conditions that may limit individual’s ability to follow study procedures such as wear Fitbit, attempt to use their PAP, participate in interviews with research team, and complete web-based surveys (ie, dementia, active substance use disorder, unstable medical or psychiatric illness, concurrent participation in another clinical trial that would interfere with study procedures, planned nonuse of PAP therapy, and planned surgery or hospitalization during study period that would limit PAP use); planned extensive travel during study period; and history of repeated nonattendance at clinic visits.
provides details on how we will operationalize the exclusion criteria.Exclusion criteria
- Conditions that may cause nocturnal hypoxemia unrelated to obstructive sleep apnea
- Heart failure: heart failure diagnosis listed in the electronic health record problem list
- Chronic lung disease: lung conditions that can cause hypoxemia including asthma, chronic obstructive lung disease, and restrictive lung disease
- Home oxygen use: evidence in the electronic health record or patient report of prescription for home oxygen
- Conditions that may interfere with the protocol
- Dementia: dementia reported by patient and/or caregiver or listed in the electronic health record
- Active substance use disorder interfering with the protocol (investigator discretion)
- Unstable medical or psychiatric illness interfering with the protocol (investigator discretion)
- Planned surgery or hospitalization during study period interfering with the protocol (positive airway pressure [PAP] access or investigator discretion)
- Planned extensive travel during study period interrupting electricity, cellular and/or internet service, or the protocol (investigator discretion)
- History of repeated nonattendance at clinic visits
- Refusal to engage in any PAP therapy
- No future intention of resuming PAP use
Procedures
Recruitment and Screening
Recruitment strategies will include (1) mailing letters to patients with active modem accounts, (2) posting flyers or posters in the clinic areas and enclosing flyers with PAP equipment distributed to patients, and (3) notifying sleep center staff about the study. Participants will undergo an initial telephone screen to assess for eligibility and to collect demographic data (age, gender, race, and ethnicity). Research staff will perform a brief medical chart review to verify eligibility and OSA history (diagnosis date, severity [apnea-hypopnea index], and PAP settings [fixed vs auto]). We will verify that the patient has a PAP modem profile on the clinic’s AirView or Care Orchestrator account. The research team will meet weekly to review eligibility requirements for each individual after completing baseline assessment and 1-night oximetry to determine whether the individual is eligible for randomization in the clinical trial.
We increased the number of letters mailed each week to patients meeting the inclusion criteria to help us achieve adequate participant enrollment to reach target sample size. Another strategy used was to present this study to the Greater Los Angeles Veteran Engagement Team (CIN 13-417) in December 2023 for feedback on our recruitment strategy. The Greater Los Angeles Veteran Engagement Team is composed of a diverse team of local veterans whose mission is to partner as active stakeholders with the Greater Los Angeles research community and impart veteran-based knowledge and perspectives on research and other improvement efforts. Some of their suggestions include posting flyers in additional locations with more foot traffic.
Assessments
Baseline Assessment
Participants in both arms will undergo a baseline assessment (T1 for the immediate intervention group; T3 for the waitlist control group), where current 7-day and 30-day PAP adherence will be collected from modem data. One-night oximetry using a United States Food and Drug Administration–approved wrist-worn pulse oximeter (Nonin) will be conducted. Other measures such as determinants of PAP compliance (ie, self-efficacy, knowledge, stages of change, and decisional balance index) [
], sleep disturbance, sleep quality, daytime function, comorbidities, and health literacy will be collected through an electronic survey using the Qualtrics platform. A baseline assessment appointment with a research team member will be conducted, where the research team member will review the survey and administer any items that were unintentionally left incomplete.Follow-Up Assessment
The immediate intervention group will undergo posttreatment assessment at T3 and follow-up assessment at T5. The waitlist control group will complete the posttreatment assessment at T5. Participants will also undergo an intervention program evaluation upon completion of the intervention (either T3 or T5, depending upon group assignment). At T3 and T5, 7-day and 30-day PAP adherence data will be abstracted from modem data, regardless of whether participants wear the watch or view the reports.
Randomization
Eligible participants will be randomized to 1 of the 2 study arms: an immediate intervention and waitlist control, using a 1:1 ratio. Randomization will be performed using a random permuted block design with varying block size generated by the study statistician. Opaque sequentially numbered envelopes were prepared by a researcher who was not involved in any part of our study, thus implementing the random allocation sequence that randomized each successive eligible participant.
Blinding
The primary and secondary outcomes at follow-up (ie, T3—week 5 and T5—week 11) will be assessed by research team members who are blinded to study arm assignment. The portion of the assessment covering program evaluation will be administered by an unblinded team member. Participants will not specifically be informed that they are in the immediate versus waitlist group; rather, they will be informed of the expected date of beginning the program.
Device Selection
We selected the Fitbit Charge 5 (Google Inc), a smartwatch with a sensor that can sample SpO2 in minute-by-minute intervals. There were three considerations:
- Whether the device had the sensor capable of collecting SpO2 data. The Fitbit Charge 5 has “red and infrared light sensors on the back of the device. [These] sensors shine red and infrared light onto skin and blood vessels and use the reflected light that bounces back to estimate how much oxygen is in the blood. Machine learning is used to estimate the SpO2 value and to ensure a high confidence level in the blood oxygen reading” [ ].
- Whether we would get data suitable for our purposes. Unlike manufacturers that provide a 15- or 30-minute average SpO2 value, or present “high” or “low” variation in oxygen, none of which are useful for self-management of OSA, the Fitbit Charge 5 sampled SpO2 in minute-by-minute intervals. For purposes of self-monitoring SpO2 while sleeping, it is critical that the data are sampled at sufficiently small intervals to allow for appropriate characterization of abnormal oxygen saturation (eg, SpO2<93%).
- Whether participants would wear the device night after night. Although there are other devices, such as an oximeter, that could provide similar data, we chose a smartwatch because it is more likely that an individual would keep wearing a smartwatch over putting on the oximeter sensor night after night. As participants get to keep the smartwatch after the trial, we hope that many will continue to use the device for its convenience and myriad of features, tracking SpO2 or otherwise.
Intervention
Immediate Intervention: Consumer-Grade Wearable-Augmented PAP Adherence Intervention Program
Immediately following randomization (day 0), each eligible participant assigned to the immediate intervention group will receive a consumer-grade wearable , which records minute-by-minute SpO2 data (Fitbit Charge 5), on day 1, along with instructions on how to use it. They will be asked to wear the wearable nightly, even if not using treatment device. Participants will be oriented to using their wearable for the self-monitoring program, including a feature that includes viewing their personal reports on demand. Participants who are not available for an in-person visit will be sent the device and scheduled for a telehealth visit with the research team. Participants will share data with project team via a third-party platform (Fitabase) and will be sent a weekly survey about OSA-related symptoms. The weekly survey about each 7-day period will be sent the morning of day 7, 14, 21, and 28. An automated reminder will be sent after 12 hours if the participant has not completed the survey. We will track the percentage of surveys completed as part of monitoring adherence to intervention protocols.
Data shared by participants will be used to generate customized reports that emphasize the amount of time participant had SpO2 values in the various oxygen range categories (eg, minutes spent >92% SpO2), PAP use modem data, and responses from the participant about their OSA-related symptoms. The juxtaposition of these 3 different types of information (SpO2, PAP use, and symptoms) is intended to help participants identify patterns of association between PAP use and objective (SpO2) and subjective (symptoms) data. Within 1 to 2 days of the first report delivery (or scheduled for delivery) to the participant, the participant will meet with a member of the research team, who will review the report and the meaning of the information presented using a structured session guide. The participants will continue to complete an OSA-related symptoms survey weekly until day 28 so that weekly customized reports can be delivered to the participant (also using the Qualtrics platform). The report is presented as an embedded image in the Qualtrics survey that participants can view and download.
The allocated intervention may be modified or discontinued at the participant’s request or by the study team in cases where the intervention (ie, charts) causes severe anxiety or distress or PAP treatment causes harms (eg, dermatitis that is persistent despite changing interfaces). Permitted concomitant care and interventions include those recommended and provided by the participant’s provider within the sleep center (eg, mask fitting, psychoeducation, and PAP desensitization).
Waitlist Control
Participants assigned to waitlist control will receive usual care from the sleep center, which includes clinic visit every 6 to 12 months on average, with access to durable medical equipment such as PAP interfaces on an as-needed basis. Participants will also have walk-in access to sleep technologists and respiratory therapists who can answer questions about PAP device issues and can fit patients with a new PAP mask. Each device can be paired with a self-monitoring app by the manufacturer so that patients can monitor adherence (eg, myAir [ResMed] and DreamMapper [Philips Respironics Inc]), and patients also receive feedback about their PAP use on the device display. These participants will receive instructions on the wearable at time point T4 and be offered the same intervention as the immediate group until T5 (28 days).
Program Evaluation
We will conduct a semistructured interview with participants at the completion of the program to obtain feedback from participants about the program and to elucidate opportunities to improve the trial design. Research staff with experience conducting program evaluation interviews will conduct these interviews using a semistructured interview guide with questions such as “What did you think about the reports?” or “What did you think about using a Fitbit to collect pulse oximetry data while you slept?” The staff will ask the participants how many of the reports they viewed and if they had any technical difficulties opening or viewing them. Those who choose not to view any reports will still be interviewed for their impressions of the process and concept. We will record and transcribe interviews for analysis.
Participant Timeline
Participants are enrolled on a rolling basis. After baseline assessment (T1), participants are randomized into either the immediate intervention group or the waitlist control group. Participants in the immediate intervention group start the 28-day program immediately (T2). After 7 days, at T3, the participants in the immediate intervention group undergo posttreatment assessment, and participants in the waitlist control group complete delayed baseline assessment. At T4, 7 days after T3, waitlist control participants start the intervention for 28 days. At T5, 7 days after intervention completion, participants in the waitlist control group undergo posttreatment assessment and participants in the immediate intervention group complete follow-up assessment.
Measures
Sample Characteristics
Participants will be asked to provide demographic characteristics, such as age, gender, race, ethnicity, marital status, and education level. We will also abstract from the medical record OSA history (severity and PAP settings). Comorbidities will be summarized by the Self-Administered Comorbidity questionnaire (convergent validity with Charlson Comorbidity index r=0.55) [
]. Participants' overnight oxygen desaturation, based on clinical overnight oximetry, will be summarized by the amount of time spent at various oxygen saturation levels.Primary Outcome Measure
The primary outcome measure will be the change in PAP adherence (average minutes per night over a 7-day period) from T1 to T3. PAP adherence, defined as the use of the device for 4 or more hours per night on 70% of nights during a consecutive 30-day period [
], is measured continuously and is recorded by the participant’s PAP machine and transmitted to the participant’s PAP account (eg, AirView and Care Orchestrator) through a cellular modem that is embedded in the device [ ]. PAP devices can distinguish between periods when the mask is on versus off the face (by detecting flow).Secondary Outcome Measures
Additional PAP adherence metrics will be abstracted from the participant’s PAP modem report: Percentage of days used for 4 or more hours, number of days used out of 7 days, and average residual apnea-hypopnea index on therapy.
Participant acceptability will be assessed [
]. We will review the data and evaluate the proportion of nights participants used the wearable overall and while on treatment to ascertain feasibility and acceptability of using a wearable to collect SpO2 data. We will further assess intervention feasibility, acceptability, and appropriateness with items developed by Weiner et al [ ]. The postprogram survey will be followed by an interview with patients about their experience using the wearable with treatment, including opinions about the wearable program and intention to continue using the wearable.Other Measures
Sleep disturbance and sleep-related impairment will be measured by the 8-item Patient-Reported Outcomes Measurement Information System (PROMIS) Sleep Disturbance and 8-item Sleep-Related Impairment [
]. Scores are presented as t scores, with an average of 50 and SD of 10. Scores >60 are considered elevated. Internal consistency has previously been very high (Cronbach α>0.94) [ ].Hypersomnolence will be assessed with the 8-item Epworth Sleepiness Scale [
]. Score ranges from 0 to 24 (internal consistency Cronbach α=0.82) [ ].Determinants of PAP compliance subscales (self-efficacy, 5 items; knowledge, 12 items) and transtheoretical model (decision balance, 11 items; stages of change, 1 item), chosen from constructs of social cognitive theory, will measure factors that are commonly associated with PAP use (subscale Cronbach α=0.66-0.93) [
].Graph literacy will be evaluated using a 4-item Short Graph Literacy Scale [
] that presents data in the form of a chart and queries the respondent’s comprehension, with the number of correct answers out of 4 indicating graph literacy. This short scale has convergent validity with both the Long Graph Literacy Scale (r=0.90) and a detailed verbal query of how well the participant comprehended the graph (r=0.44).The impact of OSA on biopsychosocial aspects (eg, mood and/or psychosocial outcomes) will be assessed using the Symptoms, Tiredness, Alertness, Mood, and Psychosocial questionnaire [
]. It is a 12-item questionnaire that is scored on a 6-point scale (internal consistency Cronbach α=0.91).Statistical Analysis
An intention-to-treat approach will be used. Demographic and clinical characteristics, as well as all outcome measures at baseline, will be summarized using descriptive statistics by study arm to assess baseline comparability. If the distribution of the continuous variable is skewed, an appropriate variable transformation will be made before the comparison. Multiple imputation will be implemented to account for missing data using software for regression models developed by Belin et al [
], Liu et al [ ], and Schafer [ ].Changes in sleep-related outcome measures will be analyzed to assess the “success” (effect) of the wearable intervention. The primary sleep-related outcome is change in average minutes per night of PAP use from T1 to T3. Our primary hypothesis is that the proposed intervention program will improve PAP adherence among participants who receive the program immediately compared to a waitlist control group. The primary analysis will be a comparison of mean change in PAP use between the immediate intervention group and the waitlist control group using a 2-sample, 2-sided t test (unadjusted). Next, we will construct an analysis of covariance regression model that includes baseline PAP adherence score, study arm (intervention vs control), demographic characteristics (eg, age), and preselected clinical characteristics (eg, determinants of PAP compliance score, OSA severity, and PAP setting) to examine whether the effect of the wearable intervention on PAP adherence, where the change score is the primary outcome, is significant. Because this is a single-site pilot, we have no plans to conduct any interim analyses that would be used to determine termination of trial.
Secondary analyses will compare secondary outcomes, such as the percentage of days used for ≥4 hours out of 28 days and the percentage of days used out of 28 days, between study arms. These comparisons will use generalized linear mixed-effects models with appropriate link functions, such as logit for binary outcomes and log for count outcomes. Each regression model will include the fixed effects of interest (study arm, time, and a 2-way study arm-by-time interaction term) and participant-level random effects to account for dependency of repeated observation within participants. Similar to the primary analysis, adjusted analyses of secondary outcomes with preselected factors will be performed. In addition, a generalized linear mixed-effects model will be used to compare change scores before and after the wearable intervention within the waitlist control group to estimate whether the difference in change scores before and after is significant (secondary hypothesis). This analysis will include the PAP adherence measurements from T1 to T5 for all the waitlist control participants. A similar modeling approach will be used to evaluate whether the effect of the 28-day wearable intervention is maintained at the end of the study (exploratory analysis).
Participant acceptability will be measured and analyzed to assess acceptability. We will summarize acceptability measures (frequency, mean, etc). For interview data, we will summarize interview content thematically using Veterans Affairs (VA)–approved qualitative data analysis software (eg, ATLAS.ti) and identify ways to improve the protocol for a future full-scale trial.
Power and Sample Size Considerations
A sample size of 25 participants per study arm will provide at least 80% power to detect a standardized effect size (Cohen d) of 0.72 using a 2-group test with a .05 two-sided significance when comparing mean changes in primary outcome between study arms. We anticipate a relatively larger effect size because the study time point is in a shorter time frame after treatment. The effect size estimated from this pilot study will be used to plan a future full-scale, multiyear trial.
Ethical Considerations
Institutional Review Board Approval
The study procedures were reviewed and approved by the VA Greater Los Angeles (VAGLA) institutional review board (IRB; approval 1754210) and University of California, Los Angeles, and the full trial was registered through ClinicalTrials.gov (NCT06039865). Any modifications to the protocol related to deviation of study aim, study design, patient populations, or study procedures will not be implemented until the formal amendment to the protocol is approved by the IRB.
Privacy and Informed Consent
A Health Insurance Portability and Accountability Act waiver will be requested for the chart review. Patients who are eligible based on preliminary telephone screening will be invited to participate in an informed consent appointment where the risks and benefits of the study will be presented. After written informed consent (either paper or electronic) is obtained, participants will undergo a baseline assessment. Data will be deidentified.
Data Management
Electronic data will be stored behind a VA firewall on a secure research server, with access limited to the research team. Paper charts will be secured in locked filing cabinets in locked research offices with access limited to the research team. PAP modem reports will be downloaded and data extracted and converted to data files using an automated process. Random files (10%) will be manually extracted, and these manually extracted data will be compared to the automated process. Data will be cleaned over the course of the study. All personal information about potential and enrolled participants will only be accessible to study team members before, during, and after the trial to protect confidentiality. We will retain and dispose of records in compliance with VA Record Control Schedules [
].Monitoring and Auditing
A data and safety monitoring board will not be needed for this study because our study is a single-site clinical trial involving the use of PAP machines that is considered standard of care for patients with OSA. We will be pairing the use of PAP machines with a consumer-grade wearable device but using both together should pose minimal risk to the patient because none of the data collected will be used for diagnosing purposes. We will conduct a check-in visit with patients to ask about their experience with the program, which will include questions about adverse events related to study participation. We will follow VA reporting requirements to our IRB for adverse events and serious adverse events.
VAGLA Compliance conducts monthly audits to ensure compliance with procedures for informed consent. This process is independent from investigators.
Results
Amendments were approved by VAGLA IRB in October 2023 and in March 2024. Primary reason for the March 2024 protocol amendment was as follows: protocol updates included addition of nonadherence to PAP therapy (use of PAP device for 4 or more hours per night on 70% of nights during a consecutive 30-day period) as inclusion criteria; changed collection of 3 nights oximetry at baseline assessment to 1 night of oximetry if no prior overnight oximetry results available; added PROMIS Sleep Disturbance Short Form and Sleep-Related Impairment Short Form and removed Pittsburg Sleep Quality Index and Insomnia Severity Index as baseline assessment instruments; and clarified that Symptoms, Tiredness, Alertness, Mood, and Psychosocial, PROMIS Sleep Disturbance Short Form, Sleep-Related Impairment Short Form, and determinants of nasal continuous PAP compliance would be asked at T3 and T5 and that the Acceptability of Intervention Measures, Intervention Appropriateness Measures, and Feasibility of Intervention Measures would be collected from participants after they complete the intervention program. Primary reason for A2 protocol amendment included protocol updated by adding VA DocuSign as a method of obtaining written consent during VA telehealth consent visit.
Recruitment began in October 2023 and should be completed by September 2024. Results will be disseminated through conferences and peer-reviewed journals in the sleep, digital health, and health services fields.
Discussion
Anticipated Findings
The proposed pilot study will examine the impact and acceptability of augmenting current PAP therapy data with a consumer-grade wearable device to promote self-management of PAP therapy for OSA. Using SpO2 data collected by a consumer-grade wearable represents an opportunity to support self-management of OSA to increase the use of PAP therapy and promote dialogue between patients and their sleep clinicians about OSA treatment. This pilot trial will provide important information regarding the acceptability of the consumer wearable intervention.
Underuse of PAP therapy is common among patients with OSA. Improving adherence to PAP therapy remains a formidable task, and new approaches that can be used alone or in combination with existing programs to improve adherence are needed. The growing use of consumer wearables provides a new opportunity to increase and optimize the use of PAP therapy. Including a consumer-grade wearable device to collect pulse oximetry data nightly and discussing the data presented in a customized report with a clinician as part of the patient’s OSA therapy represents a new approach. The self-monitoring program provides participants with the support they might need between clinic visits, agency to manage their own treatment, and self-awareness. The intervention was designed to maximize accessibility by incorporating internet-based modalities such as e-surveys and video visits to allow participants who live further away from the sleep clinic to participate in the study, thus ensuring access to care and tools for these patients who may experience greater barriers to attending follow-up visits.
Limitations
There may be data limitations to using pulse oximetry data collected by a consumer-grade wearable device. We may encounter instances where there are missing data from part of the night when a participant was asleep, which could be due to the position of the wearable while sleeping. Anticipating this issue, we have established a procedure to notify the participant that no data had been collected for the previous night and to remind them to wear the device on their nondominant wrist. In addition, we do make it clear that the report will be based on available data only, which is adequate for the purposes of self-monitoring. There may also be situations where the smartwatch fails to sync and does not transmit to the third-party platform for the research team to download. For these instances, we will check syncing weekly and call participants who do not have a sync in the past 24 hours.
As our inclusion criteria will allow for either use of Respironics or ResMed device, there could be potential discrepancies in PAP use reports due to manufacturer algorithm differences. A study by Nolan et al [
] compared adherence to an older Respironics versus older ResMed device versus Breas and found no significant difference between the Respironics versus ResMed device (there was significant difference for the Breas, but our sleep center has never used Breas). Although Isetta et al [ , ] reported differences in the algorithms between Respironics and ResMed device, noncompliance is multifactorial such that the device algorithm could be just one factor among many other non–pressure-related factors. Moreover, larger studies comparing fixed versus flexible pressure settings identified no difference in adherence for new users [ ]. We will attempt to perform stratified subanalyses for patients prescribed ResMed versus Respironics devices if we end up enrolling participants using CPAP devices by different manufacturers.Some participants may have difficulty understanding and applying information from the charts [
]. To increase the utility of the weekly report displaying nightly oxygen saturation data and patient-reported outcomes on sleep quality, mood, and functioning, our study will include a check-in video visit on day 7 to orient the participant to the weekly report, which may promote participant engagement [ ]. We will explore the effect of these sessions as well as participant experience with the intervention with semistructured interviews conducted at the end of the research study.Some studies have suggested that knowing there will be a delay in receiving the intervention may influence a participant’s behavior such that it is no longer an accurate portrayal of their natural behavior while awaiting treatment [
]. Some participants may in fact put less effort in their current treatment, potentially exacerbating their symptoms. This could result in an inflated estimated effect of the intervention if waitlist control participants improve “significantly” once in treatment. However, our trial’s wait time is brief (6 weeks), which is not very different from other delays participants may have encountered in receiving sleep equipment due to recent device recalls [ ]. We will not use the term “waitlist,” which may carry negative connotations, for participants who will start the intervention after an initial waiting period.Finally, we may encounter a selection bias due to participants who may not be comfortable with video visits or using a wearable device declining participation. This is a common issue with trials involving technology. In a future large-scale trial, we could work with patients who decline due to discomfort with technology before randomization and give them more time to acclimate to using video visits or a wearable device.
Possible Implications
This study will provide an opportunity to explore SpO2 as a use case of patient-generated health data for OSA self-management and to assess the effect of sharing these data with patients on PAP adherence. In the proposed trial, nightly SpO2 data will be visualized to show the amount of time in normal and abnormal oxygen saturation while sleeping along with sleep-related patient-reported outcomes (eg, daytime sleepiness) over a 7-day period. To our knowledge, SpO2 data have not been visualized in this manner.
This intervention will also pair the weekly report with a discussion with a research team member after week 1 so the patient can learn to interpret the figure and apply insights for OSA self-management. Findings from the study may provide additional insights on how patients with OSA might use patient-generated health data collected by consumer wearables to inform self-management of OSA and possibly increase their use of PAP therapy. When patients are provided with meaningful data, in the form of oxygen saturation and their symptoms, and they are able to identify patterns and relationships between these data points, this may help increase patient awareness of their condition and lead to better decision-making about their treatment [
]. We will be examining the utility of the curated data visualizations delivered weekly to further our understanding of how to deploy this type of intervention to improve use of PAP therapy and promote patient engagement in their own care.Promoting engagement with one’s care is vital to management of OSA. Our study will examine the effect of providing support to patients with OSA with a self-monitoring program between clinic visits. The intervention will provide patients with curated data visualizations and will also assist patients with interpreting these weekly reports. Findings from examining the acceptability and efficacy of augmenting current PAP therapy with wearable oxygen data will enable us to optimize implementation of patient-generated health data as an enhancer of daily living and routine clinic care. Findings will contribute additional knowledge regarding the implementation of interventions aimed at increasing OSA self-management practices.
Acknowledgments
The views expressed in this paper are those of the authors and do not represent the position or policy of the University of California, Los Angeles; the US Department of Veterans Affairs; or the United States government. This work is funded and sponsored by ResMed Foundation. For more information, please contact the Research Service at the VA Greater Los Angeles Healthcare System at (310) 478-3711. Author GA was supported by American Heart Association Grant #852679 (GA, 2021 to 2024) and the National Institute of Diabetes, Digestive, and Kidney Diseases of the National Institutes of Health under a mentored research scientist development award (K01DK129441). Fitbit Charge 5 devices were donated by Google. All these sponsors had and will have no role in the design of the study, data collection, data analysis, interpretation of data, writing of this or any manuscripts, or decision to submit this or any manuscripts for publication.
Data Availability
The data sets generated during and analyzed during this study are available from the corresponding author on reasonable request.
Authors' Contributions
SM participated in conceptualization, methodology, data curation, validation, supervision, and original draft preparation. GA participated in conceptualization, methodology, data curation, validation, and reviewing and editing the draft. LJL participated in methodology, validation, formal analysis, and reviewing and editing the draft. EDM participated in data curation, project administration, and reviewing and editing the draft. SG participated in data curation, project administration, and reviewing and editing the draft. AK was involved in data curation and reviewing and editing the draft. SN was involved in data curation and reviewing and editing the draft. MZ participated in conceptualization, methodology, data curation, validation, and reviewing and editing the draft. CF participated in conceptualization, methodology, data curation, validation, supervision, and original draft preparation.
Conflicts of Interest
None declared.
SPIRIT Checklist.
PDF File (Adobe PDF File), 118 KBReferences
- Young T, Peppard PE, Gottlieb DJ. Epidemiology of obstructive sleep apnea: a population health perspective. Am J Respir Crit Care Med. May 01, 2002;165(9):1217-1239. [CrossRef] [Medline]
- Omachi TA, Claman DM, Blanc PD, Eisner MD. Obstructive sleep apnea: a risk factor for work disability. Sleep. Jun 2009;32(6):791-798. [FREE Full text] [CrossRef] [Medline]
- Epstein LJ, Kristo D, Strollo Jr PJ, Friedman N, Malhotra A, Patil SP, et al. Clinical guideline for the evaluation, management and long-term care of obstructive sleep apnea in adults. J Clin Sleep Med. Jun 15, 2009;5(3):263-276. [FREE Full text] [Medline]
- Positive Airway Pressure (PAP) devices for the treatment of obstructive sleep apnea. Medicare Coverage Database. 2023. URL: https://www.cms.gov/medicare-coverage-database/view/lcd.aspx?LCDId=33718 [accessed 2024-04-29]
- Local coverage determination (LCD) for positive airway pressure (PAP) devices for the treatment of obstructive sleep apnea (L11518). Medicare Coverage Database. 2021. URL: https://www.virtuox.net/dyndocs/documents/lcdforpap.pdf [accessed 2024-04-29]
- Timkova V, Nagyova I, Reijneveld SA, Tkacova R, van Dijk JP, Bültmann U. Quality of life of obstructive sleep apnoea patients receiving continuous positive airway pressure treatment: a systematic review and meta-analysis. Heart Lung. 2020;49(1):10-24. [CrossRef] [Medline]
- Sawyer AM, Gooneratne NS, Marcus CL, Ofer D, Richards KC, Weaver TE. A systematic review of CPAP adherence across age groups: clinical and empiric insights for developing CPAP adherence interventions. Sleep Med Rev. Dec 2011;15(6):343-356. [FREE Full text] [CrossRef] [Medline]
- Liang Z, Ploderer B, Liu W, Nagata Y, Bailey J, Kulik L, et al. SleepExplorer: a visualization tool to make sense of correlations between personal sleep data and contextual factors. Pers Ubiquit Comput. Sep 16, 2016;20(6):985-1000. [CrossRef]
- Park S, Bekemeier B, Flaxman A, Schultz M. Impact of data visualization on decision-making and its implications for public health practice: a systematic literature review. Inform Health Soc Care. Sep 28, 2021;47(2):1-19. [CrossRef] [Medline]
- Samsung’s sleep apnea feature on Galaxy watch first of its kind authorized by US FDA. Samsung. URL: https://news.samsung.com/global/samsungs-sleep-apnea-feature-on-galaxy-watch-first-of-its-kind-cleared-by-us-fda [accessed 2024-04-29]
- Birrer V, Elgendi M, Lambercy O, Menon C. Evaluating reliability in wearable devices for sleep staging. NPJ Digit Med. Mar 18, 2024;7(1):74. [FREE Full text] [CrossRef] [Medline]
- Kainec KA, Caccavaro J, Barnes M, Hoff C, Berlin A, Spencer RM. Evaluating accuracy in five commercial sleep-tracking devices compared to research-grade actigraphy and polysomnography. Sensors (Basel). Jan 19, 2024;24(2):635. [FREE Full text] [CrossRef] [Medline]
- Bianchi MT. Sleep devices: wearables and nearables, informational and interventional, consumer and clinical. Metabolism. Jul 2018;84:99-108. [CrossRef] [Medline]
- Chinoy ED, Cuellar JA, Huwa KE, Jameson JT, Watson CH, Bessman SC, et al. Performance of seven consumer sleep-tracking devices compared with polysomnography. Sleep. May 14, 2021;44(5):zsaa291. [FREE Full text] [CrossRef] [Medline]
- Feng S, Mäntymäki M, Dhir A, Salmela H. How self-tracking and the quantified self promote health and well-being: systematic review. J Med Internet Res. Sep 21, 2021;23(9):e25171. [FREE Full text] [CrossRef] [Medline]
- Rafl J, Bachman TE, Rafl-Huttova V, Walzel S, Rozanek M. Commercial smartwatch with pulse oximeter detects short-time hypoxemia as well as standard medical-grade device: validation study. Digit Health. 2022;8:20552076221132127. [FREE Full text] [CrossRef] [Medline]
- Hwang D, Chang JW, Benjafield AV, Crocker ME, Kelly C, Becker KA, et al. Effect of telemedicine education and telemonitoring on continuous positive airway pressure adherence. The Tele-OSA randomized trial. Am J Respir Crit Care Med. Jan 01, 2018;197(1):117-126. [CrossRef] [Medline]
- Becker MH. The health belief model and sick role behavior. Health Educ Monogr. Dec 01, 1974;2(4):409-419. [CrossRef]
- Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. Feb 5, 2013;158(3):200-207. [CrossRef] [Medline]
- Naik S, Al-Halawani M, Kreinin I, Kryger M. Centers for Medicare and Medicaid services positive airway pressure adherence criteria may limit treatment to many Medicare beneficiaries. J Clin Sleep Med. Feb 15, 2019;15(2):245-251. [FREE Full text] [CrossRef] [Medline]
- Stepnowsky Jr CJ, Marler MR, Ancoli-Israel S. Determinants of nasal CPAP compliance. Sleep Med. May 2002;3(3):239-247. [CrossRef] [Medline]
- Case study: responsible AI: the Fitbit blood oxygen saturation (SpO2) tracking feature. Google AI. URL: https://ai.google/static/documents/case-study-blood-oxygen-saturation-tracking.pdf [accessed 2024-04-29]
- Selim AJ, Fincke G, Ren XS, Lee A, Rogers WH, Miller DR, et al. Comorbidity assessments based on patient report: results from the Veterans Health Study. J Ambul Care Manage. 2004;27(3):281-295. [CrossRef] [Medline]
- Weaver TE, Maislin G, Dinges DF, Bloxham T, George CF, Greenberg H, et al. Relationship between hours of CPAP use and achieving normal levels of sleepiness and daily functioning. Sleep. Jun 2007;30(6):711-719. [FREE Full text] [CrossRef] [Medline]
- Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. Dec 29, 2017;12(1):108. [FREE Full text] [CrossRef] [Medline]
- Yu L, Buysse DJ, Germain A, Moul DE, Stover A, Dodds NE, et al. Development of short forms from the PROMIS™ sleep disturbance and sleep-related impairment item banks. Behav Sleep Med. Dec 28, 2011;10(1):6-24. [FREE Full text] [CrossRef] [Medline]
- Jones J, Nielson SA, Trout J, Swenson M, Reiley J, Tanner J, et al. A validation study of PROMIS sleep disturbance (PROMIS-SD) and sleep related impairment (PROMIS-SRI) item banks in individuals with idiopathic Parkinson’s disease and matched controls. J Parkinsons Dis. 2021;11(2):877-883. [CrossRef] [Medline]
- Johns MW. A new method for measuring daytime sleepiness: the Epworth sleepiness scale. Sleep. Dec 1991;14(6):540-545. [Medline]
- Gonçalves MT, Malafaia S, Moutinho Dos Santos J, Roth T, Marques DR. Epworth sleepiness scale: a meta-analytic study on the internal consistency. Sleep Med. Sep 2023;109:261-269. [FREE Full text] [CrossRef] [Medline]
- Okan Y, Janssen E, Galesic M, Waters EA. Using the short graph literacy scale to predict precursors of health behavior change. Med Decis Making. Apr 2019;39(3):183-195. [FREE Full text] [CrossRef] [Medline]
- Mehta N, Mandavia R, Patel A, Zhang H, Liu Z, Kotecha B, et al. Patient-reported outcome measure for obstructive sleep apnea: symptoms, tiredness, alertness, mood and psychosocial questionnaire: preliminary results. J Sleep Res. Apr 2020;29(2):e12960. [CrossRef] [Medline]
- Belin TR, Gjertson DW, Hu MY. Summarizing DNA evidence when relatives are possible suspects. J Am Stat Assoc. Jun 1997;92(438):706. [CrossRef]
- Liu MT, Taylor JM, Belin TR. Multiple imputation and posterior simulation for multivariate missing data in longitudinal studies. Biometrics. Dec 24, 2000;56(4):1157-1163. [FREE Full text] [CrossRef] [Medline]
- Schafer JL. Analysis of Incomplete Multivariate Data. New York, NY. Chapman & Hall; 1997.
- Nolan GM, Ryan S, O'connor TM, McNicholas WT. Comparison of three auto-adjusting positive pressure devices in patients with sleep apnoea. Eur Respir J. Jul 2006;28(1):159-164. [FREE Full text] [CrossRef] [Medline]
- Isetta V, Navajas D, Montserrat JM, Farré R. Comparative assessment of several automatic CPAP devices' responses: a bench test study. ERJ Open Res. May 2015;1(1):00031. [FREE Full text] [CrossRef] [Medline]
- Isetta V, Montserrat JM, Santano R, Wimms AJ, Ramanan D, Woehrle H, et al. Novel approach to simulate sleep apnea patients for evaluating positive pressure therapy devices. PLoS One. 2016;11(3):e0151530. [FREE Full text] [CrossRef] [Medline]
- Grossman LV, Feiner SK, Mitchell EG, Masterson Creber RM. Leveraging patient-reported outcomes using data visualization. Appl Clin Inform. Jul 2018;9(3):565-575. [FREE Full text] [CrossRef] [Medline]
- Coşkun A, Karahanoğlu A. Data sensemaking in self-tracking: towards a new generation of self-tracking tools. Int J Hum Comput Interact. May 26, 2022;39(12):2339-2360. [CrossRef]
- Mohr DC, Spring B, Freedland KE, Beckner V, Arean P, Hollon SD, et al. The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychother Psychosom. 2009;78(5):275-284. [CrossRef] [Medline]
- Owens RL, Wilson KC, Gurubhagavatula I, Mehra R. Philips respironics recall of positive airway pressure and noninvasive ventilation devices: a brief statement to inform response efforts and identify key steps forward. Am J Respir Crit Care Med. Oct 15, 2021;204(8):887-890. [FREE Full text] [CrossRef] [Medline]
- Ravichandran RS, Patel SW, Kientz JA, Pina LR. Making sense of sleep sensors: how sleep sensing technologies support and undermine sleep health. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2017. Presented at: CHI '17; May 6-11, 2017:6864-6875; Denver, CO. URL: https://dl.acm.org/doi/10.1145/3025453.3025557 [CrossRef]
Abbreviations
IRB: institutional review board |
mPAP: Chronic Care Management With Wearable Devices in Patients Prescribed Positive Airway Pressure Therapy |
OSA: obstructive sleep apnea |
PAP: positive airway pressure |
PROMIS: Patient-Reported Outcomes Measurement Information System |
SPIRIT: Standard Protocol Items: Recommendations for Interventional Trials |
SpO2: blood oxygen saturation |
VA: Veterans Affairs |
VAGLA: Veterans Affairs Greater Los Angeles |
Edited by T Leung, A Schwartz; submitted 20.05.24; peer-reviewed by Y Chen, U Sinha; comments to author 18.06.24; revised version received 26.07.24; accepted 26.08.24; published 19.09.24.
Copyright©Selene Mak, Garrett Ash, Li-Jung Liang, Erin Der-McLeod, Sara Ghadimi, Anjali Kewalramani, Saadia Naeem, Michelle Zeidler, Constance Fung. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 19.09.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.