Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 18.11.16 in Vol 5, No 4 (2016): Oct-Dec

This paper is in the following e-collection/theme issue:

    Original Paper

    Testing the Feasibility of Remote Patient Monitoring in Prenatal Care Using a Mobile App and Connected Devices: A Prospective Observational Trial

    1George Washington University School of Medicine and Health Sciences, Washington, DC, United States

    2OB Hospitalist Group, Baylor All-Saints Medical Center, Dallas, TX, United States

    3Center for Healthcare Innovation and Policy Research, George Washington University School of Medicine and Health Sciences, Washington, DC, United States

    4The Jackson Laboratory, Farmington, CT, United States

    *these authors contributed equally

    Corresponding Author:

    Andrew C Meltzer, MSc, MD

    Center for Healthcare Innovation and Policy Research

    George Washington University School of Medicine and Health Sciences

    2120 L Street NW

    Suite 450

    Washington, DC, 20037

    United States

    Phone: 1 2024457044

    Fax:1 2027412921



    Background: Excessive weight gain and elevated blood pressure are significant risk factors for adverse pregnancy outcomes such as gestational diabetes, premature birth, and preeclampsia. More effective strategies to facilitate adherence to gestational weight gain goals and monitor blood pressure may have a positive health benefit for pregnant women and their babies. The impact of utilizing a remote patient monitoring system to monitor blood pressure and weight gain as a component of prenatal care has not been previously assessed.

    Objective: The objective of this study is to determine the feasibility of monitoring patients remotely in prenatal care using a mobile phone app and connected digital devices.

    Methods: In this prospective observational study, 8 women with low risk pregnancy in the first trimester were recruited at an urban academic medical center. Participants received a mobile phone app with a connected digital weight scale and blood pressure cuff for at-home data collection for the duration of pregnancy. At-home data was assessed for abnormal values of blood pressure or weight to generate clinical alerts to the patient and provider. As measures of the feasibility of the system, participants were studied for engagement with the app, accuracy of remote data, efficacy of alert system, and patient satisfaction.

    Results: Patient engagement with the mobile app averaged 5.5 times per week over the 6-month study period. Weight data collection and blood pressure data collection averaged 1.5 times and 1.1 times per week, respectively. At-home measurements of weight and blood pressure were highly accurate compared to in-office measurements. Automatic clinical alerts identified two episodes of abnormal weight gain with no false triggers. Patients demonstrated high satisfaction with the system.

    Conclusions: In this pilot study, we demonstrated that a system using a mobile phone app coupled to remote monitoring devices is feasible for prenatal care.

    JMIR Res Protoc 2016;5(4):e200



    Crowdfunding campaign to support this specific research

    We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.

    keyboard with crowdfunding key instead of enter key

    Suggested contribution levels: $20/$50/$100


    Excessive weight gain and elevated blood pressure are significant risk factors for adverse pregnancy outcomes such as gestational diabetes, premature birth, and preeclampsia [1-4]. The impact of utilizing a remote patient monitoring system to monitor blood pressure and weight gain as a component of prenatal care has not been previously assessed. Given current technology, tools to measure weight gain and blood pressure are generally affordable, readily available, and may be connected to mobile devices for data transfer to medical providers. In addition, the utilization of these technologies may promote self-care and improve overall engagement with prenatal care [5]. Mobile phone technology has been previously shown to improve disease management for diabetes self-care activities, HIV infection medication adherence, and sickle cell anemia medication adherence [6-8]. We hypothesize that using digital health tools (a mobile app and connected monitoring devices) may enhance prenatal care.

    The purpose of this study is to determine the feasibility of using digital health tools to manage prenatal care. Feasibility was determined by studying the following specific outcomes: (1) patient engagement with the app and the remote monitoring tools, (2) accuracy of the remotely collected data, (3) efficacy of the alert systems, and (4) patient satisfaction.


    Setting and Subject Selection

    This prospective observational study was conducted between July 2014 and January 2015 in the Department of Obstetrics & Gynecology at the George Washington University Hospital, an urban academic medical center that delivers approximately 2900 babies per year. Pregnant women between the ages of 18 to 40 years old presenting for routine prenatal care in the first trimester were asked to participate in the study over the course of a recruitment period of one month. Inclusion criteria included self-reported regular usage of an iPhone and low-risk pregnancy status per established guidelines [9]. In total, 8 participants were enrolled in the study and were followed until their delivery.

    There was no cost to the patients or provider for participation. Once consented, participants were given access to the Babyscripts (Washington, DC) mobile prenatal care platform consisting of a mobile phone app and connected devices. Patients received training on how to use the app and the devices as part of the enrollment process. All patients signed an end-user licensing agreement to use the app, permitting Babyscripts to access non-identifiable data collected by the app. Institutional review board (IRB) approval was granted prior to commencing the study (IRB# 051422).

    Description of the Digital Health Platform

    The Babyscripts platform was designed through a collaboration between the George Washington University Medical Faculty Associates and 1Eq Inc., the manufacturer of Babyscripts. The platform consists of a mobile phone app connected to a wireless weight scale and sphygmomanometer. The Babyscripts app contains evidence-based educational information related to prenatal care delivered at gestational age-specific times during pregnancy in the form of a to-do list (Figure 1). This information encompasses material covering pregnancy progression, modifiable risks such as alcohol intake, smoking or drug abuse, and information regarding nutrition, breastfeeding, appropriate weight gain, and pregnancy warning signs. This content was developed and validated in partnership with a committee of 3 board-certified obstetrician-gynecologists at the George Washington University Medical Faculty Associates. All items were derived from evidence-based standards supported by American Congress of Obstetrics and Gynecology (ACOG) and then further reviewed by each member of the committee.

    Figure 1. Screenshots of the Babyscripts app.
    View this figure

    Connected Devices

    In addition to the Babyscripts app, participants received connected devices including a weight scale (Smart Body Analyzer, Withings) and a sphygmomanometer (Wireless Blood Pressure Monitor, Withings). As part of participation, patients collected weight and blood pressure data on a weekly basis.

    Data Analysis and Alerts

    Data points generated by the use of connected devices automatically populated the Babyscripts app for review by the patient as well as the provider. Patients were provided automated feedback about their individual weight and blood pressure goals. Abnormal values activated alerts to the patient and physician to communicate more urgently. For example, elevated blood pressure or abnormal weight gain or weight loss generated an automated alert to the clinician. The alert system consisted of an email to the office’s triage nurse as well as an email and an in-app notification to the patient. If the alert was not addressed in 15 minutes, an automated phone call was placed to the triage nurse to alert the provider of the abnormality. The alert remained active until it was acknowledged by the provider.


    Patient Engagement

    Engagement with app and remote monitoring devices was measured by recording the number of times that a patient interacted with the app or recorded an at-home weight or blood pressure reading.

    Accuracy of Remote Patient Monitoring

    To measure the accuracy of remote monitoring, remote measurements were compared to in-office measurements. For in-office data, 2 trained abstractors reviewed the electronic medical record and then compared the data for discrepancies. Abstractors were not blinded to the study purpose. Standardized data collection sheets were used for data collection and all patient data was stored in a server compliant with the Health Insurance Portability and Accountability Act of 1996 (HIPAA).

    Efficacy of Automatic Alerts

    To measure the efficacy of the alert system, each patient’s home measurements were reviewed and abnormal values were cross-checked with the report of clinical alerts. If there were any discrepancies, a more detailed review was performed.

    Patient Satisfaction

    Patient satisfaction was measured using a 12-question survey that was completed by participants after 20 weeks of platform usage. Questions were based on established satisfaction surveys that measure patient-centered outcomes [10]. Survey creation was based on the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) [11].


    Statistical analysis was used to compare trends in the patient data collected remotely versus collected in-office. All statistical analyses were performed in the R programming environment (R Core Team, 2013) [12]. Standard statistical measures including P values and confidence intervals were calculated.


    For this feasibility study, 8 patients were recruited and consented to participate at 8 to 10 weeks gestation, and were followed through delivery. Most patients were primiparous, married, with private insurance, and no major pregnancy risk factors. The age range of the participants was from 25 to 33 years with body mass indexes (BMIs) of 17.3 to 33.8 (Table 1). One patient (#313) was identified to have fetal intrauterine growth restriction, while another (#278) was identified to have preeclampsia during labor. Of the patients, 5 delivered via normal spontaneous vaginal delivery, 2 required primary cesarean deliveries at term for non-reassuring fetal heart tracing and arrest of dilation, while 1 requested a repeat cesarean delivery.

    Table 1. Demographics, history, and delivery outcomes of each patient in the study.
    View this table
    Figure 2. Comparison of average total number of measurements per individual over the course of pregnancy for patients with remote data collection versus in-office only. BRX: Babyscripts; BP: blood pressure.
    View this figure
    Figure 3. Comparison of weight values measured in office versus with remote digital device monitoring. Each box represents data points from an individual patient. BRX: Babyscripts.
    View this figure
    Figure 4. Weight gain for patient 313, who generated a clinical alert for poor weight gain.
    View this figure
    Figure 5. Distribution of survey responses for satisfaction with the Babyscripts experience.
    View this figure

    Patient Engagement

    Patient interaction with the mobile app averaged 5.5 times per week over the 6-month study period. Weight data collection averaged 1.5 times per week and blood pressure data collection averaged 1.1 times per week. One patient (#323) stopped collecting data after 29 weeks gestational age due to residence change. Remote patient monitoring increased the total number of data points collected throughout pregnancy compared to routine office measurements during prenatal care visits (Figure 2). The mean number of weight measurements collected by the connected devices (46, P<.001) and mean number of blood pressure measurements (34, P=.01) exceeded the number of data points collected in the office (10).

    Accuracy of Remote Patient Monitoring

    Weight measurements acquired by remote digital devices did not differ from in-office measurements (P>.05 for all patients) (Figure 3). The differences in the slope of gestational weight gain were determined by the F-statistic and resulting P values were Bonferroni-corrected. For all comparisons, adjusted is P>.05. For our cohort, mean blood pressure measurements remained consistent over the course of the pregnancy with a mild elevation (<10%) of in-office systolic blood pressure values compared to home measurement. Diastolic measurements tracked very closely with systolic measurements.

    Efficacy of Automatic Alerts and Alerts

    After reviewing data sets of all clinical variables and all organized alerts, no incidences of inappropriate alerts or unaddressed alerts were discovered. There was a total of 2 alerts fired during the study, both related to inappropriate weight gain (patient 313 and 323). Patient 313 did not gain weight over a 4-week interval, which generated an automatic clinical alert. As a result of this alert, the patient’s obstetrician was notified and subsequently scheduled a more urgent office visit and closer monitoring (Figure 4). For patient 323, an automatic alert was generated at 15 weeks gestation for weight loss of 6 pounds in one week. The provider established contact with this patient and addressed any possible warning signs and monitored weight more closely until the patient was seen for her routine follow-up visit.

    Patient Satisfaction

    The patient satisfaction survey assessed themes of patient-provider relationship, engagement, patient education, and patient satisfaction and had a completion rate of 75% (6/8) (Figure 5). We attempted multiple times to reach the 2 participants who did not complete the survey.

    All 6 participants who completed the survey felt comfortable with the concept and technical aspects of remote monitoring, were able to easily access provider resources through Babyscripts, and had an easy time remembering to use Babyscripts. Most (83%, 5/6) of the participants felt that the app assisted with healthy pregnancy-related behaviors, were satisfied with prenatal care, felt more connected with their provider, and felt more knowledgeable about their pregnancy.


    Principal Findings

    The main finding of this study was that the use of a novel pregnancy platform, which incorporates remote monitoring and a clinical alert system, is feasible as evidenced by high patient-app engagement, accurate at-home measurements of weight and blood pressure, efficacy of the alert system, and high patient satisfaction scores.

    Interaction with the app met expectations and collection goals. The app was designed to provide regular educational information regarding pregnancy and prenatal care. Patient interaction with the mobile app averaged 5.5 times per week over the 6-month study period demonstrating that patients are visiting the app almost daily. The app was also designed to prompt patients to record weight and blood pressure at least weekly. Given these collection goals, the average interaction per week was chosen as a metric for engagement. Weight data collection averaged 1.5 times per week and blood pressure data collection averaged 1.1 times per week, which is a significant increase from the current standard of only recording blood pressure and weight during office visits. Based on discussions with experts, we concluded that more frequent readings were unlikely to add additional clinical information.

    Accuracy of remote measurements are essential to make appropriate clinical management decisions. Remotely collected data tracked closely with in-office data demonstrating the accuracy of the remote devices. Blood pressure values measured in the office were mildly (<10%) elevated compared to the remote measurements, which has been previously described in the literature comparing at home blood pressure measurements to office measurements [13].

    In addition, this platform demonstrated that automated alerts may be an effective way to notify the patient and provider regarding abnormal change in weight or blood pressure. The goal of the alert system is to facilitate earlier identification of pregnancy complications and optimize timely intervention. The described monitoring system has the ability to collect data more frequently than office visits alone, allowing for the potential to develop predictive models to screen normal pregnancies and identify pregnancy risk earlier.


    The major limitations to this study include the small sample size and the threat of selection bias due to a convenience sample. It is possible that our results will not be reproduced in a different population or larger population. There are a number of possible biases within the participant population that limit our ability to demonstrate feasibility. The limitations based on the breadth of the study population include a mostly married cohort with private insurance, and 75% (6/8) patients were experiencing their first pregnancy. The fact that this was their first pregnancy makes it difficult for them to compare mobile prenatal care with other models of prenatal care. None of the women had significant past medical history nor used tobacco. Despite the attempt to choose a healthy cohort of women, 25% (2/8) of the women did experience a complication of pregnancy, specifically growth delay in one fetus and preeclampsia in another. While the sample size was small, it was ethnically diverse including 3 Caucasian women, 3 African-American women, 2 Hispanic women, and 1 Asian-American woman. Future studies will include examining the efficacy within specific ethnic and racial populations.

    Second, researchers were not blinded to the purpose of the study, introducing the possibility of bias when assessing our primary outcomes. Finally, the lack of a comparison group limits the ability to draw conclusions about improved outcomes compared to usual prenatal care. However, this is a pilot study to determine the feasibility of a novel system, with plans for more rigorous studies in the future addressing these and other limitations.


    In the future, prenatal care is likely to incorporate more personalized care that integrates mobile technology, individualized risk stratification, and remote monitoring. As such, this study is the first to demonstrate the feasibility of using a digital health platform to remotely collect data in near real-time and to stratify for high-risk outcomes using an effective alert system. Future studies will compare prenatal care assisted by mobile health technology compared to routine care evaluating comparative-effectiveness and patient-centered outcomes.


    Thank you to Dr Haywood L Brown, president of the American Congress of Obstetricians and Gynecologists, for feedback regarding study and application.

    Conflicts of Interest

    Andrew Meltzer and Julia Oh have stock options in the health technology company that created Babyscripts.


    1. Pattinson R, Say L, Souza JP, Van Den Broek N, Rooney C. More effective strategies to facilitate adherence to gestational weight gain goals. WHO Maternal Death and Near-Miss Classifications. Bulletin of the World Health Organization 2009;87(10).
    2. Creanga A, Berg C, Syverson C, Seed K, Bruce F, Callaghan W. Pregnancy-related mortality in the United States, 2006-2010. Obstet Gynecol 2015 Jan;125(1):5-12. [CrossRef] [Medline]
    3. Kiel D, Dodson E, Artal R, Boehmer T, Leet T. Gestational weight gain and pregnancy outcomes in obese women: how much is enough? Obstet Gynecol 2007 Oct;110(4):752-758. [CrossRef] [Medline]
    4. The American Congress of Obstetricians and Gynecologists. Hypertension and Pregnancy. Executive summary. 2013.   URL: https:/​/www.​​~/​media/​Task%20Force%20and%20Work%20Group%20Reports/​public/​HypertensioninPregnancy.​pdf [WebCite Cache]
    5. Borrero AF, Vasques J, Vargas R. Implementation of a mobile application to promote self-care in elder diabetic patients. In: VI Latin American Congress on Biomedical Engineering. Switzerland: Springer International Publishing; Jan 01, 2015:797-800.
    6. Estepp J, Winter B, Johnson M, Smeltzer M, Howard S, Hankins J. Improved hydroxyurea effect with the use of text messaging in children with sickle cell anemia. Pediatr Blood Cancer 2014 Nov;61(11):2031-2036. [CrossRef] [Medline]
    7. Perera A, Thomas M, Moore J, Faasse K, Petrie K. Effect of a smartphone application incorporating personalized health-related imagery on adherence to antiretroviral therapy: a randomized clinical trial. AIDS Patient Care STDS 2014 Nov;28(11):579-586 [FREE Full text] [CrossRef] [Medline]
    8. Kim YJ, Rhee SY, Byun JK, Park SY, Hong SM, Chin SO, et al. A smartphone application significantly improved diabetes self-care activities with high user satisfaction. Diabetes Metab J 2015 Jun;39(3):207-217 [FREE Full text] [CrossRef] [Medline]
    9. The Management of Uncomplicated Pregnancy Working Group. DoD/VA Clinical Practice Guideline for the Management of Uncomplicated Pregnancy. Washington, DC: Department of Defense, Department of Veterans Affairs; 2001.   URL: [WebCite Cache]
    10. Hospital Consumer Assessment of Healthcare Providers and Systems. HCAHPS Hospital Survey. Baltimore, MD   URL: [accessed 2014-02-02] [WebCite Cache]
    11. Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res 2004 Sep 29;6(3):e34 [FREE Full text] [CrossRef] [Medline]
    12. The R Project for Statistical Computing.   URL: [accessed 2016-07-25] [WebCite Cache]
    13. Franklin SS, Thijs L, Hansen TW, O'Brien E, Staessen JA. White-coat hypertension: new insights from recent studies. Hypertension 2013;62:982-987.   URL: [accessed 2016-10-03] [WebCite Cache]

    Edited by G Eysenbach; submitted 07.06.16; peer-reviewed by C McGregor, MH Cheng; comments to author 07.07.16; revised version received 26.07.16; accepted 19.09.16; published 18.11.16

    ©Kathryn I Marko, Jill M Krapf, Andrew C Meltzer, Julia Oh, Nihar Ganju, Anjali G Martinez, Sheetal G Sheth, Nancy D Gaba. Originally published in JMIR Research Protocols (, 18.11.2016.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.