Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 21.01.19 in Vol 8, No 1 (2019): January

Preprints (earlier versions) of this paper are available at, first published Jun 18, 2018.

This paper is in the following e-collection/theme issue:


    Estimating Vaccine Effectiveness Against Hospitalized Influenza During Pregnancy: Multicountry Protocol for a Retrospective Cohort Study

    1Kaiser Permanente Northwest, Center for Health Research, Portland, OR, United States

    2Abt Associates, Inc, Cambridge, MA, United States

    3ICES, Toronto, ON, Canada

    4Chief Physician's Office, Clalit Health Services, Clalit Research Institute, Tel Aviv, Israel

    5School of Public Health, Curtin University, Perth, Australia

    6Cumming School of Medicine, University of Calgary, Calgary, AB, Canada

    7Kaiser Permanente Vaccine Study Center, Oakland, CA, United States

    8Alberta Health, Edmonton, AB, Canada

    9Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, United States

    10PathWest Laboratory Medicine Western Australia, Perth, Australia

    11School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada

    12Department of Laboratory Medicine and Pathology, University of Alberta, Edmonton, AB, Canada

    13Western Australia Department of Health, Perth, Australia

    14Kaiser Permanente Washington Health Research Institute, Seattle, WA, United States

    *these authors contributed equally

    Corresponding Author:

    Allison L Naleway, PhD

    Kaiser Permanente Northwest

    Center for Health Research

    3800 North Interstate Avenue

    Portland, OR, 97005

    United States

    Phone: 1 503 335 6352

    Fax:1 503 335 6311



    Background: Although pregnant women are believed to have elevated risks of severe influenza infection and are targeted for influenza vaccination, no study to date has examined influenza vaccine effectiveness (IVE) against laboratory-confirmed influenza-associated hospitalizations during pregnancy, primarily because this outcome poses many methodological challenges.

    Objective: The Pregnancy Influenza Vaccine Effectiveness Network (PREVENT) was formed in 2016 as an international collaboration with the Centers for Disease Control and Prevention; Abt Associates; and study sites in Australia, Canada, Israel, and the United States. The primary goal of this collaboration is to estimate IVE in preventing acute respiratory or febrile illness (ARFI) hospitalizations associated with laboratory-confirmed influenza virus infection during pregnancy. Secondary aims include (1) describing the incidence, clinical course, and severity of influenza-associated ARFI hospitalization during pregnancy; (2) comparing the characteristics of ARFI-hospitalized pregnant women who were tested for influenza with those who were not tested; (3) describing influenza vaccination coverage in pregnant women; and (4) comparing birth outcomes among women with laboratory-confirmed influenza-associated hospitalization versus other noninfluenza ARFI hospitalizations.

    Methods: For an initial assessment of IVE, sites identified a retrospective cohort of pregnant women aged from 18 to 50 years whose pregnancies overlapped with local influenza seasons from 2010 to 2016. Pregnancies were defined as those that ended in a live birth or stillbirth of at least 20 weeks gestation. The analytic sample for the primary IVE analysis was restricted to pregnant women who were hospitalized for ARFI during site-specific influenza seasons and clinically tested for influenza virus infection using real-time reverse transcription polymerase chain reaction.

    Results: We identified approximately 2 million women whose pregnancies overlapped with influenza seasons; 550,344 had at least one hospitalization during this time. After restricting to women who were hospitalized for ARFI and tested for influenza, the IVE analytic sample included 1005 women.

    Conclusions: In addition to addressing the primary question about the effectiveness of influenza vaccination, PREVENT data will address other important knowledge gaps including understanding the incidence, clinical course, and severity of influenza-related hospitalizations during pregnancy. The data infrastructure and international partnerships created for these analyses may be useful and informative for future influenza studies.

    International Registered Report Identifier (IRRID): DERR1-10.2196/11333

    JMIR Res Protoc 2019;8(1):e11333



    Crowdfunding campaign to support this specific research

    We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.

    keyboard with crowdfunding key instead of enter key

    Suggested contribution levels: $20/$50/$100



    Pregnant women are believed to be at greater risk of severe complications from influenza infection than nonpregnant women of childbearing age, based on findings from studies primarily conducted during influenza pandemics [1,2]. Anatomic, immunologic, and physiologic changes during pregnancy that affect respiratory, cardiovascular, and other organ systems might increase the risk and severity of infections, including influenza [3,4]. The risk of hospitalization due to clinically diagnosed influenza or pneumonia appears to increase with each trimester of pregnancy [5-7]. The vulnerability of pregnant women to severe influenza disease was observed during the 2009 A (H1N1) pandemic [8-10] and at least two prior pandemics [11,12]. However, there are substantial gaps in our knowledge regarding the seasonal burden of influenza among pregnant women.

    Influenza vaccination is an effective method of influenza prevention, but the vaccine is widely underutilized during pregnancy [13-15]. Although there are ample data on the safety of inactivated influenza vaccination (IIV) during pregnancy [16-18], a major challenge to maternal immunization policy making has been the paucity of data regarding the effectiveness of IIV in preventing severe influenza-related outcomes in pregnant women [2,19]. Serologic studies have found a similar antibody response to the vaccine among pregnant and nonpregnant women [20,21]. Several observational studies have compared the rates of nonspecific respiratory illness among vaccinated and unvaccinated pregnant women with mixed results [20,22-25]. Randomized controlled trials [24,26] and observational studies in pregnant women [27,28] have reported that IIV reduces the risk of mild to moderately severe laboratory-confirmed influenza illness by about half.


    No study to date has examined influenza vaccine effectiveness (IVE) against laboratory-confirmed influenza-associated hospitalization during pregnancy. This is an important gap in knowledge for maternal immunization policy. Perhaps the greatest challenge in addressing this IVE question is identifying study populations with sufficient numbers of influenza-related hospitalizations during pregnancy in nonpandemic seasons. Randomized controlled trials and prospective observational studies are impractical due to the large number of women that would be required to observe a statistically meaningful number of hospitalizations. In addition, randomized controlled trials may be unethical in high-income countries where influenza vaccination is recommended for pregnant women. Large-scale retrospective observational studies may be feasible, but no single public or private health care database with influenza testing results and influenza vaccination records is large enough to adequately address the question. After considering these limitations, the US Centers for Disease Control and Prevention (CDC) reached out to international partners to build a collaboration capable of determining IVE against hospitalization in pregnant women. In addition to addressing the primary IVE question, the collaboration was envisioned as a way to explore other important gaps in our understanding of influenza infection and vaccination during pregnancy.



    The Pregnancy Influenza Vaccine Effectiveness Network (PREVENT) was formed in 2016 as an international collaboration with the US CDC, Abt Associates, and study sites in 4 countries: Australia, Canada, Israel, and the United States. PREVENT was established to address multiple gaps in knowledge about influenza vaccination and infection during pregnancy (Textbox 1). The primary goal of this collaboration was to estimate IVE in preventing acute respiratory or febrile illness (ARFI) hospitalizations associated with laboratory- confirmed influenza virus infection during pregnancy.

    Textbox 1. Study goals and features intended to address specific knowledge gaps.
    View this box

    Secondary aims include estimating the incidence of influenza-associated ARFI hospitalization during pregnancy, comparing the characteristics of ARFI-hospitalized pregnant women who were tested for influenza with those who were not tested, describing the clinical course and severity of influenza and noninfluenza ARFI hospitalizations during pregnancy, and describing the clinical course of respiratory syncytial virus (RSV)–associated hospitalizations during pregnancy (Textbox 1). Participating sites will also describe influenza vaccination rates in pregnant women and compare birth outcomes (such as low birth weight, preterm delivery, and small-for-gestational age births) among women with laboratory-confirmed influenza-associated hospitalizations versus other noninfluenza ARFI hospitalizations.

    Study Sites and Enrollment

    In 2015, study investigators conducted a series of telephone interviews and written surveys to recruit potential international study sites. To be considered a potential PREVENT site, institutions were required to meet several inclusion criteria related to the underlying characteristics of the source population, clinical and laboratory practices, and availability of high-quality regional respiratory virus surveillance and electronic medical record (EMR) data (Textbox 2).

    Textbox 2. Eligibility criteria for The Pregnancy Influenza Vaccine Effectiveness Network study site selection.
    View this box
    Table 1. Pregnancy Influenza Vaccine Effectiveness Network study countries, sponsors, populations, and data sources.
    View this table

    On the basis of these criteria, 5 study sites were recruited in 4 countries: Australia, Canada, Israel, and the United States (Table 1). Each PREVENT study site developed methods to define local influenza seasons, identify pregnant women, identify relevant ARFI hospitalizations and influenza tests, and extract data about influenza vaccinations and important covariates. Influenza vaccination is recommended and available at no cost to women in all study sites. A brief description of each study site and the methods they used are provided below.


    Western Australia (WA) is the country’s largest state in total land area and has about 2.6 million residents, most of whom live in the capital city of Perth. The Western Australia Department of Health has access to data on the annual birth cohort of approximately 34,000 through its state perinatal data collection, the Midwives Notification System. This data collection includes information on >99% of births in the state with gestation ≥20 weeks (live and stillborn) and was used to identify a cohort of pregnant women who gave birth between January 2012 and December 2015. Inpatient records for all public and private hospitals in WA are available in the Hospital Morbidity Data System, which collects information on hospital discharge and was used to identify ARFI hospitalizations. Public immunization providers report influenza vaccines administered to pregnant women to the WA Antenatal Influenza Vaccination Database; the number of pregnant women obtaining vaccines in the private market is thought to be about 4% [29]. An evaluation of this dataset showed it captured 46% of the self-reported influenza vaccinations among a sample of postpartum women surveyed in WA [30]. Influenza surveillance data were obtained from 2 sources: (1) the state’s public health reference laboratory (PathWest Laboratory Medicine WA) and (2) state notifications of laboratory-confirmed influenza infection (WA Notifiable Infectious Disease Database). Laboratory real-time reverse transcription polymerase chain reaction (rRT-PCR) testing data from the state’s public health reference laboratory were linked to the cohort to identify influenza and RSV testing results.


    Overall, 2 provinces in Canada are participating in PREVENT. The province of Alberta has about 4.1 million residents and 53,500 annual births. The Alberta Ministry of Health (Alberta Health) administers its publicly funded health care system. Each resident registered in the insurance plan has a unique lifetime identifier that can be used to link the data sources described below, including the provincial vaccination repository and the vital statistics registry. All live and stillbirths of at least 20 weeks’ gestation are available through the provincial Vital Statistic Registry, which was used to identify pregnancies. The Canadian Institute for Health Information’s Discharge Abstract Database (DAD) captures administrative, clinical, and demographic information on hospital discharges directly from all 106 acute care facilities in the province and was used to identify ARFI hospitalizations. All Albertans are eligible to receive influenza vaccination free of charge, with less than 10% of influenza vaccinations not reported to the registry. Influenza surveillance is conducted continuously in Alberta with year-round laboratory testing and a community-based sentinel physician network, hospital, and emergency room surveillance. Information about clinician-ordered influenza testing with rRT-PCR was obtained through the centralized Provincial Laboratory Information System.

    The province of Ontario has about 14 million residents and approximately 147,000 births annually and includes Canada’s capital (Ottawa) and Canada’s largest city (Toronto). The sponsoring organization, The ICES, is a not-for-profit research institute whose mandate is to enable health system evaluation and research within Ontario. Data from the DAD were extracted to identify pregnant women (using their delivery hospitalization abstract) and ARFI hospitalizations. Physician and pharmacist (starting in 2012) billing claims contained in the Ontario Health Insurance Plan (OHIP) and Ontario Drug Benefits databases, respectively, were used to identify influenza vaccinations. A previous validation study of one of these sources (OHIP) found physician billing claims were 42% sensitive among pregnant women compared with self-reported influenza vaccination status, as individuals can also receive influenza vaccination through public health and workplace clinics [31]. Respiratory specimen results from Public Health Ontario and 8 academic hospital laboratories using rRT-PCR were individually linked to the health administrative data using unique encoded identifiers.


    Clalit Health Services is the largest health care fund in Israel, covering 53% of Israel’s population. About 4.4 million people are covered by the fund, including about 93,000 births annually. Nearly all patients (>98%) remain in the fund from year to year, receiving all of their publicly funded health care through the fund. Clalit’s comprehensive EMR has been universally adopted among all inpatient and outpatient health care facilities. All live births are captured through hospital EMR data and a demographic registry that feeds into the Clalit data warehouse. An algorithm based on diagnostic and procedure codes was employed to identify pregnancies ≥20 weeks’ gestation that did not end in live births. Hospitalizations of pregnant women associated with deliveries that occurred in non-Clalit hospitals (over half to two-thirds of all hospitalizations) were not captured by the EMR. Influenza vaccines are offered free of charge to health care fund members at Clalit clinics, and details regarding influenza vaccination are entered into the EMR. Influenza and RSV testing is conducted using rRT-PCR in Clalit hospitals at the discretion of the physician, and rRT-PCR results are captured in the EMR.

    United States

    Kaiser Permanente (KP) is an integrated health care delivery system serving over 12 million people in the United States. Moreover, 3 KP sites contributed data to PREVENT—KP Northwest (Portland, OR), KP Northern California (Sacramento, San Francisco Bay Area, Fresno), and KP Washington (Seattle, WA; formerly Group Health Cooperative). The combined population of the KP PREVENT sites is about 6.2 million people, including about 56,000 live births annually. KP Northern California provides inpatient care at 21 KP-owned hospitals, KP Northwest provides inpatient care at 2 KP-owned hospitals and contracts with several other regional hospitals, and KP Washington does not own any hospitals but contracts with regional hospitals for patient care. A common comprehensive EMR system is used at the KP sites. The KP sites identified pregnancies of at least 20 weeks’ gestation using a combination of local pregnancy registry data and a validated algorithm that uses diagnosis and procedure codes to identify pregnancy episodes [32]. In addition, 2 sites, KP Washington and KP Northwest, further manually reviewed the medical records of women who were hospitalized with ARFI and excluded those not found to be pregnant. Influenza vaccination records were extracted from the EMR and from state immunization registries in Oregon and Washington states. A previous study found that KP EMR records were 89% sensitive among pregnant women compared with self-reported influenza vaccination status [27]. Influenza surveillance data for Region 10 of the United States were provided by CDC and were used to identify influenza seasons for the KP sites [33]. At KP Northern California and KP Northwest, clinical influenza and RSV rRT-PCR testing dates and results were extracted directly from the EMR. At KP Washington, test dates and results were manually abstracted from medical records.

    Influenza Seasons and Peak Period Definitions

    With study sites located around the globe and in both hemispheres, a necessary first step in developing the study protocol was to agree upon a shared method for defining influenza seasons and peak periods of circulation. Each site included up to 6 seasons of data starting with the northern hemisphere 2010-2011 season as the earliest. Using a combination of regional surveillance and clinical laboratory records, each site identified the number of respiratory specimens tested and the number of laboratory-confirmed influenza positives identified among tested specimens.

    Similar to previous efforts to define influenza seasons consistently across countries [34,35], each study site identified criteria to delineate the start and end of sustained influenza circulation and to identify a period of peak influenza circulation (Table 2). A total of 3 sites (Australia, Ontario [Canada], and the United States) used the mean percentage of specimens that tested positive for influenza A or B virus infection across weeks for each surveillance year to define their threshold of increased or decreased activity. Moreover, 2 sites (Alberta [Canada] and Israel) used a weekly influenza positivity rate of greater than 5% of specimens tested as their threshold.

    Table 2. Weeks of local early, peak, and late influenza seasons; earliest and latest week of clinical influenza positives; and predominant local circulating influenza strains by year and study sites.
    View this table

    With this information, each site determined for each study season:

    • the start of each season, defined as the Sunday of the first of 3 consecutive weeks in which the percentage of specimens testing positive for influenza A or B virus infection was higher than the determined threshold;
    • the end of each season, defined as the Saturday of the first of 3 consecutive weeks in which the percentage of specimens testing positive for influenza was below the threshold;
    • the peak period, defined as the weeks that included ≥68% of influenza positives between the start and end of each season;
    • the early season, defined as the weeks from the start of the season through the week before the peak period; and
    • the late season, defined as the week after the peak period through the end of the season.

    Retrospective Cohort Identification

    Pregnancies were defined as those that ended in a live birth or stillbirth of at least 20 weeks’ gestation. Sites began analysis by identifying all pregnancies during the study years (eg, starting in July of the first year and ending in June of the last year for northern hemisphere sites), with the exception of California and Washington, United States sites that could only examine pregnancies during influenza seasons. Nonetheless, among sites that attempted to identify all pregnancies during study years, 83% (1.72 million/2.07 million) of the pregnancies overlapped with an influenza season.

    Study sites subsequently limited their study population to pregnant women who were hospitalized for ARFI during the site-specific influenza seasons. ARFI hospitalizations were identified using a shared list of International Classification of Diseases, ninth and tenth revision, diagnosis codes applied in previous studies of medically attended influenza illness [27,37,38] and expanded to include acute illnesses with febrile only, nonrespiratory, or sepsis-like presentations that may be associated with severe influenza disease among adults [39,40]. Canada and Australia used country-specific versions of these codes.

    To define the analytic sample for the primary IVE analysis, we further limited the population to women who were clinically tested for influenza virus infection using rRT-PCR with respiratory specimens collected within 3 days before admission through hospital discharge. Women who were ineligible for influenza vaccination (eg, were not covered by health insurance during the vaccination campaign period), those vaccinated within 14 days of admission, and (at some sites) those without documented influenza vaccination status were excluded. ARFI hospitalizations that were readmissions within 14 days of discharge were combined with the index hospitalization and considered single events in the IVE analytic sample.

    Data Collection

    As an important early step, PREVENT investigators developed and refined a shared data dictionary (Multimedia Appendix 1). Each site developed a site-specific plan to measure the common data requirements for the project. These plans were then compared and harmonized into a common set of requirements and strategies. The shared data dictionary initially focused on variables that were key to the primary aim of estimating IVE. All participating sites were able to provide all the variables in this core dataset. Additional data elements were added to support the secondary aims of the study, and for some of these secondary variables, only a subset of sites was able to provide data.

    For women in the retrospective cohort, we extracted the following data from records associated with the index AFRI hospitalization and, where possible, from administrative records or ambulatory care records before hospitalization: (1) basic descriptive demographic information and maternal characteristics (eg, age, race, ethnicity, socioeconomic status, height, weight, and smoking); (2) underlying health conditions before pregnancy (eg, asthma, diabetes, and cancer); (3) pregnancy history and complications with the current pregnancy (eg, gestational hypertension and gestational diabetes; (4) clinical signs and symptoms, course, and treatment during the ARFI hospitalization; (5) respiratory specimen collection and laboratory test results for influenza, RSV, and other pathogens; (6) disposition at hospital discharge (eg, home, hospital transfer, and death); (7) delivery date, gestational age of the infant at delivery, and birth outcomes (eg, birth weight and small-for- gestational age); and (9) influenza vaccination records for the current season. When hospital or birth outcome information was not available in EMR or administrative databases, a limited medical record abstraction was performed by study sites that had direct access to medical records. During the study seasons, most sites only used trivalent inactivated influenza vaccine; quadrivalent inactivated influenza vaccine represented <5% of doses administered to pregnant women starting in 2012 in the United States and 2015 in Israel. Live, attenuated influenza vaccination is contraindicated during pregnancy and was excluded.

    Ethical Approval and Considerations

    The study protocol and procedures have been reviewed and approved by institutional review boards by Abt Associates (the coordinating institution on which US CDC relies) and at each study site: Human Research Ethics Committee, Department of Health Western Australia; Conjoint Health Research Ethics Board, University of Calgary; University of Alberta Health Research Ethics Board; Sunnybrook Health Sciences Centre, Toronto, Canada; Kaiser Permanente Northwest Institutional Review Board; Clalit Health Services Research Ethics Committee. It was not possible to use a common institutional review board for this project because the institutional and regional human subjects protection policies and regulations varied for each PREVENT site.

    Each site received a waiver of informed consent for all participants. The study presented minimal risk to participants, as there was no interaction or intervention with patients. Although patient information was extracted from existing administrative databases, no personal identifiers were shared between study sites Abt Associates or US CDC. Sites provided aggregate data tables that included summary statistics rather than individual-level datasets, and measures were taken to ensure subject privacy in reports with small cell sizes. There was no risk to the participants’ health from participation in this study because data were collected either as part of patients’ routine care or for billing purposes. The study had no impact on patients’ current health care or therapeutic management plan. Consequently, patients were not provided information about their participation.


    Figure 1 summarizes the steps sites followed to create the retrospective PREVENT cohort, starting with pregnant women aged from 18 to 50 years at the time of inpatient admission whose pregnancies overlapped with the site-specific influenza seasons. This population of 1,928,147 pregnant women will be used in secondary analyses describing vaccination coverage, influenza incidence, and birth outcomes. To refine the sample for the IVE analysis, we limited this population to pregnant women who were hospitalized during influenza season (n=550,344). We identified 19,450 hospitalizations with ARFI diagnoses at discharge and 1136 of these included rRT-PCR influenza testing within the 3 days before admission through discharge. After excluding hospitalizations with incomplete vaccination histories and readmissions, the final IVE analytic dataset included 1030 hospitalizations and 1005 unique women.

    Figure 1. Pregnancy Influenza Vaccine Effectiveness Network retrospective inclusion and exclusion criteria. rRT-PCR: real-time reverse transcriptase polymerase chain reaction; RIDT: rapid influenza diagnostic test; DFA: direct fluorescent antibody; IVE: inactivated influenza vaccine.
    View this figure


    Principal Findings

    The PREVENT collaboration will provide important information about the effectiveness of influenza vaccination in preventing severe laboratory-confirmed influenza illness requiring hospitalization in pregnant women and will address additional pertinent knowledge gaps about influenza and pregnancy. As hospitalization for ARFI with laboratory-confirmed influenza is a rare occurrence in pregnant women, an international collaboration was needed to address this question. Out of approximately 2 million women who were pregnant during influenza seasons 2010-2011 through 2015-2016 at 7 study sites in 4 countries, we identified about 1000 who were hospitalized and tested for influenza by rRT-PCR for inclusion in the primary IVE analysis. This analysis to address this important gap in knowledge would not be possible without an international collaboration of this magnitude.

    Strengths and Limitations

    In addition to the magnitude and geographic diversity of the study cohort, this network has established resources valuable for antenatal influenza research. As part of this collaboration, PREVENT has brought together a pool of international expertise in influenza vaccination and infection during pregnancy. The study investigators worked together to develop methods to harmonize data collection, management, and analyses across different institutions and countries with differing underlying populations, data sources, and human subjects protection regulations. In addition to addressing the primary question about the effectiveness of influenza vaccination, PREVENT data will be used to address other important knowledge gaps including understanding the incidence, clinical course, and severity of hospitalized influenza during pregnancy. The data infrastructure and partnerships created for these analyses may be useful and informative for future studies.

    Despite the strengths of this collaboration, there are a few limitations to the analyses within this cohort. Due to the nature of the data sources across sites, we were only able to include pregnancies ending in live birth or stillbirth of at least 20 weeks’ gestational age, because several sites were unable to extract reliable data on pregnancies ending in fetal loss before 20 weeks. We are, therefore, not able to examine the impact of influenza infection or influenza vaccination on outcomes early in pregnancy, such as spontaneous abortion. In addition, we included study sites that routinely tested pregnant women for influenza and had maternal influenza immunization programs, which limited our study to the inclusion of 4 high-income countries. Therefore, PREVENT study results may not be generalizable to countries with fewer resources dedicated to testing and vaccination programs or with different underlying population characteristics (eg, high prevalence of HIV or malaria) that may impact IVE or influenza incidence and severity. Finally, there is the potential for misclassification bias in some of our measurements. To ensure consistency across sites, chronic diseases are characterized solely by International Classification of Diseases code, which may underestimate the prevalence of these conditions in the women studied. Misclassification of influenza vaccination is of most concern for the primary IVE analysis; however, the participating sites generally have high rates of influenza vaccination capture, often using a combination of EMR data and regional and national immunization registries.


    Due to methodological challenges in researching seasonal influenza infection and vaccination in pregnant women, we have several important unanswered questions, including understanding the effectiveness of influenza vaccination in preventing hospitalization during pregnancy. PREVENT will address this primary IVE question as well as a number of other important gaps in our understanding of influenza and other respiratory infections during pregnancy. This work will be informative for strengthening global influenza prevention strategies and for improving the health of pregnant women.


    This study was supported by the US Centers for Disease Control and Prevention (CDC) through contract HHSD2002013M53890B within CDC’s Achieving Public Health Impact through Research task 200-2014-F-60406 (“The Epidemiology and Prevention of Influenza Virus Infections in Low- and Middle-Income Countries”) to Abt Associates. This study was also supported by Public Health Ontario and the ICES, which is funded by an annual grant from the Ontario Ministry of Health and Long-Term Care.

    The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the CDC. Parts of this manuscript are based on data and/or information compiled and provided by the Canadian Institute for Health Information (CIHI). However, the analyses, conclusions, opinions, and statement expressed herein are those of the authors and not necessarily those of CIHI. No endorsement by the ICES, Public Health Ontario, Ontario Ministry of Health and Long-Term Care, or CIHI is intended or should be inferred.

    Members of the PREVENT workgroup in addition to the authors include the people from US CDC (Fatimah Dawood, Gayle Langley, Jerome Tokars, and Jennifer Williams), Abt Associates (Omri Drucker, Rebecca Fink, and Ryan Kling), ICES (Sarah Buchan), Israel Center for Disease Control, Israel Ministry of Health (Aharona Glatman-Freedman), Central Virology Laboratory, Israel Ministry of Health (Michal Mandelboim), Clalit Research Institute (Maya Leventer-Roberts), University of Calgary (Stephanie Booth and Lawrence Svenson), Kaiser Permanente (KP) Northwest (Bradley Crane and Matthew Slaughter), KP Northern California (Kristin Goddard, Edwin Lewis, and Sharareh Modaressi), and KP Washington (Lisa Ross and Lawrence Madziwa). In Western Australia (WA), the authors would like to thank the Linkage and Client Services teams at the Data Linkage Branch (Department of Health Western Australia) as well as the data custodians for the Midwives Notification System (Maureen Hutchinson), the Hospital Morbidity Data Collection (Vikki Mirosevich), the WA Antenatal Vaccination Database (Robyn Gibbs), PathWest Laboratory Medicine data collection (Brett Cawley), and the Western Australia Notifiable Infectious Disease Database (Gary Dowse). In Ontario, the authors would like to thank the laboratory data providers from Public Health Ontario (Jonathan Gubbay), Children’s Hospital of Eastern Ontario (Timothy Karnauchow and Dayre McNally), North York General Hospital (Kevin Katz), St Joseph’s Healthcare Hamilton (Marek Smieja), Sinai Health System and University Health Network (Allison McGeer), Sunnybrook Health Sciences Centre (Andrew Simor), and William Osler Health System (David Richardson). The authors would also like to thank IMS Brogan Inc for use of their Drug Information Database. In Alberta, the authors would like to thank Christopher Bell. In Israel, the authors would like to thank Ilan Gofer of the Clalit Research Institute.

    Authors' Contributions

    ALN and MGT developed the original proposal for Pregnancy Influenza Vaccine Effectiveness Network (PREVENT). All named authors contributed to the development of the common protocol and procedures. SB, BEW, KAS, SAI, MAK, JCK, MGT, and AKR helped coordinate the study. ALN, MGT, and SB wrote the first draft. All named authors contributed to subsequent drafts. All authors read and approved the final manuscript.

    Conflicts of Interest

    SJD reports that he is a content advisor to Johnson & Johnson (Jannsen Pharmaceuticals) on respiratory virus testing. ALN reports grants from Pfizer, MedImmune/Astra Zeneca, and Merck outside the submitted work. NPK reports grants from GlaxoSmithKline, Sanofi Pasteur, Pfizer, Protein Science (now Sanofi Pasteur), Merck & Co, MedImmune, Novartis (now GSK), and Dynavax, outside the submitted work. SAI reports grants from Medimmune/AstraZeneca, outside the submitted work. MLJ reports research grants from Sanofi Pasteur, outside the submitted work. The remaining authors declare that they have no conflicts of interest.

    Multimedia Appendix 1

    Data dictionary Pregnancy Influenza Vaccine Effectiveness Network protocol.

    PDF File (Adobe PDF File), 485KB


    1. Rasmussen SA, Jamieson DJ, Uyeki TM. Effects of influenza on pregnant women and infants. Am J Obstet Gynecol 2012 Sep;207(3 Suppl):S3-S8. [CrossRef] [Medline]
    2. Fell DB, Azziz-Baumgartner E, Baker MG, Batra M, Beauté J, Beutels P, WHO taskforce to evaluate influenza data to inform vaccine impact and economic modelling. Influenza epidemiology and immunization during pregnancy: final report of a World Health Organization working group. Vaccine 2017 Dec 13;35(43):5738-5750 [FREE Full text] [CrossRef] [Medline]
    3. Goodnight WH, Soper DE. Pneumonia in pregnancy. Crit Care Med 2005 Oct;33(10 Suppl):S390-S397. [Medline]
    4. Laibl VR, Sheffield JS. Influenza and pneumonia in pregnancy. Clin Perinatol 2005 Sep;32(3):727-738. [CrossRef] [Medline]
    5. Dodds L, McNeil SA, Fell DB, Allen VM, Coombs A, Scott J, et al. Impact of influenza exposure on rates of hospital admissions and physician visits because of respiratory illness among pregnant women. CMAJ 2007 Feb 13;176(4):463-468 [FREE Full text] [CrossRef] [Medline]
    6. Neuzil KM, Reed GW, Mitchel EF, Simonsen L, Griffin MR. Impact of influenza on acute cardiopulmonary hospitalizations in pregnant women. Am J Epidemiol 1998 Dec 01;148(11):1094-1102. [Medline]
    7. Hartert TV, Neuzil KM, Shintani AK, Mitchel EF, Snowden MS, Wood LB, et al. Maternal morbidity and perinatal outcomes among pregnant women with respiratory hospitalizations during influenza season. Am J Obstet Gynecol 2003 Dec;189(6):1705-1712. [Medline]
    8. Siston AM, Rasmussen SA, Honein MA, Fry AM, Seib K, Callaghan WM, Pandemic H1N1 Influenza in Pregnancy Working Group. Pandemic 2009 influenza A(H1N1) virus illness among pregnant women in the United States. J Am Med Assoc 2010 Apr 21;303(15):1517-1525 [FREE Full text] [CrossRef] [Medline]
    9. Jamieson DJ, Honein MA, Rasmussen SA, Williams JL, Swerdlow DL, Biggerstaff MS, Novel Influenza A (H1N1) Pregnancy Working Group. H1N1 2009 influenza virus infection during pregnancy in the USA. Lancet 2009 Aug 08;374(9688):451-458. [CrossRef] [Medline]
    10. Callaghan WM, Chu SY, Jamieson DJ. Deaths from seasonal influenza among pregnant women in the United States, 1998-2005. Obstet Gynecol 2010 May;115(5):919-923. [CrossRef] [Medline]
    11. Rasmussen SA, Jamieson DJ, Bresee JS. Pandemic influenza and pregnant women. Emerg Infect Dis 2008 Jan;14(1):95-100 [FREE Full text] [CrossRef] [Medline]
    12. Skowronski DM, De Serres G. Is routine influenza immunization warranted in early pregnancy? Vaccine 2009 Jul 30;27(35):4754-4770. [CrossRef] [Medline]
    13. Ding H, Black CL, Ball S, Donahue S, Fink RV, Williams WW, et al. Influenza vaccination coverage among pregnant women--United States, 2014-15 influenza season. MMWR Morb Mortal Wkly Rep 2015 Sep 18;64(36):1000-1005 [FREE Full text] [CrossRef] [Medline]
    14. Wong VW, Lok KY, Tarrant M. Interventions to increase the uptake of seasonal influenza vaccination among pregnant women: a systematic review. Vaccine 2016 Jan 02;34(1):20-32. [CrossRef] [Medline]
    15. Yuen CY, Tarrant M. Determinants of uptake of influenza vaccination among pregnant women - a systematic review. Vaccine 2014 Aug 06;32(36):4602-4613. [CrossRef] [Medline]
    16. Keller-Stanislawski B, Englund JA, Kang G, Mangtani P, Neuzil K, Nohynek H, et al. Safety of immunization during pregnancy: a review of the evidence of selected inactivated and live attenuated vaccines. Vaccine 2014 Dec 12;32(52):7057-7064. [CrossRef] [Medline]
    17. Kharbanda EO, Vazquez-Benitez G, Romitti PA, Naleway AL, Cheetham TC, Lipkind HS, Vaccine Safety Datalink. First trimester influenza vaccination and risks for major structural birth defects in offspring. J Pediatr 2017 Aug;187:234-239.e4. [CrossRef] [Medline]
    18. Sukumaran L, McCarthy NL, Kharbanda EO, Weintraub ES, Vazquez-Benitez G, McNeil MM, et al. Safety of tetanus toxoid, reduced diphtheria toxoid, and acellular pertussis and influenza vaccinations in pregnancy. Obstet Gynecol 2015 Nov;126(5):1069-1074 [FREE Full text] [CrossRef] [Medline]
    19. Savitz DA, Fell DB, Ortiz JR, Bhat N. Does influenza vaccination improve pregnancy outcome? Methodological issues and research needs. Vaccine 2015 Nov 25;33(47):6430-6435 [FREE Full text] [CrossRef] [Medline]
    20. Hulka JF. Effectiveness of polyvalent influenza vaccine in pregnancy. Report of a controlled study during an outbreak of Asian influenza. Obstet Gynecol 1964 Jun;23:830-837. [Medline]
    21. Steinhoff MC, Omer SB, Roy E, Arifeen SE, Raqib R, Altaye M, et al. Influenza immunization in pregnancy--antibody responses in mothers and infants. N Engl J Med 2010 Apr 29;362(17):1644-1646. [CrossRef] [Medline]
    22. Black SB, Shinefield HR, France EK, Fireman BH, Platt ST, Shay D, Vaccine Safety Datalink Workgroup. Effectiveness of influenza vaccine during pregnancy in preventing hospitalizations and outpatient visits for respiratory illness in pregnant women and their infants. Am J Perinatol 2004 Aug;21(6):333-339. [CrossRef] [Medline]
    23. Munoz FM, Greisinger AJ, Wehmanen OA, Mouzoon ME, Hoyle JC, Smith FA, et al. Safety of influenza vaccination during pregnancy. Am J Obstet Gynecol 2005 Apr;192(4):1098-1106. [CrossRef] [Medline]
    24. Zaman K, Roy E, Arifeen SE, Rahman M, Raqib R, Wilson E, et al. Effectiveness of maternal influenza immunization in mothers and infants. N Engl J Med 2008 Oct 09;359(15):1555-1564. [CrossRef] [Medline]
    25. Håberg SE, Trogstad L, Gunnes N, Wilcox AJ, Gjessing HK, Samuelsen SO, et al. Risk of fetal death after pandemic influenza virus infection or vaccination. N Engl J Med 2013 Jan 24;368(4):333-340 [FREE Full text] [CrossRef] [Medline]
    26. Madhi SA, Cutland CL, Kuwanda L, Weinberg A, Hugo A, Jones S, Maternal Flu Trial (Matflu) Team. Influenza vaccination of pregnant women and protection of their infants. N Engl J Med 2014 Sep 04;371(10):918-931. [CrossRef] [Medline]
    27. Thompson MG, Li D, Shifflett P, Sokolow LZ, Ferber JR, Kurosky S, PregnancyInfluenza Project Workgroup. Effectiveness of seasonal trivalent influenza vaccine for preventing influenza virus illness among pregnant women: a population-based case-control study during the 2010-2011 and 2011-2012 influenza seasons. Clin Infect Dis 2014 Feb;58(4):449-457. [CrossRef] [Medline]
    28. Manske JM. Efficacy and effectiveness of maternal influenza vaccination during pregnancy: a review of the evidence. Matern Child Health J 2014 Sep;18(7):1599-1609. [CrossRef] [Medline]
    29. Mak DB, Regan AK, Joyce S, Gibbs R, Effler PV. Antenatal care provider's advice is the key determinant of influenza vaccination uptake in pregnant women. Aust N Z J Obstet Gynaecol 2015 Apr;55(2):131-137. [CrossRef] [Medline]
    30. Regan AK, Mak DB, Moore HC, Tracey L, Saker R, Jones C, et al. Surveillance of antenatal influenza vaccination: validity of current systems and recommendations for improvement. BMC Public Health 2015 Nov 23;15:1155 [FREE Full text] [CrossRef] [Medline]
    31. Schwartz KL, Jembere N, Campitelli MA, Buchan SA, Chung H, Kwong JC. Using physician billing claims from the Ontario Health Insurance Plan to determine individual influenza vaccination status: an updated validation study. CMAJ Open 2016 Aug;4(3):E463-E470 [FREE Full text] [CrossRef] [Medline]
    32. Naleway AL, Gold R, Kurosky S, Riedlinger K, Henninger ML, Nordin JD, et al. Identifying pregnancy episodes, outcomes, and mother-infant pairs in the Vaccine Safety Datalink. Vaccine 2013 Jun 12;31(27):2898-2903. [CrossRef] [Medline]
    33. Centers for Disease Control and Prevention. Past Weekly Surveillance Reports   URL: [accessed 2018-11-28] [WebCite Cache]
    34. Durand LO, Cheng P, Palekar R, Clara W, Jara J, Cerpa M, et al. Timing of influenza epidemics and vaccines in the American tropics, 2002-2008, 2011-2014. Influenza Other Respir Viruses 2016 May;10(3):170-175 [FREE Full text] [CrossRef] [Medline]
    35. Hirve S, Newman LP, Paget J, Azziz-Baumgartner E, Fitzner J, Bhat N, et al. Influenza seasonality in the tropics and subtropics - when to vaccinate? PLoS One 2016;11(4):e0153003 [FREE Full text] [CrossRef] [Medline]
    36. State of Israel Ministry of Health. Weekly Influenza Surveillance Reports   URL: [accessed 2018-11-28] [WebCite Cache]
    37. McLean HQ, Thompson MG, Sundaram ME, Kieke BA, Gaglani M, Murthy K, et al. Influenza vaccine effectiveness in the United States during 2012-2013: variable protection by age and virus type. J Infect Dis 2015 May 15;211(10):1529-1540 [FREE Full text] [CrossRef] [Medline]
    38. Sokolow LZ, Naleway AL, Li D, Shifflett P, Reynolds S, Henninger ML, Pregnancy and Influenza Project Workgroup. Severity of influenza and noninfluenza acute respiratory illness among pregnant women, 2010-2012. Am J Obstet Gynecol 2015 Feb;212(2):202.e1-202.11 [FREE Full text] [CrossRef] [Medline]
    39. Reed C, Chaves S, Perez A, D'Mello T, Daily Kirley P, Aragon D, et al. Complications among adults hospitalized with influenza: a comparison of seasonal influenza and the 2009 H1N1 pandemic. Clin Infect Dis 2014 Jul 15;59(2):166-174. [CrossRef] [Medline]
    40. Oboho IK, Reed C, Gargiullo P, Leon M, Aragon D, Meek J, et al. Benefit of early initiation of influenza antiviral treatment to pregnant women hospitalized with laboratory-confirmed influenza. J Infect Dis 2016 Dec 15;214(4):507-515. [CrossRef] [Medline]


    ARFI: acute respiratory or febrile illness
    CDC: Centers for Disease Control and Prevention
    DAD: Discharge Abstract Database
    EMR: electronic medical record
    IIV: inactivated influenza vaccine
    IVE: influenza vaccine effectiveness
    KP: Kaiser Permanente
    NH: northern hemisphere
    OHIP: Ontario Health Insurance Plan
    PREVENT: Pregnancy Influenza Vaccine Effectiveness Network
    rRT-PCR: real-time reverse transcriptase polymerase chain reaction assay
    RSV: respiratory syncytial virus
    SH: southern hemisphere
    WA: Western Australia

    Edited by N Kuter; submitted 18.06.18; peer-reviewed by Y Zhang, M Das; comments to author 28.08.18; revised version received 27.09.18; accepted 28.09.18; published 21.01.19

    ©Allison L Naleway, Sarah Ball, Jeffrey C Kwong, Brandy E Wyant, Mark A Katz, Annette K Regan, Margaret L Russell, Nicola P Klein, Hannah Chung, Kimberley A Simmonds, Eduardo Azziz-Baumgartner, Becca S Feldman, Avram Levy, Deshayne B Fell, Steven J Drews, Shikha Garg, Paul Effler, Noam Barda, Stephanie A Irving, Patricia Shifflett, Michael L Jackson, Mark G Thompson. Originally published in JMIR Research Protocols (, 21.01.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.