Background: Despite many efforts, long wait times and overcrowding in emergency departments (EDs) have remained a significant health service issue in Canada. For several years, Canada has had one of the longest wait times among the Organisation for Economic Co-operation and Development countries. From a patient’s perspective, this challenge has been described as “patients wait in pain or discomfort for hours before being seen at EDs.” To overcome the challenge of increased wait times, we developed an innovative ED management platform called SurgeCon that was designed based on continuous quality improvement principles to maintain patient flow and mitigate the impact of patient surge on ED efficiency. The SurgeCon quality improvement intervention includes a protocol-driven software platform, restructures ED organization and workflow, and aims to establish a more patient-centric environment. We piloted SurgeCon at an ED in Carbonear, Newfoundland and Labrador, and found that there was a 32% reduction in ED wait times.
Objective: The primary objective of this trial is to determine the effects of SurgeCon on ED performance by assessing its impact on length of stay, the time to a physician’s initial assessment, and the number of patients leaving the ED without being seen by a physician. The secondary objectives of this study are to evaluate SurgeCon’s effects on patient satisfaction and patient-reported experiences with ED wait times and its ability to create better-value care by reducing the per-patient cost of delivering ED services.
Methods: The implementation of the intervention will be assessed using a comparative effectiveness-implementation hybrid design. This type of hybrid design is known to shorten the amount of time associated with transitioning interventions from being the focus of research to being used for practice and health care services. All EDs with 24/7 on-site physician support (category A hospitals) will be enrolled in a 31-month, pragmatic, stepped wedge cluster randomized trial. All clusters (hospitals) will start with a baseline period of usual care and will be randomized to determine the order and timing of transitioning to intervention care until all hospitals are using the intervention to manage and operationalize their EDs.
Results: Data collection for this study is continuing. As of February 2022, a total of 570 randomly selected patients have participated in telephone interviews concerning patient-reported experiences and patient satisfaction with ED wait times. The first of the 4 EDs was randomly selected, and it is currently using SurgeCon’s eHealth platform and applying efficiency principles that have been learned through training since September 2021. The second randomly selected site will begin intervention implementation in winter 2022.
Conclusions: By assessing the impact of SurgeCon on ED services, we hope to be able to improve wait times and create better-value ED care in this health care context.
Trial Registration: ClinicalTrials.gov NCT04789902; https://clinicaltrials.gov/ct2/show/NCT04789902
International Registered Report Identifier (IRRID): DERR1-10.2196/30454
Long wait times and overcrowding are challenging emergency departments (EDs) around the world [- ]. Several other countries with advanced health care systems cannot keep pace with patient demand. In particular, Canada ranks among countries with the longest wait times compared with those of peer-industrialized countries [ ]. The Canadian Institute for Health Information (CIHI) reported an 11% increase in ED wait times from 2015-2016 to 2016-2017 [ ]. This translates to long wait times and deters patients from pursuing the necessary care they need and increases the likelihood of patients leaving the ED without being seen (LWBS) by a physician [ , ]. In Newfoundland and Labrador, Canada’s easternmost province, long wait times are plaguing the province much like the rest of Canada [ - ].
The Newfoundland and Labrador provincial government and the province’s 4 regional health authorities (RHAs) have the option of expanding the health care workforce [, ] at a time of historic fiscal restraint or finding effective interventions to improve the efficiency of their current ED service [ ]. Overtime [ - ], expanding the ED [ , ] and redirecting patients to primary care [ , ] have not been shown to be effective. According to an October 2020 report from the CIHI, ED services are making up a larger percentage of total hospital spending with a 4% annual growth rate, which was observed between 2005 and 2019 [ ]. The same report states that ED staff are twice as likely to work overtime compared with staff in other departments [ ].
We have created a quality improvement intervention called SurgeCon. As a pragmatic ED management platform, SurgeCon includes 3 separate components (described below) that together act to decrease wait times and improve the sustainability of Newfoundland and Labrador’s ED services without significant workforce changes. These interventions include restructuring the ED organization and workflow, fostering a patient-centric environment, and quantifying ED demands and available resources in real time. SurgeCon is designed to enable frontline health care workers to anticipate and mitigate surges in patient volume through a series of proactive steps and decision-making tools. SurgeCon attracted the attention of the Newfoundland and Labrador Eastern Health (EH) RHA after they missed their own ED wait time benchmarks in 2016 . The initial development of the SurgeCon intervention came about after an external review was completed by an independent third party to determine which areas of ED operations could be adjusted to improve wait times and departmental efficiency. The external review was one of many components included in a provincial wait time reduction initiative [ ].
We piloted SurgeCon at the ED located in Carbonear, Newfoundland and Labrador, an EH administered hospital, over 45 months from July 1, 2013, to March 31, 2017. Data from the pilot study were analyzed using an interrupted time series analysis to assess its effect on ED performance. The resulting change in indicators was noteworthy, despite a 25.7% increase in patient volume. Over the course of the 45-month pilot study, average time to physician’s initial assessment (PIA) decreased from 104.3 (SD 9.9) minutes to 42.2 (SD 8.1) minutes, length of stay (LOS) in the ED decreased from 199.4 (SD 16.8) minutes to 134.4 (SD 14.5) minutes, and the number of patients LWBS decreased from 12.1% (SD 2.2%) to 4.6% (SD 1.7%). All of these changes were statistically significant. The marked and sustained impact of SurgeCon on ED performance in Carbonear supports the case for its extension to other EDs.
The proposed innovative clinical trial and the implementation of SurgeCon (see the implementation paper)  will generate practical information on its effectiveness in a range of urban and rural ED settings and generate data to support its more comprehensive implementation. Given the successful results from the pilot study, and if SurgeCon proves to address ED patient flow issues in this study, the rest of Canada and other countries could significantly benefit from its implementation.
Given the scope of the SurgeCon research program, a separate protocol related to evaluating the intervention’s implementation was published in a separate article . This research protocol focuses on the innovative clinical trial stepped wedge cluster randomized trial (SW-CRT) design used to assess the effectiveness of the intervention. In this protocol paper, we will provide a brief description of the intervention and associated research activities that will be carried out at each of the 4 selected ED sites.
Study Aim and Objectives
In this study, we present the protocol for a 31-month SW-CRT trial. Our aim is to evaluate the performance of the SurgeCon platform in improving important patient and service process outcomes in EDs in an RHA in Newfoundland and Labrador and develop strategies to promote its scalability, sustainability, and successful implementation across the Canadian health system. The primary objective of the trial is to evaluate the effects of SurgeCon on ED performance by assessing its impact on LOS, PIA, and LWBS. The secondary objective of the trial is to assess the intervention’s impact on patient satisfaction and patient-reported experience with ED wait times and its ability to create better-value ED services by reducing ED costs.
This study has been approved by the Newfoundland Labrador Health Research Ethics Board with researcher portal file 20201482.
Newfoundland and Labrador’s health care system is delivered through four RHAs: EH, Central Health, Western Health, and Labrador-Grenfell Health. The eastern RHA will be participating in this research initiative as a collaborative research partner and will be the only RHA participating in the study. The other 3 health authorities will act as knowledge users and will not be included in the SurgeCon trial. However, the research team will provide interim reports to the other health authorities to allow them to monitor and learn from research findings over the course of the study period to guide future implementation in their own centers.
This is a multisite study, including 2 urban and 2 rural EDs with 24/7 on-site physician support in the EH region of Newfoundland (). The remaining 2 EDs with 24/7 on-site physician support within the study area that are not receiving the intervention are a pediatric ED, which operates differently and has wait times that differ greatly from adult or general ED, and the Carbonear General Hospital, which was chosen for the pilot study. The 4 sites receiving the intervention include 2 urban sites (Health Sciences Centre and St. Clare’s Mercy Hospital) and 2 rural sites (Dr. G.B. Cross Memorial Hospital and Burin Peninsula Health Care Centre).
All individuals who visited any of the 4 selected EDs during the study period will be included in the collection of deidentified health administrative data. We will also collect and monitor ED-level key performance indicator (KPI) data such as LOS, PIA, and LWBS because they are impacted by patient volume. Patients who receive care at these EDs will be randomly selected for subsequent follow-up after they are discharged to collect information related to their experience in the ED and to determine their level of satisfaction with the care that they received.
As we will be evaluating the effectiveness of SurgeCon using an SW-CRT, the 4 different hospitals will be randomized, with 1 ED site starting at the first sequence. The next site will start 6 months later in the second sequence and will continue until all EDs are allocated to sequences. A simple random sample will be performed by the study statistician, who will generate a randomization list using statistical software that will determine the order of intervention implementation. The researchers and participants will not be blinded to whether they are in the intervention or the control cohort.
To assess patient-reported experiences and satisfaction, discharged patients who are subsequently contacted to complete satisfaction and patient experience surveys will be randomly selected using a random time and date generator program.
The SurgeCon study aims to measure both ED KPIs (LOS, PIA, and LWBS) and patient perceptions and satisfaction related to the care they received in the ED. Patient health outcomes, use of health care resources, and overall cost will also be assessed based on a patient’s arrival time. We will also collect information on the potential adverse effects of the intervention such as 24-hour readmission and mortality. These data will help examine trends in mortality and readmissions before and after intervention implementation.
The study uses a comparative effectiveness-implementation hybrid design and includes outcomes for effectiveness and implementation. Two measurement levels will be considered for the study, ED- or service-level and patient-level outcomes will be used to determine the effectiveness of SurgeCon. To guide our choice of outcomes and to determine how best to evaluate the intervention’s implementation, we applied a combination of 2 frameworks, that is, RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) and Consolidated Framework for Implementation Research [, ]. To guide our implementation strategy, we will collect data related to organizational climate, fidelity of staff training, fidelity of intervention delivery, implementation cost, barriers and enablers to adoption, implementation, institutionalization, intervention acceptability, intervention appropriateness, feasibility of maintaining SurgeCon, sustainability of SurgeCon, and scalability of the SurgeCon intervention. Detailed information on implementation assessment and outcomes is available via our other work [ ].
The SW-CRT design is a novel, robust, and flexible 1-way crossover cluster randomized trial design increasingly being used in trial arms with varying time delays in which all clusters start from the control condition to the active intervention condition state. In particular, this longitudinal stepped wedge study design includes a repeated cross-sectional design, as illustrated in, where each hospital will eventually receive the intervention. All participating sites will begin the trial in a control condition where they will continue to use a usual care model or the model of care provided before the beginning of the trial. Each site will switch from providing usual care to providing care using the intervention that will take place at predetermined time periods during the study. At the end of the trial experiment, each of the sites will have implemented all of the intervention’s components. The stepped wedge randomized trial design used in this study is normally carried out at the cluster level rather than at the individual level. Therefore, a clustered randomized stepped wedge design will be the focus of this protocol.
The advantages of the SW-CRT include logistical flexibilities, efficiencies in terms of power, and sample size compared with traditional (clustered) parallel-group designs. Furthermore, the ethical advantages in longitudinal and open cohort studies have also been recognized [- ]. A simple random sampling technique will be used to determine the order of intervention implementation across the 4 selected sites. The assignment of 1 cluster per sequence will maximize statistical power. The study period can be subdivided by four 6-month steps. Each step starts with the implementation of the intervention at one of the 4 selected sites. Observations are collected repeatedly from each cluster in multiple periods. The key parameters such as the number of clusters or clusters per sequence, steps, and measurement periods (both control and intervention conditions), intracluster correlation coefficient (ICC), and effect size are required for sample size calculation for the SW-CRT design.
The total study period available for the intervention to remain active is 31 months, and it is expected that at least one month will be needed for training and implementation at each ED site. A 1-month intervention adoption period was considered to be sufficient for the intervention to be fully operationalized for a single cluster. During the first 6 months of the baseline period, all patients who visit any of the 4 hospitals will receive usual care. After the baseline period, a randomly allocated hospital will begin SurgeCon intervention implementation every 6 months and will continue to use the intervention for operations and management until the end of the study. Staff at each of the randomly selected hospitals will undergo training, establish processes and guidelines that are consistent with efficiency principles covered during training, and begin routine data entry. During the last 6 months of the study period, all 4 hospitals will be operating using the SurgeCon ED management platform exclusively. We will be monitoring the characteristics of each hospital and the composition of their associated frontline teams to determine if significant changes have occurred since the control period and whether an adjustment to our analysis plan is required.
On the basis of the results of a pilot study conducted at a rural ED site in EH’s jurisdiction, we established a common framework for optimal sample size calculations when the number of clusters available for randomization is limited to 4 sites for the SW-CRT design. We chose 1 cluster, which will cross over to an intervention state at a randomly assigned step. To keep things relatively simple, we assume that an equal number of observations is sampled in each cross section of each cluster. Alternatively, we expect an equal amount of observations per period per cluster. Results from our pilot study show a 15% to 30% decrease in the LOS or wait times between 6 and 30 months after SurgeCon implementation [- ]. This trial is powered to detect a 15% change in LOS at 5% of type I error and 80% power with an ICC [ ] of 0.1 for repeated measures (6 measures per step). A 10% reduction in ED wait time in the study sites could result in 10-minute reduction in LOS. To detect this change, a minimum sample size of N=20,280 (169/month/hospital for 30 months and 4 hospitals) is required. To be able to conduct age, sex, and patient acuity subgroup analyses for all ED visits across the 4 intervention sites, we will include all ED visits for this portion of the analysis as there is a low cost associated with extracting data from existing ED repositories, which routinely capture patient record-level information. For patient satisfaction, the study is powered to detect a 30% change in patient-reported experience measures or patient satisfaction [ - ] at a 5% of type I error and 80% power with an ICC of 0.1. Therefore, a sample size of 1320 (11/month/hospital for 30 months and 4 hospitals) would be sufficient for this study. Considering a 50% response rate, we will conduct 25 surveys per month per hospital. In particular, we demonstrated the required sample size and power calculation procedure with illustration for different combinations of the ICC to detect the standard effect size. For this illustrative purpose, we consider a clinical trial powered to detect a 10% to 30% reduction in wait times on a continuous scale at the 4 different EDs with 5% of type I error rate and 80% power.
Data Collection and Monitoring
Aggregate- and individual record-level data will be analyzed over the course of the study period to assess the effect of the intervention on patient outcomes, health service efficiency, and the cost of providing emergency care. Our analysis will include aggregate KPI data, record-level health administrative data, and aggregate financial data and will be provided to the research team by the Newfoundland and Labrador Centre for Health Information. The ED KPIs (ie, LOS, PIA, and LWBS) used as the primary outcomes for this study are further described in Table S1 inalongside other variables that will be used for statistical modeling. Each of the primary outcomes will be calculated and assessed monthly over the course of the study period. The total number of monthly ED visits will be used as the denominator for our cluster-level summaries.
Individual record-level health administrative data will include demographic variables (eg, sex, date of birth, and postal code), mortality data, wait times data, diagnosis data, and triage acuity scores, among other variables. These data will be used to create aggregate KPI and financial data provided by Newfoundland and Labrador Centre for Health Information and to assess the intervention’s impact on the type and volume of patients who visit one of the 4 selected ED sites during the study period. Financial data will capture expenditures for staff, supplies, and procedures originating from the ED and will include data related to pharmacy, diagnostic imaging, laboratory testing, surgical day care, operating room procedures, physician salaries, physician fees for service claims, nurse salaries, administrative staff salaries, ambulance services, and other related ED costs.
Patient-reported experiences and patient satisfaction survey data will be collected 3 to 5 days after ED discharge via a telephone interview conducted by a research assistant who is also an EH employee. No identifiable information related to their ED visit will be collected during the survey, and patient consent will be obtained before the interview through an implied consent process that does not require a signed consent form. We provide all study participants with the opportunity to request an informed consent document that can be provided by email or post mail and contains contact information for the principal investigator and project manager. To minimize the loss to follow-up, the research assistant will attempt to reach patients up to 3 times within 2 weeks of the initial attempt. The interview will take <30 minutes, using a questionnaire we created based on CIHI’s patient-reported experiences  and patient satisfaction surveys for EDs [ ]. Although most of Newfoundland and Labrador’s population is English speaking (97%) [ ], language was not considered an exclusion criterion. Patient interview responses will be stored via Qualtrics (a web-based survey program), where research team members will be able to analyze the data while maintaining patient anonymity. An important consideration for this approach is that the only ethically approved means of contacting patients is by telephone using patient contact information at EH. Other options were explored such as surveying patients directly in the ED, but it was deemed unsuitable, as many patients are not likely to be in a physical or mental state conducive to participating in a study.
Beyond the data provided by traditional provincial data custodians, we will also consider the SurgeCon platform’s routinely collected aggregate data. These data include calculated SurgeCon levels, ED beds, bed availability, patient acuity, and patient process tracking. The SurgeCon action-based protocol is subdivided into 5 levels of escalation and is used to indicate the level of demand, availability of resources, and capacity in the ED. The levels range from 1 (optimal operating conditions) to 5 (very busy or patient surge). They are calculated using several variables such as ED and inpatient unit bed availability, resource shortages, and number of patients in the waiting room left to be triaged or seen by a physician, among many other options. A charge nurse or other frontline staff manually enter variables used by SurgeCon’s algorithm to determine SurgeCon levels via a data entry portal. Any data entered into the data entry portal will be made accessible to the research team through the creation of a special user role that provides access to all site-specific information and the ability to export collected data.
Our implementation strategy includes the operationalization of routine data capturing by charge nurses. The research team will regularly monitor data quality and completeness across all study sites. We will be working with frontline health care staff at each of the sites to find solutions when sites are found to be missing data entry intervals or if data quality is low. We are exploring opportunities to automate data collection for certain variables if they are found to be feasible and appropriate.
The characteristics of hospitals and patients will be recorded. We will describe the clinical and demographic characteristics of hospitals and patients for each period. We will report the response for patient satisfaction surveys and report the duration of intervention adherence at each study site and, if applicable, the reasons for noncompliance. For each outcome, we will report the results for each period, including the effect size and its precision. The 30 months of cumulatively collected data from EH and provincial health administrative databases in both the intervention and usual care periods will be modeled as a linear mixed model. We plan to analyze research data using a generalized linear mixed model (GLMM)  or generalized estimating equation [ ]. Hussey and Hughes [ ] have suggested a model-based approach for analyzing data using a repeated cross-sectional design where outcome measurements will be measured from different individuals at each measurement interval. This approach was proposed for continuous outcome variables and has been commonly used at the design stage of these studies [ ]. Individuals within the same cluster are likely to be positively correlated, and the strength of the correlation can be measured by the ICC under this model and is assumed to be constant over time. However, the model suggested by Hussey and Hughes [ ] has been extended to allow a more general correlation structure between individuals within the same cluster [ - ]. We will adhere to the intention-to-treat analysis; however, sensitivity analyses for comparing the results under the intention-to-treat assumption with the complier and per protocol will be conducted. Moreover, interim analyses will be conducted on a monthly basis to inform us about the findings in a timely manner and allow us to make any modifications if required [ ].
The primary method of analysis used in this study is GLMM, which will consider monthly cluster-level summary measures such as means of LOS, PIA, or proportion of LWBS. Our GLMM models will include fixed effects for time, intervention effects, random effects, and random time effects for each cluster. In addition, ED setting (rural or urban), ED volume, and size of ED administrative resource will be added as cluster-level covariates. For secondary outcomes such as patient-reported experience and satisfaction, our individual-level GLMM models will include fixed effects for time, intervention effect, and random effects and random time effects for each cluster, with the covariates consisting of age, gender, the reason for ED visit, and cluster-level LOS, PIA, and proportion of LWBS.
In the basic model suggested by Hussey and Hughes , a homogeneous secular trend is assumed across all clusters. However, this SW-CRT has numerous methodological difficulties such as confounding with time, time-varying correlation structure, change in treatment effect over time, within-cluster contamination, and change in design variation. These complexities differ according to the way SW-CRTs are designed. A summary of key methodological issues that need extra consideration when reporting SW-CRT is presented in Table S2 in . We will be continuously monitoring and intervening when necessary to manage analytical challenges associated with this kind of design. Any unexpected event during the study period will be recorded, and methodological approaches to overcome the issue will be described in the reports.
As a patient-oriented study, the inclusion of patients in the research team is critical. An example of this is our lead patient research partner who has been advising the research team since the pilot study. The research team is also advised by the patient engagement working group, which comprises the lead patient partner, scientific patient engagement lead, clinicians, researchers, and students. We designed the protocol to give patients a variety of opportunities to participate in research activities. Applicable research activities vary in terms of the level of engagement required (eg, surveys vs full-team membership). We are currently recruiting additional patient research partners for the study’s patient engagement working group, but patients can also be involved in other committees and working groups suited to their interests and needs. Overall, the level of engagement will vary from receiving information to consultation to full collaboration with patient partners to inform all project activities. We used 4 essential pillars, as suggested by Shippee et al , to inform our patient engagement strategy, which is further described in our implementation protocol [ ]. We are committed to upholding the guiding principles of inclusiveness, support, mutual respect, and cobuilding inherent in these pillars.
Impact of COVID-19
The impact of the COVID-19 pandemic on the study and its protocol is ongoing. Public health care measures such as stay-at-home orders, handwashing, and physical and social distancing compounded with COVID-19 concerns have caused rapid disruptions in daily life and a delay in the implementation of the intervention. A notable effect may be a significant change in the number of patients visiting EDs. The fear that the public is experiencing because of COVID-19 is likely exacerbated by measures related to stay-at-home orders, self-isolation protocols, including quarantines, travel restrictions, and closures of nonessential businesses. With most of Newfoundland and Labrador’s residents practicing social distancing and self-isolating and an increase in the number of workers who are now working remotely, the potential for injuries such as trauma due to motor vehicle collisions may decline considerably . Given the potential reduction in injury and the climate of fear at the beginning of the COVID-19 pandemic, patients were found to be less likely to use hospital ED services [ ]. Another impact of the pandemic is the temporary suspension of essential and nonessential medical procedures. The suspension of certain health care services may have downstream effects on wait times because delays in surgeries and other important medical procedures could increase the number of higher acuity patients who develop complications because of the delay. These higher acuity patients require additional resources and time and can have a significant impact on patient flow and wait times. Other pandemic-related considerations include added wait times because of public health measures such as increased handwashing, social distancing, donning and doffing of personal protective equipment, and sanitizing high-touch surfaces. More recently, a transition from in-person to web-based or telephone family physician consultations may be increasing ED patient volumes [ , ]. The pandemic has also exacerbated issues related to physician and nursing shortages in the province [ - ]. As a result, achieving optimal sample size from each of the ED sites might be compromised because of pandemic-related ED service use trends. The research team will look to explore the effects of the COVID-19 pandemic on patient flow and wait times in EDs.
Description of Intervention
Our intervention comprises several components that will be implemented sequentially. The SurgeCon intervention is a pragmatic ED management platform that includes 3 distinct intervention components that together act to improve ED efficiency, patient satisfaction, and the value of emergency service costs (). SurgeCon’s intervention process starts with a site assessment during the transition period that aims to clarify key performance issues, collect information related to the ED’s organizational and workflow structures, and prepare ED staff and management for upcoming operational changes, while also establishing a patient-centered ED environment and action-based ED management ( ). Due to the high degree of variability that exists between EDs, the information collected during the site assessment allows for the customization of SurgeCon’s underlying protocols and determines whether certain components of the intervention are appropriate or applicable for implementation. A site assessment will be conducted by members of our working group who developed SurgeCon in Carbonear. The implementation working group will follow a 4-step protocol for these site assessment visits; for further details please see the implementation protocol [ ].
|Intervention components and action plans||Description and strategy|
|Restructure EDa organization and workflow|
|Stable patient priority setting||Canadian EDs have been using the CTASb since 1999 . What the SurgeCon intervention proposes is to augment CTAS by combining CTAS scores and waiting times to best meet the suggested time frame set out by the CTAS organization. Patients who are CTAS level 1 (resuscitation) or 2 (emergent) who are not stable will still be treated immediately in this model, but individuals who are less urgent (CTAS 3-5) will be treated when the CTAS 1-2 individuals become more stable, but before they are discharged. This allows the physician to quickly treat and discharge less urgent individuals before returning to spend more time with the urgent cases. This prioritization method can significantly improve patient flow without having to compromise patient safety.|
|Door-to-door focus||A number of studies have found a strong correlation between patient satisfaction and PIAc; the shorter the PIA, the more satisfied the patient [, ]. To reduce the time to PIA, we will use the following strategies:|
|Nurse practitioner–physician communication||SurgeCon reorganizes the traditional Canadian ED communication structure by promoting communication between NPsd, ERPse, and RNsf to work collaboratively to improve patient flow through appropriate allocation of patients. By opening lines of communication between NPs, ERPs, and RNs, the entire ED can work in unison to move patients further along their path to being discharged.|
|Establish a patient-centered ED environment|
|Improve the overall appearance of physical spaces in the ED (eg, waiting room, fast-track zone, examination rooms, and treatment space) to improve patient satisfaction||This will be conducted in collaboration with Eastern Health. In consultation with our local patient partners, we will renovate, redecorate, and declutter ED spaces, removing outdated or irrelevant wall postings. All subsequent wall postings will require departmental approval and will be placed in a central location.|
|eHealth action–based ED management|
|eHealth ED management solution||Using automated extraction of data from HISsg where possible and manual entry otherwise, SurgeCon’s digital component will be able to perform real time analysis on extracted data in a routine and timely manner to give ED staff a sense of overall demand and available resources at any given time. SurgeCon’s eHealth component will be installed and tested in each hospital during the adoption phase of the study. In situations where data elements might not be captured by existing ED repositories, an ED staff member will address this issue by manually entering specific variables (eg, number of ambulances waiting to be off-loaded) as part of their regular duties. Manual entry occurs via a web-based SurgeCon portal and is subsequently reported at a frequency that is determined by ED staff and management. SurgeCon’s eHealth component is currently available on desktops and mobile devices and has been deployed in Eastern Health’s secure network with the assistance of the Newfoundland and Labrador Centre for Health Information. The data entry portal and dashboard that provides real time data is normally displayed on a large digital whiteboard in close proximity to the nursing station. This allows all team members to have a clear understanding of the level of demand, current capacity, and available resources. The Carbonear pilot site has since operationalized the task of a 2-hour data entry interval and have done so without a significant workforce change. We have found that a 2-hour interval for data entry is a feasible target and can be quickly performed once certain reporting processes have been established [, ]. We have further developed and tested the digital application at our pilot site. The development of the application will continue throughout the study to ensure feedback and information are incorporated into iterative software updates.|
|eHealth action–based protocol||We have created a unique frontline, action-based protocol that helps ED staff (paramedics, nurses, and physicians) manage their actions to actively reduce patient surges and wait times and increase patients’ access to emergency medical care. The protocol is delivered via a digital whiteboard app, which will be installed in the nursing station in the ED. The app uses algorithms (adjusted to meet the needs of each hospital) to advise when to use volume-based staffing (shifting staff between areas of the hospital based on workload), appropriate and timely involvement of hospital management, and overcapacity protocols, which may otherwise be overlooked by distracted frontline ED staff. All intervention sites will be routinely collecting data related to staff availability, ED and inpatient bed availability, aggregate patient acuity, and process tracking, among other important variables through SurgeCon’s eHealth component. A SurgeCon level is calculated via an algorithm that uses variable data to determine the level of demand in the department and resource availability to meet the demand. The action-based protocol included in SurgeCon’s eHealth platform assigns actions based on the SurgeCon level calculated.|
The following list includes examples of actions that may be assigned once a threshold for a specific variable has been exceeded:
aED: emergency department.
bCTAS: Canadian Triage and Acuity Scale.
cPIA: physician’s initial assessment.
dNP: nurse practitioner.
eERP: emergency room physician.
fRN: registered nurse.
gHIS: hospital information system.
hICU: intensive care unit.
The SurgeCon intervention is guided by continuous process improvement principles that look to ultimately improve quality of services, reduce waste (low-value care), reduce time (ED wait times), and reduce cost (eg, cost per patient, cost of overtime, and cost to patients) [- ]. The following components of the SurgeCon intervention will follow these principles closely and will be implemented using other continuous improvement methods such as Kaizen events [ ]. The SurgeCon intervention includes 3 components ( ).
The major intervention components and their action plans with description and strategy are given in.
This study was funded in April 2019, was approved by the Newfoundland and Labrador Health Research Ethics Board on March 19, 2020, and is now registered with ClinicalTrials.gov. Data collection for this study is ongoing. As of February 2022, a total of 570 randomly selected patients have participated in telephone interviews focusing on patient-reported experiences and patient satisfaction with ED wait times. The first intervention site was randomly selected and began intervention implementation in September 2021. Since that time, SurgeCon’s eHealth component has been configured, and deployed and health care staff have received ED patient flow training. The second intervention site is scheduled to be randomly selected and begin intervention implementation during the winter of 2022.
The SurgeCon intervention has the potential to be a scalable solution that can address ED wait times. In this paper, we have described the protocol for a stepped wedge design, which is a relatively new type of study design that is progressively being used to evaluate the efficiency of public health services. This study design is known for its application in assessing the implementation of evidence-based quality improvement initiatives in health care settings. We chose the stepped wedge design as an informative, efficient, and valid design to examine the SurgeCon platform’s effectiveness in improving important patient and health service processes and outcomes in EDs located in a single region of Newfoundland and Labrador.
By assessing the impact of the SurgeCon intervention on the efficiency of ED services, we hope to be able to improve wait times and patient experiences and produce better-value care.
The work summarized in this protocol is supported by the Canadian Institutes of Health Research and provincial sponsors, including the Newfoundland and Labrador Provincial Government (Department of Tourism, Culture, Industry, and Innovation), Newfoundland and Labrador Eastern Regional Health Authority, and the Trinity Conception Placentia Health Foundation. The authors would like to thank Dr James Rourke for his input related to the initial conceptualization of the study and Newfoundland and Labrador Support for People and Patient Oriented Research and Trials for advising the research team on matters related to patient engagement and knowledge translation.
All authors contributed to the concept of the study. HHM and SA developed the study content and drafted the manuscript. All authors reviewed the manuscript, provided feedback, and approved the final version of the manuscript.
Conflicts of Interest
Definitions, sources, and purpose of study variables; methodological issues encountered; and applicable strategies to overcome them.DOCX File , 23 KB
- Torjesen I. Latest waiting time figures for emergency departments in England are worse on record. BMJ 2018;361:k1658. [CrossRef] [Medline]
- Emergency department wait times in Canada continuing to rise. Canadian Institute for Health Information. 2018. URL: https://www.cihi.ca/en/emergency-room-waits-continue-to-increase [accessed 2018-07-04]
- Dramatic rise in waiting times at emergency departments. BBC News. 2018. URL: https://www.bbc.com/news/uk-northern-ireland-44562129 [accessed 2018-11-28]
- Katz A, Enns J. How long is too long to wait in an emergency room? Huffington Post. 2018. URL: https://www.huffingtonpost.ca/alan-katz/emergency-room-waits-canada_b_16132058.html [accessed 2018-12-14]
- The commonwealth fund 2010 international health policy survey in eleven countries. The Commonwealth Fund. 2010. URL: https://www.commonwealthfund.org/sites/default/files/documents/___media_files_publications_chartbook_2010_pdf_2010_ihp_survey_chartpack_full_12022010.pdf [accessed 2012-06-26]
- Vezyridis P, Timmons S. National targets, process transformation and local consequences in an NHS emergency department (ED): a qualitative study. BMC Emerg Med 2014;14:12 [FREE Full text] [CrossRef] [Medline]
- Chang AM, Lin A, Fu R, McConnell KJ, Sun B. Associations of emergency department length of stay with publicly reported quality-of-care measures. Acad Emerg Med 2017;24(2):246-250 [FREE Full text] [CrossRef] [Medline]
- Barker J. Labrador senior waits 10 hours in emergency room without care for broken arm. CBC News. 2018. URL: https://www.cbc.ca/news/canada/newfoundland-labrador/goose-bay-emergency-wait-time-1.4582333 [accessed 2018-11-30]
- Hutton F. Picture of senior waiting for hours in St.John's emergency room sparks outrage. CBC News. 2018. URL: https://www.cbc.ca/news/canada/newfoundland-labrador/senior-hsc-waiting-social-media-1.4587954 [accessed 2018-11-30]
- Breen K. St. Anthony patients kept on stretchers while beds remained in storage. CBC News. 2018. URL: https://www.cbc.ca/news/canada/newfoundland-labrador/hospital-bed-closure-st-anthony-1.4673014 [accessed 2018-11-30]
- Carter AJ, Chochinov AH. A systematic review of the impact of nurse practitioners on cost, quality of care, satisfaction and wait times in the emergency department. CJEM 2007;9(4):286-295. [CrossRef] [Medline]
- Maggio PM, Brundage SI, Hernandez-Boussard T, Spain DA. Commitment to COT verification improves patient outcomes and financial performance. J Trauma 2009;67(1):190-195. [CrossRef] [Medline]
- Jarvis PR. Improving emergency department patient flow. Clin Exp Emerg Med 2016;3(2):63-68 [FREE Full text] [CrossRef] [Medline]
- Schroeppel TJ, Sharpe JP, Magnotti LJ, Weinberg JA, Croce MA, Fabian TC. How to increase the burden on trauma centers: implement the 80-hour work week. Am Surg 2014;80(7):659-663. [Medline]
- Schroeppel TJ, Sharpe JP, Magnotti LJ, Weinberg JA, Croce MA, Fabian TC. How to further decrease the efficiency of care at a level I trauma center: implement the amended resident work hours. Am Surg 2015;81(7):698-703. [Medline]
- Christmas E, Johnson I, Locker T. The impact of 24 h consultant shop floor presence on emergency department performance: a natural experiment. Emerg Med J 2013;30(5):360-362. [CrossRef] [Medline]
- Han JH, Zhou C, France DJ, Zhong S, Jones I, Storrow AB, et al. The effect of emergency department expansion on emergency department overcrowding. Acad Emerg Med 2007;14(4):338-343 [FREE Full text] [CrossRef] [Medline]
- Mumma BE, McCue JY, Li CS, Holmes JF. Effects of emergency department expansion on emergency department patient flow. Acad Emerg Med 2014;21(5):504-509 [FREE Full text] [CrossRef] [Medline]
- van Veelen MJ, van den Brand CL, Reijnen R, van der Linden MC. Effects of a general practitioner cooperative co-located with an emergency department on patient throughput. World J Emerg Med 2016;7(4):270-273 [FREE Full text] [CrossRef] [Medline]
- Morin C, Choukroun J, Callahan JC. Safety and efficiency of a redirection procedure toward an out of hours general practice before admission to an emergency department, an observational study. BMC Emerg Med 2018;18(1):26 [FREE Full text] [CrossRef] [Medline]
- Hospital spending: focus on the emergency department. Canadian Institute for Health Information. Ottawa: CIHI; 2020. URL: https://www.cihi.ca/sites/default/files/document/hospital-spending-highlights-2020-en.pdf [accessed 2021-12-06]
- Eastern health's annual performance report 2015-2016. Eastern Health. 2016. URL: https://issuu.com/easternhealth/docs/rpt_eastern_health_apr_2015-16_fina [accessed 2017-01-09]
- A strategy to reduce emergency department wait times in Newfoundland and Labrador. Health and Community Services, Government of Newfoundland. 2012. URL: https://www.gov.nl.ca/hcs/files/wait-times-pdf-emergency-department-strategy.pdf [accessed 2021-12-06]
- Anaraki NR, Jewer J, Hurley O, Mariathas H, Young C, Norman P, et al. Implementation of an ED surge management platform: a study protocol. Research Square (forthcoming) 2021:-. [CrossRef]
- Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Health 2019;7:64 [FREE Full text] [CrossRef] [Medline]
- Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009;4:50 [FREE Full text] [CrossRef] [Medline]
- Barker D, McElduff P, D'Este C, Campbell MJ. Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. BMC Med Res Methodol 2016;16:69 [FREE Full text] [CrossRef] [Medline]
- Beard E, Lewis JJ, Copas A, Davey C, Osrin D, Baio G, et al. Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014. Trials 2015;16:353 [FREE Full text] [CrossRef] [Medline]
- Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol 2006;6:54 [FREE Full text] [CrossRef] [Medline]
- Asghari S. SurgeCon: an emergency department surge management platform. Clinical Trials. 2021. URL: https://clinicaltrials.gov/ct2/show/NCT04789902 [accessed 2021-03-08]
- Patey C, Asghari S, Norman P, Hurley O. Redesign of a rural emergency department to prepare for the COVID-19 pandemic. CMAJ 2020;192(19):E518-E520 [FREE Full text] [CrossRef] [Medline]
- Patey C, Norman P, Araee M, Asghari S, Heeley T, Boyd S, et al. SurgeCon: priming a community emergency department for patient flow management. West J Emerg Med 2019;20(4):654-665 [FREE Full text] [CrossRef] [Medline]
- Killip S, Mahfoud Z, Pearce K. What is an intracluster correlation coefficient? Crucial concepts for primary care researchers. Ann Fam Med 2004;2(3):204-208 [FREE Full text] [CrossRef] [Medline]
- Heaton HA, Castaneda-Guarderas A, Trotter ER, Erwin PJ, Bellolio MF. Effect of scribes on patient throughput, revenue, and patient and provider satisfaction: a systematic review and meta-analysis. Am J Emerg Med 2016;34(10):2018-2028. [CrossRef] [Medline]
- Bellamkonda VR, Kumar R, Scanlan-Hanson LN, Hess JJ, Hellmich TR, Bellamkonda E, et al. Pilot study of Kano "Attractive Quality" techniques to identify change in emergency department patient experience. Ann Emerg Med 2016;68(5):553-561. [CrossRef] [Medline]
- Griffen D, Callahan CD, Markwell S, de la Cruz J, Milbrandt JC, Harvey T. Application of statistical process control to physician-specific emergency department patient satisfaction scores: a novel use of the funnel plot. Acad Emerg Med 2012;19(3):348-355 [FREE Full text] [CrossRef] [Medline]
- Boudreaux ED, Mandry CV, Wood K. Patient satisfaction data as a quality indicator: a tale of two emergency departments. Acad Emerg Med 2003;10(3):261-268 [FREE Full text] [CrossRef] [Medline]
- PROMS: background document. Canadian Institute for Health Information. 2015. URL: https://www.cihi.ca/sites/default/files/document/proms_background_may21_en-web.pdf [accessed 2018-11-27]
- Patient experience. Canadian Institute for Health Information. 2018. URL: https://www.cihi.ca/en/patient-experience [accessed 2018-11-30]
- Language highlight tables, 2016 Census. Statistics Canada. 2016. URL: https://www12.statcan.gc.ca/census-recensement/2016/dp-pd/hlt-fst/lang/Table.cfm?Lang=E&T=11&Geo=00 [accessed 2021-12-10]
- McCullagh P, Nelder JA. Generalized linear models. 2nd edition. London, UK: Chapman and Hall; 1989.
- Jiang J. Consistent estimators in generalized linear mixed models. J Am Stat Assoc 1998;93(442):720-729. [CrossRef]
- Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials 2007;28(2):182-191. [CrossRef] [Medline]
- Martin J, Taljaard M, Girling A, Hemming K. Systematic review finds major deficiencies in sample size methodology and reporting for stepped-wedge cluster randomised trials. BMJ Open 2016;6(2):e010166 [FREE Full text] [CrossRef] [Medline]
- Girling AJ, Hemming K. Statistical efficiency and optimal design for stepped cluster studies under linear mixed effects models. Stat Med 2016;35(13):2149-2166 [FREE Full text] [CrossRef] [Medline]
- Hooper R, Teerenstra S, de Hoop E, Eldridge S. Sample size calculation for stepped wedge and other longitudinal cluster randomised trials. Stat Med 2016;35(26):4718-4728. [CrossRef] [Medline]
- Kasza J, Hemming K, Hooper R, Matthews J, Forbes AB. Impact of non-uniform correlation structure on sample size and power in multiple-period cluster randomised trials. Stat Methods Med Res 2019;28(3):703-716. [CrossRef] [Medline]
- Kumar A, Chakraborty BS. Interim analysis: a rational approach of decision making in clinical trial. J Adv Pharm Technol Res 2016;7(4):118-122 [FREE Full text] [CrossRef] [Medline]
- Shippee ND, Domecq Garces JP, Prutsky Lopez GJ, Wang Z, Elraiyah TA, Nabhan M, et al. Patient and service user engagement in research: a systematic review and synthesized framework. Health Expect 2015;18(5):1151-1166 [FREE Full text] [CrossRef] [Medline]
- Kamine TH, Rembisz A, Barron RJ, Baldwin C, Kromer M. Decrease in trauma admissions with COVID-19 pandemic. West J Emerg Med 2020;21(4):819-822 [FREE Full text] [CrossRef] [Medline]
- COVID-19’s impact on emergency departments. Canadian Institute of Health Information. 2021. URL: https://www.cihi.ca/en/covid-19-resources/impact-of-covid-19-on-canadas-health-care-systems/how-covid-19-affected [accessed 2021-12-06]
- Covid-19 update regarding the provision of in-person and virtual care. The College of Physicians and Surgeons of Ontario. 2021. URL: https://www.cpso.on.ca/en/News/COVID-19-Updates/Information-for-Physicians/COVID-19-update-regarding-the-provision-of-in-(1) [accessed 2021-12-14]
- COVID-19 update re: in-person and virtual care. College of Physicians and Surgeons of British Columbia. 2021. URL: https://www.cpsbc.ca/files/pdf/2021-09-03-COVID-19-Update.pdf [accessed 2021-12-14]
- Registered nurses' union calls on parties to address growing shortage of registered nurses. Registered Nurses' Union. 2021. URL: https://rnunl.ca/registered-nurses-union-calls-on-parties-to-address-growing-shortage-of-registered-nurses/ [accessed 2021-12-14]
- Physicians in NL stand in solidarity with our registered nurse colleagues on their day of action. Newfoundland and Labrador Medical Association (NLMA) News. URL: https://www.nlma.nl.ca/News-And-Events/NLMA-News/Page/0/Article/385 [accessed 2021-12-14]
- Report: physician resource forecast for family medicine: Newfoundland and Labrador. Health Intelligence Inc. 2019. URL: https://nlma.nl.ca/FileManager/Documents/docs/2019.12.09_Physician_Resource_Forecast_Family_Medicine_FINAL_reduced.pdf [accessed 2021-12-14]
- Health care in Canada, 2012: a focus on wait times. Canadian Institute for Health Information. 2012. URL: https://publications.gc.ca/collections/collection_2013/icis-cihi/H115-15-2012-eng.pdf [accessed 2021-12-14]
- El Sayed MJ, El-Eid GR, Saliba M, Jabbour R, Hitti EA. Improving emergency department door to doctor time and process reliability: a successful implementation of lean methodology. Medicine (Baltimore) 2015;94(42):e1679 [FREE Full text] [CrossRef] [Medline]
- Pang PS, McCarthy D, Schmidt M, Weiner M, Gavran G, Patterson B, et al. 440 Factors associated with perfect Press Ganey satisfaction scores for discharged emergency department patients. Ann Emerg Med 2011;58(4):S327-S328. [CrossRef]
- Womack JP, Jones DT, Roos D. The machine that changed the world: the story of lean production--Toyota's secret weapon in the global car wars that is now revolutionizing world industry. New York, NY: Simon and Schuster; 1990.
- Holweg M. The genealogy of lean production. J Oper Manag 2007;25(2):420-437. [CrossRef]
- Poole T, Mazur LM. Assessing readiness for lean change in emergency department. In: Proceedings of the 2010 Industrial Engineering Research Conference. 2010 Presented at: IIE '10; June 5-9, 2010; Cancun, Mexico p. 1-6.
- Vashi AA, Sheikhi FH, Nashton LA, Ellman J, Rajagopal P, Asch SM. Applying lean principles to reduce wait times in a VA emergency department. Mil Med 2019;184(1-2):e169-e178. [CrossRef] [Medline]
- Kaizen. Lean production. 2018. URL: https://www.leanproduction.com/kaizen/ [accessed 2018-11-28]
|CIHI: Canadian Institute for Health Information|
|ED: emergency department|
|EH: Eastern Health|
|GLMM: generalized linear mixed model|
|ICC: intracluster correlation coefficient|
|KPI: key performance indicator|
|LOS: length of stay|
|LWBS: leaving the emergency department without being seen|
|PIA: physician’s initial assessment|
|RE-AIM: reach, effectiveness, adoption, implementation, and maintenance|
|RHA: regional health authority|
|SW-CRT: stepped wedge cluster randomized trial|
Edited by G Eysenbach; submitted 16.05.21; peer-reviewed by L Dudley, C Hao; comments to author 18.11.21; revised version received 16.12.21; accepted 18.12.21; published 24.03.22Copyright
©Hensley H Mariathas, Oliver Hurley, Nahid Rahimipour Anaraki, Christina Young, Christopher Patey, Paul Norman, Kris Aubrey-Bassler, Peizhong Peter Wang, Veeresh Gadag, Hai V Nguyen, Holly Etchegary, Farah McCrate, John C Knight, Shabnam Asghari. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 24.03.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.