This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.
Background
Trauma is the most common cause of mortality among people between the ages of 1 and 45 years, costing Canadians 19.8 billion dollars a year (2004 data), yet half of all patients with major traumatic injuries do not receive evidence-based care, and significant regional variation in the quality of care across Canada exists. Accordingly, our goal is to lead a research project in which stakeholders themselves will adapt evidence-based trauma care knowledge tools to their own varied institutional contexts and cultures. We will do this by developing and assessing the combined impact of WikiTrauma, a free collaborative database of clinical decision support tools, and Wiki101, a training course teaching participants how to use WikiTrauma. WikiTrauma has the potential to ensure that all stakeholders (eg, patients, clinicians, and decision makers) can all contribute to, and benefit from, evidence-based clinical knowledge about trauma care that is tailored to their own needs and clinical setting.
Objective
Our main objective will be to study the combined effect of WikiTrauma and Wiki101 on the quality of care in four trauma centers in Quebec.
Methods
First, we will pilot-test the wiki with potential users to create a version ready to test in practice. A rapid, iterative prototyping process with 15 health professionals from nonparticipating centers will allow us to identify and resolve usability issues prior to finalizing the definitive version for the interrupted time series. Second, we will conduct an interrupted time series to measure the impact of our combined intervention on the quality of care in four trauma centers that will be selected—one level I, one level II, and two level III centers. Participants will be health care professionals working in the selected trauma centers. Also, five patient representatives will be recruited to participate in the creation of knowledge tools destined for their use (eg, handouts). All participants will be invited to complete the Wiki101 training and then use, and contribute to, WikiTrauma for 12 months. The primary outcome will be the change over time of a validated, composite, performance indicator score based on 15 process performance indicators found in the Quebec Trauma Registry.
Results
This project was funded in November 2014 by the Canadian Medical Protective Association. We expect to start this trial in early 2015 and preliminary results should be available in June 2016. Two trauma centers have already agreed to participate and two more will be recruited in the next months.
Conclusions
We expect that this study will add important and unique evidence about the effectiveness, safety, and cost savings of using collaborative platforms to adapt knowledge implementation tools across jurisdictions.
interrupted time serieswikiquality improvementknowledge translationtrauma carestakeholder engagementadapting knowledge toolsIntroductionThe Research QuestionWhat Is the Problem to Be Addressed?
Injuries represent a major health and economic burden for Canadians. They are the most common cause of mortality for people between the ages of 1 and 45 years [1], costing Canadians 19.8 billion dollars in 2004 in direct and indirect costs [2,3]. Up to half of all patients with major traumatic injuries do not receive evidence-based recommended care [4-8]. A recent study conducted in partnership with the Institut national d'excellence en santé et services sociaux (INESSS) and funded by the Canadian Health Services Research Foundation [5] determined that many trauma practices in Quebec’s trauma centers are substandard because they underuse proven therapies [4,5]. Studies in several other countries have identified adverse events, including death, that occur in trauma centers because of their failure to adopt best practices [9-13]. Aside from underusing proven therapies, there is also evidence of overuse of diagnostic procedures with known side effects, such as full-body computerized tomography (CT) scanning that exposes patients to unnecessary ionizing radiation that may increase the risk of cancer [14,15]. An estimated one million children every year in the US are unnecessarily imaged with CT [16].
Promoting best practices in trauma care has become an urgent and strategic investment for the health of Canadians and others [17,18]. Unfortunately, the implementation of best practices in the chaotic, acute trauma care environment is a difficult task because of three main factors, which are (1) macroenvironmental (eg, lack of financial resources), (2) organizational (eg, unclear definition of responsibilities within trauma team), and (3) professional (eg, resistance to clinical guidelines) [19]. Studying strategies used to implement best practices in trauma care, the Commonwealth Fund study [19] identified that trauma systems needed better knowledge management and coordination of care through well-implemented guidelines (ie, recommendations about what to do), protocols (ie, detailed procedures for how to administer care), and pathways (ie, frameworks for organizing who administers care and why). Moreover, these tools must be flexible and responsive to individual patients and to accumulating bodies of evidence. Many different health organizations have, therefore, started using wikis to manage knowledge and coordinate care [20-28]. Increasingly popular among health professionals [29-32], wikis are websites based on a novel technology that allow people to view and edit the website’s content, with viewing and editing privileges determined by different levels of access. Wikipedia—the best-known wiki—has 365 million visitors per month, is the sixth-most popular website in the world and its medical articles, available in 271 languages, are viewed about 150 million times per month [33].
In partnership with our team of researchers, the INESSS in Quebec is exploring how wikis could be used to improve the delivery of care to trauma patients. The INESSS oversees the quality of trauma care in the province of Quebec, Canada. It is also the accreditation body that designates different trauma center levels. This organization has expressed the need to explore wikis as a solution to improve the quality of care in trauma. To this end, we have conducted a scoping review that found that wikis could be effective in supporting the implementation of best practices in health care [34-39]. We also conducted a survey that identified that trauma professionals are willing to use wikis and that they share many positive beliefs about using them [40]. Specifically, wikis could serve as centralized knowledge management systems helping clinicians and decision makers coordinate the implementation of best practices by collaboratively building knowledge translation (KT) tools (eg, guidelines, protocols, pathways, and patient decision aids) that meet their needs [41-45] and monitor their use using novel Web metrics [46,47]. Wikis’ other interesting features included their low cost [40,48-51], their broad and global availability [33], their adaptability to local practices, and their capacity to empower stakeholders [52-54]. Wikis were perceived to facilitate the sharing and updating of KT tools by different professionals and to help clinicians working in rural areas where access to specialized care is limited [55,56].
Building on these results, we held a meeting funded by the Canadian Institutes of Health Research (CIHR) in May 2014 in partnership with the INESSS, the Trauma Association of Canada, and the Royal College of Physicians and Surgeons of Canada to plan a study to evaluate WikiTrauma (see Figure 1), a wiki we created to promote best practices in trauma care. At this planning meeting we decided to study its implementation in a limited number of Quebec trauma centers as a first trial for this novel intervention. We also decided to create Wiki101 (see Figure 2), a theory-based continuing professional development (CPD) program, that will train participants at the selected trauma centers to use WikiTrauma effectively and safely in order to create and share different types of KT tools (eg, care protocols, order sets, and patient decision aids).
Thus, in partnership with the INESSS and in collaboration with our other WikiTrauma partners, we propose an interrupted time series to measure the combined effect of Wiki101 and WikiTrauma on the quality of trauma care in four trauma centers in Quebec. We also propose to conduct a mixed-methods process evaluation in parallel with this trial to explore possible causal mechanisms about how our combined intervention succeeds—or fails—to lead to improved quality of trauma care.
Screenshot of WikiTrauma order set.
Screenshot of Wiki101 training program.
What Are the Principal Research Questions to Be Addressed?
Ultimately, we seek to test our hypothesis that our theory-based intervention (Wiki101) in combination with the use of WikiTrauma will result in better adoption of best practices in trauma care in Canada (see the conceptual framework in Figure 3), safer care (ie, fewer complications), improved patient outcomes, and less costly care.
Conceptual framework underlying the proposed mechanism of action for the intervention.
Why Is This Project Needed Now?
Getting new evidence into health care practice is a slow and challenging process [57-65]. There is an ongoing and urgent need to find effective and low-cost methods of promoting best practices in all areas of health care [65-67] and, particularly, into interprofessional settings such as trauma care [17,68-72]. Recognizing that wikis capitalize on the free and open access to information, scientists, opinion leaders, and patient advocates have called for more research to determine whether wikis can equip decision-making constituencies to improve the delivery of health care [33,73], decrease its cost [49,74], and improve access to knowledge within developing countries [33,75-77]. Moreover, wikis are increasingly being used in health care by different academic institutions [32,41,78-81], health organizations [20,22,25,82,83], and health professionals [84-86] to share and disseminate information. As well, the principal knowledge user involved in our project (INESSS) is planning to use a wiki to promote best practices in trauma care, but would like to have more evidence about their use. Our CIHR-funded scoping review [34] confirmed that wikis have tremendous potential for improving the delivery of health care, but that a rigorous prospective trial to evaluate their effectiveness at implementing best practices is outstanding. Both our review and our survey identified an important need to test a theory-based approach addressing the main barriers that are preventing wikis from widely benefiting our health care system. The barriers most frequently mentioned, in order of frequency, were unfamiliarity with wikis, time constraints, lack of self-efficacy (ie, belief in one’s competence to use a wiki), and lack of access to a useful wiki containing reliable information for bedside decision making. For these reasons, we have designed WikiTrauma—a wiki promoting best practices—and Wiki101—a theory-based intervention—to maximize the potential benefits, to address the main barriers, and prevent any potential negative impacts of using a wiki to promote best practices in trauma care. In summary, there is sufficient evidence to support the conduct of this prospective interrupted time series for testing our novel intervention, which will combine a wiki to promote best practices in trauma care and a theory-based implementation strategy designed to maximize its benefit. This trial will inform our knowledge users about the impact of the combined effect of WikiTrauma and Wiki101 on the implementation of best practices in trauma care.
Best Practices in Trauma CareBarriers to Implementing Best Practices in Trauma Care
Various aspects of trauma care can impede best practices [13]. Trauma professionals must often make quick decisions, mostly based on intuitive reasoning [87], which is fast, impulsive, effortless, and reflexive. While this serves trauma care well, it is also prone to error. Reminders (eg, care protocols) are knowledge tools [88] that improve intuitive decision making [87]. A recent systematic review indicated that noncomputerized reminders had the potential to improve practices in critical care [70]. Computerized reminders and clinical decision support systems, which were excluded from the previous review, offer different KT opportunities in trauma centers' hectic environments [89-91].
Systematic Reviews About Computerized Decision Support Systems and Barriers to Their Adoption
Systematic reviews indicate that computer-based reminders are effective interventions for fostering best practices in a variety of clinical areas [26,92-100], including in acute care [89]. Such reminders range from simple prescribing alerts to more sophisticated computer systems that support decision making. This said, health professionals have rejected many computer-based reminder systems on the grounds that they are slow, incompatible with work processes, unable to adapt to local practices, difficult to access, and/or are costly to implement [90,91,101-105]. Finding innovative ways to involve end users in designing, implementing, and evaluating reminder systems is key to increasing their use and their impact on health outcomes. Novel collaborative applications like wikis offer an easy and inexpensive solution [31].
Theoretical Framework Supporting the Use of Wikis as a Driver for Change in Health Systems
According to behavior-change theories, self-efficacy—roughly defined as an individual’s belief in his/her own competence—is one of the most important cognitive determinants of behavior [106-109]. By involving health professionals in sharing, updating, and creating practical reminders, wikis—highly accessible, interactive vehicles of communication—have the potential to increase professionals’ self-efficacy in using reminders [29,30,74].
Rising Use of Wikis in the Health Care System
Studies have found that 70% of junior physicians (mostly residents) use Wikipedia weekly [84], that 50-70% of physicians use it as a source of information in providing care [33], and that 35% of pharmacists refer to it for drug information [85]. Different large health care organizations (eg, Canadian Agency for Drugs and Technologies in Health [110-112], US National Institutes of Health [20,113], The Cochrane Collaboration [22], World Health Organization [83], and several universities [32,41,78-81,114]) are exploring the use of wikis and/or Wikipedia for different purposes. There is a rising use of wikis in health care and, consequently, increased potential safety risks involved with using nonvalidated information for the care of patients. Therefore, we believe there is an urgent need to evaluate the positive benefits wikis could provide in improving the quality of care, while limiting the potential negative effects. We intend to do this by conducting a rigorous and well-planned prospective trial in the controlled setting of a closed wiki (WikiTrauma) managed by strong central leadership (INESSS).
Objectives
Our main objective will be to study the combined effect of WikiTrauma and Wiki101 on the quality of care in four trauma centers in Quebec using an interrupted time series design. Our secondary objectives will be (1) to evaluate the impact of our intervention on mortality, rate of complications, length of stay, and the Functional Independence Measure (FIM), (2) to evaluate participants' opinions about the combined intervention—Wiki101 and WikiTrauma, (3) to evaluate the quality of the different knowledge tools developed in WikiTrauma, and (4) to estimate the costs saved by sharing the different knowledge tools within WikiTrauma.
MethodsPilot-Testing of WikiTrauma and Wiki101 Before the Prospective Trial
In consultation with two human factors specialists (HW, ST) and using the versions of WikiTrauma and Wiki101 developed at the planning meeting, we will further refine WikiTrauma and Wiki101 by employing user-centered design methods focused on our users' needs [115,116]. A rapid, iterative prototyping process with 15 health professionals from nonparticipating centers will allow us to efficiently identify and resolve usability issues prior to finalizing the definitive version of WikiTrauma and Wiki101 for the interrupted time series [117,118].
What Is the Proposed Trial Design?
This study will be an interrupted time series with a parallel, theory-based process evaluation alongside the trial (see Figure 4). In the context of quality improvement, the interrupted time series is a simple but powerful tool used for evaluating the impact of a quality improvement program [119]. Our time series—repeated observations of the quality of care collected over time—will be divided into two segments. The first segment will comprise 10 retrospective, quarterly measurements of the quality of care measured before our intervention (a period of 30 months), and the second segment will be four prospective, quarterly quality of care measurements after our intervention (12 months). There are 57 adult-designated trauma centers of varying levels in Quebec—three level I, 26 level II, and 28 level III trauma centers. Four trauma centers will be selected in Université Laval's trauma network. We already identified one level I trauma center and a level II trauma center as participants. We will recruit two level III centers to complete our targeted sample of participating centers. Participants will not be blinded to their study assignment, however, all analyses will be blinded. The control group will comprise all of the 53 remaining adult trauma centers in the province.
Diagram representing the interrupted times series design.
What Are the Planned Trial Interventions?Experimental Group
Participants from trauma centers assigned to the experimental group will receive a password to access and complete the Wiki101 course and to use WikiTrauma. They will receive three reminders at 2-week intervals to complete Wiki101. Before and after each Wiki101 course, participants will be administered a validated questionnaire to measure changes in opinion and beliefs about using WikiTrauma. Questionnaires will also be repeated after the prospective 12-month period. After each course, participants will also receive a 2-week reminder about skills taught during the course.
Control Group
Participants in the control group will receive an email promoting access to the regular INESSS webpage and will also receive three reminders at 2-week intervals to access the website. They will not have access to view or edit WikiTrauma.
Management of WikiTrauma During the Trial
For the purpose of this trial, to monitor its use, and ensure its quality, access to WikiTrauma will be protected by password.
Quality of Information Monitoring
Since the wiki content can be constantly changed by the participants, the quality of information and the strength of evidence will be assessed weekly by a medical expert (JL) and monthly by the steering committee using a standardized evaluation form. This committee will edit any serious deviations from recognized standards of care and will flag controversial topics to stimulate discussion within the wiki community.
What Are the Proposed Practical Arrangements for Allocating Participants to Trial Groups?
All professionals and decision makers working in the four participating trauma centers will be eligible to participate. With the help of the local leaders on the trauma committee, we will recruit as many clinicians (eg, physicians, nurses, respiratory therapists, and pharmacists) and decision makers (eg, heads of Emergency Department, Surgery Department, and Critical Care Department) as possible. All participating trauma committees will also be asked to designate five patient representatives to take part in the construction of various tools designed for their use (eg, decision aids and patient handouts). In each center, we will present the project to the local representatives of each trauma committee. We will provide a hands-on Wiki101 session to all the members of the local trauma committee and the five patient representatives, who will then become the local leaders able to teach their colleagues how to access the wiki and contribute to its content. An online version of Wiki101 will be available to all clinicians and patient representatives for future consultation.
What Are the Proposed Methods for Protecting Against Sources of Bias?
Although blinding of the participants and randomization are not feasible in this small trial, we will mobilize all efforts to minimize any other sources of bias. All data collectors (medical archivists) will be blinded to the allocation group. Throughout our study, we will prevent contamination by protecting Wiki101 and WikiTrauma by password and note any potential competing intervention. We will also identify any professional working in more than one participating trauma center to consider the impact of this potential source of bias. Wiki101 will be a standardized online training program. We will encourage all participants to complete all 12 months of the study. To minimize a potential Hawthorne effect, our control group will receive an invitation to consult the INESSS website at the beginning of the study. Moreover, our proposed study design of an interrupted time series provides the advantage of controlling for secular trends in the data.
What Are the Planned Inclusion/Exclusion Criteria?Inclusion Criteria
We will select four trauma centers—one level I, one level II, and two level III trauma centers. The two level III centers will be identified by the authors based on their willingness to participate and collaborate with the other trauma centers for the 12-month project. At the individual level, study participants must be decision makers (eg, trauma program coordinators) or health care professionals (eg, emergency physicians, critical care physicians, trauma surgeons, nurses, respiratory therapists, physiotherapists, or pharmacists). Patient representatives will be selected without any restrictions or limitations with regard to their qualifications. These patient representatives could also be caregivers to existing trauma patients. Health care professional students and trainees (eg, residents, medical students, and nursing students) will have the same access to WikiTrauma and Wiki101 as fully certified professionals.
Exclusion Criteria
At the cluster level, a trauma center will not be eligible to participate if more than 50% of the members of the local trauma committee refuse to participate. Reasons for exclusion or refusal to participate will be documented. Pediatric trauma centers will be excluded.
What Is the Proposed Duration of the Treatment Period?
Wiki101 will take 3 hours to complete for each participant and they will have access to use Wiki101 and WikiTrauma for 12 months.
What Is the Proposed Frequency and Duration of Follow-Up?
Aside from our pre- and post-Wiki101 questionnaire and the 2-week reminder after completing Wiki101, we will only administer a final questionnaire after the 12-month treatment period.
What Are the Proposed Primary and Secondary Outcome Measures?
The primary outcome measure will be the change over time in a validated, composite performance indicator score based on 15 process performance indicators found in the Quebec Trauma Registry [4]. The secondary outcome measures will be rates of complications, length of stay, mortality, and the FIM. These will also be found in the Quebec Trauma Registry. Other secondary outcome measures will be the following: (1) intention to use WikiTrauma and the sociocognitive determinants of this intention, (2) the self-reported use of WikiTrauma in clinical practice, (3) the actual frequency of WikiTrauma use—number of visits, length of visits, number of visitors, and number of unique visitors, (4) the quality of information contained within WikiTrauma, (5) the frequency of content modifications—number of visitors having modified content, number of pages modified, number of new pages created, and number of pages having generated an edit war, (6) participants’ comments about what worked and improvements suggested, (7) the estimated annual cost of maintaining WikiTrauma, (8) the cost of delivering Wiki101, (9) the estimated cost of creating new knowledge-decision tools, and (10) the estimated cost of updating old knowledge-decision tools.
How Will the Outcome Measures Be Measured at Follow-Up?
We will measure quarterly composite performance scores from the Quebec Trauma Registry for all 57 adult trauma centers. Data in the Quebec Trauma Registry is routinely collected in all Quebec trauma centers every 3 months. The composite performance score is calculated as the average of 15 other indicators routinely collected in the Quebec Trauma Registry [4]. This score has good discrimination, construct validity, criterion predictive validity, and forecasting properties [120]. Mortality rates, complication rates (for delirium, pneumonia, and deep venous thrombosis), length of stay, and FIM will also be measured on a quarterly basis for all 57 trauma centers from routinely collected data in the Quebec Trauma Registry. The intention to use WikiTrauma will be measured by a validated questionnaire [40]. The actual wiki use and the frequency of content modification will be measured on a quarterly basis using a Google Analytics account linked to WikiTrauma.
Safety Monitoring and Quality Assurance
Since participants can change wiki content, the quality of information and the strength of evidence will be assessed weekly by an INESSS medical expert, and monthly by the scientific committee using a standardized evaluation form. This committee will edit any serious deviations from recognized standards of care and will flag controversial topics to stimulate discussion within the wiki community. The quality of different KT tools will be evaluated using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology for grading quality of evidence and strength of recommendations [121]. To estimate the amount of supervision that was needed by the medical supervisor at INESSS, we will document the number of pages modified and created, and the number of edit wars. In order to ensure that only high-quality and officially approved knowledge tools will be used in clinical practice, wiki pages that are not approved for clinical use by local trauma committees will be color-coded in RED with a warning message to say that the page is currently under construction. Pages that are approved by local trauma committees will be color-coded in GREEN for use only in the trauma center that approved the page. To estimate activity that was generated by our wiki and the amount of supervision that was needed during this trial by the medical supervisor at INESSS, we will study the wiki’s revision history page to document the number of visitors having modified the content, the number of pages modified, the number of new pages created, and the number of pages having generated an edit war [122] on a quarterly basis. An edit war will be defined as more than three reverts by a single editor on a single page within a 24-hour period. An edit that undoes other editors' actions will count as a revert. All cases of potential patient harm reported by any quality assurance committee or participant will be described and declared.
Sample Size
As a rule of thumb for an interrupted time series, 10 measurement points before and 10 measurements after an intervention provides 80% power to detect a change in level of 5 standard deviations (of the predata) only if the autocorrelation is greater than .4 (ie, extent to which data collected close together in time are correlated with each other) [123]. In our case, we will be able to measure 10 measurement points before (30 months), but the period of observation after our intervention will be limited to 12 months—4 quarters is equal to 4 measurement points. This will decrease our power, but we are currently applying for funding from other sources to collect data for a total of 32 postintervention months (10 quarters).
Data Analysis
Segmented regression will be used to measure, statistically, the changes in level and slope in the postintervention period compared to the preintervention period [119]. Thus, we will present a regression model with different intercept and slope coefficients for the pre- and postintervention time periods. We will compare the changes in quality of care measured at our four intervention trauma centers to the changes in quality of care measured at the other 53 trauma centers where no experimental intervention occurred. During the implementation period of WikiTrauma, we will continue to measure the impact on the quality of care. However, we will only proceed to compare the change in slope in the postintervention period once WikiTrauma has been fully implemented. We will use a Durbin-Watson test to verify the presence of autocorrelation and use an autoregressive error model to correct for this serial correlation.
Qualitative Content Analysis
We plan to enlist two researchers experienced in qualitative content analysis who will review participants' written questionnaire answers to identify the barriers in using our intervention. They will also try to understand how our combined intervention succeeded—or failed—to lead to improved quality of trauma care. When consensus between the two reviewers is not possible, a third reviewer will be consulted.
Study Duration
This project is planned to last 18 months. We have planned 3 months to implement the trial, including ethics approval in the four designated trauma centers and for delivering Wiki101 to the four local trauma committees. We will analyze all retrospective data obtained from the Quebec Trauma Registry in the first 3 months of our study and every 3 months thereafter for a total of 12 months. The last 3 months will be used to prepare our datasets, conduct our various analyses, and write our final report.
Ethical Considerations
We will apply for ethical approval to conduct this trial in all four participating trauma centers. All participants will be asked to consent before accessing the wiki for the first time and before any questionnaire administration. Local trauma committees will be consulted and we will obtain approval and support from each trauma center's chief executive officer. Patient participants will also be asked to complete a consent form before participating in any phase of this trial.
A legal disclaimer will also be posted on the wiki site asking participants to always use their clinical judgement first. Clinical judgement should never be replaced by any information found in a protocol based in WikiTrauma. In addition, clinicians should only use the wiki pages that have been approved by their local trauma committee.
All personal information on study participants will remain anonymous and we will not publish the names of any of the participating trauma centers. All sensitive information will be kept in a locked filing cabinet at the principal investigator’s (PI) research center or in a password-protected computer at the research center.
Results
This project was funded in November 2014 by the Canadian Medical Protective Association. We expect to start this trial in early 2015 and preliminary results should be available in June 2016. Two trauma centers have already agreed to participate and two more will be recruited in the next months.
Discussion
We expect that this study will yield important and unique evidence about the effectiveness, safety, and cost savings of using collaborative platforms to adapt knowledge-implementation tools across jurisdictions. A recent scoping review had not identified any prospective studies analyzing the impact of a wiki intervention on the quality of care in any field of health care [34]. Thus, to the best of our knowledge, this will be the first interrupted time series evaluating the impact of a wiki on the implementation of best practices in trauma care. Patient safety science will gain from this project because we will investigate how WikiTrauma can help standardize care across our trauma system. This will be done by providing a unique collaborative tool that allows centers to learn from others in the implementation of evidence-based knowledge translation tools (eg, care protocols, order sets, and patient decision aids). WikiTrauma will also offer a unique knowledge-management platform to support the central leadership provided by provincial decision makers, such as the Institut national d'excellence en santé et services sociaux. This study will also provide a new platform for effective local collaboration between professionals, decision makers, and patients. Public- and patient-involvement programs will gain insight about using wikis to engage patients and the public in the implementation of best practices. Interprofessional education and quality-improvement programs will also learn about how these novel platforms can support collaboration and coordination in the implementation of novel best practices.
AbbreviationsCHAU
Centre hospitalier affilié universitaire
CHU
Centre hospitalier universitaire
CIHR
Canadian Institutes of Health Research
CPD
continuing professional development
CSSS
Centre de santé et services sociaux
CT
computerized tomography
FIM
Functional Independence Measure
GRADE
Grading of Recommendations, Assessment, Development and Evaluation
INESSS
Institut national d'excellence en santé et services sociaux
KT
knowledge translation
PI
principal investigator
The authors would like to thank the following agencies for funding this project: the Canadian Medical Protective Association, Fonds de recherche du Québec—Santé (Career Scientist Award, 24856 and Establishment of young researchers—Junior 1 grant, 24856), the Canadian Institutes of Health Research (Planning Grant, RN201023 - 309271), and the CSSS Alphonse-Desjardins—Centre hospitalier affilié universitaire (CHAU) de Lévis. The authors would also like to thank the members of the Canadian Critical Care Trials Group for supporting the development of this protocol and Dr Shane English for having peer-reviewed our manuscript. The authors would also like to thank Louisa Blair and Sandra Owens for editing the manuscript. In addition, the authors would like to thank Marie Robert from the Fondation NeuroTrauma Marie-Robert, François Belleau, Jacob Orlowitz, Patrice Di Marcantonio, Mathieu Vézina, Marcel Rheault, Sylvain Croteau, Jean-Luc Morin, Saileth Ramirez, Yves Daigle, Susie Gagnon, Claudine Blanchet, Amina Belcaïd, Charles Lacroix, Jean-Michel Garro, Amélie Bujold, Rémi Blanchette, Jean-Daniel Boutin, Dr Richard Boisvert, Dr Nelson Piché and Dr Stéphane Panic for participating in the development of this project.
Christian Chabot works for Telus Health. Telus Health offers many different health information technology solutions, including electronic medical records. Telus has not had any role in influencing the content of this protocol. None of the other authors have received any honorariums for the conduct of this trial from Telus. Richard Grenier works for Thales Canada as Director of Research and Technology. Thales has provided in-kind financial support for the development of the wiki, but has not had any role in influencing the content of this protocol. None of the other authors have received any honorariums for the conduct of this trial from Thales.
Public Health Agency of Canada2015-01-11Leading causes of death and hospitalization in Canadahttp://www.phac-aspc.gc.ca/publicat/lcd-pcd97/table1-eng.php6VUlt8IrgPublic Health Agency of Canada19982015-01-11The economic burden of injury in Canadahttp://www.phac-aspc.gc.ca/injury-bles/ebuic-febnc/index-eng.php6VUmAJrRfThe Economic Burden of Injury in Canada2009Toronto, OntarioSMARTRISKMooreLLavoieASiroisMJAminiRBelcaïdASampalisJSEvaluating trauma center process performance in an integrated trauma system with registry dataJ Emerg Trauma Shock201304629510510.4103/0974-2700.11075423723617JETS-6-95PMC3665078LavoieAMooreLLapointeJBourgeoisGFréchettePCanadian Foundation for Healthcare Improvement201009012015-01-11Performance d'un continuum de services en traumatologiehttp://www.fcass-cfhi.ca/SearchResultsNews/09-04-22/8f0a9595-e93b-4678-a2d7-a3bfb20cfba4.aspx6VUnjsAEuSimonsREliopoulosVLaflammeDBrownDRImpact on process of trauma care delivery 1 year after the introduction of a trauma program in a provincial trauma centerJ Trauma19990546581181510338397KortbeekJBBuckleyRTrauma-care systems in CanadaInjury2003934965866310.1016/S0020-1383(03)00158-XSimonsRKirkpatrickAAssuring optimal trauma care: the role of trauma centre accreditationCan J Surg20020845428829512174987PMC3684684FamularoGSalviniPTerranovaAGeraceCClinical errors in emergency medicine: experience at the emergency department of an Italian teaching hospitalAcad Emerg Med2000117111278128111073478WilsonRMRuncimanWBGibberdRWHarrisonBTNewbyLHamiltonJDThe Quality in Australian Health Care StudyMed J Aust199511616394584717476634BrennanTALeapeLLLairdNMHebertLLocalioARLawthersAGNewhouseJPWeilerPCHiattHHIncidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study IN Engl J Med1991027324637037610.1056/NEJM1991020732406041987460LeapeLLBrennanTALairdNLawthersAGLocalioARBarnesBAHebertLNewhouseJPWeilerPCHiattHThe nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study IIN Engl J Med1991027324637738410.1056/NEJM1991020732406051824793GruenRLJurkovichGJMcIntyreLKFoyHMMaierRVPatterns of errors contributing to trauma mortality: lessons learned from 2,594 deathsAnn Surg200609244337138010.1097/01.sla.0000234655.83517.561692656300000658-200609000-00005PMC1856538RodriguezRMAnglinDLangdorfMIBaumannBMHendeyGWBradleyRNMedakAJRajaASJuhnPFortmanJMulkerinWMowerWRNEXUS chest: validation of a decision instrument for selective chest imaging in blunt traumaJAMA Surg2013101481094094610.1001/jamasurg.2013.2757239255831724982SakorafasLURogersFBPan-computed tomography for blunt trauma patients may be overusedJ Trauma201005685126610.1097/TA.0b013e3181d9d7d12045378000005373-201005000-00039BrennerDJHallEJComputed tomography--an increasing source of radiation exposureN Engl J Med20071129357222277228410.1056/NEJMra07214918046031357/22/2277GreenSEBoschMMcKenzieJEO'ConnorDATavenderEJBraggePChauMPittVRosenfeldJVGruenRLImproving the care of people with traumatic brain injury through the Neurotrauma Evidence Translation (NET) program: protocol for a program of researchImplement Sci201277410.1186/1748-5908-7-74228668921748-5908-7-74PMC3543324Brain and Spinal Injury Center2015-01-11San Francisco, CASan Francisco General Hospital, University of California at San Franciscohttp://www.brainandspinalinjury.org/6VUoWqLNtMarchAThe Commonwealth Fund2006062015-01-28Facilitating implementation of evidence-based guidelines in hospital settings: learning from trauma centershttp://www.cmwf.org/usr_doc/930_March_facilitating_implementation_final_web_02.pdf6VvJljpIQPubMed Health Blog201307132015-01-11Wikipedia visits the National Library of Medicine and NIHhttp://www.ncbi.nlm.nih.gov/pubmedhealth/blog/2013/07/Wikipedia-visits-National-Library-of-Medicine-NIH/6VUoytpg9Wiki Urgence HDL Informatisation2015-01-11Urgence HDL informatisationhttps://sites.google.com/site/urgencehdlinformatisation/6VUpZ0f0FBastianHHeilmanJTharyanP21st Cochrane Colloquium20132015-01-11Wikipedia meets Cochrane: working to get better evidence into mass usehttp://abstracts.cochrane.org/2013-québec-city/wikipedia-meets-cochrane-working-get-better-evidence-mass-use6VUplRwIxNational Institutes of Health2015-01-11Guidelines for participating in Wikipedia from NIHhttp://www.nih.gov/icd/od/ocpl/resources/wikipedia/6VUpwtagUInstitut national d'excellence en santé et services sociaux, Quebec2015-01-11Healthcare professionals’ intentions to use wiki-based reminders to promote best practices in trauma care: a survey protocolhttp://fecst.inesss.qc.ca/fr/archives/nouvelle/article/new-study-healthcare-professionals-intentions-to-use-wiki-based-reminders-to-promote-best-practi-1.html6VUqJHQiCThe Canadian Agency for Drugs and Technologies in Health (CADTH)201103022015-01-11CADTH systematic review published as wikihttp://www.cadth.ca/en/media-centre/2011/3/2/cadth-systematic-review-published-as-wiki6VW6dCyaKBernerESAgency for Healthcare Research and Quality2009062015-01-11Rockville, MDAHRQClinical decision support systems: State of the Arthttp://healthit.ahrq.gov/sites/default/files/docs/page/09-0069-EF_1.pdf6VW6ytGNzErinoffEAgency for Healthcare Research and Quality20092015-01-11Rockville, MDAHRQFeasibility study of a wiki collaboration platform for systematic reviewhttp://archive.ahrq.gov/news/events/conference/2009/erinoff/index.html6VW7Dyc6xCanadian Network for International Surgery2015-01-11Primary surgery wikihttp://www.cnis.ca/what-we-do/african-information-program/primary-surgery-wiki/6VW7R4A6KMcLeanRRichardsBHWardmanJIThe effect of Web 2.0 on the future of medical practice and education: Darwikinian evolution or folksonomic revolution?Med J Aust2007086187317417717680746mcl10181_fmTapscottDWilliamsADWikinomics: How Mass Collaboration Changes Everything200701New York, NYPortfolioWrightABatesDWMiddletonBHongsermeierTKashyapVThomasSMSittigDFCreating and sharing clinical decision support content with Web 2.0: Issues and examplesJ Biomed Inform20090442233434610.1016/j.jbi.2008.09.00318935982S1532-0464(08)00125-1ChuLFYoungCZamoraAKurupVMacarioAAnesthesia 2.0: Internet-based information resources and Web 2.0 applications in anesthesia educationCurr Opin Anaesthesiol20100423221822710.1097/ACO.0b013e328337339c20090518HeilmanJMKemmannEBonertMChatterjeeARagarBBeardsGMIberriDJHarveyMThomasBStompWMartoneMFLodgeDJVondracekAde WolffJFLiberCGroverSCVickersTJMeskóBLaurentMRWikipedia: a key tool for global public health promotionJ Med Internet Res2011131e1410.2196/jmir.158921282098v13i1e14PMC3221335ArchambaultPMvan de BeltTHGrajalesFJ 3rdFaberMJKuziemskyCEGagnonSBilodeauARiouxSNelenWLGagnonMPTurgeonAFAubinKGoldIPoitrasJEysenbachGKremerJALégaréFWikis and collaborative writing applications in health care: a scoping reviewJ Med Internet Res20131510e21010.2196/jmir.278724103318v15i10e210PMC3929050ArchambaultPMvan de BeltTHGrajalesFJ 3rdEysenbachGAubinKGoldIGagnonMPKuziemskyCETurgeonAFPoitrasJFaberMJKremerJAHeldoornMBilodeauALégaréFWikis and collaborative writing applications in health care: a scoping review protocolJMIR Res Protoc201211e110.2196/resprot.199323612481v1i1e1PMC3626140PhadtareABahmaniAShahAPietrobonRScientific writing: a randomized controlled trial comparing standard and on-line instructionBMC Med Educ200992710.1186/1472-6920-9-27194735111472-6920-9-27PMC2701428MoellerSSpitzerKSpreckelsenCHow to configure blended problem based learning-results of a randomized trialMed Teach2010328e328e34610.3109/0142159X.2010.49086020662568Ioannis ChiotelisIGiannakopoulosAKalafatiMKoutsouradiMKallistratosMManolisAJSecondary prevention with internet support after an acute coronary syndrome in greek patientsEur J Cardiovasc Prev Rehabil2011181S11StutskyBJPQDT Open20092015-01-12Ann Arbor, MIProQuest LLCEmpowerment and leadership development in an online story-based learning communityhttp://pqdtopen.proquest.com/doc/305149816.html?FMT=AI6VWFIj0HoArchambaultPMBilodeauAGagnonMPAubinKLavoieALapointeJPoitrasJCroteauSPham-DinhMLégaréFHealth care professionals' beliefs about using wiki-based reminders to promote best practices in trauma careJ Med Internet Res2012142e4910.2196/jmir.198322515985v14i2e49PMC3376518KohliMDBradshawJKWhat is a wiki, and how can it be used in resident education?J Digit Imaging20110224117017510.1007/s10278-010-9292-720386950PMC3046790YatesDPaquetteSEmergency knowledge management and social media technologies: A case study of the 2010 Haitian EarthquakeInt J Inf Manage2011311613YuRCrottyBWikis to better manage shared information in a hospitalist groupJournal of Hospital Medicine, 2011 Abstracts: Research, Innovations, Clinical Vignettes Competition20110510Hospital Medicine 2011May 10–13, 2011Grapevine, TXHoboken, NJJohn Wiley & Sons, IncS140S14110.1002/jhm.920BrownTFindlayMvon DincklageJDavidsonWHillJIsenringETalwarBBellKKissNKurmisRLoeligerJSandisonATaylorKBauerJUsing a wiki platform to promote guidelines internationally and maintain their currency: evidence-based guidelines for the nutritional management of adult patients with head and neck cancerJ Hum Nutr Diet20130426218219010.1111/jhn.1203623336961den BreejenEMNelenWLKnijnenburgJMBurgersJSHermensRPKremerJAFeasibility of a wiki as a participatory tool for patients in clinical guideline developmentJ Med Internet Res2012145e13810.2196/jmir.208023103790v14i5e138PMC3510744Varga-AtkinsTPrescottDDangerfieldPCyber behavior with wikisEncyclopedia of Cyber Behavior2012Hershey, PAIGI Global164177MoroseTUniversity of Waterloo200709212015-01-11Waterloo, OntarioUniversity of WaterlooUsing an interactive website to disseminate participatory ergonomics research findings: An exploratory studyhttps://uwspace.uwaterloo.ca/handle/10012/32746VW9rAeABGiustiniDHow Web 2.0 is changing medicineBMJ2006122333375821283128410.1136/bmj.39062.555405.8017185707333/7582/1283PMC1761169MandlKDKohaneISTectonic shifts in the health information economyN Engl J Med20080417358161732173710.1056/NEJMsb080022018420506358/16/1732ArchambaultPMBlouinDPoitrasJFountainRMFleetRBilodeauALégaréFEmergency medicine residents' beliefs about contributing to a Google Docs presentation: a survey protocolInform Prim Care201119420721622828575KimJYGudewiczTMDigheASGilbertsonJRThe pathology informatics curriculum wiki: Harnessing the power of user-generated contentJ Pathol Inform2010110.4103/2153-3539.6542820805963PMC2929539KyrkjebøJMBrattebøGSmith-StrømHImproving patient safety by using interprofessional simulation training in health professional educationJ Interprof Care20061020550751610.1080/1356182060091820017000476H76L45U27X621630ColeECrichtonNThe culture of a trauma team in relation to human factorsJ Clin Nurs20061015101257126610.1111/j.1365-2702.2006.01566.x16968430JCN1566ZwarensteinMReevesSPerrierLEffectiveness of pre-licensure interprofessional education and post-licensure collaborative interventionsJ Interprof Care20050519 Suppl 114816510.1080/1356182050008280016096152XW30N3G666X43W54HameedSMSchuurmanNRazekTBooneDVan HeestRTauluTLakhaNEvansDCBrownDRKirkpatrickAWStelfoxHTDyerDvan Wijngaarden-StephensMLogsettySNathensABCharyk-StewartTRizoliSTremblayLNBrennemanFAhmedNGalbraithEParryNGirottiMJPagliarelloGTzeNKhwajaKYancharNTallonJMTrenholmJATegartCAmramOBerubeMHameedUSimonsRKResearch Committee of the Trauma Association of CanadaAccess to trauma systems in CanadaJ Trauma2010126961350136110.1097/TA.0b013e3181e751f720838258FleetRArchambaultPPlantJPoitrasJAccess to emergency care in rural Canada: should we be concerned?CJEM20130715419119323777988ForsetlundLBjørndalARashidianAJamtvedtGO'BrienMAWolfFDavisDOdgaard-JensenJOxmanADContinuing education meetings and workshops: effects on professional practice and health care outcomesCochrane Database Syst Rev20092CD00303010.1002/14651858.CD003030.pub219370580GrimshawJMThomasREMacLennanGFraserCRamsayCRValeLWhittyPEcclesMPMatoweLShirranLWensingMDijkstraRDonaldsonCEffectiveness and efficiency of guideline dissemination and implementation strategiesHealth Technol Assess200402861841496025694-08-29BeroLAGrilliRGrimshawJMHarveyEOxmanADThomsonMAClosing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review GroupBMJ1998081531771564654689703533PMC1113716OxmanADThomsonMADavisDAHaynesRBNo magic bullets: a systematic review of 102 trials of interventions to improve professional practiceCMAJ1995111515310142314317585368PMC1487455ColquhounHLBrehautJCSalesAIversNGrimshawJMichieSCarrollKChalifouxMEvaKWA systematic review of the use of theory in randomized controlled trials of audit and feedbackImplement Sci201386610.1186/1748-5908-8-66237590341748-5908-8-66PMC3702512IversNJamtvedtGFlottorpSYoungJMOdgaard-JensenJFrenchSDO'BrienMAJohansenMGrimshawJOxmanADAudit and feedback: effects on professional practice and healthcare outcomesCochrane Database Syst Rev2012016CD00025910.1002/14651858.CD000259.pub322696318FlodgrenGEcclesMPShepperdSScottAParmelliEBeyerFRAn overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomesCochrane Database Syst Rev20117CD00925510.1002/14651858.CD00925521735443FlodgrenGRojas-ReyesMXColeNFoxcroftDREffectiveness of organisational infrastructures to promote evidence-based nursing practiceCochrane Database Syst Rev20122CD00221210.1002/14651858.CD002212.pub222336783PMC4204172ThompsonDSEstabrooksCAScott-FindlaySMooreKWallinLInterventions aimed at increasing research use in nursing: a systematic reviewImplement Sci200721510.1186/1748-5908-2-15174983011748-5908-2-15PMC1878499EcclesMGrimshawJWalkerAJohnstonMPittsNChanging the behavior of healthcare professionals: the use of theory in promoting the uptake of research findingsJ Clin Epidemiol20050258210711210.1016/j.jclinepi.2004.09.00215680740S0895-4356(04)00256-2World Health OrganizationBridging the “Know–Do” gap2005Meeting on Knowledge Translation in Global HealthOctober 10-12, 2005Geneva, SwitzerlandGeneva, SwitzerlandWorld Health OrganizationArchambaultPMBilodeauAGagnonMPAubinKLavoieALapointeJPoitrasJCroteauSPham-DinhMLégaréFHealth care professionals' beliefs about using wiki-based reminders to promote best practices in trauma careJ Med Internet Res2012142e4910.2196/jmir.198322515985v14i2e49PMC3376518DeneckereSEuwemaMLodewijckxCPanellaMMutsvariTSermeusWVanhaechtKBetter interprofessional teamwork, higher level of organized care, and lower risk of burnout in acute health care teams using care pathways: a cluster randomized controlled trialMed Care2013015119910710.1097/MLR.0b013e318276331223132203SinuffTMuscedereJAdhikariNKStelfoxHTDodekPHeylandDKRubenfeldGDCookDJPintoRManoharanVCurrieJCahillNFriedrichJOAmaralAPiquetteDScalesDCDhananiSGarlandAKRITICAL Working Group‚ the Canadian Critical Care Trials Group‚ the Canadian Critical Care SocietyKnowledge translation interventions for critically ill patients: a systematic reviewCrit Care Med20131141112627264010.1097/CCM.0b013e3182982b0323939356ZwarensteinMReevesSKnowledge translation and interprofessional collaboration: Where the rubber of evidence-based care hits the road of teamworkJ Contin Educ Health Prof2006261465410.1002/chp.5016557506ReevesSPerrierLGoldmanJFreethDZwarensteinMInterprofessional education: effects on professional practice and healthcare outcomes (update)Cochrane Database Syst Rev20133CD00221310.1002/14651858.CD002213.pub323543515Czarnecka-KujawaKAbdalianRGroverSCThe quality of open access and open source Internet material in gastroenterology: Is Wikipedia appropriate for knowledge transfer to patients?Gastroenterology200841344A-325A-32610.1016/S0016-5085(08)61518-8EysenbachGMedicine 2.0: social networking, collaboration, participation, apomediation, and opennessJ Med Internet Res2008103e2210.2196/jmir.103018725354v10i3e22PMC2626430de SilvaVHanwellaRWhy are we copyrighting science?BMJ2010341c473820847026GodleeFPakenham-WalshNNcayiyanaDCohenBPackerACan we achieve health information for all by 2015?Lancet2004364943029530010.1016/S0140-6736(04)16681-615262109S0140673604166816TrevenaLWikiProject medicineBMJ2011342d338721653617BoulosMNMarambaIWheelerSWikis, blogs and podcasts: a new generation of Web-based tools for virtual collaborative clinical practice and educationBMC Med Educ200664110.1186/1472-6920-6-41169117791472-6920-6-41PMC1564136SandarsJSchroterSWeb 2.0 technologies for undergraduate and postgraduate medical education: an online surveyPostgrad Med J2007128398675976210.1136/pgmj.2007.0631231805717583/986/759PMC2750915SandarsJHaythornthwaiteCNew horizons for e-learning in medical education: ecological and Web 2.0 perspectivesMed Teach20070529430731010.1080/0142159060117640617786742781834274McGeeJBBeggMWhat medical educators need to know about Web 2.0Med Teach200830216416910.1080/0142159070188167318464141790900962CaputoIThe Washington Post200907282013-06-11NIH refers to 'Wikipedians' for help: scientists learn online etiquettehttp://www.washingtonpost.com/wp-dyn/content/article/2009/07/27/AR2009072701912.html6HIwzs52lICD11 Beta Draft20122013-04-18Geneva, SwitzerlandWorld Health Organizationhttp://apps.who.int/classifications/icd11/browse/f/en6FyVwhWC5HughesBJoshiILemondeHWarehamJJunior physician's use of Web 2.0 for information seeking and medical education: a qualitative studyInt J Med Inform200910781064565510.1016/j.ijmedinf.2009.04.00819501017S1386-5056(09)00075-6BrokowskiLSheehanAHEvaluation of pharmacist use and perception of Wikipedia as a drug information resourceAnn Pharmacother20091143111912191310.1345/aph.1M34019843833aph.1M340McGowanBSWaskoMVartabedianBSMillerRSFreiherrDDAbdolrasulniaMUnderstanding the factors that influence the adoption and meaningful use of social media by physicians to share medical informationJ Med Internet Res2012145e11710.2196/jmir.213823006336v14i5e117PMC3510763CroskerryPNimmoGRBetter clinical decision making and reducing diagnostic errorJ R Coll Physicians Edinb20110641215516210.4997/JRCPE.2011.20821677922StrausSETetroeJGrahamIDKnowledge Translation in Health Care : Moving From Evidence to Practice2009Hoboken, NJWiley-Blackwell/BMJSahotaNLloydRRamakrishnaAMackayJAProrokJCWeise-KellyLNavarroTWilczynskiNLHaynesRBCCDSS Systematic Review TeamComputerized clinical decision support systems for acute care management: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomesImplement Sci201169110.1186/1748-5908-6-91218243851748-5908-6-91PMC3169487LangESWyerPCHaynesRBKnowledge translation: closing the evidence-to-practice gapAnn Emerg Med20070349335536310.1016/j.annemergmed.2006.08.02217084943S0196-0644(06)02142-1HolroydBRBullardMJGrahamTARoweBHDecision support technology in knowledge translationAcad Emerg Med200711141194294810.1197/j.aem.2007.06.02317766733j.aem.2007.06.023BalasEAWeingartenSGarbCTBlumenthalDBorenSABrownGDImproving preventive care by prompting physiciansArch Intern Med20000214160330130810668831BuntinxFWinkensRGrolRKnottnerusJAInfluencing diagnostic and preventive performance in ambulatory care by feedback and reminders. A reviewFam Pract1993061022192288359615WensingMGrolRSingle and combined strategies for implementing changes in primary care: a literature reviewInt J Qual Health Care199406621151327953212MandelblattJKanetskyPAEffectiveness of interventions to enhance physician screening for breast cancerJ Fam Pract1995024021621717654272GargAXAdhikariNKMcDonaldHRosas-ArellanoMPDevereauxPJBeyeneJSamJHaynesRBEffects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic reviewJAMA2005039293101223123810.1001/jama.293.10.122315755945293/10/1223HuntDLHaynesRBHannaSESmithKEffects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic reviewJAMA1998102128015133913469794315jrv71066JohnstonMELangtonKBHaynesRBMathieuAEffects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of researchAnn Intern Med1994011512021351428256973KawamotoKHoulihanCABalasEALobachDFImproving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to successBMJ2005042330749476510.1136/bmj.38398.500764.8F15767266bmj.38398.500764.8FPMC555881ShojaniaKGJenningsAMayhewARamsayCREcclesMPGrimshawJThe effects of on-screen, point of care computer reminders on processes and outcomes of careCochrane Database Syst Rev20093CD00109610.1002/14651858.CD001096.pub219588323WeingartSNTothMSandsDZAronsonMDDavisRBPhillipsRSPhysicians' decisions to override computerized drug alerts in primary careArch Intern Med20031124163212625263110.1001/archinte.163.21.262514638563163/21/2625StiellIGBennettCImplementation of clinical decision rules in the emergency departmentAcad Emerg Med200711141195595910.1197/j.aem.2007.06.03917923717j.aem.2007.06.039ChanJShojaniaKGEastyACEtchellsEEDoes user-centred design affect the efficiency, usability and safety of CPOE order sets?J Am Med Inform Assoc201105118327628110.1136/amiajnl-2010-0000262148688618/3/276PMC3078654WrightASittigDFCarpenterJDKrallMAPangJEMiddletonBOrder sets in computerized physician order entry systems: an analysis of seven sitesAMIA Annu Symp Proc2010201089289621347107PMC3041397BlackADCarJPagliariCAnandanCCresswellKBokunTMcKinstryBProcterRMajeedASheikhAThe impact of eHealth on the quality and safety of health care: a systematic overviewPLoS Med201181e100038710.1371/journal.pmed.100038721267058PMC3022523BanduraAHealth promotion by social cognitive meansHealth Educ Behav20040431214316410.1177/109019810426366015090118GodinGBélanger-GravelAEcclesMGrimshawJHealthcare professionals' intentions and behaviours: a systematic review of studies based on social cognitive theoriesImplement Sci200833610.1186/1748-5908-3-36186313861748-5908-3-36PMC2507717MichieSJohnstonMAbrahamCLawtonRParkerDWalkerAMaking psychological theory useful for implementing evidence based practice: a consensus approachQual Saf Health Care200502141263310.1136/qshc.2004.0111551569200014/1/26PMC1743963MichieSJohnstonMFrancisJHardemanWEcclesMFrom theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniquesAppl Psychol Internet200857410.1111/j.1464-0597.2008.00341.xDeshpandeAKhojaSLorcaJMcKibbonARizoCHusereauDJadadARAsynchronous telehealth: a scoping review of analytic studiesOpen Med200932e69e9119946396PMC2765770MurraySGiustiniDLoubaniTChoiSPalepuAMedical research and social media: Can wikis be used as a publishing platform in medicine?Open Med200933e121e12221603044PMC3090116McIntoshBCameronCSinghSYuCAhujaTWeltonNJDahlMSecond-line therapy in patients with type 2 diabetes inadequately controlled with metformin monotherapy: a systematic review and mixed-treatment comparison meta-analysisOpen Med201151e35e4822046219PMC3205809National Institutes of Health201103022015-01-11Guidelines for participating in Wikipedia from NIHhttp://www.nih.gov/icd/od/ocpl/resources/wikipedia/6VUpwtagUSandarsJHaythornthwaiteCNew horizons for e-learning in medical education: ecological and Web 2.0 perspectivesMed Teach20070529430731010.1080/0142159060117640617786742781834274AbrasCMaloney-KrichmarDPreeceJUser-centered designBerkshire Encyclopedia of Human-Computer Interaction2004Great Barrington, MABerkshire Publishing Group764768usability.gov2015-01-12Washington, DCUS Department of Health & Human ServicesResearch-based Web design and usability guidelineshttp://www.usability.gov/sites/default/files/documents/guidelines_book.pdf?post=yes6VWG3Fa0YFaulknerLBeyond the five-user assumption: benefits of increased sample sizes in usability testingBehav Res Methods Instrum Comput20030835337938314587545LindgaardGChattratichartJUsability testing: what have we overlooked?Proceedings of the SIGCHI Conference on Human Factors in Computing Systems2007SIGCHI Conference on Human Factors in Computing SystemsApril 28 - May 3, 2007San Jose, CANew York, NYACM Press1415142410.1145/1240624.1240839PenfoldRBZhangFUse of interrupted time series analysis in evaluating health care quality improvementsAcad Pediatr201312136 SupplS38S4410.1016/j.acap.2013.08.00224268083S1876-2859(13)00210-6MooreLLavoieASiroisMJBelcaidABourgeoisGLapointeJSampalisJSLe SageNÉmondMA comparison of methods to obtain a composite performance indicator for evaluating clinical processes in trauma careJ Trauma Acute Care Surg2013057451344135010.1097/TA.0b013e31828c32f22360928801586154-201305000-00023GuyattGHOxmanADVistGEKunzRFalck-YtterYAlonso-CoelloPSchünemannHJGRADE Working GroupGRADE: an emerging consensus on rating quality of evidence and strength of recommendationsBMJ20080426336765092492610.1136/bmj.39489.470347.AD18436948336/7650/924PMC2335261YasseriTSumiRRungAKornaiAKertészJDynamics of conflicts in WikipediaPLoS One201276e3886910.1371/journal.pone.003886922745683PONE-D-12-05755PMC3380063RamsayCMatoweLGrilliRGrimshawJThomasRInterrupted time series designs in health technology assessment: lessons from two systematic reviews of behavior change strategiesInt J Technol Assess Health Care200319461362315095767