Published on in Vol 7, No 12 (2018): December

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/11101, first published .
Endotracheal Intubation Among the Critically Ill: Protocol for a Multicenter, Observational, Prospective Study

Endotracheal Intubation Among the Critically Ill: Protocol for a Multicenter, Observational, Prospective Study

Endotracheal Intubation Among the Critically Ill: Protocol for a Multicenter, Observational, Prospective Study

Protocol

Department of Anesthesiology, Mayo Clinic, Rochester, MN, United States

*all authors contributed equally

Corresponding Author:

Nathan Smischney, MD, MSc

Department of Anesthesiology, Mayo Clinic

200 First Street SW

Rochester, MN, 55905

United States

Phone: 1 507 255 6051

Email: smischney.nathan@mayo.edu


Background: Endotracheal intubation can occur in up to 60% of critically ill patients. Despite the frequency with which endotracheal intubation occurs, the current practice is largely unknown. This is relevant, as advances in airway equipment (ie, video laryngoscopes) have become more prevalent, leading to possible improvement of care delivered during this process. In addition to new devices, a greater emphasis on airway plans and choices in sedation have evolved, although the influence on patient morbidity and mortality is largely unknown.

Objective: This study aims to derive and validate prediction models for immediate airway and hemodynamic complications of intensive care unit intubations.

Methods: A multicenter, observational, prospective study of adult critically ill patients admitted to both medical and surgical intensive care units (ICUs) was conducted. Participating ICU sites were located throughout eight health and human services regions of the United States for which endotracheal intubation was needed. A steering committee composed of both anesthesia and pulmonary critical care physicians proposed a core set of data variables. These variables were incorporated into a data collection form to be used within the multiple, participating ICUs across the United States during the time of intubation. The data collection form consisted of two basic components, focusing on airway management and hemodynamic management. The form was generated using RedCap and distributed to the participating centers. Quality checks on the dataset were performed several times with each center, such that they arrived at less than 10% missing values for each data variable; the checks were subsequently entered into a database.

Results: The study is currently undergoing data analysis. Results are expected in November 2018 with publication to follow thereafter. The study protocol has not yet undergone peer review by a funding body.

Conclusions: The overall goal of this multicenter prospective study is to develop a scoring system for peri-intubation, hemodynamic, and airway-related complications so we can stratify those patients at greatest risk for decompensation as a result of these complications. This will allow critical care physicians to be better prepared in addressing these occurrences and will allow them to improve the quality of care delivered to the critically ill.

Trial Registration: ClinicalTrials.gov NCT02508948; https://clinicaltrials.gov/ct2/show/NCT02508948 (Archived by WebCite at http://www.webcitation.org/73Oj6cTFu)

International Registered Report Identifier (IRRID): RR1-10.2196/11101

JMIR Res Protoc 2018;7(12):e11101

doi:10.2196/11101

Keywords



Significance

When compared to other settings, such as the operating room, endotracheal intubation in the intensive care unit (ICU) carries with it a higher morbidity and mortality, likely due to many factors, including a lack of physiologic reserve [1-3]. For example, the incidence of a difficult airway in the ICU may be as high as 23% [2]. Unwanted effects associated with endotracheal intubations performed in the ICU include, but are not limited to, arterial desaturation, cardiovascular decompensation, esophageal intubation, regurgitation of gastric contents, and cardiac arrest [3-5]. Additionally, as intubation attempts increase, the rate of complications also increases [6]. In recognition of the above, institutions across the country have developed intubation bundles to reduce these unwanted effects. Moreover, the use of a systematic approach to, or protocol for, endotracheal intubation may reduce intubation complications [7-9]. This was recently demonstrated in a trial utilizing an intubation protocol, whereby immediate life-threatening complications surrounding ICU intubations were reduced [10].

Challenges in Endotracheal Intubation

Recently, there have been a variety of new devices emerging that are designed to assist with a difficult airway, such as video laryngoscopes. These devices have been reported to reduce unwanted effects of endotracheal intubation (ie, a failed airway). In addition to new devices, intubation checklists and sedative choices have undergone changes with uncertain effects on patient morbidity and mortality. Currently, many clinicians use the newer devices, such as video laryngoscopes, as evidence indicates that these devices result in better laryngeal view and improved intubation difficulty score with lower risk of a failed airway as compared to conventional techniques (ie, direct laryngoscopy) [11-15]. Moreover, these newer devices are user friendly even in unfamiliar hands [16]. A recent meta-analysis comparing video laryngoscopy with direct laryngoscopy reported similar findings, where video laryngoscopy reduced the risk of difficult airway, Cormack 3/4 grades, and esophageal intubation, but increased the first-attempt success rate. Additional outcomes, such as severe hypoxemia, severe cardiovascular collapse, or airway injury, were not different between the two techniques [17]. Moreover, video laryngoscopy maintains its effectiveness when used during an emergency [18]. Despite the evidence of positive outcomes for the newer devices, not all providers utilize these modalities, possibly due to inexperience with the newer techniques or evidence suggesting no benefit [19,20]. As an example, a recent study surveying Canadian resuscitation physicians demonstrated that most use direct laryngoscopy as their go-to technique for emergent endotracheal intubations [21]. Similarly, ICU physicians in Israel, when surveyed, seem to prefer fiber-optic intubation for routine airway management [22].

Medications and Procedural Advances in the Field

Along the same line as airway equipment, sedatives used during endotracheal intubation have evolved over time. Over the years, evidence has suggested that the use of etomidate in the critically ill, especially in sepsis, may be associated with increased morbidity and mortality [23-25]. However, other studies find no associations with etomidate and patient outcomes [26,27]. Etomidate traditionally has been the preferred induction drug because of its favorable hemodynamic profile. However, with mounting evidence for adrenal suppression and possible associations with mortality in septic patients, the clinician now struggles with the ideal sedative for endotracheal intubation [28-30]. Other agents and/or admixtures have shown promise [31,32]. Not only has the choice of induction medication changed in recent years, but current evidence suggests that the use of paralytics may help facilitate endotracheal intubation [33,34]. In addition, paralytics are now recommended in the setting of acute respiratory failure, with evidence demonstrating improved outcomes [35]. Thus, using paralytics in a patient with suspected lung injury who needs intubation for acute respiratory failure may be of benefit. However, certain situations may preclude their use [36].

Importance of This Study

As outlined above, temporal changes in airway and sedation management in recent years have occurred with mixed study results and the importance of short-term outcomes (ie, postintubation hypotension, hypoxemia, and difficult airway) on patient morbidity and mortality has been demonstrated. Therefore, characterization of current intubation practice among the critically ill is warranted. With this characterization, scoring systems may be developed that aid the clinician in providing optimal outcomes for patients. This information in turn may allow the clinician to provide a tailored plan, in terms of both airway and hemodynamic management of the critically ill who are in need of intubation.

Approach

In order to examine the current endotracheal intubation practice among the critically ill, a multicenter, observational, prospective study of adult, critically ill patients was conducted from July 2015 to January 2017 involving 20 ICUs.

Study Objectives

Our first objective is to derive and validate a prediction model for airway difficulty among the critically ill as defined by three or more attempts at laryngoscopy and/or the need for another operator [37].

Our second objective is to derive and validate a prediction model for hemodynamic compromise (ie, postintubation hypotension, defined as a decrease at any point in mean arterial pressure of <65 mmHg; systolic blood pressure of <80 mmHg and/or a decrease in systolic blood pressure of 40% from previous; or the introduction, or increase in infusion rate, of any vasoactive agent during the 30-minute window following endotracheal intubation) [38,39].

Our third objective is to derive and validate a predication model for hypoxemia defined as a decrease in SpO2 of <88% during the procedure.


Study Approval and Trial Registration

The Institutional Review Board at the Mayo Clinic in Rochester, Minnesota, approved this study protocol (Institutional Review Board #15-002328). This study was under waiver of informed consent and authorization given the observational nature of the study with the use of deidentified data. The trial was registered at ClinicalTrials.gov (#NCT02508948).

Design and Setting

This is a multicenter, observational, prospective study of adult critically ill patients admitted to both medical and surgical ICUs at the listed participating sites within the United States (see Multimedia Appendix 1), who meet the criteria designated below for which endotracheal intubation was needed.

Inclusion and Exclusion Criteria

Inclusion and exclusion criteria for the study are listed in Textbox 1.

Study Enrollment Procedures

All adult endotracheal intubations across all ICUs were eligible for this study. Given that this procedure is an unpredictable event, the patients were not able to consent, nor was a health care power of attorney readily available. The sites were to initiate immediate data collection; therefore, obtaining informed consent was impractical. In addition, the observational study design did not impact the procedures performed, devices used, or medications given to patients.

Study Protocol

A steering committee oversaw the administration of the protocol and was comprised of both anesthesia and pulmonary critical care physicians. A data collection form was created that focused on two periprocedural aspects of the intubation process, including airway and hemodynamic management, and was used at all participating sites (see Multimedia Appendix 2). Regarding airway management, rapid sequence intubation was defined a priori according to Sellick [40]. Although the participating sites obtained formal training in the use of the data collection form prior to study initiation, online content in the form of a web link was established to answer frequently asked questions, as well as to establish a forum among the investigators with all questions related to the study discussed (see Multimedia Appendix 3). Moreover, monthly HEModynamic and AIRway (HEMAIR) investigator meetings were conducted to further provide a platform for questions and discuss future collaborations, with a newsletter sent afterward to participating sites (see Multimedia Appendix 3). The data collection form was uploaded into RedCap during data entry. Data were obtained by the proceduralist or site study coordinator and verified by the primary investigative team. The sampling method utilized in this study was convenience sampling.

Data Management

Each clinical site was responsible for patient enrollment and data collection. Each site also provided a research investigator who was responsible for capturing and entering the study data into the study database during the collection time period. The study database was housed and managed at the Mayo Clinic in Rochester, Minnesota, including running periodic, basic data-quality-monitoring queries. Data collection on outcome measures was done weekly by trained study coordinators at each site.

Statistical Analysis

For descriptive summaries, continuous measurements will be represented as mean (SD) for parametric distributions and median (interquartile range, IQR) for nonparametric distributions. Dichotomous variables will be represented as counts and percentages. For descriptive studies, all procedures will be included for patients who require endotracheal intubation more than once during the same ICU stay. For hypothesis testing, we will consider two-tailed tests of P<.05 to be statistically significant and will report point estimates and 95% confidence intervals. The first endotracheal intubation in the ICU will be used in analyses to assess for associations between predictors and an adverse outcome. Model building will be performed using lasso regression with 10-fold cross-validation. In all cases, distributional assumptions will be assessed, with appropriate transformations used as necessary. SAS version 9.4 (SAS Institute Inc) and R statistical software version 3.4.1 (R Foundation for Statistical Computing) will be used for all analyses.

Inclusion and exclusion criteria.

Inclusion criteria:

  • Adult patients (≥18 years of age)
  • Admission to medical or surgical intensive care unit
  • Endotracheal intubation performed between July 2015 and January 2017

Exclusion criteria:

  • Pediatric patients (<18 years of age)
  • Endotracheal intubations occurring in nonintensive care unit locations
Textbox 1. Inclusion and exclusion criteria.

Sample Size

We based our sample size on the occurrence of intubation complications. Since we are most concerned with the occurrence of airway-related complications (ie, difficult intubation), and hemodynamic complications (ie, hypotension), our sample size is powered for the occurrence of these two complications. Difficult intubation and hypotension were defined in our study with an expected incidence of 12% and 11%, respectively, during the peri-intubation period [37,41]. Thus, we determined that an effective sample of 804 was sufficient to provide statistical power to detect an incidence of 12% with precision and margin of error of 1%. However, we included over 1000 patients from all sites to answer any subsequent secondary and tertiary hypotheses.


The study is currently undergoing data analysis. Results are expected in November 2018 with publication to follow thereafter. The study protocol has not yet undergone peer review by a funding body.


The HEMAIR study did not alter the care that patients received. Additionally, sharing deidentified data protected the privacy of the patients. With these procedures and requirements in place, the physical rights and welfare of patients were not adversely affected by study participation or by the waiver of consent and authorization. This multicenter, prospective trial will be among the first to include a large, diverse patient population from across the United States with a large sample size. The potential benefits would include deriving and validating prediction models for immediate severe complications regarding airway and hemodynamic management surrounding intubations among the critically ill. With this information, it is our hope that clinicians will have a tool to predict which patients will become unstable during this procedure so they may adjust treatment plans, allowing for improved quality of care delivered during this procedure. This prospective observational trial is even more important, as postintubation hypotension and hemodynamic derangement is noted by some to occur at a fairly high rate, possibly leading to increased risk of mortality [42].

Authors' Contributions

NS is the principal investigator of the HEMAIR study and conceived the study design. RK is the lead study coordinator and coprincipal investigator and participated in data collection. DS is the chief statistician and performed statistical analysis for the study. MS and DD are trial coinvestigators and participated in data collection. All authors have read and approved the final manuscript.

Conflicts of Interest

None declared.

Multimedia Appendix 1

HEModynamic and AIRway (HEMAIR) site investigators.

PDF File (Adobe PDF File), 27KB

Multimedia Appendix 2

HEModynamic and AIRway (HEMAIR) data collection form.

PDF File (Adobe PDF File), 30KB

Multimedia Appendix 3

HEModynamic and AIRway (HEMAIR) newsletter.

PDF File (Adobe PDF File), 440KB

  1. Griesdale DEG, Bosma TL, Kurth T, Isac G, Chittock DR. Complications of endotracheal intubation in the critically ill. Intensive Care Med 2008 Oct;34(10):1835-1842. [CrossRef] [Medline]
  2. Heuer JF, Barwing TA, Barwing J, Russo SG, Bleckmann E, Quintel M, et al. Incidence of difficult intubation in intensive care patients: Analysis of contributing factors. Anaesth Intensive Care 2012 Jan;40(1):120-127 [FREE Full text] [Medline]
  3. Simpson GD, Ross MJ, McKeown DW, Ray DC. Tracheal intubation in the critically ill: A multi-centre national study of practice and complications. Br J Anaesth 2012 May;108(5):792-799 [FREE Full text] [CrossRef] [Medline]
  4. Mort TC. Emergency tracheal intubation: Complications associated with repeated laryngoscopic attempts. Anesth Analg 2004 Aug;99(2):607-613, table of contents. [CrossRef] [Medline]
  5. Mort TC. The incidence and risk factors for cardiac arrest during emergency tracheal intubation: A justification for incorporating the ASA Guidelines in the remote location. J Clin Anesth 2004 Nov;16(7):508-516. [CrossRef] [Medline]
  6. Gundogan K, Coskun R, Guven M, Sungur M. Complications of endotracheal intubation in intensive care unit. Turk J Med Surg Intensive Care Med 2011;2(2):39-43. [CrossRef]
  7. Niven AS, Doerschug KC. Techniques for the difficult airway. Curr Opin Crit Care 2013 Feb;19(1):9-15. [CrossRef] [Medline]
  8. Noppens RR. Airway management in the intensive care unit. Acta Clin Croat 2012 Sep;51(3):511-517. [Medline]
  9. Divatia J. The intubation bundle: Towards safer tracheal intubation in critically ill patients. Crit Care Shock 2012;15:52.
  10. Jaber S, Jung B, Corne P, Sebbane M, Muller L, Chanques G, et al. An intervention to decrease complications related to endotracheal intubation in the intensive care unit: A prospective, multiple-center study. Intensive Care Med 2010 Feb;36(2):248-255. [CrossRef] [Medline]
  11. Sandhu H, Gombar S, Kapoor D. A comparative evaluation of glide scope and Macintosh laryngoscope for endotracheal intubation. Indian J Crit Care Med 2014;18:S9.
  12. Mosier JM, Whitmore SP, Bloom JW, Snyder LS, Graham LA, Carr GE, et al. Video laryngoscopy improves intubation success and reduces esophageal intubations compared to direct laryngoscopy in the medical intensive care unit. Crit Care 2013 Oct 14;17(5):R237 [FREE Full text] [CrossRef] [Medline]
  13. Lakticova V, Koenig SJ, Narasimhan M, Mayo PH. Video laryngoscopy is associated with increased first pass success and decreased rate of esophageal intubations during urgent endotracheal intubation in a medical intensive care unit when compared to direct laryngoscopy. J Intensive Care Med 2015 Jan;30(1):44-48. [CrossRef] [Medline]
  14. Noppens RR, Geimer S, Eisel N, David M, Piepho T. Endotracheal intubation using the C-MAC® video laryngoscope or the Macintosh laryngoscope: A prospective, comparative study in the ICU. Crit Care 2012 Jun 13;16(3):R103 [FREE Full text] [CrossRef] [Medline]
  15. De Jong A, Clavieras N, Conseil M, Coisel Y, Moury P, Pouzeratte Y, et al. Implementation of a combo videolaryngoscope for intubation in critically ill patients: A before-after comparative study. Intensive Care Med 2013 Dec;39(12):2144-2152. [CrossRef] [Medline]
  16. Itai J, Tanabe Y, Nishida T, Inagawa T, Torikoshi Y, Kida Y, et al. Tracheal intubation for a difficult airway using Airway scope®, KingVision® and McGRATH®: A comparative manikin study of inexperienced personnel. Crit Care 2013;17(Suppl2):P159. [CrossRef]
  17. De Jong A, Molinari N, Conseil M, Coisel Y, Pouzeratte Y, Belafia F, et al. Video laryngoscopy versus direct laryngoscopy for orotracheal intubation in the intensive care unit: A systematic review and meta-analysis. Intensive Care Med 2014 May;40(5):629-639. [CrossRef] [Medline]
  18. Lee D, Han M, Jung J, An J, Koh Y, Lim C, et al. Comparison of tracheal intubation using conventional direct laryngoscope and video laryngoscope during unexpected cardiopulmonary resuscitation. Intensive Care Med 2014;1:S271.
  19. Ural K, Subaiya C, Taylor C, Ramadhyani U, Scuderi-Porter H, Nossaman BD. Analysis of orotracheal intubation techniques in the intensive care unit. Crit Care Resusc 2011 Jun;13(2):89-96. [Medline]
  20. Harper Y, Waheed I, Ehsanullah B, Parmar S, Nadeem R, Gazmuri R, et al. 835. Critical Care Medicine 2014;42(12):A1561. [CrossRef]
  21. Green R, Fergusson D, Turgeon A, McIntyre L, Kovacs G, Griesdale D, et al. Emergent endotracheal intubation: Medications and device choices by Canadian resuscitation physicians. Intensive Care Med 2014;1:S168.
  22. Haviv Y, Ezri T, Boaz M, Ivry S, Gurkan Y, Izakson A. Airway management practices in adult intensive care units in Israel: A national survey. J Clin Monit Comput 2012 Dec;26(6):415-421. [CrossRef] [Medline]
  23. Hinkewich C, Green R. The impact of etomidate on mortality in trauma patients. Can J Anaesth 2014 Jul;61(7):650-655. [CrossRef] [Medline]
  24. Sunshine JE, Deem S, Weiss NS, Yanez ND, Daniel S, Keech K, et al. Etomidate, adrenal function, and mortality in critically ill patients. Respir Care 2013 Apr;58(4):639-646 [FREE Full text] [CrossRef] [Medline]
  25. Warner KJ, Cuschieri J, Jurkovich GJ, Bulger EM. Single-dose etomidate for rapid sequence intubation may impact outcome after severe injury. J Trauma 2009 Jul;67(1):45-50. [CrossRef] [Medline]
  26. McPhee LC, Badawi O, Fraser GL, Lerwick PA, Riker RR, Zuckerman IH, et al. Single-dose etomidate is not associated with increased mortality in ICU patients with sepsis: Analysis of a large electronic ICU database. Crit Care Med 2013 Mar;41(3):774-783. [CrossRef] [Medline]
  27. Gu W, Wang F, Tang L, Liu J. Single-dose etomidate does not increase mortality in patients with sepsis: A systematic review and meta-analysis of randomized controlled trials and observational studies. Chest 2015 Feb;147(2):335-346. [CrossRef] [Medline]
  28. Heffner AC, Swords D, Kline JA, Jones AE. The frequency and significance of postintubation hypotension during emergency airway management. J Crit Care 2012 Aug;27(4):417.e9-417.e13. [CrossRef] [Medline]
  29. Smischney N, Ricter B, Hoeft C, Johnson L, Ansar S, Kashyap R. Association of post-intubation hemodynamic instability in an adult ICU with in-hospital mortality and ICU length of stay. Am J Respir Crit Care Med 2014;189:A4558.
  30. Green RS, Edwards J, Sabri E, Fergusson D. Evaluation of the incidence, risk factors, and impact on patient outcomes of postintubation hemodynamic instability. CJEM 2012 Mar;14(2):74-82. [Medline]
  31. Jabre P, Combes X, Lapostolle F, Dhaouadi M, Ricard-Hibon A, Vivien B, KETASED Collaborative Study Group. Etomidate versus ketamine for rapid sequence intubation in acutely ill patients: A multicentre randomised controlled trial. Lancet 2009 Jul 25;374(9686):293-300. [CrossRef] [Medline]
  32. Gallo de Moraes A, Racedo Africano CJ, Hoskote SS, Reddy DR, Tedja R, Thakur L, et al. Ketamine and propofol combination (“ketofol”) for endotracheal intubations in critically ill patients: A case series. Am J Case Rep 2015 Feb 13;16:81-86 [FREE Full text] [CrossRef] [Medline]
  33. Mosier JM, Sakles JC, Stolz U, Hypes CD, Chopra H, Malo J, et al. Neuromuscular blockade improves first-attempt success for intubation in the intensive care unit: A propensity matched analysis. Ann Am Thorac Soc 2015 May;12(5):734-741 [FREE Full text] [CrossRef] [Medline]
  34. Mosier J, Chopra H, Sakles J, Malo J, Bloom J, Hypes C. Neuromuscular blockade improves tracheal intubation success in the intensive care unit. Crit Care Med 2014;1:1535-1536.
  35. Papazian L, Forel J, Gacouin A, Penot-Ragon C, Perrin G, Loundou A, ACURASYS Study Investigators. Neuromuscular blockers in early acute respiratory distress syndrome. N Engl J Med 2010 Sep 16;363(12):1107-1116. [CrossRef] [Medline]
  36. Blanié A, Ract C, Leblanc P, Cheisson G, Huet O, Laplace C, et al. The limits of succinylcholine for critically ill patients. Anesth Analg 2012 Oct;115(4):873-879. [CrossRef] [Medline]
  37. Jaber S, Amraoui J, Lefrant J, Arich C, Cohendy R, Landreau L, et al. Clinical practice and risk factors for immediate complications of endotracheal intubation in the intensive care unit: A prospective, multiple-center study. Crit Care Med 2006 Sep;34(9):2355-2361. [CrossRef] [Medline]
  38. Green RS, Turgeon AF, McIntyre LA, Fox-Robichaud AE, Fergusson DA, Doucette S, Canadian Critical Care Trials Group (CCCTG). Postintubation hypotension in intensive care unit patients: A multicenter cohort study. J Crit Care 2015 Oct;30(5):1055-1060. [CrossRef] [Medline]
  39. Smischney NJ, Demirci O, Diedrich DA, Barbara DW, Sandefur BJ, Trivedi S, et al. Incidence of and risk factors for post-intubation hypotension in the critically ill. Med Sci Monit 2016 Feb 02;22:346-355 [FREE Full text] [Medline]
  40. Sellick BA. Cricoid pressure to control regurgitation of stomach contents during induction of anaesthesia. Lancet 1961 Aug 19;2(7199):404-406. [Medline]
  41. Green R, Hutton B, Lorette J, Bleskie D, McIntyre L, Fergusson D. Incidence of postintubation hemodynamic instability associated with emergent intubations performed outside the operating room: A systematic review. CJEM 2014 Jan;16(1):69-79. [Medline]
  42. Green RS, Butler MB, Erdogan M. Increased mortality in trauma patients who develop postintubation hypotension. J Trauma Acute Care Surg 2017 Oct;83(4):569-574. [CrossRef] [Medline]


HEMAIR: HEModynamic and AIRway
ICU: intensive care unit
IQR: interquartile range


Edited by G Eysenbach; submitted 21.05.18; peer-reviewed by M Nomali, D Ray; comments to author 03.09.18; revised version received 05.09.18; accepted 07.09.18; published 07.12.18

Copyright

©Nathan Smischney, Rahul Kashyap, Mohamed Seisa, Darrell Schroeder, Daniel Diedrich. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 07.12.2018.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.