Published on in Vol 8, No 1 (2019): January

Preprints (earlier versions) of this paper are available at, first published .
Effect of a Mobile App on Preoperative Patient Preparation for Major Ambulatory Surgery: Protocol for a Randomized Controlled Trial

Effect of a Mobile App on Preoperative Patient Preparation for Major Ambulatory Surgery: Protocol for a Randomized Controlled Trial

Effect of a Mobile App on Preoperative Patient Preparation for Major Ambulatory Surgery: Protocol for a Randomized Controlled Trial


1Andalusian Agency for Healthcare Quality, Sevilla, Spain

2Department of Sociology, Pablo de Olavide University, Sevilla, Spain

3Pharmacoeconomics & Outcomes Research Iberia, Paseo de Joaquín Rodrigo 4-I, 28224, Pozuelo de Alarcón, Madrid, Spain

4Hospital de Alta Resolución de Utrera, APS Bajo Guadalquivir, Utrera, Sevilla, Spain

5Hospital de Alta Resolución Sierra Norte, APS Bajo Guadalquivir, Constantina, Sevilla, Spain

Corresponding Author:

Manuel Herrera-Usagre, PhD (Sociology), MSc

Andalusian Agency for Healthcare Quality

Science and Technology Park, Italian Pavillion, 3rd Floor

4 Isaac Newton Street

Sevilla, 41092


Phone: 34 645539726


Background: Inadequate preoperative patient preparation causes organizational, economic, and emotional problems to patients and professionals. In Spain, no current evidence is available on either the rate of compliance or the impact of good compliance with preoperative recommendations by patients in the ambulatory setting. However, it is known that around 25% of surgical cancellations in the major ambulatory surgery (MAS) are due to poor compliance with these recommendations and, therefore, avoidable. Introducing innovative tools based on mobile health (mHealth) apps may help patients meet the preoperative recommendations and, consequently, reduce the rate of cancellations in the ambulatory setting.

Objective: The objective of this study was to evaluate the effectiveness of the Listeo+ mHealth app as a tool for improving compliance with preoperative recommendations in MAS versus standard of care (SOC).

Methods: A multicenter, randomized, open-label clinical trial that compares SOC with the additional use of Listeo+, a specific mHealth app for MAS preoperative patient monitoring, is being conducted. The study will include patients aged ≥18 years with surgical indication for MAS who meet the necessary technological and connectivity requirements. Patients in the control group will receive written preoperative recommendations, while those in the intervention group will additionally use the Listeo+ mHealth app. There will be a competitive recruitment of 790 patients during 6 months in 4 hospitals in Andalusia (Spain) that belong to the National Health System. The primary efficacy outcome is the level of compliance with preoperative recommendations. Secondary outcomes include the rate of cancellations, associated resource consumption, and perceived usability and utility with Listeo+ by participants of the intervention group. Simple randomization 1:1 procedure will be used to allocate patients to each study group.

Results: The technological development of Listeo+ and the integration and interoperability of information systems was completed in September 2017. Subsequently, simulation tests were performed with Listeo+, and a pilot study was initiated with real patients that concluded successfully in October 2017. Patient recruitment began in December 2017 in the 4 participating centers. After an intermediate analysis performed 10 months after the start of the recruitment phase, the data collection and cleaning phases are estimated to be completed in April 2019, and the analysis with the final results will be conducted in July 2019.

Conclusions: Progress in the integration and interoperability of information systems represents a major step forward in the field of mHealth. The app will allow health professionals to monitor in real-time patients’ preparation and critical preoperative recommendations fulfillment. We expect a reduction in avoidable preoperative cancellations due to a lack of or a poor patient preparation. Self-assessed Web-based questionnaires and focus group will provide important information about the perceived usability and utility of Listeo+ app among patients and health care professionals.

International Registered Report Identifier (IRRID): DERR1-10.2196/10938

JMIR Res Protoc 2019;8(1):e10938



Providing quality care in different phases of the surgical process has become an important challenge for health systems because of the increase in the care burden, the increase in the complexity of surgical procedures, and increasingly demanding attention focused on patients’ preferences [1]. Throughout the surgical process, different factors (organizational, relative to patients’ clinical condition, or medical) can lead to surgery cancellations or surgical delay [2-4]. The implications of surgery cancellations can be analyzed from the perspectives of health management and patient safety, as their effects on health resource consumption can be considered adverse events (AEs) that require control and monitoring [5-7]. One major cause is the inadequate preoperative patient preparation because the safety guarantees for the intervention are not met [8,9]; this affects both the quality of the surgical procedure and the consumption of hospital resources as a result of the increase in hospital stay and consumption of medicines [1].

Major ambulatory surgery (MAS) is characterized by short-term postoperative care and does not require hospital admission; it has greatly increased in developed countries in recent decades [10]. In Spain, it represents 62.5% of the total number of surgeries performed by the National Health System (NHS) [11], which is one of the highest rates among Organisation for Economic Co-Operation and Development member countries [12]. Although the rate of cancellations in MAS is approximately 4% [13,14], lower than that reported in other countries where cancellations on the day of surgery oscillate between 5% and 40% [10,15], a quarter (27%) of those cancellations are because of poor compliance with preoperative recommendations and are, therefore, avoidable [13,16]. Conversely, inadequate preoperative patient preparation for MAS is also considered one of the main causes of patient no-shows on the day of surgery [17], which is likely due to patient anxiety before surgery [18].

There are tools such as preassessment clinics (PACs) and the surgical safety checklist (SSC) that help minimize risks in the preoperative process by assessing patients’ anesthetic risk [19] or verifying compliance with essential surgical aspects from the beginning to the end of surgery [20]. Regarding these two elements, one of the initiatives to ensure that the requirements established in the preoperative assessment are met is to provide recommendations to patients so they can participate in their own care in aspects such as the use of medications (eg, anticoagulants and biologicals) and hygienic and dietetic measures. In this way, we hypothesize that involving patients in the preoperative care and promoting them to meet the specific recommendations can lead to avoiding risky situations and, consequently, surgery cancellations.

Currently, there is evidence of the benefits of PACs and the SSC on the reduction of postoperative complications in the ambulatory setting [21], preoperative anxiety [18], and cancellations for medical reasons (eg, inappropriate use of medication before surgery) [22,23].

Some experiences based on information and communication technologies, such as incorporating the SSC in digital form to the electronic health record (EHR) or sending short message service text messages as a reminder of health appointments, have made it possible to increase compliance to treatment and surgical recommendations, reduce cancellations, and avoid no-shows [1,24-27]. Currently, mobile devices (tablet, mobile phone, and wearable devices) have a very high degree of penetration in Spain [28], Andalusia in particular, with 70.9% of the population (some 4.8 million inhabitants) connecting to the internet through these devices [29]. Because of its characteristics, (eg, mobility, instant access, connectivity, and variety of functionalities), mobile health (mHealth) can influence patients’ attitudes and behaviors and facilitate the asynchronous information exchange between patients and health professionals [30]. Some mHealth-based interventions such as the use of mHealth apps, have proven effective in the management of chronic diseases (eg, diabetes, asthma, and hypertension) by improving clinical parameters, compliance, and reducing disease costs [31]. Despite their great potential, the few initiatives undertaken thus far in the ambulatory surgical setting have been limited to postoperative patient monitoring [32,33]. Thus, there is no available evidence of the effect of mHealth apps on compliance with preoperative recommendations and, consequently, on the reduction of surgical cancellations.

Listeo+ is a multifunctional mobile app that provides personalized information to surgical patients (date and time of surgery), adjusted to their clinical condition. In addition to sending reminders on critical aspects of the operation at different times, Listeo+ monitors compliance with preoperative recommendations by establishing a communication channel between patients and health care professionals, which facilitates intervention in the case of possible AEs.

The aim of this study is to evaluate the impact of Listeo+ as a complement to standard of care (SOC) in patient compliance with preoperative recommendations, surgery cancellations, and associated resource consumption in the ambulatory surgical setting, in a clinical context of real-world evidence, and to evaluate the user experience with the app (perceived usability and utility).

Study Design

A multicenter, randomized, and open-label controlled trial was planned to evaluate the Listeo+ mHealth app as a complement to SOC in patients undergoing MAS. The study protocol has two arms: patients who receive preoperative written recommendations (control group) and patients who use the Listeo+ mHealth app as a multifunctional tool to monitor personal recommendations from health professionals (intervention group). The study considers guidelines and recommendations of the Standard Protocol Items: Recommendations for Interventional Trials [34] and Consolidated Standards of Reporting Trials statements [35].

The study protocol has been approved in a peer-review process by the Spanish Ministry of Economy and Competitiveness in its Technological Projects in Health call on July 14, 2015 (application identification DTS15/00228) and by the Andalusian Regional Ministry of Health in its Health Research Projects call on July 15, 2015 (application identification PI-0447-2014).

Study Setting

Four High-Resolution Hospital Centers belonging to the Public Health System of Andalusia as a part of the NHS hospital network are recruiting patients for this study (Multimedia Appendix 1). High-Resolution Hospital Centers encourage ambulatory surgery and short-term hospitalization using MAS; thus, they were considered suitable centers to evaluate the initiative. Participating Hospital reference population is about 187,957 inhabitants.

Eligibility Criteria

Characteristics and Selection Criteria of Patients Undergoing Major Ambulatory Surgery

Patients participating in this study will be adults aged ≥18 years at the start of the study who will undergo MAS in the specialties of traumatology, orthopedic surgery, ophthalmology, or general surgery.

Inclusion Criteria

To participate in this study, participants should be autonomous or dependent on one or more caregivers to perform their preoperative preparation, with the necessary technological and connectivity resources (ie, to dispose a smartphone or tablet mobile device with an Android or iOS operating system with an internet connection and familiarity with mobile technologies).

Patients who are autonomous to perform their preoperative preparation and lack the technological requirements but have caregivers with the necessary technological and connectivity resources who can supervise their preoperative preparation may also be included in the study.

Exclusion Criteria

Patients with two scheduled operations during the same clinical episode or time period will be excluded from the study. Nonautonomous patients, whose caregivers cannot be located when personal preoperative recommendations (Multimedia Appendix 2) are provided, and patients of the intervention group who have not downloaded and registered on Listeo+ will also be excluded. To avoid the loss of patients, a rescue procedure will be used with patients who, within 7-14 days, have not registered on the Listeo+ app. A telephone call will be made urging them to register on the Listeo+ app. If a patient has not registered within 72 hours (3 days) after the rescue call has been made, he or she will be excluded from the study.

Study Outcomes

Primary Outcomes

The primary outcome will be measured as the average percentage of patient compliance with preoperative recommendations (the number of recommendations met by surgical intervention). Compliance with type 2 recommendations will be checked at the point of anesthesia consultation, whereas types 1 and 3 at the point of patient reception and preparation the day of surgery.

Secondary Outcomes

The secondary outcomes include the rate of surgery cancellations (the absolute number of cancellations compared with the number of scheduled operations for each study group in the study period) and the associated consumption of hospital resources assessed by a cost analysis between the control and intervention groups, so only direct costs will be considered. To evaluate the user experience with the Listeo+ app in the intervention group, the perceived usability and utility of mHealth apps will be analyzed. The level of usability, defined as the extent to which Listeo+ is utilized by users to achieve specific objectives of mHealth apps [36], will be evaluated exclusively in patients, whereas the perceived utility of Listeo+ will be evaluated in health professionals using qualitative techniques.

Then, the absolute change (numerical difference over the two study groups) and relative change (percentage of variation among the intervention group over the SOC) will be determined to assess the impact of the intervention for the primary and secondary outcomes (except for variables related to user experience and the level of usability).


Figure 1 presents the patient flow from the MAS assessment appointment to hospital discharge. This includes a first visit to surgery consultation, a second face-to-face anesthesia consultation (all patients except for ophthalmological patients with indication for topical anesthesia), and a third hospitalization visit to undergo MAS. Patients in the control group will follow the existing MAS patient assistance route in the centers, which consists of providing written recommendations. Participants are not going to pay for the app.


Patients included in the intervention group will be provided with personal recommendations through the Listeo+ mobile app (Figures 2 and 3). These personal recommendations will also be printed and provided to the intervention group. Furthermore, the intervention group patients will be given access to download the mobile app through their mobile apps market (Google Play and Apple Store) using a link and quick response (QR)code.

Figure 1. Patient flowchart. MAS: major ambulatory surgery.
View this figure
Figure 2. Screenshots of Listeo+ app.
View this figure
Figure 3. Screenshot of the to-do list for patients in the Listeo+ app.
View this figure

Once the app is downloaded, patients will be able to use a personalized QR code included in their printed recommendations that will allow them to access their episode identification data and their personalized recommendations already set up by their anesthesiologist in the Web-based Listeo+ module integrated into the EHR platform of the Hospitals (Figure 4). Simultaneously, the EHR also sends all the necessary data for the app via Web service establishing the communication between the EHR and the app for the very first time.

Figure 4. Screenshot of health care professionals’ Listeo+ module within the electronic health record platform.
View this figure

Any interaction between app users and individualized recommendations will be immediately notified to the Listeo+ module and visualized in the EHR platform, which will automatically send notifications to the mobile app as well as emails to the designated health care professional of the participating center in case a critical recommendation (recommendations that may pose a risk to the patient or in which patient noncompliance may lead to the suspension, cancellation, or rescheduling of surgery as stated in Multimedia Appendix 2) is not marked. Additionally, health care professionals will be able to contact by phone to encourage patients to meet the recommendation or solve any potential problem. Notably, the nature of the incident will always be registered.

Sample Size and Statistical Plan

The sample size required to estimate the main objective of this study was calculated as 395 patients per group for a total of 790 patients. This estimate was made assuming an alpha risk of .05, a beta risk of .2, and a difference in proportions between the groups of 10%. The analysis will be performed considering per intention-to-treat (ITT) and per protocol populations. The ITT population will include all randomized patients, whereas the per protocol population will include randomized patients who finally obtain an appointment to undergo MAS.

In addition, statistical analyses will be performed using the R software version 3.3.2 (R Foundation for Statistical Computing). For all analyses, an alpha risk of .05 will be assumed; therefore, to consider a statistically significant difference, the P value of the contrast statistic should be ≤.05. The statistical analysis planned a priori will consist of a descriptive analysis of the demographic and clinical characteristics of patients. For quantitative variables, the mean, SD, 95% CIs, variance, SE, 5% trimmed mean, median, minimum, and maximum will be calculated. For qualitative variables, frequency distributions with their respective percentages will be calculated. To determine whether there are differences in the level of compliance with surgical recommendations between the group with written recommendations and the group with written recommendations plus the app, Fisher's exact test will be performed.

To assess the influence of sociodemographic and clinical characteristics of patients in the level of compliance with preoperative recommendations, multivariate logistic regression will be performed. Furthermore, the reasons for the exclusion of the ITT population will be included.


Patients who meet the inclusion criteria and sign informed consent will be provided with an information sheet about the project and evaluated before participating in the study. To allocate patients to study groups, simple randomization 1:1 procedure will be used. To include patients in the study, each center will be provided with one randomization scheme generated by computer. Given the characteristics of the study, it is not possible to blind patients and professionals. Subsequently, we will collect sociodemographic data (age, sex, area of residence of patients, level of education of patients or caregivers using the app or patient or caregiver of the control group, occupation, marital status, and knowledge or handling of apps), clinical data (type of surgery, medical diagnosis [International Classification of Diseases, Ninth Revision], anesthetic evaluation, and medications taken), and functional situation by measuring disability (Barthel index).

Data Collection

All the study data will be collected through an electronic case report form (eCRF). To facilitate the completion of the eCRF, a specific module has been created and integrated into the EHR of the participating centers. The information that the researchers include in the eCRF will be exported to an anonymized database (without identifying patient data to ensure data confidentiality) for further analysis of the study data. The researchers will be responsible for creating a system that relates the numbers of the EHR (containing the eCRF data) with the anonymized code in the database where the data are exported and for maintaining the list of identification codes.


The Barthel index will be used to assess physical dependence and loss of autonomy of patients at the point of patient reception and preparation. Health care professionals will score patients based on whether they did or did not require physical assistance to perform daily activities, ranging from 0 (patient is dependent in all assessed activities) to 100 (patient is independent to perform the reflected activities) [37,38].

The criteria of the American Society of Anesthesiologists (ASA) will be used to evaluate the anesthetic risk and identify the clinical outcomes in patients at the point of anesthesia consultation. It scores patient’s overall health to describe 6 different levels (level I describes a normal healthy patient, whereas level VI describes a declared brain-dead patient whose organs are being removed for donor purposes) [39]. Only low-risk (ASA I and ASA II) patients are a candidate for MAS. Eventually, ASA III patients could benefit from MAS, after undergoing evaluation on individual basis for the risk-benefit balance of the ambulatory care (ie, ASA III without decompensation in the last 3 months) [10].

The information about mobile app usability by the intervention group will be collected through a modified version of the self-assessed mobile-based Computer System Usability Questionnaire [40]. Four focus groups—with 6-8 participants each—will be organized to collect qualitative data about the utility perceived by health professionals as well as intervention group patients’ experience with the app.

Both research tools will provide very insightful information that will eventually lead to changes in the Listeo+ functionality or content. In the event an incident occurs involving the cancellation, suspension, or rescheduling of surgery, the consumption of hospital resources will be recorded (consumption of medications, hospital stay, consumption of laboratory tests, diagnostic imaging, etc).

Data Monitoring and Validation

Electronic monitoring of the completion of the eCRFs will be performed to detect missing information and possible data inconsistencies, thus, ensuring their quality. For this purpose, the researchers will be contacted during the patient recruitment phase, 3 and 6 months after the start of the project, using confidential information access codes. The inclusion of patients according to the established criteria (inclusion or exclusion criteria), the correct completion of the eCRFs, the signing and filing of the informed consent form of participating patients, and any other aspects required by the research team will be reviewed. The monitor will communicate to the corresponding research team the variables that must be reviewed in cases of lost or inconsistent data.

Technological Development, Integration, and Interoperability

To ensure proper communication between mHealth app users (patients and health professionals), a process of integration of information systems and interoperability between Listeo+ and EHR has been developed. This process was planned in 4 phases: (1) codesign of the system and pilot; (2) integration and technical tests; (3) simulation and pilot testing; and (4) real environment testing.

Ethical Aspects of the Study, Confidentiality, and Privacy

The study protocol has been evaluated and approved by the Regional Ethics Committee of Andalusia through the Biomedical Research Ethics Portal of Andalucía (PEIBA, for its acronym in Spanish). This study will be conducted in accordance with the principles of the latest version of the Declaration of Helsinki and will follow the Good Clinical Practice guidelines of Spain.

Written informed consent duly signed by all patients, legal representatives, or caregivers participating in this study will be collected before patient allocation to study groups. Data confidentiality will be protected under the Spanish law that ensures the protection of personal data (Organic Law on Protection of Personal Data, 15/1999, December 13). The researcher of each center will be responsible for keeping a study file containing patient identification and information, including the informed consent form signed by patients. Throughout the study, all related documents will be located in a secure area of the participating center. Any analysis derived from the study will be performed from an anonymized database; it will not contain any identification of patients or caregivers but only a numeric code, through which it will not be possible to reveal their identities. At the end of the study, the researcher will be responsible for preserving the necessary documentation for at least 5 years.

Currently, this study is in the recruitment phase, which will end once 790 patients are included (395 for each arm). The data collection and cleaning phases are estimated to be completed in April 2019, and the analysis with the final results will be conducted in July 2019.

Previously, the technical aspects of interoperability between the hospital and the Listeo+ app backend (set of system components accessible only to the developers or platform administrators) were resolved successfully, defining an application programming interface for Web services. In December 2016, an eCRF was created that was fully integrated into the EHR of the participating centers.

Prior to the recruitment of patients, a pilot phase was conducted in January 2017 with the aim of identifying complications in the subsequent phases of recruitment and data analysis. During the pilot phase, face-to-face sessions were held in the hospitals with both health professionals and specialized information and communication technologies personnel. In these sessions, test runs were performed with several patients, verifying the effective communication between the systems and the usability of the new functionality integrated into the EHR. As a result, a telephone call was included in the protocol, at 7 and 14 days after the provision of recommendations during the anesthesiologist appointment, for the patients of the intervention group who had not downloaded their personal preoperative recommendations using the QR code. In addition, two new recommendations were added (see Multimedia Appendix 2: R1_18 and R3_24), and the wording of the recommendations was modified to facilitate patient understanding. Simultaneously, improvements were made in the design and functionality of Listeo+.

Principal Findings

The introduction of new multifunctional technologies allows achieving different objectives in patient preparation, providing personalized information, and establishing an effective communication channel that facilitates patient monitoring by health professionals [30]. The evaluation of initiatives based on new technologies in the health sector is a fundamental element because of its subsequent adoption by the different stakeholders (patients, health professionals, and decision makers). According to the World Health Organization (WHO), the lack of evidence on the effectiveness and economic impact of mHealth-based interventions is one of the most important barriers for implementing these programs within the framework of the European Union [41]. In this sense, it is necessary to perform initiatives aimed at generating evidence on the effect of compliance with preoperative recommendations and their economic impact in MAS using mHealth apps, which evaluate their utility and efficiency in critical areas such as surgical patient safety. Taking into account the increasingly important role of citizens and patients in health systems, the possibility of having information about user experience (perceived usability and utility) makes it possible to evaluate the suitability of these tools in a real clinical setting.

Relevance of the Study

Improvements in systems integration and interoperability could have great relevance. Currently, it has been possible to incorporate into the EHR of the participating centers a generator of preoperative recommendation lists that allows selecting the information according to individual patient characteristics. In addition, the structure of information systems for data exchange has been modified from the users’ mobile device using Listeo+ and the EHR in these centers. The learning process and the improvement in systems integration and interoperability can be used for other initiatives within the framework of mHealth apps in Andalusia, a region with a favorable environment for the development of initiatives based on new technologies and, by extension, to the rest of the NHS.

Furthermore, the interest of the study lies in the increase in MAS and the adoption of mobile devices and acceptance of mHealth apps by the population. Thus, the number of MAS operations in developed countries has continued to increase in recent years. In 2015, in Spain, 1,632,824 MAS operations were performed, corresponding to an increase of 4.2% from the period of 2010-2015 [11]. In addition, it highlights that the penetration level of smartphones is also increasing, even among the elderly, reducing the generation gap [42]. Finally, data from a local survey on the use of mHealth apps show that 73.8% of patients would use them if recommended by their doctor, which suggests a high level of acceptance of mHealth apps by the population [43].


This study has some limitations related to the design of the intervention and the methodology used. First, it is a randomized clinical trial with an open-label design. Although not blinding patients and professionals could lead to potential bias in the interpretation of results, this type of design is widely accepted in complex nonpharmacological interventions (eg, surgery and medical devices) [44] in which masking cannot be applied. Second, Listeo+ has been evaluated as a complement to SOC (written recommendations). In this sense, other published clinical trials based on MAS and Patient Support Programs also use this methodological approach where intervention is assumed as a complement to SOC [45,46].


In line with WHO guidelines, mHealth apps help search for new formulas that support patient safety by involving them in the care process and making them responsible for their own safety. Listeo+ mobile app will allow health professionals to monitor in real-time patients’ preparation and critical preoperative recommendation fulfillment. The achievements obtained in the integration and interoperability of information systems prior to recruitment are considered a fundamental advancement in the development of strategies for mHealth app-based solutions. As a result, a reduction in avoidable preoperative cancellations due to a lack of or a poor patient preparation is expected, and self-assessed Web-based questionnaires and focus group will provide important information about the perceived usability and utility of Listeo+ app among patients and health care professionals.


This project has received funding from the public Institute of Health Carlos III, which is part of the Ministry of Economy and Competitiveness of Spain (file number: DTS15/00228), and the Foundation for Healthcare and Progress (file number: PI-0447-2014), which is part of the Health Department of the Regional Government of Andalusia (Spain).

Conflicts of Interest

None declared.

Multimedia Appendix 1

Listeo+ promotional video.

MOV File, 21MB

Multimedia Appendix 2

MAS preoperative recommendations in Listeo+.

PDF File (Adobe PDF File), 70KB

Multimedia Appendix 3

CONSORT-EHEALTH checklist (V 1.6.1).

PDF File (Adobe PDF File), 2MB

Multimedia Appendix 4

Peer-review report and trial registration from the national funding agency.

PDF File (Adobe PDF File), 33KB

Multimedia Appendix 5

Peer-review report and trial registration from the regional funding agency.

PDF File (Adobe PDF File), 38KB

  1. Waller A, Forshaw K, Carey M, Robinson S, Kerridge R, Proietto A, et al. Optimizing Patient Preparation and Surgical Experience Using eHealth Technology. JMIR Med Inform 2015 Sep 01;3(3):e29 [FREE Full text] [CrossRef] [Medline]
  2. Souzdalnitski D, Narouze S. Evidence-based approaches toward reducing cancellations on the day of surgery. Saudi J Anaesth 2014 Nov;8(Suppl 1):S6-S7 [FREE Full text] [CrossRef] [Medline]
  3. Mesmar M, Shatnawi NJ, Faori I, Khader YS. Reasons for cancellation of elective operations at a major teaching referral hospital in Jordan. East Mediterr Health J 2011 Aug;17(8):651-655. [Medline]
  4. Tung A, Dexter F, Jakubczyk S, Glick DB. The limited value of sequencing cases based on their probability of cancellation. Anesth Analg 2010 Sep;111(3):749-756. [CrossRef] [Medline]
  5. Kumar R, Gandhi R. Reasons for cancellation of operation on the day of intended surgery in a multidisciplinary 500 bedded hospital. J Anaesthesiol Clin Pharmacol 2012 Jan;28(1):66-69 [FREE Full text] [CrossRef] [Medline]
  6. Ezike H, Ajuzieogu V, Amucheazi A. Reasons for elective surgery cancellation in a referral hospital. Ann Med Health Sci Res 2011 Jul;1(2):197-202 [FREE Full text] [Medline]
  7. Garg R, Bhalotra AR, Bhadoria P, Gupta N, Anand R. Reasons for cancellation of cases on the day of surgery-a prospective study. Indian J Anaesth 2009 Feb;53(1):35-39 [FREE Full text] [Medline]
  8. González-Arévalo A, Gómez-Arnau JI, delaCruz FJ, Marzal JM, Ramírez S, Corral EM, et al. Causes for cancellation of elective surgical procedures in a Spanish general hospital. Anaesthesia 2009 May;64(5):487-493 [FREE Full text] [CrossRef] [Medline]
  9. Martínez RF, Codina GJ, Deulofeu QP, Garrido CJ, Blasco CF, Gibanel GX, et al. [Indicators of healthcare quality in day surgery (2010-2012)]. Rev Calid Asist 2014;29(3):172-179. [CrossRef] [Medline]
  10. Terol-García E, Palanca-Sanchez I. Manual Unidad de Cirugía Mayor Ambulatoria. Estándares y recomendaciones. [Major Ambulatory Surgery Unit Manual: Standards and recommendations.]. Madrid: Ministerio de Sanidad y Consumo. Gobierno de España. Centro de Publicaciones; 2008.   URL: [accessed 2018-11-16] [WebCite Cache]
  11. Ministry of Health, Social Services and Equality. [Statistics on Specialized Care Centers]. 2017.   URL: http:/​/www.​​estadEstudios/​estadisticas/​estHospiInternado/​inforAnual/​documentos/​Indicadores_hospitalarios_Evolucion_2010-2015.​pdf [accessed 2018-11-19] [WebCite Cache]
  12. OECDiLibrary. Paris: OECD Publishing; 2015 Nov 4. Health at a Glance 2015: OECD Indicators   URL: https:/​/www.​​social-issues-migration-health/​health-at-a-glance-2015_health_glance-2015-en [WebCite Cache]
  13. Guillén JM, Bernadó AJ, Solanas JAG, Guedea ME, Villahoz ER, Díez MM. [Cancellation in CMA: incidence and causes]. Cir Esp 2012;90(7):429-433. [CrossRef] [Medline]
  14. Bernadó AJ, Artigas C, Elia M, Casamayor C, Gracia JA, Martinez M. Cancellations in ambulatory day surgery: Ten years observational study. Ambulatory Surgery 2006 Jan;12(3):119-123. [CrossRef]
  15. Dimitriadis PA, Iyer S, Evgeniou E. The challenge of cancellations on the day of surgery. Int J Surg 2013;11(10):1126-1130 [FREE Full text] [CrossRef] [Medline]
  16. Lee CM, Rodgers C, Oh AK, Muckler VC. Reducing Surgery Cancellations at a Pediatric Ambulatory Surgery Center. AORN J 2017 Apr;105(4):384-391. [CrossRef] [Medline]
  17. Xue W, Yan Z, Barnett R, Fleisher L, Liu R. Dynamics of Elective Case Cancellation for Inpatient and Outpatient in an Academic Center. J Anesth Clin Res 2013 May 01;4(5):314 [FREE Full text] [Medline]
  18. Davidson S, McKendrick D, French T. Preassessment clinic interview and patient anxiety. Saudi J Anaesth 2016;10(4):402-408 [FREE Full text] [CrossRef] [Medline]
  19. Committee on Standards and Practice Parameters, Apfelbaum JL, Connis RT, Nickinovich DG, American Society of Anesthesiologists Task Force on Preanesthesia Evaluation, Pasternak LR, et al. Practice advisory for preanesthesia evaluation: an updated report by the American Society of Anesthesiologists Task Force on Preanesthesia Evaluation. Anesthesiology 2012 Mar;116(3):522-538. [CrossRef] [Medline]
  20. World Health Organization. WHO Guidelines for Safe Surgery 2009 Safe Surgery Saves Lives. Geneva: World Health Organization; 2009.
  21. Grau M. [Utility of surgical checklists: effect on the relationships and communication in the work team, morbidity, mortality and patient safety]. Barcelona: Agència de Qualitat i Avaluació Sanitàries de Catalunya; 2015.   URL: https:/​/www.​​resources/​documentos/​2016/​seguridad-bloque-quirurgico/​Listados_verificacion_quirurgica_AQuAS_2015_RedAgencias_MinisterioSanidad.​pdf [accessed 2018-11-19] [WebCite Cache]
  22. Knox M, Myers E, Hurley M. The impact of pre-operative assessment clinics on elective surgical case cancellations. Surgeon 2009 Apr;7(2):76-78. [Medline]
  23. McKendrick DRA, Cumming GP, Lee AJ. A 5-year observational study of cancellations in the operating room: Does the introduction of preoperative preparation have an impact? Saudi J Anaesth 2014 Nov;8(Suppl 1):S8-S14 [FREE Full text] [CrossRef] [Medline]
  24. Gitelis ME, Kaczynski A, Shear T, Deshur M, Beig M, Sefa M, et al. Increasing compliance with the World Health Organization Surgical Safety Checklist-A regional health system's experience. Am J Surg 2017 Jul;214(1):7-13. [CrossRef] [Medline]
  25. Robotham D, Satkunanathan S, Reynolds J, Stahl D, Wykes T. Using digital notifications to improve attendance in clinic: systematic review and meta-analysis. BMJ Open 2016 Dec 24;6(10):e012116 [FREE Full text] [CrossRef] [Medline]
  26. Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Atun R, Car J. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst Rev 2013 Dec 05(12):CD007458. [CrossRef] [Medline]
  27. DeKoekkoek T, Given B, Given CW, Ridenour K, Schueller M, Spoelstra SL. mHealth SMS text messaging interventions and to promote medication adherence: an integrative review. J Clin Nurs 2015 Oct;24(19-20):2722-2735. [CrossRef] [Medline]
  28. National Institute of Statistics. [Survey on Equipment and Use of Information and Communication Technologies in Homes]. 2017 Oct 05.   URL: [accessed 2018-11-19] [WebCite Cache]
  29. Sotillos-González B, Buiza-Camacho B, Herrera-Usagre M, Escobar-Ubreva A, Fernández-Bermejo MC, Santana-López V, et al. [Citizen perspectives on doctor-prescribed mobile health apps and information and communication technology usage within the Andalusian Healthcare System]. Journal of Healthcare Quality Research 2018 Jul;33(4):225-233 [FREE Full text] [CrossRef]
  30. Iribarren SJ, Cato K, Falzon L, Stone PW. What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions. PLoS One 2017;12(2):e0170581 [FREE Full text] [CrossRef] [Medline]
  31. Marcolino MS, Oliveira JAQ, D'Agostino M, Ribeiro AL, Alkmim MBM, Novillo-Ortiz D. The Impact of mHealth Interventions: Systematic Review of Systematic Reviews. JMIR Mhealth Uhealth 2018 Jan 17;6(1):e23 [FREE Full text] [CrossRef] [Medline]
  32. Armstrong KA, Coyte PC, Bhatia RS, Semple JL. The effect of mobile app home monitoring on number of in-person visits following ambulatory surgery: protocol for a randomized controlled trial. JMIR Res Protoc 2015 Jun 03;4(2):e65 [FREE Full text] [CrossRef] [Medline]
  33. Semple JL, Sharpe S, Murnaghan ML, Theodoropoulos J, Metcalfe KA. Using a mobile app for monitoring post-operative quality of recovery of patients at home: a feasibility study. JMIR Mhealth Uhealth 2015 Feb 12;3(1):e18 [FREE Full text] [CrossRef] [Medline]
  34. Chan A, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med 2013 Feb 05;158(3):200-207 [FREE Full text] [CrossRef] [Medline]
  35. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011 Dec 31;13(4):e126 [FREE Full text] [CrossRef] [Medline]
  36. International Organization for Standardization. International Organization for Standardization. 1998. ISO 9241-11:1998. Ergonomic requirements for office work with visual display terminals (VDTs) Part 11 Guidance on usability   URL: [accessed 2018-11-29] [WebCite Cache]
  37. Collin C, Wade DT, Davies S, Horne V. The Barthel ADL Index: a reliability study. Int Disabil Stud 1988;10(2):61-63. [Medline]
  38. Mahoney FI, Barthel DW. Functional Evaluation: The Barthel Index. Md State Med J 1965 Feb;14:61-65. [Medline]
  39. American Society of Anesthesiologisths (ASA). ASA Physical Status Classification System. 2014 Oct 15.   URL: [accessed 2018-11-19] [WebCite Cache]
  40. English LL, Dunsmuir D, Kumbakumba E, Ansermino JM, Larson CP, Lester R, et al. The PAediatric Risk Assessment (PARA) Mobile App to Reduce Postdischarge Child Mortality: Design, Usability, and Feasibility for Health Care Workers in Uganda. JMIR Mhealth Uhealth 2016 Feb 15;4(1):e16 [FREE Full text] [CrossRef] [Medline]
  41. World Health Organization. Geneva: WHO Regional Office for Europe; 2016. From innovation to implementation:eHealth in the WHO European Region   URL: http:/​/www.​​__data/​assets/​pdf_file/​0012/​302331/​From-Innovation-to-Implementation-eHealth-Report-EU.​pdf [accessed 2018-11-29] [WebCite Cache]
  42. Telefónica Fundación. Madrid: Editorial Ariel; 2016 Feb 22. [The Information Society in Spain 2015]   URL: https:/​/www.​​arte_cultura/​publicaciones-listado/​pagina-item-publicaciones/​itempubli/​483/​ [accessed 2018-08-02] [WebCite Cache]
  43. Herrera-Usagre M, Buiza B, Reyes-Alcázar V, Escobar A. ISQUA18-2423 Willingness to Pay for Government-Approved Mobile Health Applications and mHealth Social Acceptability In Spain. International Journal for Quality in Health Care 2018 Sep 18;30(Issue suppl_2):32-33 [FREE Full text] [CrossRef]
  44. Kahan BC, Cro S, Doré CJ, Bratton DJ, Rehal S, Maskell NA, et al. Reducing bias in open-label trials where blinded outcome assessment is not feasible: strategies from two randomised trials. Trials 2014 Nov 21;15:456 [FREE Full text] [CrossRef] [Medline]
  45. Yu K, Zhou Y, Liu G, Li B, He P, Zhang H, et al. A prospective, multicenter, controlled, observational study to evaluate the efficacy of a patient support program in improving patients' persistence to adjuvant aromatase inhibitor medication for postmenopausal, early stage breast cancer. Breast Cancer Res Treat 2012 Jul;134(1):307-313. [CrossRef] [Medline]
  46. Oliveira-Ciabati L, Vieira CS, Franzon ACA, Alves D, Zaratini FS, Braga GC, et al. PRENACEL - a mHealth messaging system to complement antenatal care: a cluster randomized trial. Reprod Health 2017 Dec 07;14(1):146 [FREE Full text] [CrossRef] [Medline]

ASA: American Society of Anesthesiologists
HER: electronic health record
ITT: intention-to-treat
MAS: major ambulatory surgery
NHS: National Health System
QR: quick response
SOC: standard of care
SSC: surgical safety checklist
WHO: World Health Organization

Edited by G Eysenbach; submitted 11.05.18; peer-reviewed by D Dunsmuir, M Nomali; comments to author 22.06.18; revised version received 13.08.18; accepted 14.08.18; published 16.01.19


©Manuel Herrera-Usagre, Vicente Santana, Ramon Burgos-Pol, Juan Pedro Oliva, Eliazar Sabater, Maria Rita-Acosta, Miguel Angel Casado, Susana Cruces, Manuel Pacheco, Carlos Solorzano Perez. Originally published in JMIR Research Protocols (, 16.01.2019.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.