ResProt JMIR Res Protoc JMIR Research Protocols 1929-0748 JMIR Publications Toronto, Canada v12i1e43028 36692940 10.2196/43028 Protocol Protocol The Ability of Austrian Qualified Physiotherapists to Make Accurate Keep-Refer Decisions and to Detect Serious Pathologies Based on Clinical Vignettes: Protocol for a Cross-sectional Web-Based Survey Leung Tiffany Lackenbauer Wolfgang PhD 1
Institute of Therapeutic and Midwifery Sciences Department of Health Sciences University of Applied Sciences Krems Piaristengasse 1 Krems, 3500 Austria 43 2732 802 0 wolfgang.lackenbauer@fh-krems.ac.at
https://orcid.org/0000-0002-7469-7950 Gasselich Simon BSc 1 https://orcid.org/0000-0002-2442-7442 Lickel Martina Edda BSc 2 https://orcid.org/0000-0003-1687-475X Beikircher Reinhard MSc 1 https://orcid.org/0000-0002-5341-689X Keip Christian MSc 1 https://orcid.org/0000-0002-5758-0136 Rausch Florian MD 3 https://orcid.org/0000-0002-0340-6685 Wieser Manfred MD 2 https://orcid.org/0000-0001-6216-2396 Selfe James PhD, DSc 4 https://orcid.org/0000-0001-9931-4998 Janssen Jessie PhD 1 https://orcid.org/0000-0002-5961-2736 Institute of Therapeutic and Midwifery Sciences Department of Health Sciences University of Applied Sciences Krems Krems Austria Karl Landsteiner University Krems Austria University Hospital Krems Krems Austria Department of Health Professions Manchester Metropolitan University Manchester United Kingdom Corresponding Author: Wolfgang Lackenbauer wolfgang.lackenbauer@fh-krems.ac.at 2023 24 1 2023 12 e43028 28 9 2022 23 11 2022 30 11 2022 30 11 2022 ©Wolfgang Lackenbauer, Simon Gasselich, Martina Edda Lickel, Reinhard Beikircher, Christian Keip, Florian Rausch, Manfred Wieser, James Selfe, Jessie Janssen. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 24.01.2023. 2023

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.

 Background

The recognition of serious pathologies affecting the musculoskeletal (MSK) system, especially in the early stage of a disease, is an important but challenging task. The prevalence of such serious pathologies is currently low. However, in our progressing aging population, it is anticipated that serious pathologies affecting the MSK system will be on the rise. Physiotherapists, as part of a wider health care team, can play a valuable role in the recognition of serious pathologies. It is at present unknown how accurately Austrian qualified physiotherapists can detect the presence of serious pathologies affecting the MSK system and therefore determine whether physiotherapy management is indicated (keep patients) or not (refer patients to a medical doctor).

 Objective

We will explore the current ability of Austrian qualified physiotherapists to recognize serious pathologies by using validated clinical vignettes.

 Methods

As part of an electronic web-based survey, these vignettes will be distributed among a convenience sample of qualified Austrian physiotherapists working in a hospital or private setting. The survey will consist of four sections: (1) demographics and general information, (2) the clinical vignettes, (3) questions concerning the clinical vignettes, and (4) self-perceived knowledge gaps and learning preferences from the perspective of study participants. Results will further be used for (1) international comparison with similar studies from the existing literature and (2) gaining insight into the participants’ self-perceived knowledge gaps and learning preferences for increasing their knowledge level about keep-refer decision-making and detecting serious pathologies.

 Results

Data collection took place between May 2022 and June 2022. As of June 2022, a total of 479 Austrian physiotherapists completed the survey. Data analysis has started, and we aim to publish the results in 2023.

 Conclusions

The results of this survey will provide insights into the ability of Austrian physiotherapists to make accurate keep-refer decisions and to recognize the presence of serious pathologies using clinical vignettes. The results of this survey are expected to serve as a basis for future training in this area.

 International Registered Report Identifier (IRRID)

DERR1-10.2196/43028

 red flags clinical reasoning physiotherapy screening referral musculoskeletal ext-peer-rev This paper was peer reviewed by the Life Science Call 2020 - Gesellschaft für Forschungsförderung Niederösterreich m.b.H. (GFF) (Pölten, Austria). See the Multimedia Appendix for the peer-review report; Introduction

We live in an aging society. The forecasted increase in the number of people older than 65 years from currently 34.4% to 59.2% by 2070 for the entire area of the European Union will pose great challenges for the health care systems of the European Union member states [1]. A very high increase in health care expenditure is to be expected [1]. In view of the challenges of an aging society, measures are being sought to cope with the increased pressure on the health care system in the future. One measure to relieve the burden on hospitals and to be able to provide the most efficient care for patients, the establishment of primary care units, is currently being propagated in Austria [2]. The core idea of primary care units is that patients are managed in a team consisting of general practitioners and different nonphysician health care professionals (such as nurses, physiotherapists, speech therapists, and occupational therapists) [2]. The expansion of primary health care in Austria is in line with the recommendations of the World Health Organization, which highlights that even though some musculoskeletal (MSK) conditions may require more specialist or surgical management, most conditions of the MSK system can readily and effectively be managed in a primary care setting [3].

MSK conditions that often present with pain and restricted mobility are highly prevalent within the general population [3]. In 2016, low back pain, for instance, was the leading cause of years lived with disability for men in 133 of 195 countries and for women in 104 of 195 countries [4].

Recent data from Denmark demonstrated that the overall prevalence of serious pathologies affecting the MSK system is at present comparatively low (2.3%) [5]. For instance, the prevalence of malignant neoplasms affecting the MSK system was 1.13% [6]. These figures are consistent with those from previous studies that reported a prevalence of metastatic spinal cancer as a serious cause of low back pain below 1% in primary care [7-10]. Another example is osteoporotic spinal fractures. The prevalence of osteoporotic fractures as a cause of vertebral pain in primary care ranges between 0.13% and 0.7% [5,9] but can be as high as 5% in a predominantly older study population [10]. In a progressively aging society, the number of people developing a serious pathology is likely to rise in the future. There is a clear link between advanced age and many cancers [11] such as prostate, lung, bowel, and breast cancer [12,13]. The significance of prostate, lung, thyroid, kidney, and breast cancer is that they account for 80% of all osseous metastases [14]. In addition, 80% of all fractures in women older than 50 years are caused by osteoporosis. One in 2 women and 1 in 5 men over the age of 50 years will experience an osteoporotic fracture [15].

The recognition of serious pathologies affecting the MSK system especially in the early stage of a disease is a challenging task [16]. However, early diagnosis is essential because this significantly improves prognosis and outcomes [16]. It is well known that especially in early stages (prodromal period), there are (if any) few or very vague/nonspecific signs and symptoms of a serious pathology [17]. However, as the disease progresses, these signs and symptoms become more obvious. Physiotherapists work very closely and sometimes over a prolonged period with their patients. They are therefore well suited to monitor the clinical situation of their patients (watchful waiting) [18] and repeatedly screen them for the occurrence or presence of specific signs and symptoms (red flags) that might indicate the presence of a serious pathology. Red flags can become apparent during the interview, physical examination, or treatment of a patient.

To analyze clinical decision-making abilities of medical and other health professionals, researchers make use of clinical vignettes that are concise paper-based or electronic descriptions of actual clinical situations [19]. Vignettes simulate real patients with various ailments and a wide range of different, sometimes complex, symptoms. Based on the clinical descriptions within such vignettes, clinicians are asked to decide about either examination procedures, (differential) diagnosis, or possible treatment options [20]. An additional advantage of vignettes is that they can be easily distributed among a large number of clinicians even with different educational backgrounds or from divergent health care settings [20,21].

Previous cross-sectional studies on qualified physiotherapists in the United States [22-26], Germany [27], Switzerland [28], Denmark [6], on Doctor of Physical Therapy students in the United States [29], and on European final year undergraduate physiotherapy students [30] have raised some concern about the physiotherapists’ ability to decide when physiotherapy is indicated (keep), or not (refer), and their ability to accurately detect the presence of serious pathologies based on clinical vignettes. Having said this, numerous case studies and case series within the literature highlight that physiotherapists can become key in the detection of serious pathologies in a clinical setting [31,32].

The ability of Austrian qualified physiotherapists to accurately detect serious pathologies and to determine if a patient is suitable for physiotherapy, or rather needs a more comprehensive medical workup, has not yet been explored. Considering the above-outlined changes to the Austrian health care sector and challenges of an increasingly aging society, this knowledge gap needs to be addressed. To fill this knowledge gap, we propose a cross-sectional web-based survey using validated clinical vignettes [6].

The overall aim of this study is to assess the ability of Austrian qualified physiotherapists to make accurate keep-refer decisions and their ability to detect serious pathologies affecting the MSK system based on 12 clinical vignettes. In addition, we want to explore potential knowledge gaps and learning preferences to acquire more expertise in making keep-refer decisions from the perspective of study participants.

 Methods Overview

The Methods, Results, and Discussion sections will adhere to the CHERRIES (Checklist for Reporting Results of Internet E-Surveys) statement [33].

 Ethics Considerations

The project was formally examined by the Commission for Scientific Integrity and Ethics of the Karl Landsteiner Private University, and it was found that in accordance with the set criteria, a further review by the commission was not required (project number: 1021/2022, date April 20, 2022). There were no medical ethical concerns about the conduct of the project.

 Eligibility Criteria

To be included in this study, prospective participants need to (1) be registered as qualified physiotherapists with the Austrian Health Professions Registry and (2) work in a hospital or private setting in Austria. Physiotherapists who have not actively treated patients during the last 12 months will not be eligible for this study.

 Recruitment Process

The email addresses of physiotherapists registered on the Austrian Health Professions Registry and with a publicly available email address have been collected. The recruitment process will be divided into the recruitment of physiotherapists working in a private setting and physiotherapists working in a health institution.

In the first part, physiotherapists who are working as private physiotherapists will be sent an email with an explanation of the study and a link to take part in the survey. If needed, after 2 weeks, the email will be re-sent to remind physiotherapists of the study.

In the second part, the multidisciplinary team leaders (n=44) of each health institution in Austria will be sent an email with information about the study and will be asked to provide information on the number of physiotherapists currently working for the institution and indicate if they are interested in taking part in the study. If interested, a new email will be sent to the multidisciplinary team leaders containing a link to forward to the physiotherapists to take part in the study.

When the link is activated, the physiotherapists will be taken to a website on the Unipark platform. Information regarding the research aim, eligibility criteria, and the anonymous nature of the study will be available. Consent will be given when participants accept the consent form and click on the “next” button.

 Sample Size Calculation

On March 15, 2022, a total of 16,991 physiotherapists were registered on the Austrian Health Professions Registry. Given this population, 376 physiotherapists need to be recruited to retain a 95% CI with a margin of error of 5% [34].

 Data Collection Tool

The survey will be constructed on the internet using the web-based survey tool Unipark. It will take 15 to 20 minutes to complete the whole survey. A copy of the survey, except the 12 translated vignettes, is provided in Multimedia Appendix 1.

The survey consists of four sections:

Demographic features of participants, for example, age, sex, working experience, and educational level.

Twelve vignettes, translated from English to German. After reading each clinical vignette, participants will be asked to decide if this is (a) an MSK condition, which does not need referral to a medical doctor (keep); (b) a noncritical medical condition, which needs referral to a medical doctor, while the patient can be treated by a physiotherapist (keep-refer); and (c) a critical medical condition, which needs immediate referral to a medical doctor and treatment by the physiotherapist should be stopped (refer). The vignettes (used with permission) have been validated by a panel of medical doctors and expert physiotherapists [6].

Feedback will be sought from participants on the 12 vignettes. Questions will be asked on

how difficult (on a Likert scale from 1 to 5) it is to make keep-refer decisions based on the information presented in the vignettes,

the relevance of the vignettes for everyday work (on a Likert scale from 1 to 5), and

possible missing information within the vignettes for making accurate keep-refer decisions (open-ended question).

Exploration of knowledge gaps and learning preferences to acquire more expertise in making keep-refer decisions and detecting serious pathologies from the perspective of study participants. Questions will be posed on

the confidence of participants to conduct clinical examination procedures (such as cranial nerve testing, reflex testing, and auscultation of blood vessels)

if participants are interested in learning more about keep-refer decision-making

suggestions for content and format of future training sessions to acquire more expertise in keep-refer decision-making (such as learning medium and environment/setting, teaching contents, and educational strategies)

any further suggestions and comments (open-ended question).

Pilot Testing

The first draft of this survey was sent to 5 physiotherapists and 4 medical doctors. Participants were asked to comment on their general understanding of the questionnaire and the appropriateness, comprehensibility, and proper sequencing of individual questions. In addition, the participants in the pilot could suggest additional questions that they deemed valuable. For an example, one participant suggested adding a question where future participants will be asked about their confidence in conducting clinical examination procedures (eg, cranial nerve testing) that might be relevant for clinical and keep-refer decision-making. Another suggestion was to add a question that could aid with the inclusion and exclusion criteria. Participants were therefore, right at the beginning of the survey, asked if they have treated patients during the last 12 months. If the participants answer this question with “no,” they will be thanked for their interest and then will automatically be prevented from continuing with the survey. The validity of some of the vignettes in the Austrian health care system was also questioned; therefore, after elaborate discussions, the originally envisioned vignettes by Jette et al [23] were replaced by the more current vignettes of Budtz et al [6]. The feedback from the pilot was collected and incorporated into the existing survey.

 Data Management and Analysis

The survey will be constructed online, and progression through the 12 vignettes will be mandatory so that an answer must be entered before one being able to continue. This will allow only completed clinical vignettes to be included in the analysis. Completed surveys will be automatically sent back to the online survey tool Unipark. The data will be stored at the QuestBack server park in Bremen, Germany. After the data collection is completed, the raw quantitative data will then be downloaded onto an SPSS file (IBM SPSS Statistics 28.0). The qualitative data will be exported to a Word document and then imported to a MAXQDA project (MAXQDA 2020). All data will be stored on a secure OneDrive folder to which only the researchers have access through their password protected laptops. The survey will be designed to be completely anonymous; however, there is a small risk that participants will share personal data in the open-ended question in the last section of the survey. If this happens, these data will be anonymized by a member of the research team.

Individual participants’ responses for each of the 12 vignettes will be classified as either being correct (Yes) or incorrect (No). Replicating previously used methodology [6,23,25,27-30], definitions of correct answers are as follows:

For the MSK vignettes: treat the patient without the need for medical referral (keep) or treat the patient with additional medical checkup (keep and refer, also called watchful waiting).

For the medical noncritical vignettes: choose to start physiotherapy with additional medical evaluation (keep and refer) or refer the patient without physiotherapy management (refer).

The sole correct answer for medical critical vignettes is sent the patient for medical evaluation without physiotherapy management (refer).

Once the data collection period is finished, the quantitative data will be checked for completeness and outliers. Missing data will be labeled. The Shapiro-Wilk test will be used to examine if the data are normally distributed. If values are normally distributed, the mean (with SD) will be calculated; if not, the median (with IQR) will be calculated. All descriptive statistics, such as age, sex, years of experience as a physiotherapist, and type of expertise, will be collected as categorical data, and the percentage for each category will be calculated.

In the clinical vignettes, the mean percentages (plus SD) of correct keep-refer decisions and actual numbers as well as percentages of participating physiotherapists who manage to accurately answer all vignettes from a specific category will be calculated (MSK vs medical noncritical vs medical critical) [6,23,25,27-30]. If it is not normally distributed, the median percentages with IQR will be presented.

The questions concerning the feedback from study participants on the 12 vignettes, such as “how sure the participants were when answering the clinical vignettes?” and “how relevant the vignettes were for the participants?” will be calculated as percentages for each category.

The questions concerning learning about red flags, such as interest for red flags training, medium of training, and interest of specific assessment techniques, will also be listed as percentages for each category.

The 2 open-ended questions concerning missing information in the clinical vignettes and any other remarks will be analyzed deductively using framework analysis [35] in MAXQDA. The predefined codes were in line with the diagnostic physiotherapeutic process [36]: referral, medical history, and physical examination. Recurrent remarks on additional information, which could help the participants with their clinical decision-making, will be coded and combined into categories to inform the next phase of the study: the development of educational clinical case studies for physiotherapists.

 Results

The distribution of the survey took place between May 2022 and June 2022. As of June 2022, a total of 479 Austrian physiotherapists completed the survey. It is anticipated that data collection, analysis, and writing up for a potential publication in a peer-reviewed journal will take 4 to 6 months.

 Discussion Study Strengths

A major strength is that our methodology is in line with previously published studies [6,23,25,27-30]. In addition, we use validated clinical vignettes (with permission) that have already been used in previous research [6,23,25,27-30]. This will give us the opportunity for international comparison.

To the best of our knowledge, this is the first study that examines the ability of Austrian physiotherapists to make accurate keep-refer decisions and to recognize the presence of serious pathologies using clinical vignettes. Moreover, this is the first attempt to explore potential knowledge gaps and learning preferences to acquire more expertise in making keep-refer decisions and recognizing the presence of serious pathologies from the perspective of Austrian qualified physiotherapists. These results will be used to inform future training in this field and should help advance patient safety and interdisciplinary collaboration within the Austrian health care system.

 Study Limitations

During the preparation of the study the aim was to collect the email addresses of all physiotherapists currently registered to work in Austria. However, from the private physiotherapists not all email addresses were retrievable on the internet, and 50% of the population will not be contacted. This could have implications on the generalizability of the study.

The limitations of clinical vignettes as a sole instrument for examining clinical decision-making strategies of health care professionals have previously been highlighted [37-39]. However, vignettes have the advantage that they can be distributed to a large pool of potential participants relatively quickly and at low cost. Our approach is in line with previous research using similar methodology [6,22,23,25,27-30]. The participants in this study will have the opportunity to provide feedback on the vignettes, which will be used to develop vignettes validated for the Austrian context.

Red Flags survey.

External peer-review from Life Science Call 2020 - Gesellschaft für Forschungsförderung Niederösterreich m.b.H. (GFF).

 Abbreviations CHERRIES

Checklist for Reporting Results of Internet E-Surveys

 MSK

musculoskeletal

The project team would like to thank the Gesellschaft für Forschungsförderung Niederösterreich m.b.H. (GFF) for the funding provided to carry out the project.

 Data Availability

We are aiming to deposit the quantitative data in a GitHub repository.

None declared.

 Directorate-General for Economic and Financial Affairs, Economic Policy Committee The 2021 Ageing Report: underlying assumptions and projection methodologies (Institutional Paper 142) European Commission 2022-12-14 https://economy-finance.ec.europa.eu/publications/2021-ageing-report-underlying-assumptions-and-projection-methodologies_en Sozialversicherung ebnet den Weg für die neue Primärversorgung den Weg für die neue Primärversorgung Hauptverband österreichischer Sozialversicherungsträger 2019 2022-03-30 https://www.ots.at/presseaussendung/OTS_20190409_OTS0184/sozialversicherung-ebnet-den-weg-fuer-die-neue-primaerversorgung Musculoskeletal conditions World Health Organisation 2019 2022-03-30 https://tinyurl.com/ms8deenk GBD 2016 Disease Injury Incidence Prevalence Collaborators Global, regional, and national incidence, prevalence, and years lived with disability for 328 diseases and injuries for 195 countries, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016 Lancet 2017 390 10100 1211 1259 10.1016/S0140-6736(17)32154-2 28919117 S0140-6736(17)32154-2 PMC5605509 Budtz CR Hansen RP Thomsen JNL Christiansen DH The prevalence of serious pathology in musculoskeletal physiotherapy patients: a nationwide register-based cohort study Physiotherapy 2021 112 96 102 10.1016/j.physio.2021.03.004 34034209 S0031-9406(21)00023-7 Budtz CR Rønn-Smidt H Thomsen JNL Hansen RP Christiansen DH Primary care physiotherapists ability to make correct management decisions: is there room for improvement? A mixed method study BMC Fam Pract 2021 22 1 196 10.1186/s12875-021-01546-1 34615482 10.1186/s12875-021-01546-1 PMC8496017 Deyo RA Diehl AK Cancer as a cause of back pain: frequency, clinical presentation, and diagnostic strategies J Gen Intern Med 1988 3 3 230 238 10.1007/BF02596337 2967893 Donner-Banzhoff N Roth T Sönnichsen AC Luckmann J Leonhardt C Chenot J Becker A Keller S Griffiths F Baum E Evaluating the accuracy of a simple heuristic to identify serious causes of low back pain Fam Pract 2006 23 6 682 686 10.1093/fampra/cml049 17046973 cml049 Henschke N Maher CG Refshauge KM Herbert RD Cumming RG Bleasel J York J Das A McAuley JH Prevalence of and screening for serious spinal pathology in patients presenting to primary care settings with acute low back pain Arthritis Rheum 2009 60 10 3072 3080 10.1002/art.24853 19790051 Enthoven WTM Geuze J Scheele J Bierma-Zeinstra SMA Bueving HJ Bohnen AM Peul WC van Tulder MW Berger MY Koes BW Luijsterburg PAJ Prevalence and "Red Flags" regarding specified causes of back pain in older adults presenting in general practice Phys Ther 2016 96 3 305 312 10.2522/ptj.20140525 26183589 ptj.20140525 Greenhalgh S Selfe J Red Flags and Blue Lights: Managing Serious Spinal Pathologies. 2nd ed 2019 Edinburgh Elsevier Cancer registration statistics, England: 2017 Office for National Statistics 2019 2022-04-06 https://tinyurl.com/45k3k24d Jahrbuch der Gesundheitstatistik 2019 Statistik Austria 2021 2022-12-09 https://www.statistik.at/web_de/services/publikationen/4/index.html?includePage=detailedView&sectionName=Gesundheit&pubId=495 Davila D Antoniou A Chaudhry MA Evaluation of osseous metastasis in bone scintigraphy Semin Nucl Med 2015 45 1 3 15 10.1053/j.semnuclmed.2014.07.004 25475375 S0001-2998(14)00064-6 Capture the fracture 2012 International Osteoporosis Foundation 2022 2022-04-06 https://www.osteoporosis.foundation/sites/iofbonehealth/files/2019-06/2012_CaptureTheFracture_ThematicReport_English.pdf Levack P Graham J Collie D Grant R Kidd J Kunkler I Gibson A Hurman D McMillan N Rampling R Slider L Statham P Summers D Scottish Cord Compression Study Group Don't wait for a sensory level---listen to the symptoms: a prospective audit of the delays in diagnosis of malignant cord compression Clin Oncol (R Coll Radiol) 2002 14 6 472 480 10.1053/clon.2002.0098 12512970 S0936-6555(02)90098-1 Gould BE Pathophysiology for the Health Professions. 3rd ed 2006 Philadelphia Saunders Elsevier Cook CE George SZ Reiman MP Red flag screening for low back pain: nothing to see here, move along: a narrative review Br J Sports Med 2018 52 8 493 496 10.1136/bjsports-2017-098352 28923844 bjsports-2017-098352 Peabody JW Luck J Glassman P Dresselhaus TR Lee M Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality JAMA 2000 283 13 1715 1722 10.1001/jama.283.13.1715 10755498 joc91362 Peabody JW Luck J Glassman P Jain S Hansen J Spell M Lee M Measuring the quality of physician practice by using clinical vignettes: a prospective validation study Ann Intern Med 2004 141 10 771 780 10.7326/0003-4819-141-10-200411160-00008 Converse L Barrett K Rich E Reschovsky J Methods of observing variations in physicians' decisions: the opportunities of clinical vignettes J Gen Intern Med 2015 30 Suppl 3 S586 594 10.1007/s11606-015-3365-8 26105672 PMC4512963 Riddle DL Hillner BE Wells PS Johnson RE Hoffman HJ Zuelzer WA Diagnosis of lower-extremity deep vein thrombosis in outpatients with musculoskeletal disorders: a national survey study of physical therapists Phys Ther 2004 84 8 717 728 15283622 Jette DU Ardleigh K Chandler K McShea L Decision-making ability of physical therapists: physical therapy intervention or medical referral Phys Ther 2006 86 12 1619 1629 10.2522/ptj.20050393 17138843 86/12/1619 Cross PS Karges JR Salsbery MA Smith D Stanley EJ Management of acute sports injuries and medical conditions by physical therapists: assessment via case scenarios Int J Sports Phys Ther 2011 6 3 158 172 21904695 PMC3163996 Mount H Screening for Medical Referral: Determining Variables That Influence Accuracy 2012 Birmingham The University of Alabama Ladeira CE Physical therapy clinical specialization and management of red and yellow flags in patients with low back pain in the United States J Man Manip Ther 2018 26 2 66 77 10.1080/10669817.2017.1390652 29686480 yjmt-26-66 PMC5901428 Beyerlein C Direktzugang in der Physiotherapie - Wie entscheiden sich Physiotherapeuten im Management ihrer Patienten? Universität Ulm 2010 2022-12-09 https://oparu.uni-ulm.de/xmlui/handle/123456789/2143 Nast I Allet L Bürge E Scheermesser M Stegen C Schämann A Direktzugang zur physiotherapie: Wie entscheiden Schweizer physiotherapeuten beim Erstkontakt über das weitere Vorgehen? Physioscience 2013 9 04 153 160 10.1055/s-0033-1355985 Vaughn DW Shoemaker MJ DaPrato D Murray KS Van Huisen J The ability of final-year doctor of physical therapy students to make keep/refer decisions J Phys Ther Educ 2011 25 3 60 67 10.1097/00001416-201107000-00010 Lackenbauer W Janssen J Roddam H Selfe J Keep/refer decision making abilities of European final year undergraduate physiotherapy students: a cross-sectional survey using clinical vignettes Eur J Physiother 2017 20 3 128 134 10.1080/21679169.2017.1408682 Boissonnault WG Ross MD Physical therapists referring patients to physicians: a review of case reports and series J Orthop Sports Phys Ther 2012 42 5 446 454 10.2519/jospt.2012.3890 22282166 2700 Goodwin RW Hendrick PA Physiotherapy as a first point of contact in general practice: a solution to a growing problem? Prim Health Care Res Dev 2016 17 5 489 502 10.1017/S1463423616000189 27263326 S1463423616000189 Eysenbach G Improving the quality of web surveys: the checklist for reporting results of Internet e-surveys (CHERRIES) J Med Internet Res 2004 6 3 e34 10.2196/jmir.6.3.e34 15471760 v6e34 PMC1550605 Sample size calculator Surveyking 2022 2022-04-04 https://www.surveyking.com/help/sample-size-calculator Ritchie J Spencer L Bryman A A Burgess RG Qualitative data analysis for applied policy research Analyzing Qualitative Data 1994 London Routledge 173 194 Hendriks HJM Oostendorp RAB Bernards ATM Van Ravensberg CD Heerkens YF Nelson RM The diagnostic process and indication for physiotherapy: a prerequisite for treatment and outcome evaluation Phys Ther Rev 2013 5 1 29 47 10.1179/ptr.2000.5.1.29 Veloski J Tai S Evans AS Nash DB Clinical vignette-based surveys: a tool for assessing physician practice variation Am J Med Qual 2005 20 3 151 157 10.1177/1062860605274520 15951521 20/3/151 Mohan D Fischhoff B Farris C Switzer GE Rosengart MR Yealy DM Saul M Angus DC Barnato AE Validating a vignette-based instrument to study physician decision making in trauma triage Med Decis Making 2014 34 2 242 252 10.1177/0272989X13508007 24125789 0272989X13508007 PMC3948210 Brunner E Probst M Meichtry A Luomajoki H Dankaerts W Comparison of clinical vignettes and standardized patients as measures of physiotherapists' activity and work recommendations in patients with non-specific low back pain Clin Rehabil 2016 30 1 85 94 10.1177/0269215515570499 25652442 0269215515570499