Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 29.07.20 in Vol 9, No 7 (2020): July

Preprints (earlier versions) of this paper are available at, first published Jan 16, 2020.

This paper is in the following e-collection/theme issue:


    Development of a Short Instrument for Measuring Health-Related Quality of Life in Oncological Patients for Clinical Use: Protocol for an Observational Study

    1Department of Medical Psychology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany

    2Department of Otolaryngology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany

    3Medical Clinic and Polyclinic, University Medical Center Hamburg-Eppendorf, Hamburg, Germany

    4Department of Stem Cell Transplantation, University Medical Center Hamburg-Eppendorf, Hamburg, Germany

    5Department of Gynecology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany

    6Department of Radiotherapy and Radiation Oncology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany

    Corresponding Author:

    Theresa Schrage, MSc

    Department of Medical Psychology

    University Medical Center Hamburg-Eppendorf

    Martinistrasse 52



    Phone: 49 40741053807



    Background: Cancer patients often suffer from the physical and psychological burden of their disease and its treatment. This is frequently insufficiently identified and addressed in clinical practice. In the context of improving patient-centered care in oncological patients, patient-reported outcomes (PROs) represent an important addition to current routine care. So far, available PRO questionnaires for cancer patients are unsuitable for routine procedures due to their length and complexity.

    Objective: This study aimed to develop and psychometrically test a short questionnaire to measure health-related quality of life (HrQoL) in cancer patients for use in routine care.

    Methods: This observational study consists of two parts: (1) a qualitative study to develop a short questionnaire measuring HrQoL and (2) a quantitative study to psychometrically test this questionnaire in five oncological departments of a comprehensive cancer center. In part 1 of the study, semistructured interviews with 28 cancer patients, as well as five focus groups with 22 clinicians and nurses, were conducted to identify clinically relevant dimensions of HrQoL. The identified dimensions were complemented with related dimensions from empirical studies and reviewed via expert discussion. Based on this, a short instrument was developed. In part 2 of the study, the developed questionnaire was tested in cancer in- and outpatients at five participating oncological clinics using additional standardized questionnaires assessing HrQoL and other important PROs. The questionnaire was presented to more than 770 patients twice during treatment.

    Results: The project started in May 2017 with recruitment for study phase I beginning in December 2017. Recruitment for study phases I and II ended in April 2018 and February 2019, respectively. After study phase II and psychometrical analyses, the newly developed questionnaire measuring the HrQoL of all cancer entities in routine care was finalized.

    Conclusions: With five to six dimensions and one item per dimension, the developed questionnaire is short enough to not disrupt routine procedures during treatment and is profound enough to inform clinicians about the patient’s HrQoL impairments and status.

    Trial Registration: Open Science Framework Registries 10.17605/OSF.IO/Y7XCE;

    International Registered Report Identifier (IRRID): RR1-10.2196/17854

    JMIR Res Protoc 2020;9(7):e17854



    Crowdfunding campaign to support this specific research

    We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.

    keyboard with crowdfunding key instead of enter key

    Suggested contribution levels: $20/$50/$100


    In addition to morbidity rates, the impact of health-related quality of life (HrQoL) has grown in cancer treatment [1]. Medical research shows a continual improvement in early detection and treatment of cancer [1]. Subsequently, there are more long-term survivors, though patients often suffer from the consequences of cancer and its treatment [2]. Assuming that cancer has become a chronic disease for many patients, the HrQoL of cancer patients needs further attention in routine procedures [3].

    Cancer patients’ role (eg, in a family or group of friends), their relationship to their spouse, and their social life can be affected by psychological impairments [4,5]. Also, the perceived existential threat to the integrity of patients can have a psychological impact [4]. As a consequence, psychosocial distress, as well as psychological comorbidities (ie, anxiety and depressive disorders) can occur or be amplified during or after treatment [6].

    Symptoms of cancer are more or less distinct, depending on the cancer entity [7]. Prostate carcinoma, for example, depicts a symptom-free course for months or years in most cases [8]. On the other hand, pituitary tumors can affect the life of the person immensely [9]. Cancer patients often experience severe side effects due to their treatment such as pain, fatigue, weak immune system, indigestion, sexual dysfunction, nausea, or hair loss [10]. Correspondingly, the negative impact on the patient’s HrQoL can be significant [5], which emphasizes the importance of focusing on HrQoL in clinical practice and research.

    In the 1990s, HrQoL was established as an essential part of cancer treatment, and since then it has existed alongside disease-related outcomes [3]. Furthermore, HrQoL can be used to evaluate treatment in cancer patients [11]. At present, HrQoL is used as a parameter for benefit-cost analysis [12], assessing which limitations in quality of life can be endured in exchange for prolonged life. HrQoL proves to be an aspect of patient-reported outcomes (PROs) since information given by the patients themselves [12] is the best source from which state of health can be adequately assessed [11]. This highlights the importance of integrating PROs, and thus HrQoL, into patient-centered care since they have been proven to be more reliable than the clinician’s assessment; they can also aid with earlier symptom identification [13]. Therefore, PROs should be implemented into clinical practice to improve screening of distress, optimize treatment, and measure quality of care [14-20].

    The question that is raised is whether HrQoL impairment in a patient is taken into account in cancer treatment. Time is a scarce resource for medical staff and has to be spent carefully [21]. Although patient-centered care, including HrQoL, is eminent and part of the German National Cancer Plan [22], there is currently no sufficient resource-oriented procedure to measure, analyze, interpret, or act upon HrQoL data [23]. Even though there already exists questionnaires to measure HrQoL in oncological patients, the complexity and time-consuming nature of these assessments prevent use in clinical routine. An example of a PRO questionnaire is the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-C30 (EORTC QoL-C30) [24]. It is a highly recommended tool for the measurement of HrQoL in cancer patients [25]. Since it comprises eight scales, several additional single items, and disease-specific modules, it is not practical for use during routine procedures [26]. Oncological patients are generally older and should be questioned several times over the course of treatment; therefore, a long questionnaire like the EORTC QoL-C30 depletes more capacity than available for both patients and practitioners [27]. These difficulties also occur with other instruments (eg, Functional Assessment of Cancer Therapy [Fact-G] [28], World Health Organization Quality of Life [WHOQOL] [29]) and result in insufficient integration of PRO measurements in clinical routine procedures [27].

    This issue can be improved by implementing measurements that are shorter, more adaptive, and prompt action. For example, the Distress Thermometer (DT) is short, which makes it a more applicable instrument [30]. Developed by the National Comprehensive Cancer Network (NCCN), this screening tool determines the type and extent of psychosocial distress in oncological patients. Though it does not measure all aspects of HrQoL, it is often used in clinical practice to screen for need of support and shortages in a patient’s HrQoL. It consists of an 11-step analogue scale from 0 to 10 to measure distress, and a list of problems. However, the NCCN-DT is only used in screening procedures [30] and misses relevant dimensions of HrQoL such as physical complaints and autonomy [31]. Including its list of problems, the NCCN-DT amounts to 36 items, which is a problematic length for a questionnaire used in routine care [27]. Due to its high feasibility [30], however, the NCCN-DT is able to function as a first step in the development of a reliable and adequate instrument in assessing HrQoL in oncological patients.

    Hence, there are no suitable short instruments to measure HrQoL in oncological patients for use in clinical routine care. The present study is the first part of a larger project that ultimately targets the implementation of PROs in cancer care clinical practice at the University Medical Center Hamburg-Eppendorf. The aim of this study is to develop a psychometrically validated short instrument with six visual analogue scales with one item each, for repeated measurement of HrQoL of oncological in- and outpatients generalized for all cancer entities. Use of the new instrument in clinical practice is expected to improve patient-centered care, as well as data management for continuous health care research.



    In order to develop a validated and reliable instrument, an observational study with a mixed methods design was conducted (Figure 1). The study consists of two phases, making use of qualitative and quantitative data and analyses. Recruitment of study participants took place at the University Medical Center Hamburg-Eppendorf, where the developed instrument will also be implemented. The implementation process is outlined elsewhere [32]. Inclusion criteria for patients are a cancer diagnosis, sufficient language skills in German, and no cognitive or verbal impairments in providing information and giving informed consent.

    Figure 1. Study design.
    View this figure
    Study Phase I

    The aim of study phase I is to develop five to six relevant dimensions of HrQoL for cancer patients. For this purpose, interviews with oncological patients (n=28) were conducted. To facilitate further discussion and exchange, five focus groups with oncologists, oncological nurses, and psychologists on relevant dimensions of HrQoL were undertaken. Patients as well as clinicians were asked to evaluate the HrQoL dimensions in general and in regard to cancer treatment. Since senior clinicians could not be present at the focus groups, interviews (n=4) were conducted instead.

    The outcome of attained qualitative data was presented to a group of eight experts for discussion. Psychooncologists, oncologists, patient representatives (leaders of self-help groups), quality of life scientists, staff nurses, a quality management representative, and a health insurance representative were included. On the grounds of these outcomes and of the current state of research, the dimensions for the instrument were identified. Items were phrased and discussed among project group members. Wording, meaning, and overall feasibility of the items were verified by means of a survey of health care researchers (n=5). This phase began in December 2017 and ended in April 2018. For additional feasibility testing, a pilot study was carried out. Three patients were asked to evaluate the newly developed instrument by using the reading-out-loud technique. Since no requests for modification of the instrument were voiced, the instrument was readied for psychometrical testing.

    Study Phase II

    To psychometrically test the developed questionnaire, oncological in- and outpatients with different cancer diagnoses and stages of disease were asked to participate. The questionnaire was presented to the subjects in paper-pencil format. Furthermore, medical data were retrieved from the Soarian Clinicals patient documentation system of the University Medical Center Hamburg-Eppendorf. A pilot run was conducted in May 2018. Three patients were asked to provide their opinion using the reading-out-loud technique in order to assess the comprehensibility and feasibility of the questionnaire. The statistical survey started in June 2018 and ended in February 2019.

    Cooperation Partners

    Recruitment of patients in study phases I and II was carried out in cooperation with the Medical Clinic and Polyclinic, the Department of Stem Cell Transplantation, the Department of Gynecology, the Department of Radiotherapy and Radiation Oncology, and the Institute and Polyclinic for Medical Psychology.

    Recruitment and Procedures

    Study Phase I

    Potential patients to be questioned were pointed out by staff. The appointed patients were asked to participate and interviewed by research staff. We planned to conduct 28 interviews with oncological patients; four additional interviews with senior clinicians were conducted. Medical staff and external experts were approached and asked to participate. After written consent, they were invited to either an interview, a focus group, or a summarizing discussion. We planned to conduct five focus groups and one expert discussion.

    Study Phase II

    Potential inpatients to be questioned were pointed out by staff in the outpatient departments; oncological patients were addressed directly by research staff. Inpatients were questioned twice, once at the beginning of their treatment and then again 3-7 days later. The interval of time for questioning outpatients differed due to practice procedures. They were asked to participate once during their treatment and again 1 week later.

    Patient and Clinician Involvement

    Patients and clinicians were not involved in the study design. Patients first became involved during study phase I when they were interviewed regarding their HrQoL appraisal. Clinicians were involved in the recruitment process and execution of the study. In study phase I, chief physicians were asked to support recruitment of clinicians by asking their staff to participate. For study phases I and II, clinicians were asked to point out potential patients to be questioned. Patients were selected on the basis of assessments made by the clinicians. For example, severe pain or low responsiveness in some cases prevented patients from participating. In order to assess the comprehensibility and feasibility of the questionnaire, three patients were asked to give their opinion using the reading-out-loud technique (pilot study).

    Measurements and Outcomes

    Study Phase I

    A semistructured interview guide was developed based on Helfferich [33], asking one main question concerning relevant dimensions of HrQoL to be assessed in routine care. An example of such a question is “If you imagine that your current doctor asks you about your quality of life, physical and mental stress, what would be important for you? / What should not be forgotten?”. For focus groups, a focus group guide was developed based on Barbour [34], including the same main question used in the interview guide.

    Study Phase II

    To test the validity and reliability of the developed questionnaire, a series of established standardized measurements were included in the quantitative survey. In addition to the developed questionnaire, sociodemographic and standardized questionnaires assessing HrQoL (Fact-G [28]), Distress Thermometers [30], Short Form 8 Health Survey (SF-8) [35]), dignity (German version of the Patient Dignity Inventory [PDI-G] [36]), as well as depressive and anxiety symptoms (Patient Health Questionnaire-4 [PHQ-4] [37]), were included for psychometric purposes. These standardized questionnaires were included to validate the newly developed questionnaire. The priority objective of study phase II is a reduction to five to six HrQoL dimensions with one item each. The final result of this study phase is a psychometrically validated short instrument to assess HrQoL in cancer patients for use in routine clinical practice.

    Data Analysis

    Qualitative Analysis

    Interviews, focus groups, and expert discussion were carried out by scientists, recorded, and afterwards transcribed by study staff. The qualitative data was structured via the software program MAXQDA 10 and analyzed using qualitative content analysis based on Mayring [38]. Within the procedure of analyzing the data, deductive-inductive category application was used: deductive main categories (generated through literature research) and inductive subcategories (derived from the qualitative text analysis of the interviews and focus groups). Quality criteria to be examined for the qualitative content analysis are interrater reliability and communicative validation.

    Quantitative Analysis

    For study phase II data, an exploratory structural equation model (principal component analysis) was planned to be computed via SPSS (IBM). Reliability as well as validity (internal consistency, construct validity, content validity, criterion validity, correlations, and responsiveness) of the instrument were assessed through item and scale analysis. Missing data were compensated for by an expectation–maximization algorithm [28]; in cases of missing data of more than 30% per case, exclusion of data was carried out. Transformations of data were only applied if required by the data structure (ie, nonnormality of residuals). Exclusion of data due to systematic bias or false statement was not necessary. Further exploration of the data to look for unexpected differences or relationships were undertaken using subgroup analysis.

    Sample Size and Power

    Confirmative models allowed for the determination of an appropriate sample size; based on Monte Carlo study results, for a power of 80%, a sample size of at least 460 patients is needed [39]. Calculating a dropout rate of 40%, a minimum number of 770 addressed patients ensures enough data will be obtained.

    Ethics and Dissemination

    The intention of this project is to improve psychosocial care for cancer patients in routine clinical practice. Patients and health care professionals were asked to participate by joining focus groups and interviews and by completing questionnaires. The written survey methodology does not involve direct intervention in medical procedures. We expect no risks or disadvantages for patients, although one potential but unlikely stressor may arise as participants confront the shortcomings of their quality of life. This could have a negative influence on adjustment to and handling of the illness. However, the participating clinics of this project already offer psychooncological support, which is also available for the patients in this study. A written informed consent is mandatory for participation in the study. Patients interested in the study were informed about the voluntary nature of participation and the possibility to refuse or discontinue participation at any time without any negative consequences. Additionally, patients were informed about the study’s aims and personal risks. For further questions concerning the study, the contact details of study assistants were provided. The study received approval by the ethics committee of the Medical Association of Hamburg (reference number: PV5636).

    The project started in May 2017 and is planned for 36 months. In December 2017, the first interviews were carried out. Qualitative data of the first study phase were evaluated by April 2018. Quantitative data collection was conducted from June 2018 to February 2019 with subsequent analysis of the obtained data.

    Regarding the dissemination plan, two further publications regarding the development of the short instrument for cancer patients will be published (eg, one paper on study phase I and one paper on study phase II).


    This project is funded by Innovationsfond des Gemeinsamen Bundesausschusses (grant number: 01VSF16024). Recruitment was completed in February 2019.

    So far, 32 interviews, 5 focus groups, and 1 expert discussion have been conducted. On the grounds of the qualitative analyses of the obtained material, six dimensions with 10 items were identified. After study phase II (n=630) and psychometrical analyses, the newly developed questionnaire (HELP-5 [Hamburger Inventar zur Erfassung von Lebensqualität bei onkologischen Patienten]; English translation: Hamburg Inventory for Measuring Quality of Life in Oncological Patients), comprising five dimensions with one item each to measure HrQoL in all cancer patients in routine care, was finalized. The first results of both study phases are expected to be submitted for publication by the end of 2020.


    HrQoL is of vast importance for cancer patients. In the context of improving oncological patient-centered care, continuous PRO monitoring represents an important addition to current routine care to identify and address patients’ needs [40,41]. As patients are highly affected by their disease and its treatment, tools for measuring HrQoL need to be a permanent feature of routine care. At present, instruments measuring HrQoL do not match the requirements of routine care (ie, brevity, adaptiveness, simplicity). The questionnaire developed in this study should be able to meet the above-mentioned requirements. With five to six dimensions and one item per dimension, the developed questionnaire is short enough to not disrupt routine procedures during treatment but is profound enough to inform clinicians about the patient’s impairments and course concerning HrQoL.


    We thank all participating student assistants in this study for their support. This work is supported by Innovationsfonds des Gemeinsamen Bundesausschusses (grant number: 01VSF16024).

    Authors' Contributions

    HS, C Bokemeyer, NK, CP, C Bleich, and VM wrote the grant proposal and obtained funding. All authors were involved in the conception and design of this study. TS and MG developed the study materials and acquired the data. TS and MG analyzed and interpreted the data. TS wrote the draft of this manuscript; HS, MG, and C Bleich provided revisions. All authors gave final approval of the version to be published.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Funding report.

    PDF File (Adobe PDF File), 112 KB


    1. Rowland JH, Bellizzi KM. Cancer Survivorship Issues: Life After Treatment and Implications for an Aging Population. JCO 2014 Aug 20;32(24):2662-2668. [CrossRef]
    2. Mehnert A, Brähler E, Faller H, Härter M, Keller M, Schulz H, et al. Four-Week Prevalence of Mental Disorders in Patients With Cancer Across Major Tumor Entities. JCO 2014 Nov 01;32(31):3540-3546. [CrossRef]
    3. Bumeder I. Lebensqualität - Begriff und Operationalisierung. In: Dorfmüller M, Dietzfelbinger H, editors. Psychoonkologie - Diagnostik - Methoden - Therapieverfahren. München: Urban & Fischer Verlag; 2013:455-461.
    4. Bergelt C, Schölermann C, Koch U. Psychoonkologische Versorgung im Akutkrankenhaus. In: Weis J, Brähler E, editors. Psychoonkologie in Forschung und Praxis. Stuttgart: Schattauer Verlag; 2013:79-90.
    5. Kusch M, Labouvie H, Hein-Nau B. Klinische Psychoonkologie. Berlin Heidelberg: Springer-Verlag; 2013.
    6. Singer S, Das-Munshi J, Brähler E. Prevalence of mental health conditions in cancer patients in acute care--a meta-analysis. Ann Oncol 2010 May;21(5):925-930 [FREE Full text] [CrossRef] [Medline]
    7. Dietzfelbinger H, Heußner P. Kriterien der Lebensqualität. In: Dorfmüller M, Dietzfelbinger H, editors. Psychoonkologie - Diagnostik - Methoden - Therapieverfahren. München: Urban & Fischer Verlag; 2013:E-70.
    8. Graefen M. Prostatakarzinom. In: Hautmann R, Gschwend J, editors. Urologie. Berlin Heidelberg: Springer-Verlag; 2014:217-229.
    9. Saeger W. Hypophyse. In: Klöppel G, Kreipe HH, Remmele W, editors. Pathologie. Urogenitale und Edokrine Organe, Gelenke und Skelett. Berlin Heidelberg: Springer-Verlag; 2016:587-629.
    10. Aigner K, Stephens F, Allen-Mersh T, Hortobagyi G, Khayat D, Picksley S. Krebstherapie. In: Aigner KR, Stephens FO, editors. Onkologie Basiswissen. Berlin Heidelberg: Springer-Verlag; 2016:77-105.
    11. Bullinger M, Blome C, Sommer R, Lohrberg D, Augustin M. [Health-related quality of life: a pivotal endpoint in benefit assessment of medical procedures]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2015 Mar 15;58(3):283-290. [CrossRef] [Medline]
    12. Berhnhard J, Ribi K. Lebensqualität in der Onkologie - Klinik und Forschung. In: Weis J, Brähler E, editors. Psychoonkologie in Forschung und Praxis. Stuttgart: Schattauer Verlag; 2013:3-15.
    13. Basch E. The Missing Voice of Patients in Drug-Safety Reporting. N Engl J Med 2010 Mar 11;362(10):865-869. [CrossRef]
    14. Darzi L. High Quality Care For All: NHS Next Stage Review Final Report. London: Department of Health UK; 2008.
    15. Devlin N, Appleby J. Getting the most out of PROMs: Putting health outcomes at the heart of NHS decision making. London: The King's Fund; 2010.
    16. Fashoyin-Aje LA, Martinez KA, Dy SM. New patient-centered care standards from the commission on cancer: opportunities and challenges. J Support Oncol 2012 May;10(3):107-111. [CrossRef] [Medline]
    17. McGrail K, Bryan S, Davis J. Let's all go to the PROM: the case for routine patient-reported outcome measurement in Canadian healthcare. Healthc Pap 2011 Jan 2;11(4):8-18; discussion 55. [CrossRef] [Medline]
    18. Mitchell AJ. Pooled Results From 38 Analyses of the Accuracy of Distress Thermometer and Other Ultra-Short Methods of Detecting Cancer-Related Mood Disorders. JCO 2007 Oct 10;25(29):4670-4681. [CrossRef]
    19. Health Outcomes of Care: An idea whose time has come. Ottawa: Canadian Instiute for Health Information; 2012.
    20. Snyder CF, Aaronson NK. Use of patient-reported outcomes in clinical practice. The Lancet 2009 Aug;374(9687):369-370. [CrossRef]
    21. Schlag PM. Anforderungen und Erwartungen an die Psychoonkologie aus Sicht des chirurgischen Onkologen. In: Weis J, Brähler E, editors. Psychoonkologie in Forschung und Praxis. Stuttgart: Schattauer Verlag; 2013:139-144.
    22. Nationaler Krebsplan: Handlungsfelder, Ziele und Umsetzungsempfehlungen. Bonn: Bundesministerium für Gesundheits; 2017 Dec.   URL: https:/​/www.​​fileadmin/​Dateien/​5_Publikationen/​Praevention/​Broschueren/​Broschuere_Nationaler_Krebsplan.​pdf [accessed 2020-05-16]
    23. Schmidt H, Merkel D, Koehler M, Flechtner H, Sigle J, Klinge B, et al. PRO-ONKO-selection of patient-reported outcome assessments for the clinical use in cancer patients-a mixed-method multicenter cross-sectional exploratory study. Support Care Cancer 2016 Jun 16;24(6):2503-2512. [CrossRef] [Medline]
    24. Aaronson N, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez N. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. Journal of the National Cancer Institute 1993;85(5):365-376. [CrossRef]
    25. Fayers P, Bottomley A. Quality of life research within the EORTC—the EORTC QLQ-C30. European Journal of Cancer 2002 Mar;38(4):125-133. [CrossRef]
    26. Bascioni R, Giorgi F, Esperide B, Iacopini D, Brugni M, Giustini L, et al. Quality of life (QOL) assessment with EORTC QLQ-C30 in daily clinical practice. JCO 2005 Jun;23(16):8205-8205. [CrossRef]
    27. Boyce MB, Browne JP, Greenhalgh J. The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research. BMJ Qual Saf 2014 Feb 06;23(6):508-518. [CrossRef]
    28. Bonomi AE, Cella DF, Hahn EA, Bjordal K, Sperner-Unterweger B, Gangeri L, et al. Multilingual translation of the Functional Assessment of Cancer Therapy (FACT) quality of life measurement system. Qual Life Res 1996 Jun;5(3):309-320. [CrossRef]
    29. Angermeyer M, Kilian R, Matschinger H. WHOQOL-100 und WHOQOL-BREF. Göttingen: Hogrefe; 2000.
    30. Mehnert A, Müller D, Lehmann C, Koch U. Die deutsche Version des NCCN Distress-Thermometers. Zeitschrift für Psychiatrie, Psychologie und Psychotherapie 2006 Jan;54(3):213-223. [CrossRef]
    31. Robbeson C, Hugenholtz-Wamsteker W, Meeus M, Devoogdt N, Nijs J, De Groef A. Screening of physical distress in breast cancer survivors: Concurrent validity of the Distress Thermometer and Problem List. Eur J Cancer Care 2018 Jul 24;28(1):e12880. [CrossRef]
    32. Görlach MG, Schrage T, Bokemeyer C, Kröger N, Müller V, Petersen C, et al. Implementation analysis of patient reported outcomes (PROs) in oncological routine care: an observational study protocol. Health Qual Life Outcomes 2020 Jan 2;18(1). [CrossRef]
    33. Helfferich C. Die Qualität qualitativer Daten. Wiesbaden: VS Verlag für Sozialwissenschaften; 2009.
    34. Barbour R. Doing Focus Groups. London: Sage Publications Ltd; 2007.
    35. Beierlein V, Morfeld M, Bergelt C, Bullinger M, Brähler E. Messung der gesundheitsbezogenen Lebensqualität mit dem SF-8. Diagnostica 2012 Jul;58(3):145-153. [CrossRef]
    36. Sautier LP, Vehling S, Mehnert A. Assessment of patients' dignity in cancer care: preliminary psychometrics of the German version of the Patient Dignity Inventory (PDI-G). J Pain Symptom Manage 2014 Jan;47(1):181-188 [FREE Full text] [CrossRef] [Medline]
    37. Löwe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. J Affect Disord 2010 Apr;122(1-2):86-95. [CrossRef] [Medline]
    38. Mayring P. Qualitative Inhaltsanalyse: Grundlagen und Techniken. Weinheim: Beltz; 2008.
    39. Wolf EJ, Harrington KM, Clark SL, Miller MW. Sample Size Requirements for Structural Equation Models: An Evaluation of Power, Bias, and Solution Propriety. Educ Psychol Meas 2013 Dec 09;76(6):913-934 [FREE Full text] [CrossRef] [Medline]
    40. Snyder CF, Aaronson NK, Choucair AK, Elliott TE, Greenhalgh J, Halyard MY, et al. Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations. Qual Life Res 2012 Oct;21(8):1305-1314. [CrossRef]
    41. Basch E, Deal AM, Kris MG, Scher HI, Hudis CA, Sabbatini P, et al. Symptom Monitoring With Patient-Reported Outcomes During Routine Cancer Treatment: A Randomized Controlled Trial. JCO 2016 Feb 20;34(6):557-565. [CrossRef]


    DT: Distress Thermometer
    EORTC QoL-C30: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-C30
    Fact-G: Functional Assessment of Cancer Therapy
    HELP-5: Hamburger Inventar zur Erfassung von Lebensqualität bei onkologischen Patienten (Hamburg Inventory for Measuring Quality of Life in Oncological Patients)
    HrQoL: health-related quality of life
    NCCN: National Comprehensive Cancer Network
    PDI-G: Patient Dignity Inventory—German version
    PHQ-4: Patient Health Questionnaire-4
    PRO: patient reported outcome
    SF-8: Short Form 8 Health Survey
    WHOQOL: World Health Organization Quality of Life

    Edited by C Hoving; submitted 16.01.20; peer-reviewed by N Schaeffeler, T Muto, J Mihanovic; comments to author 17.02.20; revised version received 19.03.20; accepted 20.03.20; published 29.07.20

    ©Theresa Schrage, Mirja Görlach, Christian Stephan Betz, Carsten Bokemeyer, Nicolaus Kröger, Volkmar Mueller, Cordula Petersen, Andreas Krüll, Holger Schulz, Christiane Bleich. Originally published in JMIR Research Protocols (, 29.07.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.