Background: Dissemination of genetic testing for disease susceptibility, one application of “personalized medicine”, holds the potential to empower patients and providers through informed risk reduction and prevention recommendations. Genetic testing has become a standard practice in cancer prevention for high-risk populations. Heightened consumer awareness of “cancer genes” and genes for other diseases (eg, cardiovascular and Alzheimer’s disease), as well as the burgeoning availability of increasingly complex genomic tests (ie, multi-gene, whole-exome and -genome sequencing), has escalated interest in and demand for genetic risk assessment and the specialists who provide it. Increasing demand is expected to surpass access to genetic specialists. Thus, there is urgent need to develop effective and efficient models of delivery of genetic information that comparably balance the risks and benefits to the current standard of in-person communication.
Objective: The aim of this pilot study was to develop and evaluate a theoretically grounded and rigorously developed protocol for telephone communication of BRCA1/2 (breast cancer) test results that might be generalizable to genetic testing for other hereditary cancer and noncancer syndromes.
Methods: Stakeholder data, health communication literature, and our theoretical model grounded in Self-Regulation Theory of Health Behavior were used to develop a telephone communication protocol for the communication of BRCA1/2 genetic test results. Framework analysis of selected audiotapes of disclosure sessions and stakeholders’ feedback were utilized to evaluate the efficacy and inform refinements to this protocol.
Results: Stakeholder feedback (n=86) and audiotapes (38%, 33/86) of telephone disclosures revealed perceived disadvantages and challenges including environmental factors (eg, non-private environment), patient-related factors (eg, low health literacy), testing-related factors (eg, additional testing needed), and communication factors (eg, no visual cues). Resulting modifications to the communication protocol for BRCA1/2 test results included clarified patient instructions, scheduled appointments, refined visual aids, expanded disclosure checklist items, and enhanced provider training.
Conclusions: Analyses of stakeholders’ experiences and audiotapes of telephone disclosure of BRCA1/2 test results informed revisions to communication strategies and a protocol to enhance patient outcomes when utilizing telephone to disclose genetic test results.
Dissemination of genetic testing for disease susceptibility, one application of “personalized medicine”, holds the potential to empower patients and providers with informed risk reduction and prevention recommendations [, ]. Genetic testing has become a standard practice in cancer prevention, where genetic testing for cancer susceptibility has become routine for high-risk populations, particularly for breast, ovarian, and colon cancer [ - ]. Heightened consumer awareness of “cancer genes” and other disease susceptibility genomic testing (eg, cardiovascular genetics [ ], genetic testing for Alzheimer’s disease [ ], and multi-gene genetic testing for cancer and common diseases [ - ]) has escalated interest in and demand for genetic risk assessment. Increasing demand for predictive genetic testing to inform prevention and medical management of cancer and other diseases is expected to surpass accessibility to genetic specialists [ - ].Thus, the promise of personalized medicine will require innovative delivery models for effective, efficient predictive genetic testing and risk communication.
Given the complexity and limitations of genetic testing for disease susceptibility, pre- and post-test counseling are recommended across a variety of fields (eg, cancer, cardiology, and neurology) to optimize patients’ informed consent, understanding of, and adaptive behavioral and psychosocial responses to genetic test results [, , , , , ]. Given the complexity of genetic information, the potential for false reassurance, and the potential for psychological distress (eg, persistent anxiety and guilt about the development of cancer in themselves or offspring), communication of genetic test results for cancer susceptibility has traditionally been conducted in-person by health professionals with genetics training [ , - ]. With increasing demand for genetic testing and time constraints regarding cancer treatment decisions dependent on test results, some genetic counselors are beginning to incorporate telephone disclosure of genetic test results for select patients [ - ]. Some direct-to-consumer companies have incorporated “streamlining” of pre- and post-test counseling protocols [ ], offering BRCA1/2 testing, including pre- and post-test counseling entirely by telephone and the Internet. These services are currently commercially available (eg, InformedDNA, Genetic Counseling Services), and some health insurers (eg, Aetna) have partnered with them in the delivery of these services [ - ]. Thus, modifications to traditional genetic service delivery have begun, in the presence of limited data regarding the impact of these changes on patients, providers, and health care systems [ , ]. These changes represent a critical knowledge gap in the translation, implementation, and dissemination of genetic knowledge into effective clinical practice. Concurrently, there is also increasing use of more complex testing, including multi-gene panels evaluating a number of cancer susceptibility loci of varied penetrance, cancer spectrum, and clinical utility [ ]. Whole-exome and -genome sequencing add additional complexity with the potential to unveil disease susceptibility beyond the condition of interest [ ]. These advances hold great promise to expand the benefits of testing, but in many cases are also associated with greater uncertainty and complexity, presenting additional challenges for providers delivering pre- and post-test counseling [ ]. The capacity for traditional counseling models to accommodate these changes is limited. Thus, there is urgent need for theoretically driven studies that evaluate innovations in communication and delivery of cancer genomic advances in real-world clinical settings, which balance the risks and benefits associated with alternatives to in-person communication, in the context of emerging and increasingly complex genomic testing that will address the potential limitations of and inform the adaptive responses to alternative communicative strategies [ , - ].
We utilized our preliminary data from patients and providers , our team’s multidisciplinary expertise, and existing literature of genetic counseling, telephone communication in medical consultations, health communication, and health behavior to develop a communication protocol for telephone disclosure of genetic test results [ , , - ]. The goal of this pilot study was to develop and evaluate a protocol for telephone communication of clinical BRCA1/2 (breast cancer) genetic test results that might be broadly generalizable. We utilized our theoretical model to inform short-term cognitive (knowledge) and psychological (state anxiety, general anxiety, and depression) outcomes and to identify audiotaped communication sessions for review. Audiotape reviews and direct stakeholder (patient and provider) feedback were utilized to evaluate and inform refinements to our initial telephone communication protocol [ ].
This study and related work [, , , ] is informed by our theoretical model to optimize and evaluate the outcomes of innovation to delivery of genetic services ( ). The health benefits of genetic testing for disease susceptibility are expected to be greatest when there are successful interventions to modify disease susceptibility and thus, to improve patient outcomes [ , , ]. As improved patient outcomes are contingent upon high-risk individuals adopting preventive or promotive health behaviors, the effectiveness of genetic testing for disease susceptibility is contingent upon successful behavior modification. Our model is grounded in the Self-Regulation Theory of Health Behavior (SRTHB), which has been utilized in descriptive and intervention-based research involving the study of health threats and health behavior [ , - ]. Simplistically, this theory proposes that the performance of a health behavior is the product of an individual’s knowledge and perceptions of the disease threat (eg, genetic risk of disease) and the health behavior (eg, risk reduction behaviors) and the biopsychosocial impact of the health behavior [ , , , - ]. Importantly, the SRTHB emphasizes common-sense representations rather than medical or scientific definitions, and incorporates individual biological, cognitive, emotional, familial, and cultural experiences that might contribute to individual variability in knowledge and perceptions of genetic information, disease etiology, and controllability, and the impact of knowledge and perceptions on risk modification for individuals and their families. It has been proposed that the SRTHB is an ideal framework for considering the psychosocial and behavioral outcomes and thus, the effectiveness of genetic screening for disease susceptibility in the era of personalized medicine [ , , ]. The SRTHB and associated literature suggests that the performance of risk reduction behaviors and psychosocial adjustment to communication of genetic test results is an iterative process, in which proximal perceptions of and responses to risk information shape more distal behavioral and psychosocial outcomes [ , , , , ]. Thus, the SRTHB suggests an innovative model for the evaluation of both the short-term and long-term responses to novel delivery methods of genetic services, communication of genetic test results, and the impact of that communication on health behaviors ( ).
The literature and our preliminary data support the hypothesis that both short-term cognitive (knowledge and perception) and psychological (state anxiety, general anxiety, and depression) outcomes and longitudinal adjustment and performance of surveillance behaviors, in response to receipt of genetic test results, will be moderated by biological (test result [, - ], cancer history [ , - ]), sociodemographic (eg, race/ethnicity [ , - ], access burden [ , ]), cognitive, and emotional [ , , ] factors. Thus, while innovations to delivery of genetic test results might provide equal outcomes in a broad population, there might be subgroups (ie, moderators) for whom this innovation to communication of genetic information is particularly harmful or particularly useful. If the promise of genomics to improve population health is to be realized broadly, it will be critical to understand those factors that have the potential to moderate that outcome for some, and to incorporate that knowledge into the design of future interventions for delivery of genomic information.
Institutional Review Board approval was obtained before initiating this study. Participants were recruited through the Fox Chase Cancer Center Risk Assessment Program between September 2009 and July 2010. Eligible patients were over 18 years old, could communicate in English, completed pre-test counseling with a genetic counselor, and elected to proceed with BRCA1/2 testing. Consistent with professional guidelines from the National Society of Genetic Counselors and clinical services at Fox Chase Cancer Center, key components of in-person pre-test counseling included ascertainment of targeted medical and family history, assessment of cancer risk, education on cancer genetics, discussion of appropriate genetic testing options, and informed consent for genetic testing [, ]. Eligible patients were approached by research staff at completion of pre-test counseling offering the opportunity to participate in a study receiving their BRCA1/2 test results by telephone and returning for in-person medical management recommendations. Written informed consent from patients was obtained prior to conducting audiotaped telephone disclosure sessions. Providers also signed informed consent and completed brief surveys assessing their perception of how participants perceived their disclosure sessions.
Telephone Disclosure Communication Protocol
We utilized our preliminary data from patients and providers , our team’s multidisciplinary expertise, existing literature of genetic counseling, health communication, telephone communication in medical consultation, and our theoretical model grounded in SRTHB to develop a protocol for telephone disclosure of genetic test results [ , , , - , , ]. The key components, although tailored for this study to the disclosure of BRCA1/2 testing results by telephone, were designed to be broadly adaptable to communication of genetic/genomic test results, hereditary risk, and risk reduction strategies for other heritable diseases. Key components include ( ): “Visual Aids”, “Standardized Communication Topics”, and “Provider Probes”; “standard probes” are used intermittently throughout the session to assess patient understanding (eg, “What questions do you have for me before we go on?”) and affect (eg, “How are you feeling now that you know…?”). At the conclusion of the session, a “Teach Back” probe (eg, “Please tell me in your own words your understanding of your genetic test results and what those results mean for you”) is used to assess comprehension [ ]; “situational probes” are used as needed (eg, “It sounds like this might not be the best time for us to talk. Is there another time that would work better for you?”) in contexts where the situation might present challenges to optimal outcomes. Other key components include “Provider Training”: in-person training was provided to genetic counselor (GC) providers to optimize the translation and implementation from in-person to telephone disclosure; and “Quality Assurance and Protocol” evaluation where all telephone disclosure sessions were audiotaped. Sessions’ meeting criteria (see Statistical Analyses) were reviewed by research staff in tandem with disclosure checklists completed by the genetic counselors to (1) ensure inclusion of 12 key components of disclosure [ ], and (2) inform potential refinements to the communication protocol. Additionally, all participants who completed telephone disclosure were asked to return for an in-person follow-up appointment with a physician to address any remaining questions and to discuss and implement medical recommendations for cancer screening and/or risk reduction strategies (ie, prophylactic surgery and/or chemoprevention) [ ].
|Associated cancer risks|
|Sample genetic test results|
|Risk reduction options|
|Standardized Communication Topics|
|Confirm patient’s identity|
|Introduce all participants|
|Assess adequacy of hearing and access to Visual Aids|
|Affirm session purpose and patient’s desire for results|
|Provide test results, interpretation, and implications|
|Standard - Evaluate patient:|
|Situational - Address:|
|Others present in session reactions/needs|
|Evaluate patient understanding at conclusion|
|Challenges to telephone communication|
|Mock telephone disclosure w/Individualized feedback|
|Innovations in delivery of genetic/genomic information|
|Inclusion of key components|
|Appointment with physician|
|Address remaining questions|
|Discuss and implement medical management recommendations|
Patients completed quantitative assessments of knowledge [- ], psychological distress (state anxiety) [ ], psychological adjustment (general anxiety and depression) [ ], and satisfaction with genetic services [ - ] previously reported [ ] within 3-5 days after their pre-test counseling session (baseline) and telephone disclosure. Participants completed 7 selected items consistent with the National Institute of Health National Center for Human Genome Research Cancer Genetics Consortium Knowledge scale and utilized in prior research [ ], including items evaluating mechanism of cancer inheritance (1 item), and the meaning of positive (3 items) and negative (3 items) results. Internal consistency in this study was good (mean alpha=.72).
State anxiety was measured with the 20-item State Inventory of the State-Trait Anxiety Inventory (STAI), which is a sensitive indicator of transient or situational changes in anxiety (test-retest reliability: r=16 - .62) experienced by patients in response to stressful procedures or life events  and is frequently used to assess the short-term response to the receipt of a genetic test result [ , ]. Internal consistency in this study was high (mean alpha=.95). General anxiety and depression were assessed with the 7-item Hospital Anxiety and Depression Scale (HADS) anxiety and depression subscales, which have been utilized in the general population and a wide range of medical patients, including those with cancer [ , ]. Internal consistency in this study was good for both the anxiety and depression subscales (mean alpha=.88, .78, respectively) [ ].
Satisfaction With Genetic Services
Satisfaction with health communication was measured with a 9-item scale, reflective of constructs identified in prior qualitative, quantitative, and comparative research evaluating participants’ perceptions of their genetic counseling and testing experience, including cognitive, affective, and time/attention items [- ]. Internal consistency in this study was good (mean alpha=.73) [ ].
Opinions and Experiences Regarding Telephone Disclosure Post-Disclosure Only
Patients and providers also completed parallel open-ended questions after telephone disclosure to elicit patient experiences (3 items), GC experiences (3 items), and GC perceptions of patient experiences (3 items) with, and suggestions for improving their telephone disclosure session .
Changes in pre-test and 3-5 days post telephone disclosure scores were calculated for each participant and each construct, which are reported separately . Pre-defined criteria were developed to select telephone disclosure sessions for review to inform modifications to the communication protocol [ ]. These included (1) all positive results (n=9), (2) discordance between patient reported satisfaction, perceived understanding/ emotional response, and provider perceptions of patient satisfaction/ understanding/ emotional responses; discordance was defined as a difference of >2 points between patient and provider for any individual item (n=12), (3) provider request (n=1), (4) decline in knowledge in the lowest 10 percentile; these included a decline in knowledge of >3.3 points (n=8), and (5) increase in state anxiety, general anxiety, or depression in highest 10 percentile (n=21). These included increases in state anxiety scores >11.3 points, HADS-anxiety, or HADS-depression subscale scores >3 points. These selection criteria resulted in review of 38% (33/86) of recorded telephone disclosures. Participants selected for review did not differ statistically from those not selected for review on race, age, education, test result, cancer history, treatment decision, and known familial mutation.
Framework analysis was utilized to analyze open-ended responses regarding patient and GC reported advantages, disadvantages, and recommended modifications (eg, “What did you/your patient like/dislike about receiving genetic test results by telephone? What changes would you recommend?”) [, , - ]. The intent of this analysis was to identify themes that might not have been represented in quantitative surveys, informing modifications to the intervention from both patient and provider perspectives. Two investigators, a clinical health psychologist trained in health outcomes research, and a medical oncologist, each with extensive clinical experience in the delivery of hereditary cancer risk information, independently reviewed responses utilizing thematic analysis to record primary and secondary themes for each open-ended item.
A total of 167 eligible subjects were approached for participation. Of the 167 eligible subjects, 100 (59.9%) agreed to participate, provided informed consent, and completed the baseline assessment, and 95 proceeded with BRCA1/2 testing . A total of 86 participants completed both baseline and post-telephone disclosure surveys, and participant characteristics are described in .
All participants were women, 10% (9/86) were non-white, 59% (51/86) had a personal history of cancer, and 50% (43/86) had a college degree or graduate education. The majority of participants (83%, 71/86) received an uninformative negative result (ie, negative BRCA1/2 result with no known clinically significant mutation in the family). Nine women received a positive result (ie, clinically significant BRCA1/2 mutation), 4 received a true negative result (ie, negative for a known clinically significant mutation in the family), and 2 received a variant of uncertain significance. Provider checklists revealed high fidelity to communication topics .
|Age, median (range)||49 (24-73)|
|Black / African American||6 (7)|
|High school only||13 (15)|
|Some college / vocational||30 (35)|
|College degree||21 (24)|
|Graduate degree||22 (26)|
|Marital status: married/domestic partnership||54 (62)|
|History of cancer||51 (59)|
|Treatment decisiona||19 (22)|
|Known mutation in family||6 (7)|
|Genetic test (BRCA 1/2) result|
|Indeterminate (uninformative negative)||71 (83)|
|True negative||4 (5)|
|Variant of unknown significance||2 (2)|
aDefined as individuals who had not received definitive surgical treatment for their breast cancer at the time of initial counseling.
Patient and Provider Open-Ended Responses
Patients and providers identified several advantages for patients to telephone disclosure of genetic test results, including patient conveniences, setting, and timing. Patient and provider reported advantages for patients did not differ. Providers also identified advantages of telephone disclosure for genetic counselors, including setting, scheduling, and efficiency (). Most patients and genetic counselors reported no disadvantages to telephone receipt of test results for patients. Primary themes reported by patients and genetic counselors were communication, delivery, and patient specific challenges ( ). Providers reported similar disadvantages for genetic counselors, which also focused on communication and delivery challenges, as well as patient specific factors, such as providing a positive or variant of uncertain significance (VUS) result.
|Advantages / disadvantages|
|Patient advantages reported by patients and genetic counselors/providers|
|Patient conveniences, eg, less travel, lost work time, need for dependent care|
|Setting, eg, being in a comfortable environment, having a support person available|
|Timing, eg, receiving results prior to MD appointment|
|Provider advantages reported by genetic counselors/providers|
|Scheduling, eg, greater availability and flexibility for scheduling patient appointments|
|Setting, eg, having access to resources in provider’s office during appointment|
|Efficiency, eg, no travel to and wait in clinic|
|Patient disadvantages reported by patients and genetic counselors/providers|
|Communication, eg, not being able to see the genetic counselor for nonverbal communication|
|Delivery, eg, interruptions (workplace, children in the home)|
|Patient-specific factors, eg, receiving positive or uncertain results|
|Provider disadvantages reported by genetic counselors/providers|
|Communication, eg, not being able to see the patient for nonverbal communication|
|Delivery, eg, interruptions (workplace, children in the home)|
|Patient-specific factors, eg, delivering positive or uncertain results|
aFrom 86 encounters (n=86 patients, n=4 providers).
Modifications to the Communication Protocol
Modifications to the original communication protocol were informed by the audiotape review (33/86, 38%) as described above, open-ended survey responses from patients (n=86) and providers (n=4) on 86 disclosure sessions, our theoretical model, and the literature, and developed by a clinical health psychologist. Primary modifications are summarized inand included GC clarification of patient instructions for telephone disclosure during pre-test counseling (eg, reviewing visual aids), and appointments for telephone disclosure scheduled to allow patients to plan to be in a private, comfortable place where they would be free of interruptions. Scheduling the disclosure session also allowed patients to include significant others in the session. Additionally, it had the potential to reduce anticipatory anxiety and eliminate the frustration of “playing phone tag”. Other modifications included refinement of visual aids, including more clearly labeling mock test report forms to avoid patient confusion, and more detailed telephone disclosure checklists were created for GCs to ensure the communication protocol’s coverage of all critical elements of disclosure (eg, Genetic Information Nondiscrimination Act, or GINA), to enhance fidelity to the protocol (eg, reminder that session will be audiotaped), and to facilitate use of verbal knowledge and affective probes, critical to the assessment of understanding and emotional response in the context of telephone communication where nonverbal cues are not available for this purpose. Another modification included GC training to facilitate identification and management of situations that might present unique challenges in the context of telephone communication. Situations addressed included identifying (1) patients’ biopsychosocial risk factors prior to disclosure session (eg, personal/familial cancer history; baseline high anxiety or low health literacy; uninformative test results, or need for additional testing), (2) signs of potentially poorer affective and cognitive responses during result disclosure (eg, silence, pressured speech, incongruous affect), and (3) need for session management (eg, interruptions), in the absence of the visual information providers are accustomed to incorporating into their assessments of patients in the conduct of in-person sessions. Training included, in addition to regular utilization of affective and knowledge probes and the “teach-back”, increased attention and response to auditory cues in patients’ speech, eg, rate, pitch, volume, amount, type and congruity; and utilization of situational probes, eg, “Did I catch you at an inconvenient time…”, “Would it be ok to check in now with your (spouse, mother, sister, etc?)”, “Is this the information you were expecting, or how can I better help you meet your needs?”
|Modifications to the communication protocol||Reason for tape review||Reviewer observations||Patient comments||GCbcomments|
|1. Clarified telephone disclosure (TD) instructions in pre-test counseling||-Visual aid: read in advance and have for session||-Visual aid: read in advance and have for session|
|-Schedule sufficient time for session and processing||-Schedule sufficient time for session and processing|
|-Have support person||-Have support person|
|2. Scheduled TD appointments||-Increase in anxiety or depression or decline in knowledge||Session occurred in non-private environment without visual aids||-Session was disrupted (eg, workplace, childcare)||-Session was disrupted (eg, workplace, childcare)|
|-Session disrupted other activities||-Difficult to reach patient (“phone tag”)|
|3. Refined visual aids||Visual aids confusing||Visual aids confusing|
|4. Improved disclosure checklist:||-Increase in anxiety||-Some elements of disclosure checklist omitted||Who else is on call/present?|
|-Included information on GINAc||-Patient concerned about genetic discrimination|
|5a. GC training:||-Increase in anxiety or depression||-High baseline anxiety||-Communication challenging without visual cues||Interpreting patient affective response and providing emotional support challenging without visual cues|
|-Recognizing signs of negative affect in the absence of visual cues||-Patient/GC discordance||-Inaccurate expectations|
|-Effective use of affective and situational probes|
|-Need to pace session to meet patient needs|
|-Identifying risk factors for negative affective response||-Positive test result||-Personal history of cancer||-Need to be prepared for all results|
|-Treatment decision pending|
|-Family history (uninformative or extensive cancer)|
|-Need for additional tests (self or family members)|
|5b. GC training:||-Decline in knowledge||Low health literacy||Interpreting patient cognitive response and providing remediation challenging without visual cues|
|-Identifying risk factors for confusion|
|-Recognizing signs of confusion|
|-Techniques to improve patient comprehension||-VUSdtest result|
|-Effective use of knowledge and situational probes and “teach back” to assess understanding|
|5c. GC training:||-Decline in knowledge||-Responding to challenging patients/situations|
|-Effective use of situational probes to control situation||-Controlling the session|
|6. Conduct larger trial to evaluate outcomes for potentially vulnerable subgroups||-Positive test result||-Need for additional testing (self or family members)||TD might be more challenging in some situations (eg, Positive test result, need for additional testing, poor understanding after pre-test counseling, psychological factors)||TD might be more challenging in some situations (eg, Psychosocial comorbidities, English as a second language, pending treatment decisions, personal cancer history)|
|-VUS test result||-Personal history of cancer|
|-Family history of cancer|
|-Increase in anxiety or depression||-Uninformative negative result|
aBased on a priori review criteria
bGC: genetic counselor
cGINA: Genetic Information Nondiscrimination Act
dVUS: variant of uncertain significance
The goal of this pilot study was to evaluate stakeholder (patient and provider) experiences with our telephone disclosure protocol, grounded in our theoretical model, to inform refinements to our initial protocol for the delivery of genetic test results and to obtain preliminary outcome data for future research. To our knowledge, this is the first study to describe the development and refinement of a telephone communication protocol for the disclosure of genetic test results informed by provider and patient feedback, as well as systematic review of communication sessions grounded in a theoretical model of health behavior [, ]. This study provides a standardized model for optimizing telephone communication that will allow future studies to implement and evaluate the efficacy, risks, and benefits of telephone disclosure of genetic test results. This protocol includes a number of innovations made in response to our findings, supported by our theoretical model and the literature regarding inclusion of telephone communication into primary care. These include the need for specific training for providers to learn compensatory techniques for telephone communication [ , ] (eg, the need to implement more verbal probes in the absence of nonverbal cues) [ , , , , , ], and have suggested that telephone disclosure might provide equal or improved outcomes when compared to in-person disclosure [ , , , ]. This is consistent with our data [ , ] and primary care literature suggesting that telephone might be better suited to encounters following an initial in-person consultation [ ]. Given an increased demand for genetic counseling services and the increasing availability of many new modes of genetic and genomic testing (eg, multi-gene, germline, tumor, and pharmacogenomic testing), our study has focused on reconciling provider and patient perspectives on telephone communication to formulate an effective and efficient telephone communication protocol delivery of genetic test results.
The results of our study indicate that patients and providers identify both advantages and disadvantages of telephone disclosure of genetic test results (). Advantages, highlighted by both patients and providers, included the convenience, scheduling, setting, timing, and efficiency of telephone disclosure. Perceived disadvantages to telephone communication, associated with the loss of nonverbal communication, included the possibility that some subgroups of patients (eg, positive test results, pre-existing psychosocial or cognitive comorbidities) might be more vulnerable to poorer outcomes with telephone communication of genetic test results. In the absence of a randomized trial, it is not possible to know if patients in these subgroups might also have fared differently from others had they received their results in person. Patient and provider feedback and review of disclosure session audiotapes suggested many modifications that are expected to optimize communication of genetic test results by telephone. The results of our study illustrate the challenges in assessing patients’ emotional response and understanding via telephone and providers’ response to those patient needs. They emphasize the importance of identifying and developing the training needed to establish skills necessary for novel modalities of communication of genetic/genomic information.
To address these challenges, provider training, including additional verbal probes and procedures to assess patients’ psychological response and understanding, as well as situations unique to non-in person communication, must be incorporated into counseling to ensure effective communication of health information via telephone. Professional or educational training for alternative counseling models that incorporate these probes and procedures could prove invaluable for future counseling for both novice and experienced genetic counselors. Evolving genetic technologies have the potential to expand the reach of genetic testing. Realizing the associated health gains will require a workforce of genetic counselors with training in telephone and other nontraditional models of communication of genetic information. Research has shown that effective communication between providers and patients can be achieved through these technologies and might result in improved outcomes . Future studies must focus on evaluating the potential disadvantages of telephone disclosure for vulnerable subgroups in randomized clinical trials.
In this paper, we present a model for adapting the standard genetic counseling model for innovations in the delivery of genetic medicine. Our model includes stakeholder (patient and provider) input, as well as systematic review of audiotapes of pilot sessions of telephone disclosure of genetic testing results and is theoretically informed. We expect this model will be broadly applicable to adaptions of counseling for other innovations in the delivery of genetic/genomic test results. For example, we are currently employing adaptations of this model to study the potential to increase access by utilizing telemedicine to deliver genetic counseling services to community practices where genetic counselors are not available , to inform modifications to genetic counseling and delivery of multi-gene testing for cancer susceptibility for patients with suspected hereditary breast and ovarian cancer (HBOC) and other hereditary cancer syndromes, including hematological and gastrointestinal syndromes, and to inform prescriptive decisions for providers. We expect this model to be broadly generalizable to evolving contexts in genetics and medicine as innovations develop.
We acknowledge several limitations to this study. Despite the recruitment of a clinical population, we had relatively low representations of some subgroups (eg, ethnic minorities and those of low socioeconomic status). Thus, our findings may not be generalizable to a more diverse population. Our on-going multi-center randomized study aims to increase representation of these subgroups. It will also inform how cognitive and affective responses might differ between patients receiving in-person and telephone communication of genetic test results.
Providers delivering and patients receiving genetic test results by telephone identified advantages to telephone disclosure (eg, perceived convenience for patients and providers) and disadvantages (eg, loss of non-verbal cues to assess and communicate emotional responses and understanding). Review of stakeholder reported experiences and audiotapes of telephone disclosures lead to a number of communication strategy and protocol revisions to enhance patients’ cognitive, affective, and behavioral responses to genetic test results in the context of telephone disclosure of genetic test results.
This project is funded, in part, under a grant with the Pennsylvania Department of Health. The Department specifically disclaims responsibility for any analyses, interpretations, or conclusions. Support was also provided by NIH grant P30 CA006927.
Conflicts of Interest
- Khoury MJ, Gwinn M, Yoon PW, Dowling N, Moore CA, Bradley L. The continuum of translation research in genomic medicine: how can we accelerate the appropriate integration of human genome discoveries into health care and disease prevention? Genet Med 2007 Oct;9(10):665-674. [Medline]
- Burke W, Psaty BM. Personalized medicine in the era of genomics. JAMA 2007 Oct 10;298(14):1682-1684. [CrossRef] [Medline]
- Olopade OI, Grushko TA, Nanda R, Huo D. Advances in breast cancer: pathways to personalized medicine. Clin Cancer Res 2008 Dec 15;14(24):7988-7999 [FREE Full text] [CrossRef] [Medline]
- Schwartz GF, Hughes KS, Lynch HT, Fabian CJ, Fentiman IS, Robson ME, The International Consensus Conference Committee. Cancer. 2008 Nov 15 Presented at: International Consensus Conference on Breast Cancer Risk, Genetics, & Risk Management; April, 2007; Philadelphia p. 2627-2637. [CrossRef]
- Robson ME, Storm CD, Weitzel J, Wollins DS, Offit K, American Society of Clinical Oncology. American Society of Clinical Oncology policy statement update: genetic and genomic testing for cancer susceptibility. J Clin Oncol 2010 Feb 10;28(5):893-901. [CrossRef] [Medline]
- American Society of Clinical Oncology. American Society of Clinical Oncology policy statement update: genetic testing for cancer susceptibility. J Clin Oncol 2003 Jun 15;21(12):2397-2406. [CrossRef] [Medline]
- U.S. Preventive Services Task Force. Genetic risk assessment and BRCA mutation testing for breast and ovarian cancer susceptibility: recommendation statement. Ann Intern Med 2005 Sep 6;143(5):355-361. [Medline]
- Berliner JL, Fay AM, Practice Issues Subcommittee of the National Society of Genetic Counselors' Familial Cancer Risk Counseling Special Interest Group. Risk assessment and genetic counseling for hereditary breast and ovarian cancer: recommendations of the National Society of Genetic Counselors. J Genet Couns 2007 Jun;16(3):241-260. [CrossRef] [Medline]
- Ashley EA, Hershberger RE, Caleshu C, Ellinor PT, Garcia JG, Herrington DM, American Heart Association Advocacy Coordinating Committee. Genetics and cardiovascular disease: a policy statement from the American Heart Association. Circulation 2012 Jul 3;126(1):142-157 [FREE Full text] [CrossRef] [Medline]
- Roberts JS, Cupples LA, Relkin NR, Whitehouse PJ, Green RC, REVEAL (Risk Evaluation Education for Alzheimer's Disease) Study Group. Genetic risk assessment for adult children of people with Alzheimer's disease: the Risk Evaluation and Education for Alzheimer's Disease (REVEAL) study. J Geriatr Psychiatry Neurol 2005 Dec;18(4):250-255. [CrossRef] [Medline]
- Scheuner MT, Sieverding P, Shekelle PG. Delivery of genomic medicine for common chronic adult diseases: a systematic review. JAMA 2008 Mar 19;299(11):1320-1334. [CrossRef] [Medline]
- Khoury MJ, McBride CM, Schully SD, Ioannidis JP, Feero WG, Janssens AC, Centers for Disease Control and Prevention. The Scientific Foundation for personal genomics: recommendations from a National Institutes of Health-Centers for Disease Control and Prevention multidisciplinary workshop. Genet Med 2009 Aug;11(8):559-567 [FREE Full text] [CrossRef] [Medline]
- Bloss CS, Jeste DV, Schork NJ. Genomics for disease treatment and prevention. Psychiatr Clin North Am 2011 Mar;34(1):147-166 [FREE Full text] [CrossRef] [Medline]
- Churpek JE, Onel K. Heritability of hematologic malignancies: from pedigrees to genomics. Hematol Oncol Clin North Am 2010 Oct;24(5):939-972. [CrossRef] [Medline]
- Sivell S, Iredale R, Gray J, Coles B. Cancer genetic risk assessment for individuals at risk of familial breast cancer. Cochrane Database Syst Rev 2007(2):CD003721. [CrossRef] [Medline]
- McBride CM, Rimer BK. Using the telephone to improve health behavior and health service delivery. Patient Educ Couns 1999 May;37(1):3-18. [Medline]
- Peshkin B, Demarco TA, Graves KD, Brown K, Nusbaum RH, Moglia D, et al. Telephone genetic counseling for high-risk women undergoing BRCA1 and BRCA2 testing: rationale and development of a randomized controlled trial. Genet Test 2008 Mar;12(1):37-52. [CrossRef] [Medline]
- Biesecker BB, Boehnke M, Calzone K, Markel DS, Garber JE, Collins FS, et al. Genetic counseling for families with inherited susceptibility to breast and ovarian cancer. JAMA 1993 Apr 21;269(15):1970-1974. [Medline]
- Riley BD, Culver JO, Skrzynia C, Senter LA, Peters JA, Costalas JW, et al. Essential elements of genetic cancer risk assessment, counseling, and testing: updated recommendations of the National Society of Genetic Counselors. J Genet Couns 2012 Apr;21(2):151-161. [CrossRef] [Medline]
- Helmes AW, Culver JO, Bowen DJ. Results of a randomized study of telephone versus in-person breast cancer risk counseling. Patient Educ Couns 2006 Dec;64(1-3):96-103. [CrossRef] [Medline]
- Ormond KE, Haun J, Cook L, Duquette D, Ludowese C, Matthews AL. Recommendations for Telephone Counseling. Journal of Genetic Counseling 2000 Feb 01;9(1):63-71. [CrossRef]
- Coelho JJ, Arnold A, Nayler J, Tischkowitz M, MacKay J. An assessment of the efficacy of cancer genetic counselling using real-time videoconferencing technology (telemedicine) compared to face-to-face consultations. Eur J Cancer 2005 Oct;41(15):2257-2261. [CrossRef] [Medline]
- Sturm AC, Hershberger RE. Genetic testing in cardiovascular medicine: current landscape and future horizons. Curr Opin Cardiol 2013 May;28(3):317-325. [CrossRef] [Medline]
- Chen WY, Garber JE, Higham S, Schneider KA, Davis KB, Deffenbaugh AM, et al. BRCA1/2 genetic testing in the community setting. J Clin Oncol 2002 Nov 15;20(22):4485-4492. [Medline]
- Bradbury AR, Patrick-Miller L, Fetzer D, Egleston B, Cummings SA, Forman A, et al. Genetic counselor opinions of, and experiences with telephone communication of BRCA1/2 test results. Clin Genet 2011 Feb;79(2):125-131 [FREE Full text] [CrossRef] [Medline]
- Doughty Rice C, Ruschman JG, Martin LJ, Manders JB, Miller E. Retrospective comparison of patient outcomes after in-person and telephone results disclosure counseling for BRCA1/2 genetic testing. Fam Cancer 2010 Jun;9(2):203-212. [CrossRef] [Medline]
- Baumanis L, Evans JP, Callanan N, Susswein LR. Telephoned BRCA1/2 genetic test results: prevalence, practice, and patient satisfaction. J Genet Couns 2009 Oct;18(5):447-463. [CrossRef] [Medline]
- Schwartz MD, Lerman C, Brogan B, Peshkin BN, Halbert CH, DeMarco T, et al. Impact of BRCA1/BRCA2 counseling and testing on newly diagnosed breast cancer patients. J Clin Oncol 2004 May 15;22(10):1823-1829. [CrossRef] [Medline]
- Christensen KD, Roberts JS, Shalowitz DI, Everett JN, Kim SY, Raskin L, et al. Disclosing individual CDKN2A research results to melanoma survivors: interest, impact, and demands on researchers. Cancer Epidemiol Biomarkers Prev 2011 Mar;20(3):522-529 [FREE Full text] [CrossRef] [Medline]
- Geransar R, Einsiedel E. Evaluating online direct-to-consumer marketing of genetic tests: informed choices or buyers beware? Genet Test 2008 Mar;12(1):13-23. [CrossRef] [Medline]
- Schwartz MD, Valdimarsdottir HB, Peshkin BN, Mandelblatt J, Nusbaum R, Huang AT, et al. Randomized noninferiority trial of telephone versus in-person genetic counseling for hereditary breast and ovarian cancer. J Clin Oncol 2014 Mar 1;32(7):618-626. [CrossRef] [Medline]
- Informed DNA. URL: http://www.informeddna.com/ [WebCite Cache]
- Genetic Counseling Services. URL: http://www.geneticcounselingservices.com/ [WebCite Cache]
- Patrick-Miller L, Egleston BL, Daly M, Stevens E, Fetzer D, Forman A, et al. Implementation and outcomes of telephone disclosure of clinical BRCA1/2 test results. Patient Educ Couns 2013 Dec;93(3):413-419. [CrossRef] [Medline]
- Domchek SM, Bradbury A, Garber JE, Offit K, Robson ME. Multiplex genetic testing for cancer susceptibility: out on the high wire without a net? J Clin Oncol 2013 Apr 1;31(10):1267-1270. [CrossRef] [Medline]
- Croyle RT, Lerman C. Risk communication in genetic testing for cancer susceptibility. J Natl Cancer Inst Monogr 1999(25):59-66. [Medline]
- Department of Health and Human Services. Dissemination and Implementation Research in Health (R01) URL: http://grants.nih.gov/grants/guide/pa-files/PAR-10-038.html [WebCite Cache]
- Hesse BW, Arora NK, Khoury MJ. Implications of Internet availability of genomic information for public health practice. Public Health Genomics 2012;15(3-4):201-208 [FREE Full text] [CrossRef] [Medline]
- Leventhal H, Benyamini Y, Brownlee S, Diefenbach M, Leventhal EA, Patrick-Miller L, et al. Perceptions of health illness: current research applications. In: Petrie KJ, Weinman JA, editors. Illness Representations: Theoretical Foundations. The Netherlands: Harwood Academic Pub; Jul 01, 1997:19-46.
- Kelly K, Leventhal H, Andrykowski M, Toppmeyer D, Much J, Dermody J, et al. Using the common sense model to understand perceived cancer risk in individuals testing for BRCA1/2 mutations. Psychooncology 2005 Jan;14(1):34-48. [CrossRef] [Medline]
- Innes M, Skelton J, Greenfield S. A profile of communication in primary care physician telephone consultations: application of the Roter Interaction Analysis System. Br J Gen Pract 2006 May;56(526):363-368 [FREE Full text] [Medline]
- Shiloh S. Illness representations, self-regulation, and genetic counseling: a theoretical review. J Genet Couns 2006 Oct;15(5):325-337. [CrossRef] [Medline]
- Shiloh S, Drori E, Orr-Urtreger A, Friedman E. Being 'at-risk' for developing cancer: cognitive representations and psychological outcomes. J Behav Med 2009 Apr;32(2):197-208. [CrossRef] [Medline]
- Communicating genetic test results by telephone: a randomized trial. 5R01CA160847-02 (PI: Bradbury) URL: http://projectreporter.nih.gov/project_info_description.cfm?aid=8513942&icde=17523231&ddparam=&ddvalue=&ddsub=&cr=1&csb=default&cs=ASC
- Virtual cancer genetic services: telemedicine delivery in community clinics. 1R21CA164121-01A1 (PI: Bradbury) URL: http://projectreporter.nih.gov/project [WebCite Cache]
- Burke W, Khoury MJ, Stewart A, Zimmern RL, Bellagio Group. The path from genome-based research to population health: development of an international public health genomics network. Genet Med 2006 Jul;8(7):451-458. [Medline]
- Burgess MM. Beyond consent: ethical and social issues in genetic testing. Nat Rev Genet 2001 Feb;2(2):147-151. [CrossRef] [Medline]
- Cameron L, Leventhal EA, Leventhal H. Symptom representations and affect as determinants of care seeking in a community-dwelling, adult sample population. Health Psychol 1993 May;12(3):171-179. [Medline]
- Patrick-Miller L, Kelly K, Toppmeyer D, Leventhal H, Much J, Baron J, et al. Breast cancer screening behaviors and perceived control in individuals interested in testing for BRCA1/2 mutations. American Society of Clinical Oncology 2001;Abstract.
- Weinman J, Petrie KJ, Sharpe N, Walker S. Causal attributions in patients and spouses following first-time myocardial infarction and subsequent lifestyle changes. British Journal of Health Psychology 2000;5:263-273. [CrossRef]
- Zimmerman RS, Safer MA, Leventhal H, Baumann LJ. The effects of health information in a worksite hypertension screening program. Health Educ Q 1986;13(3):261-280. [Medline]
- Park DC. Self-regulation and control of rheumatic disorders. In: Maes S, Leventhal H, Johnston MC, editors. International Review of Health Psychology, Volume 3. Chichester, England: John Wiley & Sons; 1994.
- Kelly KM, Ferketich AK, Sturm AC, Porter K, Sweet K, Kemp K, et al. Cancer risk and risk communication in urban, lower-income neighborhoods. Prev Med 2009 Apr;48(4):392-396. [CrossRef] [Medline]
- Acheson LS, Crabtree BF. How do people interpret their family histories of diabetes, coronary disease, or cancer? Ann Fam Med 2004;2(6):532-533 [FREE Full text] [CrossRef] [Medline]
- Rees G, Fry A, Cull A. A family history of breast cancer: women's experiences from a theoretical perspective. Soc Sci Med 2001 May;52(9):1433-1440. [Medline]
- Patrick-Miller L, Bradbury AR, Terry MB. Controversies in communication of genetic screening results for cancer: a report from the American Society of Preventive Oncology's Screening Special Interest Group (ASPO's 33rd Annual Meeting, March 8 to 10, 2009, Tampa, Florida). Cancer Epidemiol Biomarkers Prev 2010 Feb;19(2):624-627 [FREE Full text] [CrossRef] [Medline]
- Hamilton JG, Lobel M, Moyer A. Emotional distress following genetic testing for hereditary breast and ovarian cancer: a meta-analytic review. Health Psychol 2009 Jul;28(4):510-518 [FREE Full text] [CrossRef] [Medline]
- O'Neill SC, Rini C, Goldsmith R, Valdimarsdottir H, Cohen LH, Schwartz MD. Distress among women receiving uninformative BRCA1/2 results: 12-month outcomes. Psychooncology 2009 Oct;18(10):1088-1096 [FREE Full text] [CrossRef] [Medline]
- Lynch HT, Snyder C, Lynch JF, Karatoprakli P, Trowonou A, Metcalfe K, et al. Patient responses to the disclosure of BRCA mutation tests in hereditary breast-ovarian cancer families. Cancer Genet Cytogenet 2006 Mar;165(2):91-97. [CrossRef] [Medline]
- Schlich-Bakker KJ, ten Kroode HF, Ausems MG. A literature review of the psychological impact of genetic testing on breast cancer patients. Patient Educ Couns 2006 Jul;62(1):13-20. [CrossRef] [Medline]
- Halbert C, Kessler L, Collier A, Paul Wileyto E, Brewster K, Weathers B. Psychological functioning in African American women at an increased risk of hereditary breast and ovarian cancer. Clin Genet 2005 Sep;68(3):222-227. [CrossRef] [Medline]
- Kinney AY, Bloor LE, Mandal D, Simonsen SE, Baty BJ, Holubkov R, et al. The impact of receiving genetic test results on general and cancer-specific psychologic distress among members of an African-American kindred with a BRCA1 mutation. Cancer 2005 Dec 1;104(11):2508-2516 [FREE Full text] [CrossRef] [Medline]
- Kinney AY, Simonsen SE, Baty BJ, Mandal D, Neuhausen SL, Seggar K, et al. Risk reduction behaviors and provider communication following genetic counseling and BRCA1 mutation testing in an African American kindred. J Genet Couns 2006 Aug;15(4):293-305. [CrossRef] [Medline]
- Jenkins J, Calzone KA, Dimond E, Liewehr DJ, Steinberg SM, Jourkiv O, et al. Randomized comparison of phone versus in-person BRCA1/2 predisposition genetic test result disclosure counseling. Genet Med 2007 Aug;9(8):487-495. [Medline]
- Weitzel J, Blazer KR, Macdonald DJ, Culver JO, Offit K. Genetics, genomics, and cancer risk assessment: State of the Art and Future Directions in the Era of Personalized Medicine. CA Cancer J Clin 2011 Aug 19;61(5) [FREE Full text] [CrossRef] [Medline]
- McKinstry B, Hammersley V, Burton C, Pinnock H, Elton R, Dowell J, et al. The quality, safety and content of telephone and face-to-face consultations: a comparative study. Qual Saf Health Care 2010 Aug;19(4):298-303. [CrossRef] [Medline]
- Ubel PA. Critical Decisions: How You and Your Doctor Can Make the Right Medical Choices Together. New York: HarperOne; Sep 04, 2012.
- Kelly K, Leventhal H, Marvin M, Toppmeyer D, Baran J, Schwalb M. Cancer genetics knowledge and beliefs and receipt of results in Ashkenazi Jewish individuals receiving counseling for BRCA1/2 mutations. Cancer Control 2004;11(4):236-244 [FREE Full text] [Medline]
- American College of Medical Genetics. Statement on population screening for BRCA-1 mutation in Ashkenazi Jewish women. 1996. URL: https://www.acmg.net/StaticContent/StaticPages/Ashkenazi.pdf [WebCite Cache]
- Lerman C, Narod S, Schulman K, Hughes C, Gomez-Caminero A, Bonney G, et al. BRCA1 testing in families with hereditary breast-ovarian cancer. A prospective study of patient decision making and outcomes. JAMA 1996 Jun 26;275(24):1885-1892. [Medline]
- Speilberger CD, Gorsuch RL, Lushene R, Vagg PR, Jacobs GA. Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press; 1983.
- Zigmond AS, Snaith RP. The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand 1983 Jun;67(6):361-370. [Medline]
- Pieterse AH, van Dulmen AM, Beemer FA, Bensing JM, Ausems MG. Cancer genetic counseling: communication and counselees' post-visit satisfaction, cognitions, anxiety, and needs fulfillment. J Genet Couns 2007 Feb;16(1):85-96 [FREE Full text] [CrossRef] [Medline]
- DeMarco TA, Peshkin BN, Mars BD, Tercyak KP. Patient satisfaction with cancer genetic counseling: a psychometric analysis of the Genetic Counseling Satisfaction Scale. J Genet Couns 2004 Aug;13(4):293-304 [FREE Full text] [Medline]
- Cella D, Hughes C, Peterman A, Chang CH, Peshkin BN, Schwartz MD, et al. A brief assessment of concerns associated with genetic testing for cancer: the Multidimensional Impact of Cancer Risk Assessment (MICRA) questionnaire. Health Psychol 2002 Nov;21(6):564-572. [Medline]
- Braithwaite D, Emery J, Walter F, Prevost AT, Sutton S. Psychological impact of genetic counseling for familial cancer: a systematic review and meta-analysis. Fam Cancer 2006;5(1):61-75. [CrossRef] [Medline]
- Bjelland I, Dahl AA, Haug TT, Neckelmann D. The validity of the Hospital Anxiety and Depression Scale. An updated literature review. J Psychosom Res 2002 Feb;52(2):69-77. [Medline]
- Armstrong K, Micco E, Carney A, Stopfer J, Putt M. Racial differences in the use of BRCA1/2 testing among women with a family history of breast or ovarian cancer. JAMA 2005 Apr 13;293(14):1729-1736. [CrossRef] [Medline]
- Lea DH, Johnson JL, Ellingwood S, Allan W, Patel A, Smith R. Telegenetics in Maine: Successful clinical and educational service delivery model developed from a 3-year pilot project. Genet Med 2005 Jan;7(1):21-27. [Medline]
- Godard B, Pratte A, Dumont M, Simard-Lebrun A, Simard J. Factors associated with an individual's decision to withdraw from genetic testing for breast and ovarian cancer susceptibility: implications for counseling. Genet Test 2007;11(1):45-54. [CrossRef] [Medline]
- Curtis P. The telephone interview. In: Reisman AB, Stevens DL, editors. Telephone Medicine: A Guide for the Practicing Physician. Philadelphia: American College of Physician-American Society of Internal Medicine; 2002.
- Silverman J, Kurtz SM, Draper J. Skills For Communicating With Patients. Alberta: Radcliffe Medical Press; 1998.
- Platten U, Rantala J, Lindblom A, Brandberg Y, Lindgren G, Arver B. The use of telephone in genetic counseling versus in-person counseling: a randomized study on counselees' outcome. Fam Cancer 2012 Sep;11(3):371-379 [FREE Full text] [CrossRef] [Medline]
- Mackenzie A, Patrick-Miller L, Bradbury AR. Controversies in communication of genetic risk for hereditary breast cancer. Breast J 2009;15 Suppl 1:S25-S32. [CrossRef] [Medline]
- Ngo-Metzger Q, Hayes GR, Yunan Chen, Cygan R, Garfield CF. Improving communication between patients and providers using health information technology and other quality improvement strategies: focus on low-income children. Med Care Res Rev 2010 Oct;67(5 Suppl):246S-267S. [CrossRef] [Medline]
|GC: genetic counselor|
|GINA: Genetic Information Nondiscrimination Act|
|HADS: Hospital Anxiety Depression Scale|
|SRTHS: Self-Regulation Theory of Health Behavior|
|STAI: State-Trait Anxiety Inventory|
|TD: telephone disclosure|
|VUS: variant of uncertain significance|
Edited by G Eysenbach; submitted 19.02.14; peer-reviewed by C Bellcross; comments to author 17.04.14; revised version received 12.06.14; accepted 18.07.14; published 29.10.14Copyright
©Linda J Patrick-Miller, Brian L Egleston, Dominique Fetzer, Andrea Forman, Lisa Bealin, Christina Rybak, Candace Peterson, Melanie Corbman, Julio Albarracin, Evelyn Stevens, Mary B Daly, Angela R Bradbury. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 29.10.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.