This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.
Challenges in the clinical and research consent process indicate the need to develop tailored, supportive interventions for all individuals, especially those with limited decisional capacity. We developed a tool to enhance shared decision making and the decisional capacity for individuals with fragile X syndrome engaged in the informed consent process for a clinical trial.
We describe the design and development process of a tablet-based decision support tool.
Our development process for the decision support tool employed a user-centered, feature-driven design approach. We began with an environmental scan to catalog relevant mobile apps, and we conducted interviews with people with a diagnosis of fragile X syndrome and clinicians at fragile X syndrome clinics. To develop content for the decision support tool, we extracted key concepts and elements from a real clinical trial consent form and rewrote it using plain-language principles.
We used iterative testing to continuously evaluate and revise the decision support tool content. The tool was finalized in 2016 and contained a series of vignettes, quiz questions, and a sorting activity. A randomized controlled trial was then conducted to compare the efficacy of the decision support tool with a standard verbal presentation of material that mimicked typical informed consent practice.
The informed consent process is primed to leverage digital health resources that promote increased understanding and engagement of research participants in the consent and research process. The process and experiences we describe may provide a model for other digital health design and development initiatives seeking to create more interactive and accessible decision support resources.
ClinicalTrials.gov NCT02465931; https://www.clinicaltrials.gov/ct2/show/NCT02465931 (Archived by WebCite at http://www.webcitation.org/6zx2KY9YW)
Digital technologies can serve as a communication bridge between patients, caregivers, and health care providers, making information available to users when and where they need it, and allowing users to better communicate their needs and preferences. For those with intellectual and developmental disabilities, technological advances can be used to support daily living skills, enhance cognition, and support communication. Further, multimedia formats for information delivery—including interactive, computer-based interventions—may contribute to greater patient understanding of complex information when compared with traditional formats [
Electronic informed consent strategies use electronic media (such as websites, video, or audio) to convey study information and obtain the participant’s consent [
Prospective research participants sometimes struggle to comprehend informed consent standards and regulations [
Fragile X syndrome (FXS) is the leading inherited type of intellectual disability. Males with a diagnosis of FXS typically have impairment ranging from mild to severe; females are generally less impaired [
To date, most research on individuals with FXS has been noninvasive, limited to parent surveys and secondary assessment of clinical data [
The knowledge base surrounding the decisional capacity of those with intellectual disability and FXS is inadequate, and reviews concluded that the literature is limited in both scope and focus [
The user-centered design process outlines the design and development life cycle focused on gaining a deep understanding of a system’s end users. A variety of user-centered design guidelines are available to inform the development of digital technologies. For example, the international standard 9241-210:2010 [
To begin, our team conducted an environmental scan to catalog available tablet-based apps that focus on health care or were designed for individuals with intellectual and developmental disabilities. Our goal was to evaluate the apps based on user-centered design principles and determine what features we needed to include when developing the tool. Study staff purchased an iPad (Apple Inc, Cupertino, CA, USA) and identified 31 apps (see
Methodology for decision support tool content development.
Recommended key features of apps.
Decision support tool feature | Feature description |
Apply clear communication and plain-language principles | The tool should reflect clear communication principles (eg, avoid jargon, use a low reading level) and be easy to understand. |
Ensure appropriateness to sensitivities | Content and presentation elements need to be respectful of particular sensitivities common among individuals with fragile X syndrome (eg, heightened sensitivity to light, color, and sound). |
Combine animation and real-life images | The combination of animation and real-life images provides engagement while grounding concepts in the real world and provides tangible orientation to relevant scenarios (eg, a clinic waiting room). |
Enable customization | Customization of the content and delivery should be enabled to ensure accessibility to a broader audience. |
Incorporate active learning | Active learning principles should be incorporated to facilitate greater engagement and integration of the information. |
Assess comprehension | Existing methods (eg, the “teach back” method) should be incorporated or new ways should be developed to assess a user’s comprehension of information received to gauge the effectiveness of the tool. |
Support decision making | Simple decision support tools should be offered to facilitate reasoning about a decision (eg, a pro/con list) and assessment of preference (eg, importance of factors) related to that decision. |
In the second step to inform the appropriate features and functionality for the decision support tool, we conducted 6 in-person observation-based interviews with individuals with a diagnosis of FXS. This was a convenience sample of participants identified through a larger study on health care decision making among individual with FXS; 5 participants were male and their average age was 22.3 years (range 16-28 years). Participants were given an iPad and rated on their engagement and performance of simple skills, advanced skills, and exploration skills interacting with specific apps. Overall, all participants interacted with the assessment apps and were most engaged with exploring app hotspots that involved avatars or narration, and least engaged with simplistic app features. Results from these interviews will be published at a later date.
To establish a better understanding of the context within which the decision support tool would be used, we conducted 3 in-depth interviews with clinician stakeholders who had taken participants with FXS through the consent process for clinical trials. This was a convenience sample of clinicians or physician scientists who were known members of our project team and willing to serve as consultants, and to provide feedback on the content creation, as well as the design and development efforts throughout the life cycle of the project. From the interviews, it was unclear whether there is a standard or maximum reading level for consent forms. One FXS clinical trial research manager stated that their consent forms were written for an eighth-grade reading level, and the other 2 clinicians noted that their forms include simple questions (possibly at a second- or third-grade reading level) to prompt a yes-or-no response from the patient. It was also the consensus that most individuals with FXS don’t understand much of the information presented to them; however, they are able to understand that they will be taking a new medication, and they are able to understand the risks and benefits of that new medication. Although none of the clinicians regularly used tablets as part of the informed consent process, one clinician emphasized that keeping the participant happy and engaged is the greatest challenge, and they welcomed anything to make the process easier.
Sample decision support tool content mapping.
Institutional review board element | Real clinical trial consent | Hypothetical clinical trial consent | Decision support tool content |
Description of risks or discomforts to subject. | Risks are possible side (adverse) effects from the study drug, other drugs, taking the blood pressure or taking blood. | The new medication is generally considered to be very safe, but one purpose of the study is to determine whether any serious side effects occur. The most common side effects expected are fatigue and a mild headache. | You might not like some parts of the study. If you get the real pills, you might feel a little sick or tired. |
Description of voluntary compensation and treatment if the subject is injured related to the research. Applicable for research posing greater than minimal risks. | Each study subject will receive US $200 per study visit when you have to stay overnight and US $120 for other visits to the study center, to compensate for your time. | US $25 will be given for each study visit and US $10 for each phone call. | You will get US $25 after each visit. Your name and information about you will be kept private. |
Content development began with a review of informed consent forms from previously conducted FXS clinical trials. Although the tool focused on a hypothetical trial, we used the actual consent forms as a guide to extract key concepts and elements that would also be needed in our tool (eg, randomization, blinding, and use of a placebo, as well as concepts that anecdotally are difficult to comprehend and typically explained with medical terminology and jargon). We rewrote these concepts and elements using plain-language principles and incorporating other recommendations we identified in the environmental scan. We used a table to map institutional review board requirements and the clinical trial consent content with language in the decision support tool to ensure that we addressed all mandatory elements of informed consent disclosure.
To aid in the development of closed-ended quiz questions for the tool, we adapted the MacArthur Competence Assessment Tool for Clinical Research, which is the main measure of decisional capacity in individuals with FXS [
As the next step in our development process, we created audiovisual components to accompany the content of the tool. Universal design can be defined as a tool that is accessible and usable by everyone [
The results section focuses on initial testing of the decision support tool and how feedback received throughout each phase of testing further influenced the content and design of the tool.
We sought input from individuals with FXS on the 3 stylistic options for the decision support tool. We displayed a sample of each graphic style (simplistic, cartoon, and graphic novel, as
Study staff also conducted in-depth, in-person interviews with 9 individuals with FXS to seek feedback on an early iteration of the tool’s content. Interviews focused mainly on learning whether the images, text, and narration captured the clinical trial component as intended. Interviewers also asked the participants their opinions about the graphics used, suggestions for improvement, and whether the text and narration were understandable. Lower-functioning males with FXS expressed a preference for the cartoon graphic style; however, higher-functioning participants preferred the simplistic style, and we ultimately selected that design in order to appeal to these users.
Decision support tool testing.
Decision support tool graphic styles.
Our interviews also revealed scenes that required modification and enhancements to increase comprehension among individuals with FXS. For one particular scene, we tested participants’ comprehension of the clinical trial concept of placebo with an animation showing that some pills will contain medicine and others will not. Although participants liked the animation, they had difficulty grasping the concept. Participants also had difficulty understanding the concept of blinding, and that no one will know who will receive the trial drug. Similarly, participants were also confused by the concept of randomization, particularly regarding who decides which trial participant receives the drug versus the placebo. Participants had an easier time understanding more concrete concepts such as trial procedures (eg, providing a urine sample or having blood drawn), and they were able to easily navigate through the different screens on the iPad and liked the narration and animations included throughout the tool.
In the fall of 2015, we completed a draft of the tool composed of a series of 6 vignettes or interactive narratives, close-ended multiple-choice quiz questions, and a sorting activity. Each vignette discussed a separate component of the consent using plain language: study purpose, study involvement, how the study will work, study benefits, study risks, and withdrawing from the study. To evaluate each user’s understanding of the content, multiple-choice questions followed each vignette. Before answering the multiple-choice questions, users were given the option to watch the vignette again. If they answered the questions incorrectly, the vignette automatically replayed for the user 1 time and the multiple-choice question was presented again. A sorting activity was also used to facilitate a self-directed values clarification of the perceived reasons an individual may choose to participate or not participate in a clinical trial. Users were provided with 7 features of study participation (eg, “I would have to see my doctor several times” or “I might feel better”) and asked to sort each feature as a reason to be or not be in the study. Participants were required to sort a minimum of 2 features.
We conducted incremental field testing on each component of the draft decision support tool: the vignettes, the quiz questions, and the sorting activity. On completion of the initial series of vignettes and in parallel with development of the quiz items, we pretested each component of the tool. We collected feedback from pretesting in a subsequent version while fielding the quiz component; we implemented input on the quiz during development of the sorting activity until we assembled the final decision support tool. The complete decision support tool underwent beta testing and internal software quality assurance testing to exercise the compiled decision support tool, verify skip logic, and confirm capture of accurate scoring metrics and session analytics. We completed the final version of the decision support tool in 2016.
We initiated a two-arm randomized controlled trial (NCT02465931) in 2016 to compare the efficacy of the decision support tool with a standard verbal presentation of the consent material that mimicked typical consent practice. Participants were randomly assigned to receive the tablet-based decision support tool or the verbal script and paper consent. The trial protocol and outcomes will be published at a later date.
The movement to empower patients through health technology to support complex decision making is gaining momentum. As the number of clinical trials targeting those with FXS increases, the goal of involving participants in the decision-making process will become increasingly important, emphasizing the need for tools that allow trial participants to become active members in the decision-making process. The process we describe strives to encourage those conducting trials with FXS patients to reevaluate how their participants are involved in the consenting process. The methods we employed in the design and development of the decision support tool described here can be developed, tested, and incorporated into routine practice. Further, although those with intellectual disability face challenges in making health decisions, those without such impairments are not immune to similar struggles.
Health literacy is defined as an individual’s ability to obtain, process, and understand health information and to use it to make health-related decisions [
The informed consent process is primed to leverage digital health resources given recent changes to the Common Rule in the United States that promote increasing understanding and engagement of research participants in the consent and research process. Interactive electronic informed consent material provides more adaptable content than traditional paper-based materials. The digital decision support tool can be deployed in a variety of settings, such as inpatient and outpatient clinics, hospitals, research facilities, or at home. The home setting enables a prospective trial participant to learn about the trial in a familiar and comfortable setting without perceiving potential undue pressure from medical or research personnel. The ability to go through the consent process at home also fosters shared decision making, as family members or those important to the individual can more easily review and openly discuss the information together. Additionally, the ability to use the tool at home provides convenience and reduces the need for travel to a clinic or physician’s office, which may be difficult for some individuals due to their living situation, financial status, or health issues, or the trial location.
Agile software development is a group of methods in which requirements and solutions evolve through collaboration between self-organizing, cross-functional teams [
Our development process for the decision support tool was consistent with an agile, feature-driven process. This can deliver value and yield a more efficient, responsive product, all while conforming to mandatory research processes such as evidence reviews, stakeholder engagement, regulatory compliance, and protection of human participants.
The principle of “team science” addresses barriers associated with intervention development and implementation through engagement of an interdisciplinary team. This tactic brings together a variety of researchers with specialized expertise, approaches, and methodologies to solve complex problems [
A team science approach is especially critical when considering digital health interventions, which require input and coordination from information technologists, researchers, and health care professionals [
Central to the success of this project were the team’s recognition of the importance of a user-centered approach, stakeholder engagement and input, appreciation of interdisciplinarity, and willingness to explore and adapt commercial software methods and management techniques. The process and experiences described here may provide a model for other digital health design and development initiatives seeking to create more interactive and accessible decision support resources. Future research is needed on the impact of decision support tools in obtaining electronic informed consent and their influence on shared decision making and the user’s decisional capacity.
Mobile app environmental scan results.
fragile X syndrome
The authors would like to thank Tania Fitzgerald and Julia Kish Doto for their work in conducting the environmental scan. Funding for this work was provided by the Eunice Kennedy Shriver National Institute of Child Health & Human Development of the National Institutes of Health under Award Number R01HD071987. The content of this paper is the responsibility of the authors and does not reflect the view of RTI International.
None declared.