JMIR Publications

JMIR Research Protocols


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 10.06.16 in Vol 5, No 2 (2016): Apr-Jun

This paper is in the following e-collection/theme issue:

    Original Paper

    Informing Patients About Placebo Effects: Using Evidence, Theory, and Qualitative Methods to Develop a New Website

    1Psychology Department, Faculty of Social and Human Sciences, University of Southampton, Southampton, United Kingdom

    2Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom

    3Centre for Innovation & Leadership in Health Sciences, Faculty of Health Sciences, University of Southampton, Southampton, United Kingdom

    4Primary Care and Population Sciences, Faculty of Medicine, University of Southampton, Southampton, United Kingdom

    5ZeMedia, Southampton, United Kingdom

    Corresponding Author:

    Felicity L Bishop, MA, MSc, PhD, AFBPsS, CPsychol

    Psychology Department

    Faculty of Social and Human Sciences

    University of Southampton

    Building 44

    Highfield Campus

    Southampton, SO17 1BJ

    United Kingdom

    Phone: 44 2380599020

    Fax:44 2380594597



    Background: According to established ethical principles and guidelines, patients in clinical trials should be fully informed about the interventions they might receive. However, information about placebo-controlled clinical trials typically focuses on the new intervention being tested and provides limited and at times misleading information about placebos.

    Objective: We aimed to create an informative, scientifically accurate, and engaging website that could be used to improve understanding of placebo effects among patients who might be considering taking part in a placebo-controlled clinical trial.

    Methods: Our approach drew on evidence-, theory-, and person-based intervention development. We used existing evidence and theory about placebo effects to develop content that was scientifically accurate. We used existing evidence and theory of health behavior to ensure our content would be communicated persuasively, to an audience who might currently be ignorant or misinformed about placebo effects. A qualitative ‘think aloud’ study was conducted in which 10 participants viewed prototypes of the website and spoke their thoughts out loud in the presence of a researcher.

    Results: The website provides information about 10 key topics and uses text, evidence summaries, quizzes, audio clips of patients’ stories, and a short film to convey key messages. Comments from participants in the think aloud study highlighted occasional misunderstandings and off-putting/confusing features. These were addressed by modifying elements of content, style, and navigation to improve participants’ experiences of using the website.

    Conclusions: We have developed an evidence-based website that incorporates theory-based techniques to inform members of the public about placebos and placebo effects. Qualitative research ensured our website was engaging and convincing for our target audience who might not perceive a need to learn about placebo effects. Before using the website in clinical trials, it is necessary to test its effects on key outcomes including patients’ knowledge and capacity for making informed choices about placebos.

    JMIR Res Protoc 2016;5(2):e106



    Crowdfunding campaign to support this specific research

    We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.

    keyboard with crowdfunding key instead of enter key

    Suggested contribution levels: $20/$50/$100


    Clinical trials must be conducted in accordance with Good Clinical Practice guidelines [1] and ethical principles espoused in the Declaration of Helsinki [2]. In particular, patients should be fully informed about the interventions they might receive and must give written informed consent. In a placebo-controlled randomized clinical trial this means that all participants should be fully informed about both the new intervention being tested and the placebo control. However, a content analysis of participant information leaflets from United Kingdom–based placebo-controlled trials found that written information about placebos is typically incomplete and at times misleading [3]. For example, despite strong evidence of placebo effects and mechanisms in the scientific literature, [4-7] only 1 of 45 leaflets explicitly stated that patients might experience beneficial effects from the placebo [3]. Using placebos in clinical trials appears to be generally acceptable to patients, but crucially this depends not only on the severity of the condition being treated and available alternative controls, but also the adequacy of informed consent [8]. Furthermore, evidence from surveys and qualitative studies shows that clinical trial participants often have false beliefs about, and partial understanding of, placebos and their possible effects [9-11]. Examples of such false beliefs include the belief that placebo effects are fake, or illusory, and that people who respond to placebos are gullible or foolish [11-13]. This might explain why the inclusion of placebo controls can deter people from volunteering to participate in trials [14]. Overall, it seems that a significant proportion of clinical trial participants might have inadequate understandings of the potential clinical effects of placebo interventions [9-13], thus jeopardizing the ethical validity of informed consent [3] and potentially hampering recruitment [14]. More accurate and complete information about placebos could usefully address this ethical shortcoming, could combat patient anxiety about placebo effects [12], and reduce distress at being debriefed in placebo condition participants [15,16].

    This paper describes the development of an educational website about placebo effects. We aimed to create an informative, scientifically accurate, and engaging website that could be used to improve understanding of placebo effects among patients who might be considering taking part in a placebo-controlled clinical trial. We chose to develop a website rather than a traditional printed information leaflet because websites (1) are increasingly popular sources of consumer health [17-20], suggesting that this format reflects consumer preferences, (2) easily incorporate interactive features [21], which can enhance engagement and effective education[22], (3) are easily and cheaply disseminated for widespread access [21] (86% of UK households had Internet access and 78% of adults accessed the Internet daily or almost daily in 2015 [23]), and (4) can be readily adapted and/or tailored to different subgroups [21]. Our intention was to develop a resource that could potentially be used across a large number of clinical trials and/or adapted for use in specific trials. However, because the effects and mechanisms of placebos differ across symptoms and diseases [24], we chose one clinical target to focus on for this version of the website. We chose placebo analgesia as pain is relevant to a large number of clinical conditions and placebo analgesia is a well-documented placebo effect [4,25-27]. The target audience for this website was thus adults experiencing pain symptoms (from any clinical condition).


    An Evidence-, Theory-, and Person-Based Approach

    We drew on existing evidence and theory, and conducted qualitative research to develop our website using an approach derived from evidence-based, theory-based [28,29], and incorporating elements of person-based [30] intervention development. In the context of a website about placebos, we felt this combined approach was more valuable than any single approach. It was important to use existing evidence and theory about placebo effects to ensure our content was scientifically accurate. Drawing on existing evidence and theory about health behavior was essential to ensure our content would be communicated persuasively to an audience who might currently be ignorant or misinformed about placebo effects. Conducting our own qualitative research was necessary to ensure our website was engaging and convincing for our target audience who might not have a perceived need to learn about placebo effects. Figure 1 provides an overview of the process of developing the website.

    Figure 1. Overview of methods used to develop the website.
    View this figure

    Planning the Intervention

    To plan the content and structure of the website we considered four key questions:

    What psychological targets are relevant to providing information about placebos? In other words, what would we expect to change as a result of viewing our website?

    What do patients typically believe about placebos and placebo effects?

    What is the current scientific understanding of placebos and placebo effects?

    How should information about placebos and placebo effects be provided to be most effective?

    Psychological Targets

    Given current partial understandings, misunderstandings, and poor quality information about placebos [3,9-11], we decided our website should focus on promoting informed choices about placebos. Making an informed choice can be understood as choosing to act in a way that is based on one’s knowledge and one’s values [31-33]. According to this definition, it is incorrect to specify that a particular option is the correct choice for everyone: what counts as the informed choice will differ across equally knowledgeable individuals according to their values. To make an informed choice, a person needs to have an accurate understanding of the options available, have formed an opinion about the options based on their values, and make a decision (or otherwise act in a way) that is consistent with their knowledge and values. We chose to focus on informed choice, rather than informed consent, because the process of informed consent to take part in a placebo-controlled clinical trial would typically involve a face-to-face interaction between trial personnel and potential participants and would involve the provision of trial-specific information (eg, about the trial intervention). Our website is intended to provide a generic resource to educate and inform members of the public who may be considering receiving placebos as part of a clinical trial.

    In the context of placebos, an informed choice to receive a placebo (eg, by taking part in a trial) requires knowledge about the possible effects of placebos, a positive attitude to taking placebos, and a decision to take placebos. An informed choice not to receive a placebo requires knowledge about the possible effects of placebos, a negative attitude to taking placebos, and a decision not to take placebos. To promote informed choice our website thus needed to improve people’s knowledge of placebos. Therefore, knowledge about placebos and their effects was our primary target for change.

    Making an informed choice to receive placebos can be understood as a volitional behavior, and thus can be modelled using the Theory of Planned Behavior [34]. According to the Theory of Planned Behavior, patients’ intentions to take placebos are driven by attitudes, subjective norms, and perceived behavioral control. These, in turn, are determined by beliefs [34]. Thus, patients will be more likely to make an informed choice to receive placebos if they (1) believe that placebos are effective/good for them and value these effects (attitudes), (2) believe that people whose opinion they value would approve of placebos (subjective norms), and (3) believe that they control whether or not they receive placebos (perceived behavioral control). While we did not want to encourage people to decide to receive placebos (except in the context of an informed choice), we did want to provide information that was consistent with people’s existing cognitive structures. Therefore, we designed the website to address the following: consequences of receiving placebos for the individual (attitudes), other people’s views on placebos (subjective norms), and practicalities around receiving placebos (perceived behavioral control).

    Typical Beliefs About Placebos

    To understand typical beliefs about placebos we reviewed qualitative studies of patients’ experiences of placebos in clinical trials. This literature showed that people are interested in but often anxious about or confused by placebos [35,36]. For example, in qualitative studies embedded in acupuncture trials patients described interest or anxiety as to whether they receive placebo or real treatment [37], and the knowledge that they may receive placebo made them doubt any perceived improvements in symptoms [12,13]. Patients conceptualize placebos and their effects in various ways, dominant among which are understandings of placebos: as fake treatments that fool people into thinking they are better; as tools that are necessary for scientific research; and as interventions that have real effects mediated by psychological mechanisms [11]. Patients’ reactions to being told they had been in the placebo arm of one clinical trial included surprise and disbelief. Some worried that they would ‘throw the trial off’ and interpreted their experiences in a way that affirmed their understanding of their illness or emphasized the positive effect of social support from trial staff [15].

    Based on these findings, we devised website content to describe the possible (positive and negative) effects and experiences of placebo (‘can it help?’, ‘what is it like?’). The website also addresses common concerns about placebos (‘what concerns me’), debunks myths that placebo responders are malingerers or gullible (‘who does it help?’), and explains the mechanisms underpinning placebo effects (‘how could it work?’).

    Scientific Understanding of Placebo Effects

    To ensure scientific accuracy we consulted systematic and narrative reviews and seminal studies concerning the effects and mechanisms of action of placebos [4,6,7,24]. We selected key evidence-based facts about placebo effects to convey in the website including: placebos can relieve pain and stiffness in osteoarthritis [27]; placebos can improve reported pain across a number of painful conditions [25]; and placebos can elicit side effects in what is called a ‘nocebo’ effect [38] (ie, the negative aspect of the placebo effect that occurs when an adverse event, such as experiencing side effects, is triggered by negative expectations [39]). The website also conveyed that it is difficult to know how many people placebos will work for, but they seem to improve pain for between 26% and 51% of people in placebo studies [6].

    The mechanisms of action of placebos have been described in neurobiological, psychological, and anthropological terms. Patients also appear to develop understandings of placebo effects at different levels, with some focusing on psychological processes and others emphasizing social processes [11,15]. To accurately represent the scientific literature and appeal to different patients, we therefore chose to convey a number of different theories of placebo effects, specifically neurobiological pathways [40], expectancy [41], conditioning [42], meaning response [43], and the therapeutic relationship [44].

    We also drew on scientific literature when developing material on other aspects of placebos outlined in the previous section. For example, in addressing concerns that doctors have to lie to patients to give them placebos, we drew on evidence about open-label placebo prescribing, suggesting that doctors do not have to lie to patients to elicit placebo effects [5].

    Effective Information Provision

    To plan how to provide information effectively to educate people about placebos and thus improve their knowledge, we considered a selection of relevant theories. In particular, we drew on theories of motivation, learning, and attitude formation.

    We drew on Self-Determination Theory [45] to plan how to design our website so that it would be maximally engaging for people. Self-Determination Theory distinguishes between intrinsic motivation (eg, curiosity) and extrinsic motivation (eg, payment) as drivers for action; our website relies on intrinsic motivation as we do not anticipate eventual users to receive external rewards for using it. Cognitive Evaluation Theory (1 of 6 ‘mini-theories’ within Self-Determination Theory) elaborates on how social contexts can impact on intrinsic motivation, and suggests that intrinsic motivation can be enhanced by satisfying basic human needs of competence and autonomy [45]. Thus, if the website supports people’s perceptions of themselves as competent and autonomous it should enhance intrinsic motivation and be more engaging. To promote perceptions of competence, we designed easy quizzes (using the word ‘surprise’ rather than ‘wrong’ to give feedback on incorrect answers) and used simple and consistent navigation. To promote perceptions of autonomy, we allowed users as much freedom of choice as possible, for example in terms of the order in which to view different pages.

    Educational theory suggests that people have different learning styles [46]; therefore, we decided to provide information in different formats: written text, photographs and images, audio clips, and film. We used quizzes to engage readers in active learning [47] and to test readers’ knowledge (tests are an effective means of improving learning [48]). We also considered to whom to attribute different sources of information. According to Social Learning Theory, when we identify with another person (a ‘model’) and perceive them to be competent and similar to us, we may learn from observing them [49-51]. Therefore, we decided to use actors to narrate first-person accounts of patients’ experiences of taking placebos, and to choose actors of various ages, genders, and ethnicities. We drew on qualitative studies of real patients’ experiences in clinical trials to develop the first-person accounts [11-13,15].

    While our focus was on educating people by providing accurate information about placebos, attitude formation and change processes might also occur in response to information provision. According to leading theories of attitude change, there are both central and peripheral routes to attitude formation and change [52]. Central routes are well-described by the Elaboration Likelihood Model and entail highly-motivated individuals engaging in an effortful way with substantive messages, assessing new information in relation to previously held beliefs, and coming to a reasoned conclusion [53]. Peripheral routes, as described by the Heuristic Systematic Model of persuasion, entail the use of simple heuristics or ‘rules of thumb’ based on superficial cues such as source credibility and number of arguments presented [54,55]. To encourage the development of more informed attitudes toward placebo effects, we described scientific evidence to support our substantive message that placebos can have effects, presented multiple scientific theories about how placebos produce effects, and bolstered the credibility of the message source by describing the website and study authors’ academic credentials.

    We followed guidance for developing patient-focused health information by considering five key issues: information needs, accessibility, quality, readability and comprehensibility, and usefulness [56]. To ensure we addressed different needs for information, we allowed readers a choice about whether to access basic or more complex information. In other words, we used simple text to convey basic information about a topic (based on the literature), then offered a click-through to a more detailed evidence summary describing a specific study or review, and then offered another click-through to access the actual scientific paper. To provide access to scientific evidence we wrote accurate text, evidence summaries, and in some cases, provided full papers. We considered color blindness and dyslexia in our choice of colors and formatting; for example, using clear, plain text and consistent formatting throughout. We also ordered the items on the pages to make them more accessible for people using text-reader software. To ensure we provided high-quality information we used peer-reviewed publications and reviews. To enhance readability we wrote in short sentences with simple sentence construction and used readability indices to guide our writing. To enhance usefulness, we provided information on relevant topics (according to the literature on patients’ views of placebos), included patient representatives in the research team, and conducted a think aloud study to elicit users’ feedback.

    Designing and Building the Intervention

    We used the insights gained during the planning phase to write the content and map out the initial structure of our website using PowerPoint slides. Content was based on published evidence, as described above. To ensure content was relevant to our primary targets for change (knowledge, informed choice) and mapped onto existing cognitive structures (attitudes, subjective norms, perceived behavioral control), we reviewed each draft page for relevance to these targets and structures. We then built the website using LifeGuide open source software to facilitate the design and scientific testing of Web-based behavior change interventions [57].

    Audio clips were produced for first-person narratives about the phenomenology of placebo effects. A film was scripted and produced to illustrate a placebo effect in an experimental context (using a cold pressor task) and to describe the effects and mechanisms of action of placebos. As a visual medium that lends itself well to linear narrative, film provides an unrivalled, vivid view of the world and may capture events, people, and performances with detail and richness. Koumi [58] suggested a number of considerations for writing instructional film scripts including: the ‘hook’ (an element which captures viewers’ attention), asking questions, synergy between image and narration, clarity of argument, audio/visual cues to denote changes, and argument consolidation. The film we produced integrated these steps through the use of animated infographic, live action, interview, and narration to reinforce key messages. While there is no hard-and-fast rule as to how many messages a video can contain, studies show that people can store approximately four discrete ‘chunks’ of information in short-term memory [59], and some writers advise that a 30-minute video can comfortably elucidate three essential points in some detail. As the placebo video has a running time of 4 minutes 20 seconds, the script was written to focus on two key points: that placebos have significant, measurable, positive effects on health, and that these effects are present in conventional treatments.

    Korakidou and Charitos [60] asserted that film involves viewers on an emotional as well perceptual level, employing empathy to facilitate engagement and retention. In addition, in productions that include the spoken word it is believed that viewers prefer and empathize more readily with conversational language that is easily understood [61]. To facilitate this, the video used live action sequences to encourage viewers to imagine themselves in similar situations, and simple, jargon free narration to ease comprehension and reduce cognitive load.

    Think Aloud Study

    A small qualitative study during this phase informed the final content and structure of the website. Ethical approval was obtained from the host institution (reference: ergo id 10933) and all participants gave written informed consent. Posters and Web-based advertisements were used to recruit 10 participants from the host institution (9 female, a mix of staff and students, aged 19-35 years, 4 with musculoskeletal pain). They worked through the website in the presence of the researcher, speaking aloud their thoughts and answering specific, probing questions (eg, “what do you think this page is about?”, “What did you think about navigating through the site?”). The mean interview duration was 32 minutes (range, 22-40) and interviews were audio-recorded. Interviewees’ comments were reviewed and coded according to the topic to which they referred using deductively derived codes based on aspects of the website (eg, “placebos in clinical practice”, “patients’ stories”) and inductively derived codes for comments that did not relate directly to specific contents (eg, “technical terms”). Comments were further categorized as primarily related to content, style, or navigation. Two researchers were involved in interpreting interviewees’ comments, which avoided an idiosyncratic focus on particular issues and enabled discussion of which comments to prioritize when deciding on modifications to the website (eg, in cases where interviewees provided divergent and/or conflicting perspectives). Interviews proceeded iteratively, with early interviews being analyzed first and used to inform changes to the website that were then presented in later interviews.


    Comments from participants in the think aloud study highlighted aspects of the website that participants felt were engaging as well as occasional misunderstandings and stylistic and structural features that were off-putting and/or confusing, and thus needed improving. Elements of content, style, and navigation were therefore modified to improve participants’ experiences of using the website. Table 1 presents selected quotes from participants, illustrating how their perspectives were used to inform website modifications. Content changes included: elaborating on ‘mind-body healing processes’ as participants found this vague and wanted more information about how placebo effects might work; adding reassurance that pain is still real even if it reduces with placebo; adding specific details and evidence from scientific papers about how many doctors use placebos; and adding an example to address participants’ concerns about how doctors can justify using placebos clinically: “For example, sometimes doctors may listen to a patient's chest, even when it is not essential for making a medical diagnosis, because it can be reassuring for the patient.” Stylistic changes included: choosing photos (for patient’s stories) that look more realistic as participants felt some looked like stock photos, and thus lacked authenticity; ensuring alignment and consistent logo placement throughout as participants noticed minor misalignments and saw them as unprofessional, reducing the credibility of the website; and modifying patients’ stories to always use convincing lay language, and thus avoid the off-putting impression of advertising. Navigation changes included: adding a menu bar to all pages to make each page accessible from any other page, and page buttons changing color once viewed.

    Table 1. Illustrative Quotes from Participants Used to Refine the Website
    View this table

    The final structure and main content of the website is shown in Figure 2. Nine topics are covered across 10 main pages (the last page offering a summary of key facts), which can be accessed in any order. Text and images are supplemented by scientific evidence summaries (on 4 pages), audio clips with photos and transcripts of patients’ experiences (on 4 pages), a film, and 2 quizzes (with immediate feedback). Figure 3 shows one page (“Can a placebo help with my pain”), annotated with key features that illustrate the contribution of evidence-, theory-, and person-based approaches.

    Figure 2. Overview of structure and contents of website.
    View this figure
    Figure 3. Example page annotated to highlight key features and their development from evidence-, theory-, and person-based approaches.
    View this figure



    We have developed a new website about placebos that conveys scientifically accurate information in a way that should engage members of the public and enable them to make informed choices about placebos. The development process drew on evidence about placebo effects, theory about education, attitudes and motivation, and qualitative research to maximize the website’s likely effects.

    Strengths and Limitations

    Strengths of this project include the multidisciplinary team and the combination of evidence-, theory-, and person-based approaches [28-30]. Team members shared expertise in topics, including placebo effects, digital interventions, film, and chronic pain, and contributed diverse professional perspectives (eg, psychology, general practice, physiotherapy, acupuncture). Two team members were patient representatives whose input helped ensure our website addressed important issues in an accessible and nonpatronizing manner. By drawing on a combination of approaches we were able to incorporate evidence, theory, and users’ perspectives in a flexible manner throughout the intervention development process.

    The main limitation of the study was the homogeneous sample of participants. Involving a more diverse sample of patients in our think aloud study would have allowed us to better gauge the comprehensibility of the website among members of our target audience, adults with experience of pain symptoms. The same issues were raised repeatedly across the 10 interviews, suggesting additional interviews would have produced diminishing returns for additional cost. However, additional interviews with people with other characteristics (eg, more severe chronic pain conditions) might have elicited novel comments. While participants’ views on the format and structure of the website were vital for improving its usability, these issues may have been particularly pertinent for our sample because, from their comments, they appeared to be experienced Internet users with a good baseline understanding of placebo effects. A more diverse sample might have uncovered additional issues and/or misunderstandings about placebos and placebo effects. Future think aloud studies for website development would benefit from sampling diverse participants from the population of likely end-users and finding ways to encourage them to focus on the substance of the website as well as its style and structure. The full person-based approach includes guidance on how to achieve this to ensure qualitative research goes beyond user-testing to focus on participants’ perspectives on substantive issues [30].


    Using our website to inform potential clinical trial participants about placebos could have both beneficial and detrimental consequences. For example, it might improve the validity of informed consent [3], alleviate anxiety about placebos, ease the process of unblinding to placebo allocation at the end of trials [15,16], reduce adverse effects [62], and/or enhance recruitment [14]. However, increasing patients’ expectations of benefit during trials by encouraging positive beliefs about placebos might increase the size of the placebo effect [63,64]. This could introduce bias [65] particularly if placebo and intervention effects are not additive [66] and/or could reduce estimated treatment effects [11]. It is therefore vital to test the effects of providing comprehensive information about placebos before changing research practice. To contribute to this much-needed evidence base, we will report separately a randomized experiment testing the effects of our new website on knowledge and informed choice about placebos.


    In conclusion, we have developed an evidence-based website that incorporates theory-based techniques to inform members of the public about placebos and placebo effects. Before using the website in clinical trials it is necessary to test its effects on key outcomes, including patients’ knowledge and capacity for making informed choices about placebos.


    This project was funded by a grant from Arthritis Research UK (grant reference 20113). The funder had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

    The authors would like to thank the participants who took part in the think aloud study, Christine Bagg (patient representative) who contributed to study design and helped review the website, the student volunteers who helped to test the website, and Dr Jin Zhang and the core LifeGuide team who provided technical support for programming the webpage.

    Conflicts of Interest

    None declared.


    1. Medicines and Healthcare Products Regulatory Agency (MHRA). Good Clinical Practice Guide. Norwich: The Stationery Office; 2012.
    2. World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA 2013;310:2191-2194. [CrossRef] [Medline]
    3. Bishop FL, Adams AEM, Kaptchuk TJ, Lewith GT. Informed consent and placebo effects: a content analysis of information leaflets to identify what clinical trial participants are told about placebos. PLoS One 2012;7:e39661 [FREE Full text] [CrossRef] [Medline]
    4. Finniss DG, Kaptchuk TJ, Miller F, Benedetti F. Biological, clinical, and ethical advances of placebo effects. Lancet 2010;375:686-695 [FREE Full text] [CrossRef] [Medline]
    5. Kaptchuk TJ, Friedlander E, Kelley JM, Sanchez MN, Kokkotou E, Singer JP, et al. Placebos without deception: a randomized controlled trial in irritable bowel syndrome. PLoS One 2010;5:e15591 [FREE Full text] [CrossRef] [Medline]
    6. Price DD, Finniss DG, Benedetti F. A comprehensive review of the placebo effect: recent advances and current thought. Annu Rev Psychol 2008;59:565-590. [CrossRef] [Medline]
    7. Benedetti F, Amanzio M. The placebo response: how words and rituals change the patient's brain. Patient Educ Couns 2011;84:413-419. [CrossRef] [Medline]
    8. Huston P. What does the public think of placebo use? The Canadian experience. Sci Eng Ethics 2004;10:103-117. [Medline]
    9. Pope JE, Tingey DP, Arnold JMO, Hong P, Ouimet JM, Krizova A. Are subjects satisfied with the informed consent process? A survey of research participants. J Rheumatol 2003;30:815-824. [Medline]
    10. Criscione LG, Sugarman J, Sanders L, Pisetsky DS, St Clair EW. Informed consent in a clinical trial of a novel treatment for rheumatoid arthritis. Arthritis Rheum 2003;49:361-367 [FREE Full text] [CrossRef] [Medline]
    11. Bishop FL, Jacobson EE, Shaw JR, Kaptchuk TJ. Scientific tools, fake treatments, or triggers for psychological healing: how clinical trial participants conceptualise placebos. Soc Sci Med 2012;74:767-774 [FREE Full text] [CrossRef] [Medline]
    12. Kaptchuk TJ, Shaw J, Kerr CE, Conboy LA, Kelley JM, Csordas TJ, et al. “Maybe I made up the whole thing”: placebos and patients' experiences in a randomized controlled trial. Cult Med Psychiatry 2009;33:382-411 [FREE Full text] [CrossRef] [Medline]
    13. White P, Bishop FL, Prescott P, Scott C, Little P, Lewith G. Practice, practitioner, or placebo? A multifactorial, mixed-methods randomized controlled trial of acupuncture. Pain 2012;153:455-462. [CrossRef] [Medline]
    14. Welton AJ, Vickers MR, Cooper JA, Meade TW, Marteau TM. Is recruitment more difficult with a placebo arm in randomised controlled trials? A quasirandomised, interview based study. BMJ 1999;318:1114-1117 [FREE Full text] [Medline]
    15. Bishop FL, Jacobson EE, Shaw J, Kaptchuk TJ. Participants' experiences of being debriefed to placebo allocation in a clinical trial. Qual Health Res 2012;22:1138-1149 [FREE Full text] [CrossRef] [Medline]
    16. Di BZ, Crawford F, Bradley C, Kleijnen J. Reactions to treatment debriefing among the participants of a placebo controlled trial. BMC Health Serv Res 2005;5:30 [FREE Full text] [CrossRef] [Medline]
    17. Moreland J, French TL, Cumming GP. The prevalence of online health information seeking among patients in Scotland: a cross-sectional exploratory study. JMIR Res Protoc 2015;4:e85 [FREE Full text] [CrossRef] [Medline]
    18. Powell J, Inglis N, Ronnie J, Large S. The characteristics and motivations of online health information seekers: cross-sectional survey and qualitative interview study. J Med Internet Res 2011;13:e20 [FREE Full text] [CrossRef] [Medline]
    19. Santana S, Lausen B, Bujnowska-Fedak M, Chronaki CE, Prokosch H, Wynn R. Informed citizen and empowered citizen in health: results from an European survey. BMC Fam Pract 2011;12:20 [FREE Full text] [CrossRef] [Medline]
    20. Atkinson NL, Saperstein SL, Pleis J. Using the internet for health-related activities: findings from a national probability sample. J Med Internet Res 2009;11:e4 [FREE Full text] [CrossRef] [Medline]
    21. Cline RJ, Haynes KM. Consumer health information seeking on the Internet: the state of the art. Health Educ Res 2001;16:671-692 [FREE Full text] [Medline]
    22. Cook DA, Dupras DM. A practical guide to developing effective web-based learning. J Gen Intern Med 2004;19:698-707 [FREE Full text] [CrossRef] [Medline]
    23. Office for National Statistics. Statistical Bulletin: Internet Access - Households and Individuals. 2015.   URL: http:/​/www.​​peoplepopulationandcommunity/​householdcharacteristics/​homeinternetandsocialmediausage/​bulletins/​internetaccesshouseholdsandindividuals/​2015-08-06 [accessed 2015-03-15] [WebCite Cache]
    24. Benedetti F. Mechanisms of placebo and placebo-related effects across diseases and treatments. Annu Rev Pharmacol Toxicol 2008;48:33-60. [CrossRef] [Medline]
    25. Hróbjartsson A, Gøtzsche PC. Placebo interventions for all clinical conditions. Cochrane Database Syst Rev 2010;1:CD003974. [CrossRef] [Medline]
    26. Mistiaen P, van OM, van VL, Howick J, Bishop FL, Di BZ, et al. The effect of patient-practitioner communication on pain: a systematic review. Eur J Pain 2015;20:675-688. [CrossRef] [Medline]
    27. Zhang W, Robertson J, Jones AC, Dieppe PA, Doherty M. The placebo effect and its determinants in osteoarthritis: meta-analysis of randomised controlled trials. Ann Rheum Dis 2008;67:1716-1723. [CrossRef] [Medline]
    28. Michie S, Abraham C. Interventions to change health behaviours: evidence-based or evidence-inspired? Psychol Health 2004;19:29-49. [CrossRef]
    29. Michie S, Johnston M. Theories and techniques of behaviour change: developing a cumulative science of behaviour change. Health Psychology Review 2012;6:1-6. [CrossRef]
    30. Yardley L, Morrison L, Bradbury K, Muller I. The person-based approach to intervention development: application to digital health-related behavior change interventions. J Med Internet Res 2015;17:e30. [CrossRef] [Medline]
    31. Marteau TM, Dormandy E, Michie S. A measure of informed choice. Health Expect 2001;4:99-108. [Medline]
    32. Dormandy E, Hooper R, Michie S, Marteau TM. Informed choice to undergo prenatal screening: a comparison of two hospitals conducting testing either as part of a routine visit or requiring a separate visit. J Med Screen 2002;9:109-114. [CrossRef]
    33. Michie S, Dormandy E, Marteau TM. The multi-dimensional measure of informed choice: a validation study. Patient Educ Couns 2002;48:87-91. [Medline]
    34. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process 1991 Dec;50:179-211. [CrossRef]
    35. Ellis PM, Butow PN. Focus group interviews examining attitudes to randomised trials among breast cancer patients and the general community. Aust N Z J Public Health 1998;22:528-531. [Medline]
    36. Asai A, Ohnishi M, Nishigaki E, Sekimoto M, Fukuhara S, Fukui T. Focus group interviews examining attitudes towards medical research among the Japanese: a qualitative study. Bioethics 2004;18:448-470. [CrossRef]
    37. Barlow F, Scott C, Coghlan B, Lee P, White P, Lewith GT, et al. How the psychosocial context of clinical trials differs from usual care: a qualitative study of acupuncture patients. BMC Med Res Methodol 2011;11:79 [FREE Full text] [CrossRef] [Medline]
    38. Amanzio M, Corazzini LL, Vase L, Benedetti F. A systematic review of adverse events in placebo groups of anti-migraine clinical trials. Pain 2009;146:261-269. [CrossRef] [Medline]
    39. Colloca L, Finniss D. Nocebo effects, patient-clinician communication, and therapeutic outcomes. JAMA 2012;307:567-568. [CrossRef] [Medline]
    40. Benedetti F, Mayberg HS, Wager TD, Stohler CS, Zubieta J. Neurobiological mechanisms of the placebo effect. J Neurosci 2005;25:10390-10402 [FREE Full text] [CrossRef] [Medline]
    41. Kirsch I. Response expectancy theory and application: a decennial review. Appl Prev Psychol 1997;6:69-79. [CrossRef]
    42. Colloca L, Tinazzi M, Recchia S, Le Pera D, Fiaschi A, Benedetti F, et al. Learning potentiates neurophysiological and behavioral placebo analgesic responses. Pain 2008;139:306-314. [CrossRef] [Medline]
    43. Moerman DE, Jonas WB. Deconstructing the placebo effect and finding the meaning response. Ann Intern Med 2002;136:471-476. [Medline]
    44. Kaptchuk TJ, Kelley JM, Conboy LA, Davis RB, Kerr CE, Jacobson EE, et al. Components of placebo effect: randomised controlled trial in patients with irritable bowel syndrome. BMJ 2008;336:999-1003 [FREE Full text] [CrossRef] [Medline]
    45. Ryan RM, Deci EL. An overview of self-determination theory. In: Deci EL, Ryan RM, editors. The Handbook of Self-Determination Research. Rochester, NY: University of Rochester Press; 2002:3-33.
    46. Biggs J, Tang C. Teaching for Quality Learning at University (Society for Research Into Higher Education). Maidenhead: Open University Press; 2011.
    47. Prince M. Does active learning work? A review of the research. J Eng Educ 2004;93:223-231. [CrossRef]
    48. Roediger HL, Karpicke JD. Test-enhanced learning: taking memory tests improves long-term retention. Psychol Sci 2006;17:249-255. [CrossRef] [Medline]
    49. Bandura A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs: Prentice-Hall; 1986.
    50. Schunk DH. Vicarious influences on self-efficacy for cognitive skill learning. J Soc Clin Psychol 1986;4:316-327. [CrossRef]
    51. Schunk DH. Peer models and children's behavioral change. Rev Educ Res 1987;57:149-174. [CrossRef]
    52. Gilbert DT, Fiske ST, Lindzey G. Attitude change: multiple roles for persuasion variables. In: The Handbook of Social Psychology. Boston: McGraw-Hill; 1998:323-390.
    53. Petty R, Cacioppo J. Communication and persuasion: central and peripheral routes to attitude change. New York: Springer-Verlag; 1986.
    54. Chaiken S. Heuristic versus systematic information processing and the use of source versus message cues in persuasion. J Pers Soc Psychol 1980;39:752-766. [CrossRef]
    55. Chaiken S. The heuristic model of persuasion. In: Zanna MP, Olson JM, Herman CP, editors. Social influence: The Ontario Symposium. Hillsdale, NJ: Erlbaum; 1987:3-39.
    56. Coulter A, Ellins J. Patient-Focused Interventions: A Review of the Evidence. London: The Health Foundation; 2006.
    57. Williams S, Yardley L, Wills GB. A qualitative case study of LifeGuide: users' experiences of software for developing Internet-based behaviour change interventions. Health Informatics J 2013;19:61-75. [CrossRef] [Medline]
    58. Kuomi J. Guidelines for Pedagogic Video Production. 2010.   URL: [accessed 2016-02-09] [WebCite Cache]
    59. Cowan N. The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav Brain Sci 2001;24:87-114; discussion 114. [Medline]
    60. Korakidou V, Charitos D. Creating and perceiving abstract animation. 2006 Presented at: The 8th Conference on on “Consciousness Reframed: Αrt & Consciousness in the Post-Biological Era”; 21-23 July 2006; Planetary Collegium, University of Plymouth.
    61. Allen J. The BBC News Styleguide. London: BBC; 2003.   URL: [accessed 2016-02-09] [WebCite Cache]
    62. Loftus EF, Fries JF. The potential perils of informed consent. Mcgill J Med 2008;11:217-218 [FREE Full text] [Medline]
    63. Diener HC, Dowson AJ, Ferrari M, Nappi G, Tfelt-Hansen P. Unbalanced randomization influences placebo response: scientific versus ethical issues around the use of placebo in migraine trials. Cephalalgia 1999;19:699-700. [Medline]
    64. Kirsch I, Weixel LJ. Double-blind versus deceptive administration of a placebo. Behav Neurosci 1988;102:319-323. [Medline]
    65. Kaptchuk TJ. The double-blind, randomized, placebo-controlled trial: gold standard or golden calf? J Clin Epidemiol 2001;54:541-549. [Medline]
    66. Paterson C, Dieppe P. Characteristic and incidental (placebo) effects in complex interventions such as acupuncture. BMJ 2005;330:1202-1205 [FREE Full text] [CrossRef] [Medline]

    Edited by G Eysenbach; submitted 09.02.16; peer-reviewed by J Hughes, Q Wang; comments to author 10.03.16; revised version received 23.03.16; accepted 30.03.16; published 10.06.16

    ©Maddy Greville-Harris, Jennifer Bostock, Amy Din, Cynthia A. Graham, George Lewith, Christina Liossi, Tim O’Riordan, Peter White, Lucy Yardley, Felicity L. Bishop. Originally published in JMIR Research Protocols (, 10.06.2016.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.