Published on 22.07.16 in Vol 5, No 3 (2016): Jul-Sept
Targeted Facebook Advertising is a Novel and Effective Method of Recruiting Participants into a Human Papillomavirus Vaccine Effectiveness Study
Background: Targeted advertising using social networking sites (SNS) as a recruitment strategy in health research is in its infancy.
Objective: The aim of this study was to determine the feasibility of targeted Facebook advertisements to increase recruitment of unvaccinated women into a human papillomavirus (HPV) vaccine effectiveness study.
Methods: Between September 2011 and November 2013, females aged 18 to 25 years, residing in Victoria, Australia, were recruited through Facebook advertisements relating to general women’s health. From November 2013 to June 2015, targeted advertising campaigns were implemented to specifically recruit women who had not received the HPV vaccine. Consenting participants were invited to complete an online questionnaire and those who had ever had sexual intercourse were asked to provide a self-collected vaginal swab. The HPV vaccination status of participants was confirmed from the National HPV Vaccination Program Register (NHVPR).
Results: The campaign comprised 10 advertisements shown between September 2011 and June 2015 which generated 55,381,637 impressions, yielding 23,714 clicks, at an overall cost of AUD $22,078.85. A total of 919 participants were recruited. A greater proportion of unvaccinated women (50.4%, 131/260) were recruited into the study following targeted advertising, compared with those recruited (19.3%, 127/659) prior to showing the modified advertisement (P<.001). A greater proportion of the total sample completed tertiary education and resided in inner regional Victoria, compared with National population census data (P<.001), but was otherwise representative of the general population.
Conclusions: Targeted Facebook advertising is a rapid and cost-effective way of recruiting young unvaccinated women into a HPV vaccine effectiveness study.
JMIR Res Protoc 2016;5(3):e154
Crowdfunding campaign to support this specific research
We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.
Suggested contribution levels: $20/$50/$100
Human papillomavirus (HPV) is the most common sexually transmitted viral infection worldwide. Approximately 80% of sexually active individuals will acquire an HPV infection during their lifetime; most within a few years following sexual debut . Persistent infection with high-risk or oncogenic HPV genotypes, particularly HPV 16 or 18 is a prerequisite to cervical cancer [ ].
In 2007, Australia was the first country to implement a national government-funded HPV vaccination program using the quadrivalent HPV (6, 11, 16, and 18) vaccine Gardasil (4vHPV) [- ]. The vaccine is available free-of-charge to 12 to 13 year old girls as an ongoing program and had a catch-up component for up to 26 year olds to December 2009, with vaccinations administered through schools, general practices and other community health services. Since the initiation of the program, the National HPV Vaccination Program Register (NHVPR) has documented high vaccine uptake, with coverage rates of approximately 85% of females aged 15 having received at least 1 dose, and 77% having completed the 3 dose course in 2015 [ ].
Although Internet social networking sites (SNS) have been in use for over a decade, the concept of targeted advertising as a recruitment strategy in health research is still in its infancy. Approximately 93% of Australians use Facebook, including 97% of 18 to 29 year olds . Of those aged 18 to 29, 79% of females use Facebook at least daily [ ]. The increasing pervasiveness and utility of social media as powerful communication channels means that SNS, such as Facebook, can potentially be used to effectively engage young people in health studies. There is evidence to show that Internet-based research can yield high response rates at a considerably lesser cost than that accrued by traditional recruitment methods [ - ]. In addition, findings from pilot studies demonstrate that Facebook advertising is a feasible recruitment strategy for health studies and yields a broadly representative sample of a target population [ , - ]. In one particular study, investigators looked at geographic variation in HPV vaccine uptake in men and women using targeted Facebook advertisements to recruit residents in Minnesota [ ]. However, this has only just been utilized as a methodology in Australia in the Vaccine Against Cervical Cancer Impact and Effectiveness (VACCINE) study [ ].
The VACCINE study is a cross-sectional survey in which Facebook was used to recruit participants . The objective of this study was to investigate the changes in prevalence of vaccine-targeted HPV genotypes in a cohort of 4vHPV vaccine-eligible young women aged 18 to 25 years living in Victoria, Australia. Within the recruitment strategy we also modified the initial Facebook advertising campaign to specifically target and over-recruit unvaccinated women, to better understand why a free vaccine was not being embraced. We hypothesized that targeted advertising through Facebook enables faster and more efficient recruitment of vaccine-eligible women who have not yet received the HPV vaccine compared with non-targeted advertising.
The methods for this study have been published previously . The study protocol was approved by the Human Research and Ethics Committee at the Royal Women’s Hospital, Melbourne, Australia.
Participant Recruitment and Inclusion Criteria
Participants were recruited through advertisements published on Facebook. From September 2011 to November 2013, advertisements were set to randomly appear to Facebook users who were (1) female; (2) between the ages of 18 and 25 years; and (3) residing in Victoria, Australia.
The advertisements contained a brief headline (eg, “Women’s Health Matters”), a generic picture of young women and a brief caption (). The advertisements were subsequently modified by changing the text to target women who had not received the 4vHPV vaccine, and made visible to Facebook users from November 22, 2013 to June 2015 ( ). The decision to modify these advertisements arose mid-way through the study as we wished to understand the determinants of women eligible for, but not accepting, the HPV vaccine.
Respondents could click through to the secure VACCINE Study website to read more about the study and register an expression of interest (EOI). Potential participants were contacted and screened by telephone to assess their eligibility and willingness to comply with the study requirements.
Participants who verbally consented to the study were invited to provide electronic consent and to complete a self-administered, password-protected questionnaire hosted by the online survey tool SurveyMonkey. The survey questions related to demographic characteristics, sexual history and knowledge, attitudes and practices regarding HPV, the HPV vaccine, and cervical cancer screening. Participants were also requested to provide their HPV vaccination status and written or electronic consent for their HPV vaccination history to be verified with the NHVPR.
Descriptive statistical analyses were conducted using Stata 13.1 (StatCorp LP, College Station, TX, USA). The demographics of our cohort were compared with general population data sourced from the Australian Bureau of Statistics 2011 census data . Socioeconomic status was assigned using the Postal Area of Relative Socio-Economic Disadvantage 2011 [ ]. The Chi-square test was used for all demographic comparisons between our sample of study and the general population, as well as within study comparisons between females recruited by general advertisements and those recruited by targeted advertisements. A 2-sided P value <.05 was considered statistically significant. Data were treated as missing if a question was skipped or “prefer not to answer” was selected.
Participants who received all 3 doses of the HPV vaccine were considered “vaccinated”; those who had received 1 or 2 doses were considered “under-vaccinated” and women who never received the HPV vaccine were recorded as ”unvaccinated“.
For the duration of the entire campaign (September 2011 to June 2015), 10 advertisements resulted in 55,381,637 impressions, reaching 984,159 people, and yielding 23,714 clicks, at an overall cost of AUD $22,078.85. This translated to an average cost of AUD $24.02 per participant. The general advertisements which were implemented from September 2011 to November 2013, made 35,906,205 impressions, yielding 15,304 clicks, with an overall cost of AUD $15,381,92. The average cost per click was AUD $1.01 with a click-through rate of 0.04% per impression. From November 2013 to June 2015, 19,475,432 impressions were made, yielding 8410 clicks, with an overall cost of AUD $6696.93. The average cost per click was AUD $0.80 .
A total of 919 participants completed the online questionnaire. Among women who were recruited and completed the questionnaire following modification of the advertisements, 50.1% (131/260) were unvaccinated. In contrast, only 19.3% (127/659) of the participants who completed the questionnaire prior to modification of the advertisements had never been vaccinated (P<.001) (). There were no significant differences in socio-demographics of the unvaccinated group recruited prior to targeted advertisements with those recruited post targeting (data not shown).
No significant differences were detected between the general population participating in the VACCINE study to those that were then targeted for not being vaccinated against HPV, except that for the latter group a greater proportion were born outside of Australia (19.1% vs 12.4%, P<.001) ().
|Characteristic||Non targeted advertisement (n=659), na (%)||Targeted advertisement (n=260), na (%)||P valueb|
|Age (years), median (Q1-Q3c)||22 (20-23)||22 (20-24)||.08|
|Major city||510 (77.3)||212 (81.5)||.5|
|Inner regional||127 (19.3)||40 (15.4)|
|Outer regional/remote||21 (3.3)||8 (3.1)|
|Country of birth|
|Australia||574 (87.6)||208 (80.9)||<.001|
|Other||81 (12.4)||52 (19.1)|
|Aboriginal or Torres Strait Islander||5 (0.8)||3 (1.2)||.6|
|Other||654 (99.2)||257 (98.8)|
|Socioeconomic level (SEIFA decile)d|
|1-5||214 (32.6)||75 (29.2)||.3|
|6-10||443 (67.4)||182 (70.8)|
|Highest level of education completede|
|< Year 12||29 (4.4)||14 (5.4)||.7|
|Year 12||257 (39.0)||98 (37.7)|
|> Year 12||365 (55.4)||145 (55.8)|
|Single||237 (36.0)||91 (35.0)||.7|
|Casual relationship||60 (9.1)||30 (11.5)|
|Committed relationship||350 (53.1)||136 (52.3)|
aNumbers may not add up to the total due to missing data.
bChi-square test was used for all demographic comparisons.
cQ1: 25th percentile; Q3: 75th percentile.
dBased on postal area code. Deciles are rankings within Victoria, Australia. The lowest 10% of areas are assigned a decile number of 1 and the highest 10% of areas are given a decile number of 10. Decile 1 is the most disadvantaged relative to the other deciles.
eYear 12 is the final year of high school in the Australian education system.
The age distribution of participants reflected the general population, with the median age being 22 years (Q1 25th percentile to Q3 75th percentile: 20-23) (). Compared with the 2011 census data, more women who enrolled in this study were born in Australia (86 % vs 76%, P<.001) and had completed tertiary education (57% vs 43%, P<.001). Women living in inner regional areas were over-represented (18% vs 16% of the total, P<.001) ( ).
|Demographic||Total study populationa, n (%)||Target populationb, %||P valuec|
|Age group, years|
|Major city||722 (78.6)||80.7||0.1|
|Inner regional||167 (18.2)||16.3||0.001|
|Outer regional/remote||30 (3.3)||3.1||0.6|
|Country of birth|
|Aboriginal or Torres Strait Islander||8 (0.9)||0.9||1.000|
|Completed year 12 or below||398 (43.4)||57.4||<0.001|
|Completed tertiary education||519 (56.6)||42.6|
aNumbers may not add up to 919 due to missing data.
bPopulation data were sourced from the 2011 Australian Bureau of Statistics Census, with figures corrected for non-responses to add up to 100%.
cThe Chi-square test was used for all demographic comparisons.
dYear 12 is the final year of high school in the Australian education system.
Targeted Facebook advertising led to increased recruitment of young women who had not received the HPV vaccine, without employing other recruitment methods. The rationale behind over-recruiting unvaccinated women was to allow us to reliably measure any difference in the prevalence of high-risk HPV between unvaccinated and vaccinated women. We also show that recruiting through Facebook is cost-effective given that the cost per participant in this study was AUD $24.02.
Evidence from previous studies has shown that targeted Facebook advertising is effective in recruiting participants into health research [, , ]. In these studies, recruitment was targeted based on broad demographic characteristics such as gender, age, and location, to maximize generalizability [ , , ]. However, there have been few studies in which Facebook advertising has been used to recruit participants with more specific characteristics [ , ]. For example, young adults who were cigarette users were sought in a study of tobacco and substance use [ , ].To attract their target audience, investigators developed Facebook advertisements which were shown to users whose profile pages contained tobacco- or marijuana-related keywords drawn from their listed interests, activities, job titles as well as the Facebook pages they ”liked“ or groups to which they belonged [ ]. Our study differed slightly from this approach. Instead of using keywords to define the people to whom our advertisements were displayed, we relied primarily on Facebook users to read and respond to the text in our customised advertisements.
Our study sample compared well with the general population in age. The significantly greater proportion of women born outside of Australia recruited via targeted advertisements compared with those recruited through general advertisements is intuitive as overseas students are not eligible for the HPV vaccine. Although young women who were born in Australia and/or had completed tertiary education were over-represented in the total sample; these biases are common in population-based studies [, , ]. This is perhaps because highly-educated people are more likely to be aware of health issues. Therefore, highly-educated people may choose to participate in health research to address their personal health concerns and/or because of altruistic motives such as the desire to contribute to medical knowledge and improving the health of others [ ]. The difference in the distribution of women living in inner regional areas in our study sample was statistically significant but small compared with the general population (2%, P<.001); a larger sample size is required to determine whether this is meaningful.
There is an inherent risk of introducing sampling bias when targeting Facebook advertising for specific characteristics. We found that our sample was reasonably representative of the general population, except for country of birth and education level. Another potential cause of bias associated with this recruitment method is snowball or chain-referral sampling, whereby users exposed to these advertisements share information about the study on their Facebook profile page with their friends, or relatives, who may then submit an EOI. We found that 78% heard about the study from the Facebook advertisements, whereas approximately 17% either read a post on their friend’s Facebook wall or were told by a friend to participate. These 17% referrals were constant pre and post changes to the advertisements. Given the small proportion who submitted an EOI without having seen the Facebook advertisements, we contend that this did not have a significant impact on our results.
We have demonstrated the utility of paid, targeted Facebook advertising as a contemporary and effective recruitment method. The ability to specifically target individuals with particular characteristics by tailoring Facebook advertisements enables researchers to recruit specific groups of individuals of interest into health studies.
This work was supported by grants from the National Health and Medical Research Council (Program Grant #568971) and the Victorian Cancer Agency (TS10_04). We would like to thank the research nurses and staff that helped collect data for the VACCINE study and also to the participants for their time.
Conflicts of Interest
- Moscicki AB. HPV infections in adolescents. Dis Markers 2007;23(4):229-234 [FREE Full text] [Medline]
- Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, et al. Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol 1999 Sep;189(1):12-19. [CrossRef] [Medline]
- Garland SM, Hernandez-Avila M, Wheeler CM, Perez G, Harper DM, Leodolter S, Females United to Unilaterally Reduce Endo/Ectocervical Disease (FUTURE) I Investigators. Quadrivalent vaccine against human papillomavirus to prevent anogenital diseases. N Engl J Med 2007 May 10;356(19):1928-1943. [CrossRef] [Medline]
- FUTURE II Study Group. Quadrivalent vaccine against human papillomavirus to prevent high-grade cervical lesions. N Engl J Med 2007 May 10;356(19):1915-1927. [CrossRef] [Medline]
- Giuliano A, Palefsky JM, Goldstone S, Moreira ED, Penny ME, Aranda C, et al. Efficacy of quadrivalent HPV vaccine against HPV infection and disease in males. N Engl J Med 2011 Feb 3;364(5):401-411 [FREE Full text] [CrossRef] [Medline]
- Palefsky J, Giuliano AR, Goldstone S, Moreira ED, Aranda C, Jessen H, et al. HPV vaccine against anal HPV infection and anal intraepithelial neoplasia. N Engl J Med 2011 Oct 27;365(17):1576-1585. [CrossRef] [Medline]
- National HPV Vaccination Program Register. HPV Vaccination Coverage 2015. 2015 Jun 30. National (Australia) HPV 3 dose vaccination coverage for females turning 15 years of age in 2015 URL: http://www.hpvregister.org.au/research/coverage-data/HPV-Vaccination-Coverage-2015 [accessed 2016-06-20] [WebCite Cache]
- The Digital Industry Association of Australia. Sensis. 2015 May. Sensis social media report May 2015: how Australian people and businesses are using social media URL: https://www.sensis.com.au/assets/PDFdirectory/Sensis_Social_Media_Report_2015.pdf [accessed 2016-06-20] [WebCite Cache]
- Ramo D, Prochaska JJ. Broad reach and targeted recruitment using Facebook for an online survey of young adult substance use. J Med Internet Res 2012;14(1):e28 [FREE Full text] [CrossRef] [Medline]
- Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, et al. Web-based recruiting for health research using a social networking site: an exploratory study. J Med Internet Res 2012;14(1):e20 [FREE Full text] [CrossRef] [Medline]
- Villanti A, Jacobs MA, Zawistowski G, Brookover J, Stanton CA, Graham AL. Impact of baseline assessment modality on enrollment and retention in a Facebook smoking cessation study. J Med Internet Res 2015;17(7):e179 [FREE Full text] [CrossRef] [Medline]
- Partridge SR, Balestracci K, Wong AT, Hebden L, McGeechan K, Denney-Wilson E, et al. Effective strategies to recruit young adults into the TXT2BFiT mHealth randomized controlled trial for weight gain prevention. JMIR Res Protoc 2015;4(2):e66 [FREE Full text] [CrossRef] [Medline]
- Pedrana A, Hellard M, Gold J, Ata N, Chang S, Howard S, et al. Queer as F**k: reaching and engaging gay men in sexual health promotion through social networking sites. J Med Internet Res 2013;15(2):e25 [FREE Full text] [CrossRef] [Medline]
- Jones J, Salazar LF. A review of HIV prevention studies that use social networking sites: implications for recruitment, health promotion campaigns, and efficacy trials. AIDS Behav 2016 Feb 22. [CrossRef] [Medline]
- Lane T, Armin J, Gordon JS. Online recruitment methods for web-based and mobile health studies: a review of the literature. J Med Internet Res 2015;17(7):e183 [FREE Full text] [CrossRef] [Medline]
- Loxton D, Powers J, Anderson AE, Townsend N, Harris ML, Tuckerman R, et al. Online and offline recruitment of young women for a longitudinal health survey: findings from the australian longitudinal study on women's health 1989-95 cohort. J Med Internet Res 2015;17(5):e109 [FREE Full text] [CrossRef] [Medline]
- Khatri C, Chapman SJ, Glasbey J, Kelly M, Nepogodiev D, Bhangu A, STARSurg Committee. Social media and internet driven study recruitment: evaluating a new model for promoting collaborator engagement and participation. PLoS One 2015;10(3):e0118899 [FREE Full text] [CrossRef] [Medline]
- Nelson E, Hughes J, Oakes JM, Pankow JS, Kulasingam SL. Estimation of geographic variation in human papillomavirus vaccine uptake in men and women: an online survey using facebook recruitment. J Med Internet Res 2014;16(9):e198 [FREE Full text] [CrossRef] [Medline]
- Pedersen ER, Helmuth ED, Marshall GN, Schell TL, PunKay M, Kurz J. Using facebook to recruit young adult veterans: online mental health research. JMIR Res Protoc 2015;4(2):e63 [FREE Full text] [CrossRef] [Medline]
- Osborne SL, Tabrizi SN, Brotherton JM, Cornall AM, Wark JD, Wrede CD, et al. Assessing genital human papillomavirus genoprevalence in young Australian women following the introduction of a national vaccination program. Vaccine 2015 Jan 1;33(1):201-208. [CrossRef] [Medline]
- Young EJ, Tabrizi SN, Brotherton JM, Wark JD, Pyman J, Saville M, et al. Measuring effectiveness of the cervical cancer vaccine in an Australian setting (the VACCINE study). BMC Cancer 2013;13:296 [FREE Full text] [CrossRef] [Medline]
- Australian Bureau of Statistics. 2011. Socio-Economic Indexes for Areas (SEIFA) 2011 URL: http://www.abs.gov.au/websitedbs/censushome.nsf/home/seifa2011?opendocument&navpos=260 [accessed 2016-06-20] [WebCite Cache]
- Kapp JM, Peters C, Oliver DP. Research recruitment using Facebook advertising: big potential, big challenges. J Cancer Educ 2013 Mar;28(1):134-137. [CrossRef] [Medline]
- Ahmed N, Jayasinghe Y, Wark JD, Fenner Y, Moore EE, Tabrizi SN, et al. Attitudes to Chlamydia screening elicited using the social networking site Facebook for subject recruitment. Sex Health 2013 Jul;10(3):224-228. [CrossRef] [Medline]
- Richiardi L, Pivetta E, Merletti F. Recruiting study participants through Facebook. Epidemiology 2012 Jan;23(1):175. [CrossRef] [Medline]
- Lord S, Brevard J, Budman S. Connecting to young adults: an online social network survey of beliefs and attitudes associated with prescription opioid misuse among college students. Subst Use Misuse 2011;46(1):66-76 [FREE Full text] [CrossRef] [Medline]
- Ramo D, Thrul J, Chavez K, Delucchi KL, Prochaska JJ. Feasibility and quit rates of the Tobacco Status Project: a Facebook smoking cessation intervention for young adults. J Med Internet Res 2015;17(12):e291 [FREE Full text] [CrossRef] [Medline]
- Curtis B. Social networking and online recruiting for HIV research: ethical challenges. J Empir Res Hum Res Ethics 2014 Feb;9(1):58-70 [FREE Full text] [CrossRef] [Medline]
- Veale HJ, Sacks-Davis R, Weaver ER, Pedrana AE, Stoové MA, Hellard ME. The use of social networking platforms for sexual health promotion: identifying key strategies for successful user engagement. BMC Public Health 2015;15(1):85 [FREE Full text] [CrossRef] [Medline]
|4vHPV: Quadrivalent human papillomavirus vaccine|
|EOI: expression of interest|
|HPV: human papillomavirus|
|NHVPR: National human papillomavirus vaccination program register|
|SNS: social networking sites|
|VACCINE: Vaccine against cervical cancer impact and effectiveness|
Edited by G Eysenbach; submitted 28.02.16; peer-reviewed by S Alley, J Thrul; comments to author 17.03.16; revised version received 07.04.16; accepted 03.07.16; published 22.07.16
©Asvini K Subasinghe, Margaret Nguyen, John D Wark, Sepehr N Tabrizi, Suzanne M Garland. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 22.07.2016.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.