Published on 17.09.14 in Vol 3, No 3 (2014): Jul-Sep
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/3317, first published Feb 11, 2014.
Social Networking Versus Facebook Advertising to Recruit Survey Respondents: A Quasi-Experimental Study
Background: Increasingly, social contact and knowledge of other people’s attitudes and behavior are mediated by online social media such as Facebook. The main research to which this recruitment study pertains investigates the influence of parents on adolescent alcohol consumption. Given the pervasiveness of online social media use, Facebook may be an effective means of recruitment and intervention delivery.
Objective: The objective of the study was to determine the efficacy of study recruitment via social networks versus paid advertising on Facebook.
Methods: We conducted a quasi-experimental sequential trial with response rate as the outcome, and estimates of cost-effectiveness. The target population was parents of 13-17 year old children attending high schools in the Hunter region of New South Wales, Australia. Recruitment occurred via: method (1) social recruitment using Facebook, email-based, social networks, and media coverage followed by method (2) Facebook advertising.
Results: Using a range of online and other social network approaches only: method (1) 74 parents were recruited to complete a survey over eight months, costing AUD58.70 per completed survey. After Facebook advertising: method (2) 204 parents completed the survey over four weeks, costing AUD5.94 per completed survey. Participants were representative of the parents recruited from the region’s schools using standard mail and email.
Conclusions: Facebook advertising is a cost-effective means of recruiting parents, a group difficult to reach by other methods.
JMIR Res Protoc 2014;3(3):e48
Crowdfunding campaign to support this specific research
We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.
Suggested contribution levels: $20/$50/$100
Social Media and Research
Increasingly, online social media and social network sites mediate social contact and perceptions of other people’s attitudes and behavior. There are 728 million people worldwide that use Facebook at least daily . A recent review confirms Facebook’s potential for the study of human behavior [ ].
Several recent studies report Facebook as a cost effective and expedient method for recruitment [- ], though not all enjoy success [ ]. Successful approaches vary from Facebook network media and advertising alone to advertising through several search engines and websites. While Facebook advertising is widely used for marketing, and is recommended by some researchers [ - ], it is unclear whether this approach is more effective than other online or traditional approaches for securing participation in online surveys or forums. No randomized trials have investigated the effectiveness of recruitment through Facebook relative to other approaches.
The Current Research
We are interested in investigating the role of parents in influencing adolescents’ alcohol consumption. Engaging parents has historically been a challenge for educators, public health practitioners, and researchers, with low response rates and high attrition plaguing parent- and family-focused interventions . Given the uncommonness of direct connections between parents [ ], the pervasiveness of social media use [ ], and the success of programs that correct misperceptions about others’ drinking [ - ], Facebook may be a useful means of study recruitment and intervention delivery.
This study investigates the efficacy and cost-effectiveness of method (1) social recruitment using Facebook, email-based, social networks, and media coverage relative to method (2) Facebook advertising to recruit parents to complete an online survey. The outcomes are participant numbers, the representativeness of participants, and the recruitment cost per participant.
We conducted a quasi-experimental sequential trial of recruitment methods, with method (1) initiated first, followed by method (2) in the same population of parents. Inferences about effects are based on the number and timing of responses resulting from methods (1) and (2). It is not possible to measure the response fraction associated with approach (1), as the number of people who were exposed to our recruitment efforts cannot be determined.
The target population was parents in the Hunter Region of New South Wales (population 644,300), Australia. Eligibility was limited to parents of adolescents 13-17 years old attending the 59 secondary schools in the region. The demographic characteristics of participants are summarized in.
Each of Facebook’s network media was used to create an active parent network and to invite parents to complete the survey. The “Hunter Parents Alcohol Forum” (HPAF) was a closed group designed to pilot the use of this approach for intervention. A HPAF Facebook page was designed to attract participants, and a profile (“Hunter PAF”) was used for forum discussion and to connect with existing groups and pages. All participants who completed the survey or joined the forum were entered into an iPad prize draw.
Social Network Recruitment and Social Marketing, Method (1)
There were 18 networks likely to include our target population that were identified through Facebook’s search function, and connection was established via “friend request”, “liking”, or “joining”. A private message was sent to the administrator introducing the researchers and the project, and requesting they share the survey and HPAF links among their members. There were three of the networks that posted a description and links to the project on their “wall”, and we indirectly addressed members of other networks through a public posting on their wall.
Invitations to participate and share the links were circulated via email through our own networks of colleagues, friends, and family. The research was featured twice each in a popular regional newspaper and local radio program at morning and evening “drive-times”. An article was featured in a publication with a circulation of 70,000 through regional newspapers. Flyers and recruitment cards were placed in cafes and public places locally, and were disseminated to parents by sporting clubs. There were three clubs that advertised the project in their newsletter. Dr Gilligan spoke at one school’s Parents and Citizens Committee meeting and another school posted information about the study on its website and distributed 1000 flyers to parents in a school-fee mail-out.
Materials distributed as part of this approach included brief notices with Web links and scannable codes, flyers and posters more fully explaining the purpose of the study and what parents were invited to do, and longer written pieces about the background to the larger project and its purpose. The content and images varied for each medium used.
Facebook Advertising, Method (2)
To generate a Facebook advertisement, clients select from a series of options for the purpose of the advertisement and pricing arrangement (cost per click or per metric), provide text and images, stipulate the Facebook demographic parameters, and specify a budget and time frame. Cost per click is automatically calculated to optimize the number of clicks in accordance with a maximum set by the user. We produced an advertisement (shows this advertisement) targeting people in the Hunter region (based on postcode), age ≥ 30 years, and whose Facebook profiles indicated that they were parents of children 13-15 years or 16-19 years old (the most relevant available parameters). The advertisement ran for five weeks, immediately following from intervention (1), including an initial trial and several modifications to the advertising parameters. The maximum budget was AUD350 per week, and a cost per click arrangement was used. To assess the impact of the “parents of children” variable depending on accurate profile information, we ran one weeklong advertisement without this limitation.
Comparative Recruitment Rates and Costs
During the eight month social recruitment phase of the trial, 74 people completed the online survey. The main cost of this approach was in research assistant time (AUD4349 for the eight month period based on 10 hours per week dedicated to recruitment efforts), equating to AUD58.70 per survey completion.
Facebook advertising identified a population of 15,900 individuals meeting our eligibility criteria. In the two weeks of active advertising using parent parameters and the final agreed budget framework, the advertisements generated 259 clicks per week (AUD402 total) and 160 survey completions (AUD2.51 per completion). When the “parents of children variable” was removed in an intervening week, the population size increased to 182,000, but the number of clicks decreased (215 clicks costing AUD344 in total) and survey completions (29 completions at AUD11.90 each) also declined.
In total, AUD1107 was spent on advertising, 840 clicks were generated, and 204 surveys were completed during this period. The cost per completed survey was AUD5.94, including one month of a research assistant wage.
Study Participants and the Parent Population Comparison
presents a comparison (for the purposes of assessing population representativeness) between the study participants and the population of parents recruited from three Hunter schools using more traditional postal and electronic mail techniques in a separate study conducted in the same year (Gilligan et al, 2014 unpublished data).
|Participants in the present study||Hunter schools study|
(N=278), mean (SD)
(N=444), mean (SD)
|Adolescent age||15.44 (1.34)||15.05 (1.43)|
|Parent age||45.02 (6.07)||46.55 (5.49)|
|Parent educationa||2.24 (1.36)||2.26 (1.35)|
|Adolescent gender, % female (n)||53 (148)||42 (187)|
|Parent relationship, % mothers (n)||89 (246)||74 (330)|
|Australian born, % (nb)||92 (187)||94 (301)|
aParent education is calculated as a score based on a 0-5 scale from year 10 school certificate to postgraduate education.
bn for the country of birth variable was 204 for the present study and 320 for the Hunter schools study.
Comparative Effectiveness of Recruitment Methods
Facebook advertising was time-efficient and cost-effective for recruiting parents of 13-17 year olds to participate in our study. While specific costs were not attached to the traditional recruitment methods, the researcher time associated with this phase was substantial. In contrast, the development and dissemination of a Facebook advertisement were fast and straightforward. The cost per respondent AUD5.94 was lower than, or similar to, other studies reporting costs of US $20 , US $4.20 [ ], and AUD12 [ ] per completed survey or registered participant. (Note, in 2013, AUD1 was approximately equal to US $1).
The effect size would be over estimated if approach (1) continued to have effects during the implementation of approach (2), and/or that the combination of approaches (1) and (2) is greater than (2) alone. This is judged unlikely given the small effect size of (1) and the rapidity of the onset of a response after (2) was administered. While we did not utilize the “conversion tracking” feature of Facebook advertising, future studies could directly measure website visits resulting from a Facebook advertisement using this feature, which would be a more specific measure of advertisement success than the number of clicks.
Recruitment of large numbers of participants at low cost is a potentially powerful use of Facebook advertising, but the most appropriate target populations and research topics amenable to this type of recruitment should be considered. While Facebook is pervasive, variation exists by age in terms of member numbers and the extent of engagement.
Different Types of Facebook Users
People 35-54 years old constitute a third of Facebook users , but based on user types defined by Evans et al [ ], this does not equate to the proportion likely to participate in research. Older Facebook users are predominantly categorized as “neutrals” or “gamers”, accounting for 23% and 4% of Facebook users respectively, but with vastly different levels and types of use [ ]. Neutrals have low engagement in terms of time spent on the site and frequency of visits, primarily using it to stay connected and informed about social events. Gamers are the smallest group numerically, but largest in terms of level of use. Evans et al [ ] report that the primary motivation for gamers to engage in groups or link with others is the attainment of extrinsic rewards such as coupons and gaming points. Anecdotal evidence from members of the HPAF suggests that the majority of the parents who engaged in that part of the study were gamers. While neutrals may represent a large proportion of our prospective target population, attracting these users to engage in research and networking is challenging.
Considerations for Recruiting Through Facebook
The study populations generated through Facebook are arguably more socially engaged, educated, and higher income groups than the general population. Several studies, however, report successfully recruiting participants that reflect the demographic spread reported in population surveys and census data [, ]. In our study, the parents who completed the survey had diverse education levels and income, and reflected the population of Hunter schools in terms of demographics and ethnic diversity. In epidemiological analysis, diversity in the exposures of interest is more important than representativeness in estimating associations with outcomes [ ].
An important consideration highlighted by our trial is the trade off between specificity and reach. Many potential participants may not have current or detailed profiles, such that they do not receive targeted advertising. More relaxed parameters increase the likelihood that an advertisement will be viewed by members of the target population, but decrease cost-effectiveness. It is possible that the pattern of response reflects the relationship between the relevance of an advertisement for an individual and their likelihood of responding. We found stricter parameters more economical in terms of the clicks/survey completions trade off.
The restrictive geographic inclusion criteria we used limited our participant numbers. Facebook recruitment approaches may be most appropriate for targeting large geographically and demographically diverse population groups, or for identifying highly targeted groups based on specific inclusion criteria associated with their profile or location.
This study was funded through a grant from the Australian Rechabite Foundation.
Conflicts of Interest
- Socialbakers. Facebook overview statistics. URL: http://www.socialbakers.com/facebook-overview-statistics/ [accessed 2013-12-06] [WebCite Cache]
- Wilson RE, Gosling SD, Graham LT. A review of Facebook research in the social sciences. Perspectives on Psychological Science 2012 May 16;7(3):203-220. [CrossRef]
- Brickman Bhutta C. Not by the book: Facebook as a sampling frame. Sociological Methods & Research 2012 Mar 21;41(1):57-88. [CrossRef]
- Bauermeister JA, Zimmerman MA, Johns MM, Glowacki P, Stoddard S, Volz E. Innovative recruitment using online networks: Lessons learned from an online study of alcohol and other drug use utilizing a web-based, respondent-driven sampling (webRDS) strategy. J Stud Alcohol Drugs 2012 Sep;73(5):834-838 [FREE Full text] [Medline]
- Ramo DE, Prochaska JJ. Broad reach and targeted recruitment using Facebook for an online survey of young adult substance use. J Med Internet Res 2012;14(1):e28 [FREE Full text] [CrossRef] [Medline]
- Morgan AJ, Jorm AF, Mackinnon AJ. Internet-based recruitment to a depression prevention intervention: Lessons from the mood memos study. J Med Internet Res 2013;15(2):e31 [FREE Full text] [CrossRef] [Medline]
- Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, et al. Web-based recruiting for health research using a social networking site: An exploratory study. J Med Internet Res 2012;14(1):e20 [FREE Full text] [CrossRef] [Medline]
- Kapp JM, Peters C, Oliver DP. Research recruitment using Facebook advertising: Big potential, big challenges. J Cancer Educ 2013 Mar;28(1):134-137. [CrossRef] [Medline]
- Foxcroft DR, Tsertsvadze A. Universal family-based prevention programs for alcohol misuse in young people. Cochrane Database Syst Rev 2011(9):CD009308. [CrossRef] [Medline]
- Gilligan C, Toumbourou JW, Kypri K, McElduff P. Factors associated with parental rules for adolescent alcohol use. Subst Use Misuse 2013 Sep 4. [CrossRef] [Medline]
- Kypri K, Langley JD. Perceived social norms and their relation to university student drinking. J Stud Alcohol 2003 Nov;64(6):829-834. [Medline]
- Kypri K, Saunders JB, Gallagher SJ. Acceptability of various brief intervention approaches for hazardous drinking among university students. Alcohol Alcohol 2003;38(6):626-628 [FREE Full text] [Medline]
- Moreira MT, Smith LA, Foxcroft D. Social norms interventions to reduce alcohol misuse in university or college students. Cochrane Database Syst Rev 2009(3):CD006748. [CrossRef] [Medline]
- Evans D, Robertson N, Lively T, Jacobson L, Llamas-Cendon M, Isaza H, et al. The Four Peaks Review. 2012 Jun. Facebook's 8 fundamental hooks and 6 basic user types: A psychographic segmentation URL: http://www.termpaperwarehouse.com/essay-on/Facebook-s-8-Fundamental-Hooks-And-6/190246 [accessed 2014-08-28] [WebCite Cache]
- Kleinbaum DG, Kupper LL, Morgenstern H. Epidemiologic research: Principles and quantitative methods (industrial health & safety). USA: Wiley; 1982.
|HPAF: Hunter Parents Alcohol Forum|
Edited by G Eysenbach; submitted 11.02.14; peer-reviewed by D Ramo, L Ning, Q Li; comments to author 17.07.14; revised version received 30.07.14; accepted 02.08.14; published 17.09.14
©Conor Gilligan, Kypros Kypri, Jesse Bourke. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 17.09.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.