Published on 23.05.18 in Vol 7, No 5 (2018): May
Recruitment and Participation of Recreational Runners in a Large Epidemiological and Genetic Research Study: Retrospective Data Analysis
Background: With the increasing capacity for remote collection of both data and samples for medical research, a thorough assessment is needed to determine the association of population characteristics and recruitment methodologies with response rates.
Objective: The aim of this research was to assess population representativeness in a two-stage study of health and injury in recreational runners, which consisted of an epidemiological arm and genetic analysis.
Methods: The cost and success of various classical and internet-based methods were analyzed, and demographic representativeness was assessed for recruitment to the epidemiological survey, reported willingness to participate in the genetic arm of the study, actual participation, sample return, and approval for biobank storage.
Results: A total of 4965 valid responses were received, of which 1664 were deemed eligible for genetic analysis. Younger age showed a negative association with initial recruitment rate, expressed willingness to participate in genetic analysis, and actual participation. Additionally, female sex was associated with higher initial recruitment rates, and ethnic origin impacted willingness to participate in the genetic analysis (all P<.001).
Conclusions: The sharp decline in retention through the different stages of the study in young respondents suggests the necessity to develop specific recruitment and retention strategies when investigating a young, physically active population.
JMIR Res Protoc 2018;7(5):e141
Crowdfunding campaign to support this specific research
We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.
Suggested contribution levels: $20/$50/$100
Large-scale recruitment for research studies is now more easily achieved because of the internet . In addition, new technologies simplify genetic research by enabling unassisted sample collection in the participant’s own home [ ]. However, when compared with the traditional recruitment methods, the distance imposed by this methodology challenges sampling bias as well as the ability to provide individualized information to participants for informed consent. Additionally, this method may hinder the development of trust, which according to some authors aids in recruitment to genetics studies [ , ].
Internet-Based Recruitment for Research Studies
Internet-based sample collection has become commonplace for health research studies. For example, a recent systematic review covered 110 studies that used Facebook to recruit up to 12,000 adult participants per study . Given this trend, it has been recommended that recruitment strategies in research studies are evaluated and reported [ ]. Overall, recruitment analysis conducted to date has assessed studies designed to evaluate specific health conditions or the general population, and some authors have studied the association between participants’ physical activity and recruitment success [ ]. However we are not aware of any research studies that have analyzed recruitment success and the efficacy of different strategies to recruit participants from a physically active population.
Participants’ Attitudes to Genetic Data Collection
Clinical data belong to an individual’s sensitive personal information, and genetic data pose specific ethical and security concerns for participation in research projects . Studies show that the public appears to have a positive view of genetic research; however, this may not be associated with actual willingness to participate in a genetic study [ , ]. Demographic factors such as sex, age, education, and ethnicity have shown varying degrees of association with declared willingness to participate or actual participation in genetic research [ , ]. The informed consent process needs to address the concern for privacy intrusion by presenting information to participants in a clear and simple way [ ], and the potential obstacles of Web-based contact in this regard warrant a specific evaluation [ ]. All of these factors need to be reported to improve our management of research studies [ ].
To our knowledge, the AIS (Australian Institute of Sport) Running Injury Study is the largest genetic study to date conducted on a physically active cohort [, ]. The analysis presented here had two aims: (1) to assess the success and demographic representativeness of different recruitment strategies and (2) to highlight subject’s characteristics associated with declared willingness to participate and with actual participation in the genetic arm of the study.
The AIS Running Injury Study was an initiative of the AIS and the Collaborative Research Network for Advancing Exercise and Sport Science in response to the dramatic increase in recreational running in Australia in the past decade [, ]. The study was approved by the Bond University Human Research Ethics Committee (approval RO1688B). The initial aim was to recruit 10,000 participants and the goal was two-fold: (1) to document health profiles and injury rates in recreational runners, (2) to discover gene-environment interactions associated with two common types of lower leg injuries in runners—Achilles tendinopathy and bone stress injury. The survey, available online through the SurveyGizmo platform (Boulder, CO, USA) for a period of 25 months, played two roles: (1) to measure self-reported running habits, injury profiles, physical and mental health indicators, and nutrition in recreational runners and (2) to act as a screening tool by revealing factors for eligibility to the genetic study.
The genetic study involved an email request to eligible participants to confirm their postal address containing an electronic copy of the participant information sheet and consent form. Email respondents were mailed information and consent documents to sign, a saliva collection kit (Oragene DNA Collection Kit, DNA Genotek Inc., Ontario, Canada), instructions for collection, and a reply-paid envelope. The consent form included a request for permission to store the participant’s sample in an approved Sports Science & Exercise Biobank specimen repository and shared with other ethically approved research teams. Participants were deemed unreachable when no response was received to the initial email plus 2 reminders, or when their sample was not returned after delivery plus 2 email reminders. A second saliva kit was sent to a small number of those who reported lost or damaged kits.
Participants and Survey
Participants self-selected for inclusion in the survey on the basis of the following criteria: recreational runners aged 18 or older who run more than 15 km per week. Between September 2014 and October 2016, 9069 participants initiated the 30-min Web-based survey and 5248 completed it. Some participants completed the survey 2 times (N=233), some 3 times (N=13), 4 times (N=3), or 5 times (N=1). Only the most recent submission was used for data analysis. Despite the selection criteria, 213 participants reported running less than 15 km per week in the actual survey, but a decision was made to include them in the current analysis.
Eligibility for genetic analysis was complex and participants were not made aware of inclusion criteria so they would not self-deselect from the survey on this account. It included the following: running more than 15 km per week, 18 to 50 years old, having selected the items “Caucasian European” or “Mediterranean” for at least 3 grandparents when asked about their ethnicity, nonsmoker, absence of musculoskeletal comorbidities (arthritis or osteoporosis), medications (quinolone antibiotics, chemotherapy, or others), and recent lower limb fractures. Ethnicity was restricted to simplify genetic association analysis, which in multiethnic cohorts can potentially conceal or confound weak genetic effects . An Australian address was required to eliminate issues with import of biological material. A key requirement for eligibility was acceptance of the following: “I give permission, if I am eligible, to be contacted in the future to provide a saliva sample for genetic related analysis.” No individual feedback was promised to participants at any stage of the study.
The full panel of recruitment activities used throughout the study is presented in. To assess if this cohort was representative of the Australian population of runners, the sample was compared with the 2016 AusPlay survey, based on telephonic interviews of a probability-based sample of 70,000 [ ]. In January 2016, with only 2232 respondents of the targeted 10,000, a survey item was added asking respondents how they had learned about the study.
|Strategy, methods, and channels||Outcomes (other than recruitment)||Types of expenses||Estimated cost (Aus $)||Participants (n)||Cost per participant (Aus $)|
|Group page with regular posts||Page followers and post sharing||N/Aa||N/A||N/A||N/A|
|Posts in other pages||N/A||Advertising fees||1624||979||1.66|
|Other social media|
|Relevant articles||Presence in webpages||N/A||N/A||N/A||N/A|
|Press interview||Blog post||None||0||161||0|
|Flyers, emails to event participants||N/A||N/A||N/A||N/A||N/A|
|Presence in race results emails||N/A||N/A||N/A||N/A||N/A|
|Contact with running-related businesses||Further promotions||Travel||4173||458||9.11|
|Flyers||N/A||Printed materials, travel, stand booking and fitting||N/A||N/A||N/A|
|Presence in Expo social media||N/A||Printed materials, travel, stand booking and fitting||N/A||N/A||N/A|
|Contact with running-related businesses||Further promotions||Printed materials, travel, stand booking and fitting||5249||160||32.81|
|Presence at events||N/A||N/A||N/A||N/A||N/A|
|Referrals (personal and professional)|
|Emails to previous survey participants||Facebook posts||N/A||N/A||N/A||N/A|
|Sports health professionals||Advice to patients||N/A||N/A||N/A||N/A|
|Word of mouth||N/A||None||0||144||0|
|Running events||Mentions in newsletters||N/A||N/A||N/A||N/A|
|Running clubs||Invitations to events||N/A||N/A||N/A||N/A|
|Running-related businesses||Facebook, other social media||N/A||N/A||N/A||N/A|
|Fitness business, personal trainers, running coaches||Referrals||N/A||N/A||N/A||N/A|
|Triathlon and athletics state organisations||N/A||None||0||Unknown||0|
|Discount promo codes to participants||N/A||N/A||N/A||N/A||N/A|
aN/A: not applicable.
bAIS: Australian Institute of Sport.
The purpose was to monitor the success of each recruitment channel with the goal of optimizing future efforts. Data from the remaining 2776 responses were analyzed based on this item. Finally, the demographic factors associated with participants’ willingness to be contacted for genetic research, their actual participation in the research once contacted, and their consent to have their genetic material stored in a biobank were assessed.
Categorical data were arranged in contingency tables and assessed by goodness-of-fit chi-square test in which the expected frequencies (E) were determined from the observed frequencies and tested with the formula (O-E)2/E, except where stated otherwise. The null hypothesis was that the observed frequencies did not differ from the expected frequencies and it was rejected if P value was <.05. Cells for which the standardized residuals had an absolute value higher than 5.00 were considered major contributors to the statistically significant chi-square value and indicated with asterisks. All statistical analyses were conducted using the R statistical software package (R Core Team) .
Aim 1: The Recruitment Process
Age, sex, country of citizenship, and weekly running distance are associated with recruitment strategy. Recruitment strategies spanned a number of methods, either paid or free of cost (). An early partnership with parkrun [ ], an organizer of free weekly running events, returned numerous participants through communications in newsletters, presence at events, and parkrun Facebook pages ( ). Direct contact with runners at popular events, competitions for running apparel, and social media presence accounted for peaks in recruitment rates. However, throughout the second half of 2015, participation rates were very low. In 2016, a survey item was added to assess participants’ self-reported recruitment channel, and a new recruitment campaign was initiated. New methods that incurred a cost comprised advertising in Facebook and running-related websites, presence at a fitness expo, and presence at 9 running-related events, including 7 races and 2 Running Film Festival premieres. Facebook paid advertising was conducted with evolving criteria—people interested in running aged 30 to 50 years from February to April and aged 18 to 50 years from May to October. Free strategies comprised the creation of a study Facebook page with regular updates, Web-based media articles and interviews, and agreements with sports-related businesses to provide online discount codes (10%-25% off).
References to incentives were included in the Facebook advertisements (). In June 2016, an email campaign contacted all previous respondents (3000 at that stage) requesting help by word of mouth and social media, and hundreds of emails were sent to running event organizers, running clubs, and other running-related businesses. Throughout the recruitment period, the study was supported by the social media, communications, design and commercial capability of the AIS, which provided expertise and some assistance at no cost. The average cost per participant for the period between January and October 2016, excluding the cost of researchers’ time, was estimated as Aus $4 ( ). The age and sex representativeness of this cohort could be assessed by comparing these data to AusPlay, the national survey of sports participation [ ]. The population estimates from AusPlay were used to derive expected values, and the significance of the chi-square test suggests that the sample selected for our study was overrepresented in runners aged 35 years and older and female runners ( ). It must be noted, however, that AusPlay reports participation at least once per year in athletics, track and field, which for over 95% of this population involves running and jogging, and our inclusion criteria required regular running.
Facebook recruited the largest number of participants, but it was also the most diverse strategy, comprising paid and free channels such as targeted advertising, our study page, posts on running-related pages, and personal referral. Other strategies contributed directly to recruitment and frequently provided additional outcomes, for example physical presence at events allowed contact with business representatives which led to promo codes or contact with bloggers or journalists which in turn led to interviews and articles. Some of these additional outcomes ultimately returned more participants than a direct contact with runners.
Different recruitment methods delivered different demographic associations (see). The standardized residuals of the chi-square statistic suggested a high contribution of 35- to 44-year-old participants to recruitment by Facebook. Older participants were overrepresented when recruitment was mediated by other social media and parkrun, and participants recruited through the AIS tended to be overrepresented in the 18 to 24 age category. Facebook recruitment showed an association with female participation, whereas Web-based media (blogs, podcasts, and newsletters) appeared to recruit more male participants. People whose country of citizenship is not Australia were less likely to be recruited by Web-based media but more easily recruited through direct presence at running events.
|Age and sex categories||AusPlay survey Estimate (×1000)||This study||Significance|
|Expected||Observed||Chi-squared P value|
|Age in years|
|65 and older||71.3||123||120||<.001|
aCells that are the main contributors to the chi-square test statistic.
Respondents reported their average weekly running distance (see), and the chi-square test revealed a significant association between recruitment method and distance covered. The standardized residuals showed that participants who run less than 20 km per week were more highly represented in the Facebook and parkrun categories. In contrast, those who run 40 km per week or more, showed the least presence in the parkrun category. As the study was focused specifically on injury, this factor was also tested for association with recruitment methods. Over half of the participants had sustained an injury in the past 2 years, however this rate was not significantly different between the different recruitment categories. No association was found between ethnic origin or eligibility for genetic analysis and recruitment method. Overall, recruitment methods appear to have affected runners’ profiles with regard to age, sex, country of citizenship, and weekly running distance, and the overall sample distribution is dominated by older respondents.
Aim 2: The Genetic Study
Age is associated with respondents’ attitudes and actual participation in genetic analysis. Early in the survey, before exposure to demographic questions and after exposure to the participant information sheet, participants had the option to tick a box for each of the following items: “I give permission, if I am eligible, to be contacted in the future for related research” and “I give permission, if I am eligible, to be contacted in the future to provide a saliva sample for genetic-related analysis.” Positive answers were given, respectively, by 93.91% (4663/4965) and 89.81% (4459/4965) of participants (). The chi-square test showed significance for both items, with the 18- to 24-year-old group as the largest contributor to the former, and both age groups below 35 as key contributors to the latter item. Overall, the rates of positive answers tended to increase steadily with older age, from 75.1% (266/354) to 96.6% (115/119) for willingness to participate in genetic research. The association with sex was weak and potentially confounded by an association between age and sex. Participants were also asked the ethnic group of each of their grandparents because an exclusion criterion for the genetic study was to have less than 3 Caucasian European or Mediterranean grandparents. The results suggest that this majority group was more willing to participate in genetic or other research than the minority group, formed by individuals with 2 or more grandparents of Indigenous Australian or Torres Strait Islander, Polynesian, Asian, African, other, or unknown ethnicity.
A total of 1664 participants met the inclusion criteria for genetic analysis, including consent, ethnicity, and age, and the following results are limited to this cohort (See). Eligible participants were contacted by email to request confirmation of contact details. Of all the participants 9 lived overseas, 4 declined participation at this stage, and 278 were deemed unreachable. A total of 1323 out of 1664 (80%) participants replied to emails requesting contact details and 1142 of 1323 (86%) returned saliva samples. Younger age was significantly associated with a lower rate of response to emails requesting contact details, but it did not affect sample return rates. A total of 1038 of 1142 participants (91%) consented for sample storage and biobanking, and no association was observed with age or sex. Overall, no independent association was found between recruitment strategy and follow-up rate, sample return, or biobank consent (results not shown). A graph depicting the rates of participants’ loss in the different age brackets throughout the study is shown in .
|Categories||Total (n=4965)||Permission to be contacted for related research||Permission to be contacted for genetic analysis|
|Yes (n=4663)||No (n=302)||Chi-squared|
|Yes (n=4459)||No (n=506)||Chi-squared|
|Ethnicity, n (%)a||<.001||<.001|
|Caucasian European/ Mediterranean||4508 (87.8)||4255 (94.39)||253 (5.61)||4090 (90.73)||418 (9.27)|
|Other||456 (5.0)||410 (89.9)||46 (10.1)a||371 (81.4)||85 (18.6)a|
|Age, n (%)||<.001||<.001|
|18-24||354 (7.1)||309 (87.3)||45 (12.7)b||267 (75.4)||87 (24.6)b|
|25-34||1173 (23.6)||1076 (91.73)||97 (8.27)||1012 (86.27)||161 (13.73)b|
|35-44||1632 (32.9)||1554 (95.22)||78 (4.78)||1495 (91.61)||137 (8.39)|
|45-54||1225 (24.7)||1165 (95.10)||60 (4.90)||1139 (92.98)||86 (7.02)|
|55-64||462 (9.3)||444 (96.1)||18 (3.9)||430 (93.1)||32 (6.9)|
|65 and over||119 (2.4)||115 (96.6)||4 (3.4)||116 (97.5)||3 (2.5)|
|Sex, n (%)||.499||<.01|
|Male||2266||2122 (93.65)||144 (6.35)||2063 (91.04)||203 (8.96)|
|Female||2699||2541 (94.15)||158 (5.85)||2396 (88.77)||303 (11.23)|
bCells that are the main contributors to the chi-square test statistic.
Part 1: The Recruitment Process
Web-based health data collection is now possible because of the ubiquitous presence of the internet and the multiplicity of access devices. In addition, technologies for the collection of saliva samples without a skilled practitioner or refrigeration in transit facilitate remote donations for genetic analysis. These two advances enabled the design of an epidemiological and genetic study with the ambition of recruiting 10,000 survey participants and obtain at least 3000 genetic samples . The final numbers, however, amounted to slightly under 5000 participants and 1142 samples in a period of 2 years [ ]. This sample size leaves the genetic study underpowered, but with potential to contribute to meta-analyses and replication studies. The number of adult runners in Australia in 2015-2016 was estimated over 2.8 million [ ], so there was no shortage of potential participants. Here we analyzed the recruitment strategies employed, their efficiency, and their impact on population representativeness. We also searched for associations between participants’ characteristics, recruitment, and retention throughout the genetic arm of the study.
Every recruitment method shows potential for bias , so to minimize overall bias we used a combination of recruitment strategies. Nevertheless, a comparison with data from the randomly sampled AusPlay sport participation survey [ ] revealed a significant underrepresentation of young adults. It must be noted that the analysis of recruitment strategies presented here is based on data obtained in the second wave of recruitment, after an item addressing the source of recruitment was included in the survey, and provides no information on recruitment trends in the initial wave of recruitment. Despite social media being considered as a suitable platform for this population [ ] and Facebook being the most popular social media platform in Australia for all ages [ ], neither Facebook nor other social media boosted the participation of younger adults in our study. Facebook preferentially recruited participants in the 35 to 44 years age bracket, which may be a result of our advertising campaign being targeted to runners aged 30 to 50 years during the first 3 months, before it was extended to ages 18 to 50 years for another 6 months. However, targeted advertising was only one of the many Facebook-related strategies used to promote the study, in addition to snow-balling, presence on pages for running groups, and others. It is possible that physically active young adults are just difficult to reach, and use of Facebook is not sufficient to promote a research study to this population. Alternative channels such as universities or sports organizations may have been more successful. In fact, our own website, the AIS, which provides programs and facilities for elite athletes, was the only channel that recruited a representative proportion of young adults. Conversely, a network of free, weekly, timed 5 km outdoor runs called parkrun recruited numerous participants, but a high proportion of those were in the 55 to 64 years age category. Overall, the reported bias in age distribution for each recruitment method highlights the need to use a range of recruitment activities. One cannot expect, however, that a mix of methods will cancel bias, as is the case with this study where the most successful strategies returned samples biased toward older ages.
Other associations were evident. Sex distribution was affected by Facebook and Web-based media. Despite an absence of sex-related differences in social media or Facebook usage or behavior , the female recruitment rate through Facebook of 61.4% (601/979) was high, in line with previous studies that also used Facebook (60% in average) [ ]. The large contribution of the Facebook cohort to the sample may have been responsible for the overall female predominance in the study, although it is not unusual for women to show higher rates of enrollment in health research studies [ ]. Respondents who run less than 20 km per week were overrepresented and those who run over 40 km per week were underrepresented in the parkrun group, which aligns with the observation that parkrun attracts people with lower running ability [ ].
Overall, no specific strategy combined the desired requirements for high recruitment rate, population representativeness, and low cost; however the relative representation reported here could help researchers choose the recruitment methods that best fit their target population. Additionally, it is recommended that an item asking for participants’ self-reported method of recruitment is included in surveys so that these data can be used to assess or modify recruitment strategies. This study was characterized by two waves of intensified recruitment, one at study roll-out and another after a long lag in recruitment. Each wave involved consultation with the AIS communications team and the design of a tailored recruitment plan. The initial campaign was successful but it lacked momentum, and another campaign, reported here in detail, was required to boost recruitment. Despite the assistance of communication experts and the use of a reputable and popular brand such as the AIS, the study only recruited half of its projected participants. According to our experience, large-scale recruitment for internet data collection sits at the interface of marketing and research and acts in a direct competition with many other scientific studies and market research. In this competitive environment, the communication requirements for large-scale recruitment are beyond the researchers’ expertise. Only by engaging marketing experts and allocating sufficient resources will a study succeed in large-scale recruiting.
Part 2: Respondent Participation in the Genetic Study
Significant time and consideration was invested in developing a process of informed consent that explained the study’s purpose in a clear and simple way. The participant information sheet was followed by requests for permission to be contacted for related research and for genetic analysis. The fact that the former question, open and nonspecific, received a slightly higher positive answer rate than the latter, which is linked to this specific research study and backed by detailed information, aligns with reports indicating that the presence of a genetic component in studies aimed at the general population has a negative impact on survey participation [, - ]. Overall, willingness to participate in the genetic arm of the study was slightly higher than in other studies (90% vs 83-86%) [ , , ]. As shown by others, younger age was associated with a negative answer to both requests [ , , ]. This could be linked to lower levels of trust in research and greater privacy concerns in younger adults [ , , ], and a more altruistic attitude to research in older adults [ ]. Those who were not Caucasian European or Mediterranean were significantly more likely to answer negatively despite the survey item for ethnicity being located well after the request for permission to be contacted. This agrees with some studies examining the willingness of ethnic minorities to participate in genetic research [ , , ] but not with others [ , ]. It must be noted that all these studies were conducted in the United States and the minorities described were African American and Hispanic, whereas our study was conducted in Australia and the minorities encountered were primarily Asian, Indigenous Australian, Pacific Islander, and African. The combined observations indicate that there is a broader pattern suggesting that recruitment should be tailored to enhance representation of ethnic minorities in genetic studies.
Only 80% of eligible, willing participants responded to the follow-up email, similarly to previous genetic research studies [, ]. We can only speculate about the reasons for this drop. As people’s belief in the importance of genetic research appears to be higher than their individual willingness to participate [ ], it is likely that participants only considered their individual concerns when confronted with actual participation. Alternatively, email, the vehicle of contact, is prone to loss by incorrect records or spam filters, or it may simply be ignored. Accordingly, the fact that response rates approached 65% in the 18 to 24 years age category versus 83% in the 35 to 50 years age category may reflect the abovementioned association between age and attitude to research or privacy, or it could reveal age-related differences in email usage. Previously reported age effects in studies that did not involve email [ ], combined with recent data supporting that email is still strong in young adults [ ], seem to indicate that the effect stems from different attitudes to research or privacy. We recommend that studies targeting young adults design contact protocols that match the specific attitudes supported by this population.
An additional drop in retention occurred when participants were mailed the materials needed to donate their sample. Despite the simple procedure designed to minimize participant burden, only 86% of the samples were returned. However others have reported lower saliva kit return rates between 42% and 82% [, , , ]. Unlike another study [ ], no age associations were found at this stage, although the older age categories tended to show higher return rates. This was the most expensive drop in participation because it combined administrative costs, postal fees, and the cost of the collection kits. Informal feedback from participants indicated that they might have been more engaged had they been given a deadline for sample return. A study in young adults (age around 28 years) found that offering a small incentive for sample collection tripled the odds of obtaining a sample but decreased the likelihood of obtaining biobank consent [ ]. These strategies were not tested by us but may be worth considering. Of those respondents who returned the saliva sample, 93% gave consent for biobank storage, irrespective of age or sex. This rate reveals that, once enrolled in the study and having donated a sample, participants generally see the benefits of storage and sharing their deidentified sample for future studies.
Overall, this analysis reveals an age-related bias experienced throughout the study. Sex was associated with survey participation but not with other steps of the process, in agreement with some studies  but not with others [ , , ]. Our sample comprised physically active people and participation rates suggest that they are at least equivalent to other populations in their likelihood to participate in genetics research. There are two previous studies providing evidence for [ ] or against [ ] an association between physical activity, or exercise capacity, and participation in genetics studies in participants aged 40 years or older. Nonetheless, to our knowledge, no studies to date have examined this kind of association in younger cohorts, and our data may suggest that physically active people aged under 35 years are particularly hard to reach and retain for genetics research. Therefore, it is recommended that studies targeted at this population use recruitment strategies designed to match the specific characteristics of this population.
This study is not without limitations. It is an observational study that lacks a systematic assessment of confounding factors. Recruitment strategies were self-reported, and our measure of recruitment strategies from the participants’ response to the survey item is a gross measure. In addition, some recruitment channels, such as promotions and the email campaign to previous respondents, could not be assessed for success because these items were not included in this survey item. This item was added to the survey over halfway through the recruitment period, precluding any analysis on the initial phase of recruitment. The target population for Facebook advertising, a successful recruitment channel in this study, was also updated halfway through the campaign. This adaptive move, which aided with recruitment to satisfy the primary aims of the study, imposes an additional limitation to the current analysis. A limitation to the generalizability of the results is the inclusion or exclusion criteria of both the survey-based and genetic arms of the study.
The internet undoubtedly offers many opportunities to reach potential participants for genetic research. However, the results of this study show that initial contact and follow-up methods need to be designed according to the target population. A caveat of these studies is that, even though initial recruitment is done through popular channels such as social media, subsequent contact needs to be done in person or by mail, which exposes these studies to the traditional hurdles such as email or parcel loss, change of address or loss of participants’ interest due to lack of immediacy. Contact by email could be replaced by more immediate channels such as text message or social media; however, the requirement for a mailing address for parcel delivery will continue to be a challenge for recruitment, and it is difficult to conceive a system that would eliminate this challenge.
The authors thank Dr Renae Domaschenz for her contribution to survey design, and Assistant Professor Kevin Ashton and Dr Paul Leo for their roles as supervisors of MK. The authors also thank the Collaborative Research Network for Advancing Exercise and Sports Science members who contributed to the AIS Running Injury Study—Dr Justin Keogh, Professor Nuala Byrne (Bond University), Professor Matthew A Brown (Queensland University of Technology), and Professor Maria A Fiatarone Singh (University of Sydney). We are grateful to parkrun and all other organizations that assisted with recruitment, to the businesses that donated incentives, and especially to the runners who completed the survey.
Conflicts of Interest
Multimedia Appendix 1
Respondents’ characteristics by recruitment strategy. Superscript "a" indicates cells that are the main contributors to the chi-square test statistic.XLSX File (Microsoft Excel File), 15KB
Multimedia Appendix 2
Participants who replied to contact emails for the genetic arm of the study, those who returned the sample and those who provided signed consent to biobank their sample, calculated as percentages of the previous category and categorized by age and sex. Superscript "a" indicates cells that are the main contributors to the χ2 test statistic.XLSX File (Microsoft Excel File), 12KB
- Toledano MB, Smith RB, Brook JP, Douglass M, Elliott P. How to establish and follow up a large prospective cohort study in the 21st century--lessons from UK COSMOS. PloS One 2015;10(7):e0131521. [CrossRef]
- Bhutta MF, Hobson L, Lambie J, Scaman ES, Burton MJ, Giele H, et al. Alternative recruitment strategies influence saliva sample return rates in community-based genetic association studies. Ann Hum Genet 2013 May;77(3):244-250 [FREE Full text] [CrossRef] [Medline]
- Amiri L, Cassidy-Bushrow AE, Dakki H, Li J, Wells K, Oliveria SA, et al. Patient characteristics and participation in a genetic study: a type 2 diabetes cohort. J Investig Med 2014 Jan;62(1):26-32 [FREE Full text] [CrossRef] [Medline]
- Storr CL, Or F, Eaton WW, Ialongo N. Genetic research participation in a young adult community sample. J Community Genet 2014 Oct;5(4):363-375 [FREE Full text] [CrossRef] [Medline]
- Thornton L, Batterham PJ, Fassnacht DB, Kay-Lambkin F, Calear AL, Hunt S. Recruiting for health, medical or psychosocial research using Facebook: systematic review. Internet Interv 2016 May;4, Part 1:72-81. [CrossRef]
- Mapstone J, Elbourne D, Roberts I. Strategies to improve recruitment to research studies. Cochrane Database Syst Rev 2007 Apr 18(2):MR000013. [CrossRef] [Medline]
- Vlahovich N, Fricker P, Brown MA, Hughes D. Ethics of genetic testing and research in sport: a position statement from the Australian Institute of Sport. Br J Sports Med 2017 Jan;51(1):5-11 [FREE Full text] [CrossRef] [Medline]
- Kerath SM, Klein G, Kern M, Shapira I, Witthuhn J, Norohna N, et al. Beliefs and attitudes towards participating in genetic research - a population based cross-sectional study. BMC Public Health 2013 Feb 07;13:114 [FREE Full text] [CrossRef] [Medline]
- Johnsson L, Helgesson G, Rafnar T, Halldorsdottir I, Chia KS, Eriksson S, et al. Hypothetical and factual willingness to participate in biobank research. Eur J Hum Genet 2010 Nov;18(11):1261-1264 [FREE Full text] [CrossRef] [Medline]
- Matsui K, Kita Y, Ueshima H. Informed consent, participation in, and withdrawal from a population based cohort study involving genetic analysis. J Med Ethics 2005 Jul;31(7):385-392 [FREE Full text] [CrossRef] [Medline]
- Khan A, Capps BJ, Sum MY, Kuswanto CN, Sim K. Informed consent for human genetic and genomic studies: a systematic review. Clin Genet 2014 Sep;86(3):199-206. [CrossRef] [Medline]
- Glass DC, Kelsall HL, Slegers C, Forbes AB, Loff B, Zion D, et al. A telephone survey of factors affecting willingness to participate in health research surveys. BMC Public Health 2015 Oct 05;15:1017 [FREE Full text] [CrossRef] [Medline]
- Kozlovskaia M, Vlahovich N, Rathbone E, Manzanero S, Keogh J, Hughes DC. A profile of health, lifestyle and training habits of 4720 Australian recreational runners – the case for promoting recreational running for health benefits. Health Promot J Austr 2017 (forthcoming).
- Domaschenz R, Vlahovich N, Keogh J, Compton S, Hughes DC, Collaborative Research Network For Advancing Exercise & Sports Science Scientific Committee. Exercise-induced tendon and bone injury in recreational runners: a test-retest reliability study. JMIR Res Protoc 2015;4(4):e117. [CrossRef]
- Medina-Gomez C, Felix JF, Estrada K, Peters MJ, Herrera L, Kruithof CJ, et al. Challenges in conducting genome-wide association studies in highly admixed multi-ethnic populations: the Generation R Study. Eur J Epidemiol 2015 Apr;30(4):317-330 [FREE Full text] [CrossRef] [Medline]
- Australian Sports Commission. Ausport. 2016. AusPlay Participation data for the sport sector URL: http://www.ausport.gov.au/__data/assets/pdf_file/0007/653875/34648_AusPlay_summary_report_accessible_FINAL_updated_211216.pdf [accessed 2017-03-16] [WebCite Cache]
- R-project. 2008. R: A language and environment for statistical computing URL: http://www.R-project.org/ [accessed 2017-03-16] [WebCite Cache]
- Parkrun Australia. Parkrun. URL: http://www.parkrun.com.au/ [accessed 2018-03-07] [WebCite Cache]
- Loxton D, Powers J, Anderson AE, Townsend N, Harris ML, Tuckerman R, et al. Online and offline recruitment of young women for a longitudinal health survey: findings from the Australian longitudinal study on women's health 1989-95 cohort. J Med Internet Res 2015 May 04;17(5):e109 [FREE Full text] [CrossRef] [Medline]
- Fazzino TL, Rose GL, Pollack SM, Helzer JE. Recruiting U.S. and Canadian college students via social media for participation in a web-based brief intervention study. J Stud Alcohol Drugs 2015 Jan;76(1):127-132 [FREE Full text] [Medline]
- Sensis. 2016. How Australian people and businesses are using social media URL: https://www.sensis.com.au/asset/PDFdirectory/Sensis_Social_Media_Report_2016.PDF [accessed 2017-06-19] [WebCite Cache]
- Espeland MA, Dotson K, Jaramillo SA, Kahn SE, Harrison B, Montez M, Look AHEAD Research Group. Consent for genetics studies among clinical trial participants: findings from Action for Health in Diabetes (Look AHEAD). Clin Trials 2006;3(5):443-456 [FREE Full text] [CrossRef] [Medline]
- Stevinson C, Hickson M. Exploring the public health potential of a mass community participation event. J Public Health (Oxf) 2014 Jun;36(2):268-274. [CrossRef] [Medline]
- Melas PA, Sjöholm LK, Forsner T, Edhborg M, Juth N, Forsell Y, et al. Examining the public refusal to consent to DNA biobanking: empirical data from a Swedish population-based study. J Med Ethics 2010 Feb;36(2):93-98. [CrossRef] [Medline]
- McQuillan GM, Pan Q, Porter KS. Consent for genetic research in a general population: an update on the National Health and Nutrition Examination Survey experience. Genet Med 2006 Jun;8(6):354-360. [CrossRef]
- McQuillan GM, Porter KS. Consent for future genetic research: the NHANES experience in 2007-2008. IRB 2011;33(1):9-14. [Medline]
- Mezuk B, Eaton WW, Zandi P. Participant characteristics that influence consent for genetic research in a population-based survey: the Baltimore epidemiologic catchment area follow-up. Community Genet 2008;11(3):171-178 [FREE Full text] [CrossRef] [Medline]
- Trinidad SB, Fullerton SM, Bares JM, Jarvik GP, Larson EB, Burke W. Genomic research and wide data sharing: views of prospective participants. Genet Med 2010 Aug;12(8):486-495 [FREE Full text] [CrossRef] [Medline]
- Wood F, Kowalczuk J, Elwyn G, Mitchell C, Gallacher J. Achieving online consent to participation in large-scale gene-environment studies: a tangible destination. J Med Ethics 2011 Aug;37(8):487-492. [CrossRef] [Medline]
- Blogs.adobe. Email Use 2017 EMEA Report URL: https://blogs.adobe.com/digitaleurope/files/2017/08/20170815_Email2017_EMEA_Report.pdf [accessed 2017-12-12] [WebCite Cache]
- Etter JF, Neidhart E, Bertrand S, Malafosse A, Bertrand D. Collecting saliva by mail for genetic and cotinine analyses in participants recruited through the Internet. Eur J Epidemiol 2005;20(10):833-838. [CrossRef] [Medline]
- Nishita DM, Jack LM, McElroy M, McClure JB, Richards J, Swan GE, et al. Clinical trial participant characteristics and saliva and DNA metrics. BMC Med Res Methodol 2009 Oct 29;9:71 [FREE Full text] [CrossRef] [Medline]
- Mcquillan GM, Porter KS, Agelli M, Kington R. Consent for genetic research in a general population: the NHANES experience. Genet Med 2003 Feb;5(1):35-42. [CrossRef] [Medline]
|AIS: Australian Institute of Sport|
Edited by G Eysenbach; submitted 19.06.17; peer-reviewed by T Fazzino, C Storr, Y Uesugi, D Ose; comments to author 19.11.17; revised version received 07.12.17; accepted 03.01.18; published 23.05.18
©Silvia Manzanero, Maria Kozlovskaia, Nicole Vlahovich, David C Hughes. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 23.05.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.