This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.
Traditionally, postal surveys or face to face interviews are the main approaches for health researchers to obtain essential research data. However, with the prevalence of information technology and Internet, Web-based surveys are gaining popularity in health research.
This study aims to report the process and outcomes of recruiting Chinese migrants through social network sites in Australia and to examine the sample characteristics of online recruitment by comparing the sample which was recruited by an online survey to a sample of Australian Chinese migrants collected by a postal survey.
Descriptive analyses were performed to describe and compare the process and outcomes of online recruitment with postal survey questionnaires. Chi square tests and
In total, 473 Chinese migrants completed the online health survey from July to October 2013. Out of 426 participants recruited through the three Chinese social network sites in Australia, over 86.6% (369/426) were recruited within six weeks. Participants of the Web-based survey were younger, with a higher education level or had resided in Australia for less time compared to those recruited via a postal survey. However, there was no significant difference in gender, marital status, and professional occupation.
The recruitment of Chinese migrants through social network sites in our online survey was feasible. Compared to a postal survey of Chinese migrants, the online survey attracted different group of Chinese migrants who may have diverse health needs and concerns. Our findings provided insightful information for researchers who are considering employing a Web-based approach to recruit migrants and ethnic minority participants.
Migrant and ethnic minority groups often have poorer self-perceived health status than the general population, and recruiting participants from those groups for health research is challenging [
Conventional population-based sampling is usually costly and time consuming in producing sufficient numbers of minorities [
Web-based or Internet-based data collection methods have been credited for the speed with which data can be collected, low cost, and direct data entry in comparison with traditional paper-based questionnaires [
Social network sites (SNSs) include all types of online social platforms that allow participants to connect and interact within broader Internet communities [
Australia is a culturally-mixed country with more than a quarter of the population born overseas [
Participants who self-identified as Chinese and had been living in Australia longer than 3 months were recruited through several social websites to complete an online health survey from July to October, 2013. A structured questionnaire with 57 questions regarding demographics, health related risk behaviors, health service use, antibiotic use, and mental problems was uploaded to the University of Queensland server using online survey software [
Our recruitment posts with detailed survey information were initially posted on 3 major Chinese social network sites, including ”Oursteps”, ”Ozyoyo”, and ”Freeoz”. In addition, those notices were also posted on other Chinese social network sites such as “Yeeyi”, “ozchinese”, QQ instant message, and Weibo. “Oursteps” and “Freeoz” had members Australia-wide while “Ozyoyo” is self-claimed to be the largest Chinese website in Queensland. The primary language of all these sites is Simplified Chinese.
The data collected in this online survey were compared with a data set of Australian Chinese respondents collected through a postal survey from November 2005 to February 2006. The process of the postal survey was reported elsewhere [
The survey software was able to capture some information about participation such as IP addresses of each participants, as well as date and time of starting and finishing the survey. Data were exported directly from the survey software as Excel files. As all analyses were performed using Stata 13 [
Of the 600 Chinese migrants who visited the survey webpage, 473 (78.8%) completed the online questionnaire. While online recruiting was set to be closed on September 30th, 2013, notices were not removed from the SNSs after the closing date, and we still received a few completed questionnaires, which were included in the final total number of participants. During the total survey period (July-October, 2013), the advertising posts were viewed more than 8000 times including repeated viewings and administrative viewings. By the end of September, 426 out of 473 (90%) participants were recruited through 3 Chinese social network sites “Oursteps”, “Freeoz”, and “Ozyoyo”; 35 migrants were recruited through other social network sites. There were an additional 12 completed questionnaires received between September 30thand October 30th, 2013.
We provided 10 50 Australian Dollar (AUD) gift cards presented as lucky draw winners. Each gift card was mailed to the winner who was randomly selected from the valid participants. The postage for 10 registered mails was AUD44. No additional costs were incurred, as the University of Queensland provided free access to the university’s server and the survey software.
Increasing number of participants over the ten-week recruitment period (total recruitment and recruitment by three SNSs).
The online survey software enabled us to capture the IP address of each participant. IP addresses identified 94.1% (445/473) of the participants as living in Australia when they undertook the survey. Around 2.5% (12/473) of the participants’ IP addresses were outside Australia, and the remaining 3.4% (16/473) of the IP addresses were not detectable. Seven pairs of duplicate IP addresses were detected, which were further verified as different participants (with different personal information such as gender and age).
The selection criteria for our online survey include “self-claimed as Chinese” and “have resided in Australia for longer than 3 months”. Out of 473 total participants, 440 (93.0%) were born in Mainland China. Others were born in Taiwan, Hong Kong, Macau, and Malaysia. Among the total participants, 4 of them reported living in Australia for less than three months and another 7 did not answer the question about their length of residence in Australia.
Participants of the online survey were spread over of Australia including Queensland, New South Wales, South Australia, Victoria, and West Australia. Fifty-five percent were females. The mean age of participants in the Web-based survey was 33.1 (SD 8.2) years.
Over 90% of total participants in the Web-based survey (440/473) were born in mainland China versus only 31% in the postal survey. The proportion with an undergraduate or higher degree was significantly higher in the Web-based survey group (85.6%, 405/473) than in the postal survey group (75%). A substantial proportion of the participants had a family doctor in the postal survey (73%) compared to the Web-based survey (47.1%, 223/473). However, there was no significant difference in gender, marital status, BMI, or professional occupation between the 2 samples.
Recruiting details in Chinese social network sites from July to October 2013a.
Study websites | Start | End | Number of viewingsb | Valid participants |
Oursteps | 23/07/2013 | 30/09/2013 | 2774 | 146 |
Freeoz | 22/07/2013 | 30/09/2013 | 1861 | 135 |
Ozyoyo | 30/07/2013 | 30/09/2013 | 2290 | 145 |
Yeeyi | 04/09/2013 | 30/09/2013 | 2109 | 22 |
a13 participants recruited from several other websites plus 12 participants recruited after the deadline had passed were not included in the table.
bIncluding duplicated viewings
Comparison of demographic characteristics between the 2 samples of Australia Chinese migrants, n (%) or mean (SD).
Characteristics | Online survey | Postal survey |
|
|
|
mean (SD) or n (%) | mean (SD) or n (%) |
|
|
Total participantsa | 473 | 213 |
|
|
|
|
|
|
|
|
mean (SD) | 33.1 (8.2) | 45.1 (14.3) | <.001 |
|
<30 | 158 (34.1) | 36 (18.5) | <.001 |
|
30-39 | 214 (46.1) | 30 (15.5) |
|
|
40-49 | 71 (15.3) | 62 (32.0) |
|
|
≥50 | 21 (4.5) | 66 (34.0) |
|
Female | 261 (55.2) | 116 (56.0) | .84 | |
Born in Mainland China, n (%) | 440 (93.2) | 66 (31.0) | <.001 | |
Undergraduate or higher degree | 405 (86.2) | 157 (74.8) | <.001 | |
Professional occupation b | 206 (43.6) | 86 (42.2) | .72 | |
Married or in a partnership | 352 (74.7) | 144 (78.3) | .34 | |
|
|
|||
|
Mean (SD) | 5.8 (4.2) | 14.1 (8.8) | <.001 |
|
≥5 | 264 (55.8) | 182 (85.5) | <.001 |
BMI, mean (SD) | 23.2 (4.4) | 22.6 (3.1) | .08 | |
Have a family doctor, n (%) | 223 (48.2) | 155 (72.8) | <.001 | |
Family doctor speaks same language, n (%) | 133 (59.6) | 108 (73.0) | .008 |
aThe sum of participants in subgroups may not equal to the total number of participants due to missing values.
bNon-professionals include administrative positions, those with home duties, skilled laborers, the unemployed, pensioners, manual laborers, and the self-employed.
Overall, it is feasible to recruit large numbers of community-based Chinese migrants through social network sites with minimal cost. The majority of participants were recruited within 6 weeks through 3 major Chinese SNSs. Participants of the online survey were younger or had resided in Australia for a relatively shorter time than those of the postal survey. However, participants’ gender, marital status, and professional occupations were comparable.
In this online survey, we recruited over four hundred Chinese migrants. Based on a review of the postal codes of participants, we determined that the Chinese migrants resided dispersedly in 5 different states of Australia. The survey was initially designed to recruit Chinese participants through the 3 major Chinese SNSs, where the principal investigator is an active member of the SNS. We then extended our study to include other Chinese SNSs where the principal investigator is a newly registered member. As of September 30th, 2013, 426 participants were recruited from the three social network sites and 35 participants were recruited from other sites. As we can see in
We noted that the majority (86.6%, 369/426) of participants were recruited within 6 weeks of the survey period and the incoming numbers of respondents slowed down dramatically thereafter. Findings supported the assumption that online survey responses would be quicker compared to traditional mail surveys [
We provided incentives to participants in the form of 10 lottery draws for gift cards worth AUD50 each. The marginal cost for this survey was close to AUD1.20 per participant plus organizational expenses, comparable to the cost of the postal survey (AUD0.60 postage plus organizational expenses). Since the financial incentive was relatively small and probability based, it was not likely to be a major factor in deciding to participate in the online health survey. However, by announcing the lottery winners multiple times over the survey period, we were able to attract more attention to the recruiting threads in the SNSs and expand the viewing audience.
The online survey attracted younger participants with a higher educational level than the postal survey, consistent with the existing literature that older participants with lower education might be underrepresented in Web-based surveys due to the disparity in Internet and computer access [
As regards migrant health studies, the length of stay in a host country is an important indicator of acculturation. In this study, we found that 85% of participants in the postal survey had been residing in Australia for more than 5 years, compared with about half of participants in the Web-based survey. Similarly, studies amongst US migrants found samples of longer-stay migrants using a telephone directory list [
In addition, we found the percentage of the participants having a family doctor was significantly higher in the postal survey than in the Web-based survey. Compared to Web-based survey participants, the postal survey participants were more likely to have a family doctor who could speak the same language as themselves. The findings indicate that health-related behavior may be very different due to various demographic features of the 2 samples. Researchers need to be aware of such differences when interpreting findings from different survey approaches.
Nevertheless, the online survey approach enabled us to quickly recruit Chinese migrants who were living in different states of Australia within a specific limited time and budget. The findings reported here regarding recruiting processes and outcomes are strictly applicable to these specific Chinese social network sites. More studies will be needed to articulate how to effectively recruit migrants or ethnic minorities of various populations using the Internet.
We also identified several limitations when we compared the data of these 2 surveys. First, these 2 health surveys adopted different strategies which may have contributed to the discrepancy in the composition of the 2 samples. The participants of postal survey included Chinese who were born in Hong Kong, Taiwan, Malaysia, Singapore, and other countries. The majority of the participants of online survey were born in Mainland China because that is where the majority of the registered members of the study websites were from. Second, the incentive of winning a gift card was offered in the online recruitment, whereas no financial incentives were provided in the postal survey. However, since the incentive is small and probability-based, we believe it is unlikely to be the major motivation of taking part in the health survey. Third, due to convenience sampling, neither sample is representative to the whole Australian Chinese community. Fourth, access to the online survey was confined to participants with adequate computer literacy to complete a questionnaire online. Our recruiting through social network sites was likely to overlook those older Chinese migrants who do not use computers and Internet. Last but not least, the postal survey was conducted 7 years prior to the Web-based survey. The demographic composition of migrants might have changed over time. Even so, however, that potential change in demographics is unlikely to account for the observed differences between 2 surveys. A recent study in the United States, using a telephone directory to obtain a sample of Chinese migrants, also showed that the sample population of a postal survey was relatively older and they were longer-stay migrants [
Recruiting Chinese migrants through social network sites for health research is demonstrated to be feasible in our online survey. This paper provided detailed processes and outcomes for recruiting Chinese migrants through social network sites in Australia. This online recruitment method is likely to reach younger or shorter-stay Chinese migrants but may miss those older or longer-stay migrants who may not use the Internet. Researchers need to be cautious of this potential sampling bias when interpreting their results. Nevertheless, these findings could be useful for planning and conducting future research or intervention programs among migrants and ethnic minorities.
We especially thank the Chinese immigrants who participated in our health surveys.
This work was supported by National Health & Medical Research Council of Australia (NHMRC, APP1042343).
None declared.