Background: Chronic pain places an enormous burden on health care systems. Multidisciplinary pain management services are well documented as an effective means to improve patient outcomes. However, waiting lists to access these services are long and outcomes deteriorate. Innovative solutions such as social media are gaining attention as a way to decrease this burden and improve outcomes. It is a challenge to design research that demonstrates whether social media are acceptable to patients and clinically effective.
Objective: The aim was to conduct a longitudinal pilot study to understand what aspects of research design are key to the success of running a larger-scale study of social media use in the clinical management of chronic pain.
Methods: A 12-week study examined social media use by patients on the waiting list for the Royal Melbourne Hospital Pain Management Service. Selected social media resources were suggested for use by patients waiting for an appointment at the clinic. Patients filled out measures for pain interference and pain self-efficacy before and after the study. Follow-up was conducted at monthly intervals via telephone semistructured interviews to discuss engagement and garner individual perceptions towards social media use. A social media-use instrument was also administered as part of the after-study questionnaire.
Results: Targeted recruitment refined 235 patient referrals to 138 (58.7%) suitable potential participants. Contact was made with 84 out of 138 (60.9%) patients. After a further exclusion of 54 out of 84 (64%) patients for various reasons, this left 30 out of 84 (36%) patients fitting the inclusion criteria and interested in study participation. A final study cohort of 17 out of 30 (57%) was obtained. Demographics of the 17 patients were mixed. Low back pain was the primary condition reported as leading to chronic pain. Semistructured interviews collected data from 16 out of 17 (94%) patients who started the trial, and at final follow-up 9 out of 17 (53%) patients completed questionnaires. Low specificity of the resources to one’s condition and time poorness may have been barriers to engagement.
Conclusions: Results suggest that with refinements, this study design can be implemented successfully when conducting a larger social media study. At present, comment cannot be made on what effect using social media can have on patients on hospital waiting lists, nor whether those who use social media while waiting in pain achieve better outcomes from eventual participation in a chronic pain program. Long-term follow-up should be included in future studies to answer this. Future research should focus on multicenter randomized controlled trials, involving patients in the intervention design for improved participation and outcomes and for evidence to be sound.
Chronic pain is one facet of chronic disease placing a significant burden on health care systems and individuals alike, through stigma, personal suffering, loss of income, and isolation. It is estimated to affect approximately 1 in 5 Australians and to cost the economy AUD $34 billion a year [- ]. One consequence has been increased waiting list times to access clinic-based pain management services (up to 6 months). This correlates to poorer patient-reported outcomes (PROs) for quality of life (QOL), and for psychological and physical well-being [ , ].
Specialized multidisciplinary team approaches and pain management programs are well-established forms of management  for the primary reasons of cost, social interaction, and sensations of validation among attendees. There has been a strong national endeavor across pain services to monitor patient outcomes to ensure that treatments provided actually result in improved function and QOL for patients [ ]. Regardless, the health care system struggles to provide timely access to such services. Chronic pain self-management support is, therefore, crucial.
Barlow and colleagues describe self-management as the individual’s ability to manage the symptoms and treatment, as well as the physical and social consequences of lifestyle changes linked to living with a chronic condition . Various self-management interventions have been described, for example the Stanford model of chronic disease self-management program, acceptance and commitment therapy, and cognitive behavioral therapy (CBT) [ ]. From a broader health care system point of view, benefits of effective self-management strategies can include decreased medical consultations, hospitalizations, and imaging investigations. From a patient point of view, benefits include decreased use of analgesic and days off work, as well as improved QOL, mood, self-efficacy, and empowerment, to name a few [ , , ].
Innovative and cost-effective strategies are recommended to alleviate the pressing need for self-management support [, ]. Web-based resources are one area gaining attention [ , , ]. These may be implemented as stand-alone interventions, as adjuncts to traditional care, or as tools to bridge the waiting time between obtaining a referral from a general practitioner and receiving a place in a pain clinic program [ ]. Recent examples in Australia include the following: painHEALTH from Western Australia [ ] and the Pain Management Network from New South Wales [ ]. However, it is a challenge to demonstrate that such resources are clinically effective and accepted by patients [ ].
The success of Web-based resources may lie in their ability to provide individuals with a means to tailor management to their own needs, as well as a channel for support outside of traditional clinic hours [, ]. This is a distinct advantage over offline chronic pain management; there is the potential to reach large, diverse populations at relatively low cost and provide geographically unrestrained access to resources. Hence, their appeal for reaching people with chronic pain (PWCP) in remote areas, those with changing schedules, stigmatized and isolated individuals, and those who have mobility issues [ ].
Social media—sometimes referred to as Health 2.0 tools—provide an innovative approach to Web-based resources. Unlike general Web-based interventions, social media are characterized by more highly evolved platforms that allow enhanced user engagement and autonomy, as well as greater social functionality and interaction [, ]. This ultimately allows patients to better appraise their own individual situation. In social cognitive theory this is called self-efficacy [ ] and it can be enhanced by peer modeling and support, things that social media may enable. Patients may thus become more empowered and engaged in collaborative self-management [ - ].
Studies have examined social media use in chronic pain [- ]. However, none have examined the utility of social media for PWCP on waiting lists for specialist pain services. Nor have any studies involved patients in the study design process, with a focus on their perceptions and motivations for using different social media [ ]. Results from studies conducted to date are not yet sufficient to inform design or implementation of social media interventions in clinical settings [ ]. Greater emphasis is needed on conceptual research frameworks within a participatory health research paradigm for social media to become useful tools in chronic pain self-management [ ].
Therefore, the aim of this pilot study was to understand what aspects of research design are key to the success of running a larger-scale study of social media use in the clinical management of chronic pain.
The methodology of this pilot study aligns with previous research into the therapeutic affordances of social media in PWCP [- ]. This approach recognizes that each patient has individualized needs, building on the principles of participatory health care [ ].
The setting chosen for the study was the Royal Melbourne Hospital—Pain Management Services (RMH-PMS). The Royal Melbourne Hospital (RMH) is a large publicly funded hospital in Melbourne, Australia. It offers one of the most comprehensive outpatient pain management services in the country. RMH-PMS has between 900 and 1100 outpatient referrals per year. At any one time, there are from 200 to 300 PWCP on the waiting list, and they have a wait time of 6 to 8 months for a first appointment. RMH-PMS provides an ideal context in which to test a social media intervention.
The Human Research Ethics Committees of Melbourne Health and the University of Melbourne approved this study (ID No. 2014.043). During the review of the project, the ethics committee specifically considered the following areas of study design:
1. The sample: comments were made about representativeness and selection of the sample, as well as the impact using social media may have on expectations of patients for management of their condition.
2. Social media resources: feedback centered on anticipated outcomes and what impact social media would have on participants’ conditions. Queries related to the appropriateness of the resources, who would be responsible for the content, and monitoring the resources.
3. Logistics and staff allocation: this covered staff and time required to recruit, to manage participant numbers during the study, to collect data, and to conduct follow-up.
Targeted Patients and Recruitment
The sample pool consisted of patients with chronic pain—pain of greater than 3-months duration [, ]—on the RMH-PMS outpatient waiting list. Sampling was sequential and inclusion criteria were applied (see ). Exclusion criteria were also applied, including the following: a change in priority status (ie, immediate intervention required) or discharge from the waiting list.
|Competent in English (reading and writing)|
|Regular Internet access and competent usage abilities based on a preexisting, validated model ||An Internet-literate cohort was sought because Internet users were the primary point of reference for this study.|
|Willing to register with Gmail and Facebook (if they didn’t already have accounts) and be bound to each site’s terms and conditions|
|Not currently undertaking any online intervention to manage their pain|
|Not currently using chronic pain-related social media resources for management of this condition||We defined this as follows: being a member of a pain support group online and/or regularly reading blogs, watching videos, and contributing to forums about pain (this did not exclude general/personal social media use).|
|Medically appropriate (based on physical/psychological status, cognitive function, visual/hearing function)||This was determined by clinical study investigators.|
A clinically relevant sample was sought. Desired cohort size for this study was estimated based on the following factors: participant numbers used in pilot studies within a similar domain [- ], the number of referrals to the RMH-PMS program within a 3- to 4-month period, and the number of patients managed in the pain service at any particular time. Based on a combination of these factors, the aim was to enroll approximately 20 patients.
Potential patients classified as priority 2 were sourced from the RMH-PMS Direct Access Unit referrals database. Priority 2 includes patients receiving support via a primary care practitioner while waiting for a consult at RMH-PMS. Referrals are received from general practitioners in the local area, community health centers, other medical specialists, and internal referrals from RMH. Each referral was reviewed for preliminary suitability by two of the study’s investigators who met nine times between April and September 2014. Potentially suitable participants were flagged based on matching information recorded in their referral with study inclusion/exclusion criteria (ie, English language ability, current interventions/treatments, any significant conditions requiring treatment noted in the history). Recruitment was conducted via phone calls from July to September 2014. The people reached were advised of typical waiting list times and introduced to this study as a self-management strategy available in the meantime. The phone transcript can be found in.
Interested patients were emailed with a link to the study website and a unique identifier. The link led to SurveyMonkey—an online survey site—where the study information, consent form, and pretest questionnaire were hosted. After 1 week, follow-up phone calls were made to discuss the study, determine suitability, confirm Internet competence, and to ensure the prestudy questionnaire was submitted to confirm registration in the study. Once registered, contact was made to discuss final details and educational material was emailed that contained links to the suggested social media resources and instructional videos—filmed by the study’s primary investigator—to act as an introduction to the resources and provide instructional information for using the resources. The educational material can be found in.
Patients who were ineligible to participate in the study were provided with information about online resources (ie, painHEALTH ) if they desired for their future reference.
Each enrolled patient completed the intervention over 12 weeks and because recruitment was staggered, some commenced at different points in time. The entire intervention period ran from July 24 to December 5, 2014. Waiting list time is typically between 6 and 8 months with specialist preclinic pain education provided close to the medical admission appointment. Therefore, treatment was not delayed by completing this study. No incentives were offered to participate. It was also explained that the study was a pilot study and that participant feedback may help to shape future consideration of social media resources for the RMH-PMS.
Patients were informed that the intervention consisted of using the suggested social media-based pain management resources in an unrestrained fashion over the allotted time period. Patients were asked to interact with these at their own pace. They were given the autonomy to be selective as to which they interacted with and how. Of interest was the impact that use might have on their condition and on their understanding about pain management, and finally, to know how they interacted with the resources—this would be examined during monthly semistructured interviews that will be described further.
The social media resources incorporated into this study included a large chronic pain support community on Facebook, a selection of chronic pain blogs, and pain management YouTube videos filmed by painHEALTH. Further detail about these resources and their selection for this study can be found in. These particular platforms were suggested based on social media used by PWCP from a global online survey investigating social media use in chronic pain self-management. Also, platforms were selected based on each platform’s ability to foster various therapeutic affordances that appear conducive to positively impacting health effects in chronic pain [ , ]. The resources were reviewed and agreed on by all study investigators from both the Health and Biomedical Informatics Centre at the University and RMH-PMS.
Pre- and postintervention data were collected, as well as data collected at monthly intervals during the study. To start, participants completed a questionnaire on SurveyMonkey that amalgamated demographic information, chronic pain status, and patient-reported outcome measures (PROMs)—pain interference and pain self-efficacy—into one survey (see). Patient-reported outcomes (PROs) provide insight into the patient’s perception of the impact that interventions have on their health [ ].
Pain interference (PI) is an example of a regularly examined standardized outcome that measures the burden on an individual across a wide range of health-related quality-of-life (HRQOL) measures [, ]. PI was measured using 16 items from the Patient-Reported Outcomes Measurement Information System—Pain Interference (PROMIS-PI) item bank and included one item from the pain behavior item bank to measure pain severity. Unlike common legacy outcome measures used to measure chronic pain, the PROMIS-PI item bank demonstrates good reliability and validity across a variety of chronic diseases, including chronic pain, and shows strong correlations to other common outcome measures, allowing findings from this study to be compared and generalized in the future [ , ].
Pain self-efficacy (PSE), or confidence in one’s ability to perform certain tasks in the face of pain, was measured using the 10-item Pain Self-Efficacy Questionnaire (PSEQ) . Social cognitive theory underlying PSE was discussed briefly in the introduction [ ]. Based on social media’s ability to foster peer modeling and support, it was logical to include the PSEQ as a primary measure. The PSEQ has frequently been cited as a standardized outcome measure in chronic pain management. Accordingly, efficacy determines the effort and persistence an individual will apply when faced with hurdles and adverse experiences. Like PROMIS-PI, the PSEQ provides a means to overcome inconsistency and generalizability among previous existing legacy measures covering a range of general behaviors and activities, and directly contextualizes self-efficacy in regard to living with pain [ , ]. Similar to the argument made for the use of PROMIS-PI, the PSEQ is favored over legacy self-efficacy measures because it more effectively overcomes the variability in measurement presented by other instruments.
At the end of the study, patients were guided to a second SurveyMonkey questionnaire that amalgamated all PROMs (PROMIS-PI and PSEQ) and a social media-use instrument into one survey (see). The social media-use instrument sought to examine which resources were used, the amount used, features of each used, positive/negative aspects of using the resources, and perceptions toward various therapeutic affordances. The same line of questioning was used for each resource—Facebook page, blogs, and YouTube videos. Questions about therapeutic affordances were phrased to better understand the degree to which each affordance is present and impacts PROs. Five therapeutic affordances of social media, refined through a global online survey of PWCP [ ], were examined through 15 statements, each consisting of three exploratory components. These measured the following: (1) self-presentation—preferences regarding one’s identity, (2) connection—using social media to connect with others, (3) exploration—guidance toward useful information, (4) narration—sharing experiences of chronic pain, and finally (5) adaptation—motivation, frequency, and type of use.
At monthly intervals during the intervention period, patients were also contacted on the phone by the primary investigator to complete a brief 10- to 15-minute, semistructured interview (see). Semistructured interviews are well suited to small-scale studies with small participant numbers, and their utility lies in their ability to collect rich qualitative data that can be analyzed in a variety of ways to supplement pre- and posttest survey data [ , ]. Data collection gave people a chance to discuss participation and study progress, but more importantly offered patients the opportunity to help shape social media use in future studies and interventions by collecting information regarding social media use and perceptions toward the five therapeutic affordances free of coercion. These phone calls were not medical consultations and patients were advised of this. Any queries of a medical nature were flagged for follow-up by a member of the clinical team.
Major study design procedures and the study process are the focus of the results described. Brief descriptive statistics of pre- and posttest survey data are also presented. Pertinent to the study was the examination of barriers to engagement with the resources and intervention. To explore these, thematic analysis was employed using a grounded theory inductive phenomenological approach on the semistructured interview data to uncover any emergent themes.
Deductive coding of semistructured interviews was also conducted to categorize patient comments against our list of five therapeutic affordances: self-presentation, connection, exploration, narration, and adaptation. These results will be the subject of a separate manuscript.
Furthermore, the posttest PROMs were analyzed using paired t tests and Fisher's exact test. In order to compute the PROMIS-PI data, raw scores were first translated into a T score for each patient. The T score rescales the raw scores into a calibrated and standardized score with a mean of 50 and standard deviation of 10. The value of hypothesis testing is limited due to the small sample size and given that potential covariates such as gender, age, and educational level were not able to be stratified .
Study Design and Processes
During nine rounds of referral screening at RMH-PMS Direct Access Unit, 235 referrals were examined for suitability. A total of 138 out of 235 (58.7%) were deemed appropriate for possible study inclusion. A total of 55 out of 235 (23.4%) were inappropriate for inclusion based on priority status for medical intervention and/or medical status, planned discharge, psychological status, drug-seeking behavior, and/or cognitive impairment. A further 42 out of 235 (17.9%) were from non-English-speaking backgrounds (NESBs) and, thus, inappropriate for this particular study (see).
|Assessed, n||Suitable, n||Inappropriate, n||Non-English speaking, n|
|Total, n (%)||N/Aa||235 (100)||138 (58.7)||55 (23.4)||42 (17.9)|
aN/A: not applicable
is the recruitment spreadsheet detailing success of the recruitment effort. Unreachable patients are shaded with grey (54/138, 39.1%); these represented roughly equal numbers of males (25/54, 46%) and females (29/54, 54%), while age range of nonresponders was relatively unremarkable. Contact was made with 84 out of 138 (60.9%) potentially suitable patients. Those indicated by the color red in were excluded (54/84, 64%). Reasons for exclusion are further broken down into self (19/54, 35%) or external (35/54, 65%). shows reasons for exclusion. Major reasons for self-exclusion were as follows: no interest in participating and no connected devices. External reasons for exclusion included the following: patient moved to priority treatment, medically inappropriate, and non-English speaking.
|Reason for nonparticipation||n (%)|
|Not interested in participating||8 (42)|
|No connected devices||4 (21)|
|Prolonged computer use flares pain||3 (16)|
|Time poor||2 (11)|
|Against Internet and Facebook||1 (5)|
|Confident with self-management||1 (5)|
|Moved to priority treatment||12 (34)|
|Medically inappropriate||8 (23)|
|Non-English speaking||8 (23)|
|Discharged from waiting list||5 (14)|
|Duplicate referral||2 (6)|
This process left a total of 30 out of 84 (36%) patients fitting the inclusion criteria and interested in study participation. All 30 patients were emailed the study information for registration purposes; this process yielded a final study cohort of 17 out of 30—indicated in blue in—who supplied pretest data, giving a participation rate of 57%. Those that did not register are highlighted in orange. The full recruitment process can be seen in .
Demographics are presented in. The study included slightly more females (10/17, 59%). Age range was spread: 13 out of 17 (76%) patients were aged between 18 and 39 years, with only 1 patient aged older than 50 years. A total of 10 out of 17 (59%) patients reported never being married and 4 out of 17 (24%) were married/partnered. Education level also varied, with 9 out of 17 (53%) patients having completed high school or less and 8 out of 17 (47%) having obtained a university degree or higher. Work status indicated that more than half of the patients were not working due to ill health (9/17, 53%) and only 3 out of 17 (18%) patients were currently working full time.
Enrolled patients were asked to provide information about their chronic pain. A total of 9 out of 17 (53%) patients reported a duration of chronic pain between 1 and 5 years; 7 out of 17 (41%) reported pain duration of greater than 5 years. Low back pain was the primary ailment reported (8/17, 47%)—defined as upper/middle/lower back pain—whereas 3 out of 17 (18%) patients reported hip/leg/foot pain as their primary pains. Various offline treatment modalities—in the last 12 months—for pain management were noted. Doctor’s visits (16/17, 94%) and medication (15/17, 88%) were most reported. Physical therapies (ie, physiotherapy, massage, myotherapy) were next (13/17, 76%), followed equally by exercise classes and relaxation/meditation (8/17, 47%), and finally, psychology/counseling (5/17, 29%). Other free-text responses also highlighted acupuncture and walking.
Each patient was asked whether their pain was flared or stable at the time of the study. The majority (12/17, 71%) reporting flared, with 12 out of 17 (71%) patients reporting average day-to-day pain at a level of 6 to 7 out of 10 (mean 7.1, SD 1.2). Patients were also asked to indicate whether they had been formally diagnosed with a condition causing their pain and 10 out of 17 (59%) indicated this was the case. Fibromyalgia (3/17, 18%) and osteoarthritis (2/17, 12%) were most noted. Other recorded conditions included, but were not limited to, posttraumatic stress, temporomandibular joint syndrome, sciatica, and low back pain.
|Patient characteristics (n=17)||n (%)|
|Age range in years|
|Never married||10 (59)|
|Currently married/partnered||4 (24)|
|Level of education|
|High school or less||9 (53)|
|College/university completed||6 (35)|
|Postgraduate degree completed||2 (12)|
|Full time||3 (18)|
|Part time||2 (12)|
|Not working (ill health)||9 (53)|
|Not working (other)||3 (18)|
Engagement and Completion of the Study
Out of 17 patients, 16 were contactable, supplying data for this study (94% success rate).
A total of 12 patients out of 17 (71%) reported using the resources during the study. Based on the number of times each patient could be reached on the phone to collect data (n=38) and call durations of 15 minutes, on average, it is approximated that a rich dataset of 570 minutes or 9.5 hours of qualitative interview data was collected.
Study completion rate was calculated based on the number of completed posttest questionnaires received. Despite the success of the semistructured interviews, 9 out of 17 completed posttest questionnaires were received, giving a study completion rate of 53%. Out of 17 patients, 1 (6%) dropped out between study enrolment and first feedback phone call, 1 (6%) withdrew before final follow-up as she reported no longer needing pain management services, 2 (12%) submitted the final questionnaire but reported not having used the resources (hence, were eliminated from further analysis), and finally, 4 (24%) failed to submit the posttest questionnaire despite several attempts to contact them. No contact by patients was attempted during any phase of data collection requesting assistance completing the surveys. This satisfied the research team that the data collection tools were acceptable.
Barriers to Engagement With the Social Media Resources
Coding of the semistructured interview data yielded eight separate engagement themes (see). Based on the number of times each barrier was identified, time poor and low specificity of resources to one’s condition were most noted. Effects of medication was also highlighted; patients noted that this was due to their sedative effect and/or impact on concentration. Only 2 out of 17 patients (12%) suggested access to the Internet was an issue.
Some of these barriers were also identified in the free-text responses of the posttest survey, for example, low specificity of resources. According to Patient SM021, “I have a more localized pain condition and most of the resources were for generalized conditions so I had trouble relating to many of them.” This was echoed by Patient SM112, who stated, “I think that because they weren’t about my pain and there were none about the pain I was going through I found it not very useful.”
|Theme||Participants (n=17), n (%)|
|Time poor||7 (41)|
|Low specificity of resources||6 (35)|
|Effects of medication||4 (24)|
|High pain levels||2 (12)|
|Pain-focused mentality||2 (12)|
|Internet access||2 (12)|
|Too much text-based information||1 (6)|
|Pain resolved||1 (6)|
The aim of this study was to examine the pilot-testing of social media use with patients in the clinical setting, focusing on major aspects of the study design. The study also produced evidence to support social media use and PROs from earlier studies [, ]. However, these findings are not the focus of this protocol paper.
The use of mixed methods in eHealth research is often advocated [- ]. This study also presents a strong case for the complementarity of such a research design. The richness of both quantitative and qualitative datasets and their value to examining the effectiveness of pilot studies has been discussed within a similar research context to this study [ , , ].
By combining empirical PROs data from PROMIS-PI, PSEQ, and from the social media-use instrument with the qualitative semistructured interview data and free-text responses about social media use from the posttest survey, a rich dataset was obtained. This becomes particularly useful with a small sample size, such as the one in this study. It helps to cross-validate findings and strengthen converging inferences .
Collecting empirical data about social media use was able to corroborate semistructured interview data. Similarly, data collected regarding patient perceptions toward each of the five therapeutic affordances of social media helped validate findings from a global online survey of PWCP [, ]. This enhances the scope to generalize study findings in future research and across different study areas and conditions within similar domains.
The recruitment procedure used in this study was extensive and demonstrates a targeted method aimed at recruiting the most suitable clinical cohort that might benefit from the intervention. It is the belief of the research team that the method for recruiting such a targeted cohort in this study is appropriate and would be scalable in a larger-scale randomized controlled trial (RCT) study. This is because the aim was to refine the most suitable cohort required to test the effectiveness of social media to positively impact PROs. This was not a study of readiness to adopt social media. A similar targeted approach has been seen in other pilot studies within a similar study domain [, , ].
However, targeted recruitment does highlight pertinent ethical considerations, such as “representativeness and selection.” Internet access and English language problems were two considerations noted from the RMH-PMS population. Similarly to this study, most social media interventions target Internet-competent, social media-using participants and/or people thinking about engaging in health behavior change [, , ]. While some may argue that this may limit the generalizability of findings, it has also been argued that chronic pain patients almost always self-select their own management (ie, medication, physiotherapy, exercises, surgery, etc). Hence, a self-selecting study design is still ecologically valid [ ].
Demographic characteristics predicting participation in social media or other Web-based interventions for chronic disease management are also interesting and relevant. This has traditionally been skewed towards well-educated females of a relatively high socioeconomic status. Marital status and age are more varied but studies are typically slanted toward those in relationships/married and aged 30 to 60 years [- ]. Literature has also previously reported that people living with chronic illness are typically more representative of lower socioeconomic status and educational level [ , , ]. What was found in the present study is that the clinical setting is representative of a greater demographic spread and it was this clinical PWCP population that was of interest for examination. Patients were an equal mix of males and females, education level was generally lower (in this study, 9/17 [53%] completed high school or less), more than half were unemployed due to ill health (9/17, 53%), and age range varied from approximately 18 to 59 years. Earlier studies, such as that of Berman et al [ ], reported significant improvements in PROs for older chronic pain patients (55+ years). They also reported minimal issues for participants navigating the online resources, suggesting that older adults in the chronic pain setting may also derive benefit from online interventions. In this study 19 out of 138 (13.8%) potentially suitable study recruits were aged 55 years or over.
Engagement and Completion of the Study
According to Sheaves et al , the study completion rate of 53% (9/17) is comparable with other Web-based health studies. Reasons for attrition according to interview data about barriers to engagement, may have been low specificity of resources to one’s condition and lack of time to use the resources.
The semistructured interviews conducted monthly by telephone were an important tool in understanding reasons for engagement or nonengagement above. In contrast to overall completion rate, results showed that 94% (16/17) of patients were able to be engaged by phone. This enhanced collaboration between patients and the research team and placed greater emphasis on patient preferences and perceptions about using social media for their self-management. In other studies, such as that of Sheaves et al , email was used to collect data. The authors reported that lack of response to feedback emails was high. Hence, conducting semistructured interviews by telephone rather than via email may be a more successful data collection and patient engagement method in social media studies.
As noted from patient feedback, low specificity of resources to one’s condition negatively influenced engagement. It has been reported that often those living with chronic conditions have multiple comorbid manifestations and, hence, Web-based resources can fail to cover enough of their individualized needs for them to be deemed of significant value . As could be seen from the research design, general chronic pain management social media resources were suggested to patients, not those specific to any one chronic condition (eg, low back pain, rheumatoid arthritis). This was decided based on current evidence-based approaches to chronic pain management, focusing on holistic multi-faceted, versus disease-specific, management [ ]. The conflict observed between a desire to deliver evidence-based practice (EBP) and patient preferences for their own management highlights the need for greater emphasis on shared decision-making models between patient and clinician to achieve success in larger-scale studies in the future [ ].
Suggesting certain social media resources as a starting point was done to provide some element of quality control and uphold ethical standards of care. However, freedom was encouraged for patients to use the resources as they wished and explore different avenues using the social media resources. Unlike many earlier studies conducted in this space, the aim of the present study was to more closely replicate social media use in day-to-day life (ie, open, engaging, collaborative, participatory) rather than to create a specific online intervention that dictates exactly what patients engage with and how they engage with it.
Finally, facilitated engagement of social media interventions, or involvement of clinicians, has been reported as another positive way to improve participation and intervention adherence. In turn, this has a positive flow onto PROs [, , - ]. In Hoch et al [ ], the entire pilot intervention was guided by a clinical nurse. This led to a completion rate of 24 out of 28 (86%). However, unlike this study, that of Hoch et al [ ] was a social media intervention that translated a traditional face-to-face intervention into one delivered in a virtual world. The nurse had an integral role in delivering each session, thus mimicking offline management. Autonomous self-management was the goal for this study, not translating an intervention into an online one. Hence, using social media resources cannot be truly facilitated in the same manner. Empowering patients to make their own decisions about using social media in this manner also has positive connotations for study logistics, suggesting that fewer clinical staff would be required to run future larger-scale studies.
Strengths and Limitations
The foremost strength of this pilot study lay in the intervention design. The choice was to encourage participating patients to be more autonomous and decide on which social media to use and how to use them as part of self-management. This breaks away from conventional Web-based intervention design based on constrained, predefined online interventions. As discussed, this idea fits within a participatory model, suggesting, not prescribing, a Web-based intervention. It places greater weight on patients’ perceptions and preferences for health self-management online.
Web-based interventions in chronic pain traditionally collect data using several disparate PROMs. As seen and described in Buhrman et al , the decision to incorporate several legacy measures increases the risk of deriving findings due to chance. The authors also suggest that many chronic pain PROMs have a weak theoretical basis. Future research would benefit from utilizing standardized, validated, and generalizable measures to overcome such issues. This is another reason to advocate for the strength of using PROMs such as PROMIS within this research domain [ , ]. It is the belief of the research team that, to date, no similar studies have used PROMIS for outcome measurement in this context. PROMIS has been validated against a variety of measures and across a range of conditions. Hence, using this study as a benchmark, researchers interested in studying social media for chronic pain management will be able to compare findings across a range of contexts and conditions in the future.
RCT designs are synonymous with robust health research. This method is strongly advocated in trials of effectiveness and has been employed in other Web-based chronic pain studies [, ]. However, the decision was made to run this study as a single-arm trial with only an intervention group as numbers would not be sufficient to warrant an RCT at this stage. Similar designs and sample sizes have been seen in other social-media-in-chronic-disease pilot studies [ ]. The recruitment process showed how difficult it is to recruit large numbers of patients into studies where no incentives are offered. As was seen, it was not until members of the clinical team began conducting recruitment phone calls that a rise in study interest was seen and, hence, enrolments. Future research warrants larger-scale studies to recruit sufficient numbers to use RCT designs to accurately test the effectiveness of social media use in the clinical management of chronic pain.
The decision to merely suggest social media resources, but allow patients to make their own decisions about which to use, meant that the resources patients actually used were not able to be verified. PROs collected may be in reference to a variety of social media resources, both reputable and not. Thus, study findings are open to interpretation bias. This is one of the reasons that emphasis is not placed on posttest PROMIS-PI and PSEQ findings in this study.
There is a trade-off between targeted recruitment of competent and enthusiastic social media-using chronic pain population members and ensuring all chronic pain patients who may benefit from social media can participate. Until social media interventions can better address the needs of chronic pain patients who suffer from a lack of Internet access, poor literacy skills, poor Internet literacy, and language barriers, they will always be biased toward self-selecting populations. Hence, any conclusions drawn from this pilot study regarding recruitment, intervention design, and engagement are in reference to the current sample only.
Other pilot studies [, ] have reported completion rates slightly better than those of this study (9/17, 53%). However, both of these studies utilized incentives ranging from monetary amounts through to allowing participants to keep the supplied technology. This study did not offer incentives as a way to minimize selection bias, but their value is not discounted for future study as another way to enhance recruitment and/or decrease attrition.
Recommendations and Conclusions
This pilot study has outlined key considerations for conducting social media interventional research in the clinical setting, in particular, study design, recruitment, and engagement.
Targeted recruitment of social media users indicates that enthusiastic, competent social media users may be still largely underrepresented on pain management services’ waiting lists. Therefore, these interventions may not yet be appropriate for all PWCP. Further work is required to ensure that those in need of online support will also be catered to by social media’s integration into clinical service models. In line with recommendations by Sheaves et al , future studies would be well advised to (1) include general practice sites in research, where patients may have more need for information (given that they are more likely to be earlier in the course of managing their pain) and (2) include eHealth literacy education, training, and support as part of care models for those who have low computer literacy skills, but may stand to benefit from online resources [ ].
As patients become increasingly connected and active shared decision makers in their self-management, researchers would be advised to pay close attention to study designs that give patients greater flexibility and empower them to make decisions about the online resources they use. This is where the potential for social media sits above traditional Web-based interventions. Social media resources must actively engage patients as seen in this study. Finally, acknowledging patient preferences for resources that adequately address disease-specific needs is also a consideration.
Future research into the effectiveness and potential for social media use in the clinical management of chronic pain is warranted. While this study cannot ascertain what effect the use of social media resources can ultimately have on hospital waiting lists, a considered approach to conducting this type of research has been offered. Future studies need to focus on larger-scale, multicenter RCTs and involve patients in the intervention design in order to achieve desired effect sizes and for evidence to be sound.
The authors would like to thank the Melbourne Networked Society Institute (MNSI) at the University of Melbourne, Victoria, Australia for ongoing support of this research. We would also like to thank the entire team involved in this project from the Chronic Pain Clinic at the Royal Melbourne Hospital-Pain Management Services. We also acknowledge Dr Guillermo Lopez-Campos from the Health and Biomedical Informatics Centre, the University of Melbourne, for his advice on data analysis, and Professor Danny Liew of the Melbourne EpiCentre, the Royal Melbourne Hospital, for his advice on study design and data analysis.
Conflicts of Interest
Multimedia Appendix 1
Telephone transcript.PDF File (Adobe PDF File), 132KB
Multimedia Appendix 2
Patient educational material.PDF File (Adobe PDF File), 112KB
Multimedia Appendix 3
Selected study resources.PDF File (Adobe PDF File), 54KB
Multimedia Appendix 4
Pretest questionnaire.PDF File (Adobe PDF File), 306KB
Multimedia Appendix 5
Posttest questionnaire.PDF File (Adobe PDF File), 420KB
Multimedia Appendix 6
Semistructured interview template.PDF File (Adobe PDF File), 34KB
Multimedia Appendix 7
Recruitment list.PDF File (Adobe PDF File), 64KB
- Mann EG, Lefort S, Vandenkerkhof EG. Self-management interventions for chronic pain. Pain Manag 2013 May;3(3):211-222. [CrossRef] [Medline]
- Hogg MN, Gibson S, Helou A, DeGabriele J, Farrell MJ. Waiting in pain: a systematic investigation into the provision of persistent pain services in Australia. Med J Aust 2012 Apr 2;196(6):386-390. [Medline]
- Cousins MJ. Unrelieved pain: a major health care priority. Med J Aust 2012 Apr 2;196(6):373-374. [Medline]
- Blyth FM, March LM, Brnabic AJ, Jorm LR, Williamson M, Cousins MJ. Chronic pain in Australia: a prevalence study. Pain 2001 Jan;89(2-3):127-134. [Medline]
- Lynch ME, Campbell F, Clark AJ, Dunbar MJ, Goldstein D, Peng P, et al. A systematic review of the effect of waiting for treatment for chronic pain. Pain 2008 May;136(1-2):97-116. [CrossRef] [Medline]
- Burke AL, Denson LA, Mathias JL, Hogg MN. An analysis of multidisciplinary staffing levels and clinical activity in Australian tertiary persistent pain services. Pain Med 2015 Jun;16(6):1221-1237. [CrossRef] [Medline]
- Barlow J, Wright C, Sheasby J, Turner A, Hainsworth J. Self-management approaches for people with chronic conditions: a review. Patient Educ Couns 2002;48(2):177-187. [Medline]
- Reuben DB, Tinetti ME. Goal-oriented patient care--an alternative health outcomes paradigm. N Engl J Med 2012 Mar 1;366(9):777-779. [CrossRef] [Medline]
- van Uden-Kraan CF, Drossaert CH, Taal E, Shaw BR, Seydel ER, van de Laar MA. Empowering processes and outcomes of participation in online support groups for patients with breast cancer, arthritis, or fibromyalgia. Qual Health Res 2008 Mar;18(3):405-417. [CrossRef] [Medline]
- Semple TJ, Hogg MN. Waiting in pain. Med J Aust 2012 Apr 2;196(6):372-373. [Medline]
- Nevedal DC, Wang C, Oberleitner L, Schwartz S, Williams AM. Effects of an individually tailored Web-based chronic pain management program on pain severity, psychological health, and functioning. J Med Internet Res 2013;15(9):e201 [FREE Full text] [CrossRef] [Medline]
- painHEALTH: Musculoskeletal Pain Help. 2013. URL: http://painhealth.csse.uwa.edu.au/ [accessed 2015-04-14] [WebCite Cache]
- Pain Management Network. Chatswood, NSW, Australia: Agency for Clinical Innovation; 2014. URL: http://www.aci.health.nsw.gov.au/chronic-pain [accessed 2015-04-14] [WebCite Cache]
- Hesse BW, O'Connell M, Augustson EM, Chou WS, Shaikh AR, Rutten LJ. Realizing the promise of Web 2.0: engaging community intelligence. J Health Commun 2011;16 Suppl 1:10-31 [FREE Full text] [CrossRef] [Medline]
- Schein R, Wilson K, Keelan J. Literature Review on Effectiveness of the Use of Social Media: A Report for Peel Public Health. Brampton, ON: Peel Public Health; 2010. URL: https://www.peelregion.ca/health/resources/pdf/socialmedia.pdf [accessed 2015-08-02] [WebCite Cache]
- Kamel Boulos MN, Wheeler S. The emerging Web 2.0 social software: an enabling suite of sociable technologies in health and health care education. Health Info Libr J 2007 Mar;24(1):2-23. [CrossRef] [Medline]
- Glasziou P, Haynes B. The paths from research to improved health outcomes. ACP J Club 2005;142(2):A8-A10. [Medline]
- Martin-Sanchez F, Lopez-Campos G, Gray K. Biomedical informatics methods for personalized medicine and participatory health. In: Sarkar N, editor. Methods in Biomedical Informatics: A Pragmatic Approach. Oxford, UK: Academic Press; 2014:347-394.
- Rodham K, McCabe C, Blake D. Seeking support: an interpretative phenomenological analysis of an Internet message board for people with Complex Regional Pain Syndrome. Psychol Health 2009 Jul;24(6):619-634. [CrossRef] [Medline]
- Schulz PJ, Rubinelli S, Mariotti G, Keller N. Meeting the ranging of informational needs of chronic low back pain sufferers: conceptual design and rationale of the interactive website ONESELF. Disabil Rehabil 2009;31(25):2118-2124. [CrossRef] [Medline]
- Ruehlman LS, Karoly P, Enders C. A randomized controlled evaluation of an online chronic pain self management program. Pain 2012 Feb;153(2):319-330 [FREE Full text] [CrossRef] [Medline]
- deBronkart D. From patient centred to people powered: autonomy on the rise. BMJ 2015;350:h148. [Medline]
- Maher CA, Lewis LK, Ferrar K, Marshall S, De Bourdeaudhuij I, Vandelanotte C. Are health behavior change interventions that use online social networks effective? A systematic review. J Med Internet Res 2014;16(2):e40 [FREE Full text] [CrossRef] [Medline]
- Weiss JB, Berner ES, Johnson KB, Giuse DA, Murphy BA, Lorenzi NM. Recommendations for the design, implementation and evaluation of social support in online communities, networks, and groups. J Biomed Inform 2013 Dec;46(6):970-976 [FREE Full text] [CrossRef] [Medline]
- Merolli M, Gray K, Martin-Sanchez F. Developing a framework to generate evidence of health outcomes from social media use in chronic disease management. Med 2 0 2013;2(2):e3 [FREE Full text] [CrossRef] [Medline]
- Merolli M, Gray K, Martin-Sanchez F. Therapeutic affordances of social media: emergent themes from a global online survey of people with chronic pain. J Med Internet Res 2014;16(12):e284 [FREE Full text] [CrossRef] [Medline]
- Merolli M, Gray K, Martin-Sanchez F, Lopez-Campos G. Patient-reported outcomes and therapeutic affordances of social media: findings from a global online survey of people with chronic pain. J Med Internet Res 2015;17(1):e20 [FREE Full text] [CrossRef] [Medline]
- Miron-Shatz T, Hansen MM, Grajales 3rd FJ, Martin-Sanchez F, Bamidis PD. Social media for the promotion of holistic self-participatory care: an evidence based approach. Contribution of the IMIA Social Media Working Group. Yearb Med Inform 2013;8(1):162-168. [Medline]
- Butler DS, Moseley GL. Explain Pain. 2nd edition. Adelaide City West, Australia: Noigroup Publications; 2013.
- Johannes CB, Le TK, Zhou X, Johnston JA, Dworkin RH. The prevalence of chronic pain in United States adults: results of an Internet-based survey. J Pain 2010 Nov;11(11):1230-1239. [CrossRef] [Medline]
- Eurostat. Community Survey on ICT Usage in Households and by Individuals. Version 3.1. Luxembourg City, Luxembourg: Eurostat; 2011. URL: http://www.dst.dk/extranet/varedekl/204.pdf [accessed 2015-04-14] [WebCite Cache]
- Hoch DB, Watson AJ, Linton DA, Bello HE, Senelly M, Milik MT, et al. The feasibility and impact of delivering a mind-body intervention in a virtual world. PLoS One 2012 Mar;7(3):e33843 [FREE Full text] [CrossRef] [Medline]
- Berman RL, Iris MA, Bode R, Drengenberg C. The effectiveness of an online mind-body intervention for older adults with chronic pain. J Pain 2009 Jan;10(1):68-79. [CrossRef] [Medline]
- Roblin DW. The potential of cellular technology to mediate social networks for support of chronic disease self-management. J Health Commun 2011;16 Suppl 1:59-76. [CrossRef] [Medline]
- Moore SK, Guarino H, Acosta MC, Aronson ID, Marsch LA, Rosenblum A, et al. Patients as collaborators: using focus groups and feedback sessions to develop an interactive, web-based self-management intervention for chronic pain. Pain Med 2013 Nov;14(11):1730-1740 [FREE Full text] [CrossRef] [Medline]
- Sheaves B, Jones RB, Williamson GR, Chauhan R. Phase 1 pilot study of e-mail support for people with long term conditions using the Internet. BMC Med Inform Decis Mak 2011;11:20 [FREE Full text] [CrossRef] [Medline]
- Kawaguchi T, Azuma M, Ohta K. Development of a telenursing system for patients with chronic conditions. J Telemed Telecare 2004;10(4):239-244. [CrossRef] [Medline]
- Fledderus M, Schreurs KM, Bohlmeijer ET, Vollenbroek-Hutten MM. Development and pilot evaluation of an online relapse-prevention program based on acceptance and commitment therapy for chronic pain patients. JMIR Human Factors 2015 Jan 05;2(1):e1. [CrossRef]
- Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol 2010 Nov;63(11):1179-1194 [FREE Full text] [CrossRef] [Medline]
- Amtmann D, Cook KF, Jensen MP, Chen W, Choi S, Revicki D, et al. Development of a PROMIS item bank to measure pain interference. Pain 2010 Jul;150(1):173-182 [FREE Full text] [CrossRef] [Medline]
- Nicholas MK. The pain self-efficacy questionnaire: taking pain into account. Eur J Pain 2007 Feb;11(2):153-163. [CrossRef] [Medline]
- Tonkin L. The Pain Self-Efficacy Questionnaire. Aust J Physiother 2008;54(1):77. [Medline]
- Newton N. The use of semi-structured interviews in qualitative research: strengths and weaknesses. Exploring Qualitative Methods 2010:1-11.
- Drever E. Using Semi-Structured Interviews in Small-Scale Research: A Teacher's Guide. Glasgow, Scotland, UK: Scottish Council for Research in Education; 1995:1-89.
- Lancaster GA, Dodd S, Williamson PR. Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract 2004 May;10(2):307-312. [CrossRef] [Medline]
- Gable G. Integrating case study and survey research methods: an example in information systems. Eur J Inf Syst 1994 Jan;3(2):112-126. [CrossRef]
- Borkan JM. Mixed methods studies: a foundation for primary care research. Ann Fam Med 2004;2(1):4-6 [FREE Full text] [Medline]
- Straus SE, McAlister FA. Evidence-based medicine: a commentary on common criticisms. CMAJ 2000 Oct 3;163(7):837-841 [FREE Full text] [Medline]
- Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol 2010;10:1 [FREE Full text] [CrossRef] [Medline]
- Buhrman M, Nilsson-Ihrfeldt E, Jannert M, Ström L, Andersson G. Guided internet-based cognitive behavioural treatment for chronic back pain reduces pain catastrophizing: a randomized controlled trial. J Rehabil Med 2011 May;43(6):500-505 [FREE Full text] [CrossRef] [Medline]
- Khazaal Y, van Singer M, Chatton A, Achab S, Zullino D, Rothen S, et al. Does self-selection affect samples' representativeness in online surveys? An investigation in online video game research. J Med Internet Res 2014;16(7):e164 [FREE Full text] [CrossRef] [Medline]
- Alshaikh F, Ramzan F, Rawaf S, Majeed A. Social network sites as a mode to collect health data: a systematic review. J Med Internet Res 2014;16(7):e171 [FREE Full text] [CrossRef] [Medline]
- Lorig KR, Ritter PL, Laurent DD, Plant K. The internet-based arthritis self-management program: a one-year randomized trial for patients with arthritis or fibromyalgia. Arthritis Rheum 2008 Jul 15;59(7):1009-1017 [FREE Full text] [CrossRef] [Medline]
- Schubart JR, Stuckey HL, Ganeshamoorthy A, Sciamanna CN. Chronic health conditions and internet behavioral interventions: a review of factors to enhance user engagement. Comput Inform Nurs 2011 Feb;29(2):81-92. [CrossRef] [Medline]
- McLaughlin M, Nam Y, Gould J, Pade C, Meeske KA, Ruccione KS, et al. A videosharing social networking intervention for young adult cancer survivors. Comput Human Behav 2012 Mar;28(2):631-641. [CrossRef]
- Fox S, Purcell K. Pew Research Center. Washington, DC: Pew Internet & American Life Project; 2010 Mar 24. Chronic disease and the Internet URL: http://www.pewinternet.org/2010/03/24/chronic-disease-and-the-internet/ [accessed 2014-11-17] [WebCite Cache]
- Close S, Smaldone A, Fennoy I, Reame N, Grey M. Using information technology and social networking for recruitment of research participants: experience from an exploratory study of pediatric Klinefelter syndrome. J Med Internet Res 2013;15(3):e48 [FREE Full text] [CrossRef] [Medline]
- Børøsund E, Cvancarova M, Ekstedt M, Moore SM, Ruland CM. How user characteristics affect use patterns in web-based illness management support for patients with breast and prostate cancer. J Med Internet Res 2013;15(3):e34 [FREE Full text] [CrossRef] [Medline]
|CBT: cognitive behavioral therapy|
|EBP: evidence-based practice|
|HRQOL: health-related quality of life|
|MNSI: Melbourne Networked Society Institute|
|N/A: not applicable|
|NESB: non-English-speaking background|
|PI: pain interference|
|PRO: patient-reported outcome|
|PROM: patient-reported outcome measure|
|PROMIS: Patient-Reported Outcome Measurement Information System|
|PROMIS-PI: Patient-Reported Outcome Measurement Information System—Pain Interference|
|PSE: pain self-efficacy|
|PSEQ: Pain Self-Efficacy Questionnaire|
|PWCP: people with chronic pain|
|QOL: quality of life|
|RCT: randomized controlled trial|
|RMH: Royal Melbourne Hospital|
|RMH-PMS: Royal Melbourne Hospital—Pain Management Services|
Edited by G Eysenbach; submitted 06.05.15; peer-reviewed by E Gabarron, P Tighe; comments to author 24.05.15; revised version received 20.06.15; accepted 10.07.15; published 07.08.15Copyright
©Mark Merolli, Kathleen Gray, Fernando Martin-Sanchez, Steven Mantopoulos, Malcolm Hogg. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 07.08.2015.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.