Background: eHealth facilitation of chronic disease management has potential to increase engagement and effectiveness and extend access to care in rural areas.
Objective: The objective of this study was to demonstrate the feasibility and acceptability of an eHealth system for the management of chronic conditions in a rural setting.
Methods: We developed an online management program which incorporated content from the Flinders Chronic Condition Management Program (Flinders Program) and used an existing software platform (goACT), which is accessible by patients and health care workers using either Web-enabled mobile phone or Internet, enabling communication between patients and clinicians. We analyzed the impact of this eHealth system using qualitative and simple quantitative methods.
Results: The eHealth system was piloted with 8 recently hospitalized patients from rural areas, average age 63 (SD 9) years, each with an average of 5 chronic conditions and high level of psychological distress with an average K10 score of 32.20 (SD 5.81). Study participants interacted with the eHealth system. The average number of logins to the eHealth system by the study participants was 26.4 (SD 23.5) over 29 weeks. The login activity was higher early in the week.
Conclusions: The pilot demonstrated the feasibility of implementing and delivering a chronic disease management program using a Web-based patient-clinician application. A qualitative analysis revealed burden of illness and low levels of information technology literacy as barriers to patient engagement.
eHealth facilitation of chronic disease management has potential to add to program components, increase engagement and effectiveness, and extend access for underserved groups [- ]. Systems have been developed for specific chronic conditions, particularly diabetes [ ], but generic chronic disease management systems are also needed to structure overall care, especially for the majority of patients who have multi-morbidities [ , ]. However, there appear to be no well-evaluated eHealth systems to support delivery of generic chronic disease management and self-management support for individual patients [ ]. Comorbidity is the norm in chronic illness, and mental health problems are often present [ , ]. We therefore piloted an eHealth disease management program in people with comorbid mental health and physical health conditions or risk factors who live in rural areas. eHealth technologies should be developed and evaluated from the start as complex individual, social, organizational, and technical interventions [ ]. We therefore report quantitative and qualitative data from this pilot, providing preliminary assessment of initial patient acceptance, patient engagement, feasibility of delivery, and outcome measurement to inform further system development.
Our objective was to inform development of an eHealth system of chronic disease management by observing its use by patients with comorbid chronic diseases who live in rural areas and health care workers delivering the program to the patients.
An online management program was specifically developed for the study. This incorporated content from the Flinders Chronic Condition Management Program (Flinders Program) and used an existing software platform (goACT), which is accessible by patients and health care workers using either Web-enabled mobile phone or Internet .
The Flinders Program is an overarching program for chronic condition management applicable to medical and psychiatric conditions and to multi-morbidities . It provides a structured collaborative disease management process addressing behaviors of both patient and clinician. The program is based on cognitive behavior therapy, motivational interviewing, and behavioral psychotherapy. It uses a set of tools: the Partners in Health scale (PIH), Cue and Response interview (C&R), and Problem and Goals assessment (P&G). The patient completes the PIH to assess self-management knowledge, attitudes, behaviors, and impacts of chronic conditions. The health care worker uses the C&R to further explore the same concepts and shares his or her perspective with the patient. Strengths, barriers, priorities, and goals identified through shared use of these tools are incorporated into a negotiated care plan that integrates self-management and medical issues, management aims, agreed interventions, responsibilities, and review dates. The Flinders Program care plan tailors a range of possible self-management interventions to the individual, including disease-specific programs, skill-building programs, or community activities. The Flinders care plan is provided to the patient and, with permission, their health professionals and can be incorporated into an overall medical care plan.
Research studies have shown improved outcomes with use of the Flinders Program across a variety of conditions and patient groups [- ], including patients with mental health disorders [ ].
goACT is an online platform accessible by patients and health workers using either Web-enabled mobile phone or computer. Tools for some psychological therapies were already available on the platform but additional forms and communications could readily be added. Investigators wished to assess the feasibility of eHealth delivery of as many components of the Flinders Program as possible. All Flinders Program components (PIH, C&R, and P&G and the Flinders care plan) were therefore added to the goACT platform. Features of electronic systems were used where possible to improve on paper-based methods, for example in transfer of information between components of the program, and continual updating and sharing of information. eHealth features, such as reminders about goals, appointments, and activities, were integrated and negotiated so patients could view them as short message service (SMS) text or email messages or by logging into their goACT webpage. The patient was able to engage with goACT software to record progress and notes against their goals and activities on the Flinders Program and to send messages to the coach. Clients could also access additional goACT tools such as mood diaries.
eHealth-supported delivery of the Flinders Program included completion of PIH, C&R, and P&G tools and care plan into the goACT system where results could be accessed and updated by patients and health care workers, automated delivery of patient supports (such as action and appointment reminders), and email and SMS communication options to supplement any meetings or telephone contact agreed upon between patient and health care worker. The Flinders care plan was shared with health care providers and support network as identified by the patient, using appropriate electronic or physical formats.
The study was conducted in 2011 and 2012 and based in Mount Gambier, a regional center in South Australia with a population of about 25,000. The intervention was delivered by staff of a local community care organization, UnitingCare Wesley.
Inclusion criteria for the study were the presence of chronic physical and psychological comorbidities as recorded in case records of the recruiting organization, being a patient of the Mount Gambier Hospital (in rural South Australia) either as an inpatient or an outpatient, or a client of the local community care organization that delivered the program. Patients were not invited if currently physically or mentally distressed (eg by acute illness) where participation in the study would be burdensome. Participants were also required to use a simple mobile phone or Internet-based program. Mobile phones and dongles were provided for those participants who were experienced in the use of mobile phones and the Internet but who did not currently have access. Patients would be approached for recruitment after case note review, in medical or surgical wards of the hospital, in outpatient clinics, in the emergency department, and in community care settings. Potential participants were approached by nursing staff in the hospital and by community care workers in the community. The study was approved by the government of South Australia, Department of Health, Department of Health Human Research Ethics Committee.
Training in the Program
Health care workers had existing credentials and experience in delivery of the Flinders Program but had no knowledge of goACT prior to the study. The health care workers were provided with initial training in goACT and follow-up support. Ongoing modifications were made to the health care worker interface and functions in response to in-use experiences.
The health care worker introduced each participant to the goAct software on an Internet-enabled computer at the care organization or on a mobile phone that had an Internet connection. Ongoing technology-related education was provided by the health care worker at face-to-face visits and/or over the phone to match the learning needs of the participant.
Quantitative: Measures of Online Activity
The goACT program had the capacity to record a range of on line activity of subjects, including the number and date of subject logins.
Quantitative: Outcome Measures
At baseline, a range of sociodemographic and diagnostic data were recorded. Subjects also completed the SF36 , the K10 [ ], and the Partners in Health scale [ ]. These scales were repeated at 6 months.
Qualitative findings were drawn from documentary records. These were notes recorded by the health care worker conducting recruitment at Mount Gambier Hospital and a study report written by the health care worker responsible for delivery of the intervention program. This narrative report was based on the experiences and observations of the two health care workers delivering the program, along with findings from exit interviews performed by the workers as participants left the program. The content of the notes and report were analyzed using established thematic analysis methods to derive the two themes of feasibility of use and acceptability of use, and the subcategories such as “infrastructure/hardware problems” and “IT skills and confidence” [, ].
We report quantitative and qualitative findings for recruitment (as an indicator of patient acceptance), use of the system by patients and clinicians (as indicators of engagement and feasibility of delivery), and outcome measures (as an indicator of potential effectiveness).
Recruitment: Quantitative Findings
We recruited 8 participants to the program during the study: 5 from medical and surgical wards of the Mt Gambier Hospital and 3 from community services. The profiles of subjects recruited into the study are shown inand their online interactions are shown in .
|Case||Gender||Age (y)||Marital status||Source of referral||Diagnosis/conditions|
|1||M||54||Not known||A&Ea/hospital||Diabetes, multiple sclerosis|
|2||F||63||Married||A&E/hospital||Diabetes, post-traumatic stress disorder, hypertension, tachyarrhythmia|
|3||M||78||Married||Mental health team||Depression, back pain, eyesight, low mobility|
|4||F||65||Not known||A&E/hospital||Diabetes type 2, fibromyalgia, hypercholesterolemia, hypertension, diabetic neuropathy, restless legs, low mobility|
|5||F||51||Not known||A&E/hospital||Chronic pain, social agoraphobia|
|6||M||62||Not known||General practitioner||Depression, Crohn disease, osteoarthritis, anemia, bipolar disorder|
|7||F||70||Not known||Psychosocial rehabilitation service||Bipolar disorder|
|8||F||49||Single||Employment access (disability employment) service||Fibromyalgia, depression, scoliosis|
aA&E/hospital: Accident and emergency department in a hospital.
|Interaction (No. of patients)||Mean (SD; SEM)|
|Number of logins (8)||26.4 (23.5; 8.3)|
|emails to patients (4)||1.8 (0.5; 0.3)|
|SMS to patients (3)||1.7 (0.6; 0.3)|
|Internal emails sent to patients (7)||3.9 (3.4; 1.3)|
|Internal emails sent by patients (2)||4.5 (2.1; 1.5)|
|Exercise (3)||17.3 (19.6; 11.3)|
|Mood (5)||11.2 (14.3; 6.4)|
|Notes (3)||9.7 (13.3; 7.7)|
|Not done (8)||16.5 (18.9; 6.7)|
|Completed (8)||16.5 (15.2; 5.4)|
|Completion rate (6) (%)||45.2 (26.3; 10.7)|
During the recruitment period, 16 inpatients were identified from notes as meeting inclusion criteria, and 12 (75%) of these were available when study staff were available to conduct recruitment (eg, not transferred to another hospital or died). Of the 12, 5 (42%) consented and participated, 3 (25%) declined, and 3 (25%) initially consented but withdrew before participating. A further 3 patients were approached from community services, all of them consented and participated. The recruitment and intervention processes are outlined inand .
Recruitment: Qualitative Findings
The health care workers' narrative report of the project commented on unexpected difficulties with recruitment. Severity of illness was the main reason that approaches were not made. The report noted that there were unexpectedly high numbers of younger, more acutely ill patients admitted to the hospital during the period of the study, thereby reducing the number of patients who fit the inclusion criteria due to the severity of illness. The study report also noted that recruitment from the emergency department was not feasible due to high levels of acuity, lack of privacy to discuss the study project, and pressure for patients to be quickly triaged. Those who were approached but declined gave a range of reasons, including stigma associated with participating in a project associated with psychological health.
System Use: Quantitative Findings
All participants owned a mobile phone or had Internet access except for 2 participants, who were provided with a mobile phone and dongle to enable participation.
Overall, the goACT online management program was accessed 383 times during the study period. The 2 health care workers logged in 172 times (169 by the main health worker for the study). There were 211 logins by 6 of the 8 participants and no logins by 2 participants (see breakdown inbelow). The median number of logins for each week after recruitment and total number of participants logging in per week are also shown in . The number of logins varies between 4 and 8 per week during the first 8 weeks and decreases rapidly after this period. contains descriptive statistics for different types of interactions with patients.
The average number of logins by day of the week is shown in.
System Use by Health Care Workers: Qualitative Findings
The narrative study report provided the views and experiences of the health care workers in relation to the feasibility, acceptability, and development issues of delivering the Flinders Program via the goACT platform.
The health care worker was able to use goACT online management program to manage delivery, record-keeping, and communication with patients and other health professionals for the Flinders Program. However, Flinders Program aspects requiring in-depth conversations between health care worker and patient were entered into the software after the consultation. This was deemed necessary by the health care worker to achieve effective and conversational face-to-face interaction. This is important because the Flinders Program is based on patient-centered communication and shared decision-making.
Staff reported that the software was beneficial in that it supported electronic scoring of problems, goals, and activities. This was more useful than the traditional scoring on paper copies because it removed any need for transcribing. For example, goACT increased the ease of sharing information with other staff, including general practitioners who were not in the same area.
Despite the difficulties that the pilot group of participants experienced with the e-version of the program (as explained in the next section), the health care workers thought that the ability to deliver the Flinders Program via goACT added extra layers to the communication between staff and patient. They thought that there could be more attractive or convenient ways for some patients to interact with their health care workers, or for the patients to be more involved in their self-management. The goACT program clearly offers new communication options via email, as well as tools such as an exercise diary and the capacity to provide links to high-quality disease information and online therapy websites.
System Use by Patients: Qualitative Findings
In the narrative report, health care workers observed that most participants encountered difficulties with technology use and none used the software extensively. Information technology issues fell into three different categories. First, infrastructure/hardware problems, including drop-out of rural Internet connections (which are still not highly reliable in all areas of rural Australia) and 1 participant's mobile phone being stolen. It was difficult for staff to complete the C&R and P&G with 1 participant as they were repeatedly logged off the Internet. This problem was later resolved by obtaining a more efficient Internet dongle. Physical barriers to use included small-sized phone screens and poor eyesight. The second problem was related to general information technology (IT) skills and confidence. Client difficulties with using the FP+goACT software reflected their general lack of basic knowledge and confidence for use of IT. Participants may have had general lack of familiarity with mobile phones and the Internet or limited experience (eg, familiarity with voice calls on a mobile phone but not SMS or Internet access). Third, the degree of illness severity affected performance. For 2 participants, their health conditions affected their ability to use the software. For example, due to multiple sclerosis, 1 participant reported having difficulty comprehending and remembering information. This reduced his ability to use the goACT software because he was unable to recall how to use the software after training from both the health care worker and his wife.
Outcome Measures: Quantitative Findings
Differences between scores at admission and exit were analyzed using paired t-test, in SPSS version 19. There was little change in functional outcome during the period of the study, as indicated in.
|Admission to Program||Exit from Program||Change|
|Scale||Mean, SEM, SD||Mean, SEM, SD||Mean, SEM, SD||Student’s t test||P value|
|PIHa||71.4, 3.7, 8.2||66.8, 3.5, 7.8||4.6, 5.0, 11.1||0.92||0.4|
|K10b||32.2, 2.6, 5.8||30.8, 2.4, 5.3||1.4, 1.1, 2.5||1.25||0.3|
|SF36 (Bodily pain score)c||37.8, 12.5, 28.0||43.6, 5.1, 11.5||−5.8, 11.6, 25.9||−0.50||0.6|
|SF36 (Emotional score)c||13.3, 8.2, 18.3||26.7, 12.5, 27.9||−13.3, 17.0, 38.0||−0.78||0.5|
|SF36 (Physical functioning score)c||29.0, 12.4, 27.7||22.0, 9.3, 20.8||7.0, 3.7, 8.4||1.87||0.1|
|SF36 (Social functioning score)c||40.0, 10.8, 24.0||62.5, 11.9, 26.5||−22.5, 14.5, 32.4||−1.55||0.2|
|SF36 (Mental health score)c||50.4, 6.0, 13.4||46.4, 5.9, 13.1||4.0, 5.5, 12.3||0.73||0.5|
|SF36 (Physical health summary)c using Australian norms||31.8, 7.8, 17.5||29.2, 3.0, 6.6||2.6, 5.3, 11.8||0.49||0.7|
This pilot study has demonstrated that an existing chronic disease management program can be successfully transferred to an existing eHealth platform for combined face-to-face and eHealth delivery. It also provides pointers for further development and targeting of eHealth-facilitated chronic disease management.
After training, the 2 health care workers used the goACT platform to successfully manage and deliver the Flinders Program, although a significant amount of additional time and effort was required for the health care worker to become familiar and skilled with goACT. They reported advantages to the eHealth version over the traditional paper-based program, such as greater ease of sharing patient information with other health care professionals. The health care workers proposed however that the eHealth version piloted was useful as an additional layer in service delivery, but not as a complete replacement.
The rapid decrease in number of weekly logins after the first 8 weeks () might be explained by the decrease in intensity of coaching that occurs during the later parts of the Flinders care plan. It is encouraging to note that the automated weekly care summary email sent each Sunday night was associated with a higher number of logins in the earlier part of the week. The email summarized care plan activities, appointments, and data provision scheduled for the upcoming week and reminded participants that they could go into the system to see more detail and check off completed activities. The emails could be switched off by participants but none chose to do so. Future research in eHealth interventions should focus on strategies to maintain engagement beyond the early period, such as optimizing automated and personalized online support.
The intervention achieved only limited participant use. One reason may be that most participants had complex and severe illnesses and their daily lives were concerned with managing their health conditions. As well as health status, other factors limiting successful eHealth use among study participants may be the age profile (49-78 years old, with the average in their 50s or 60s), and the rural location of residents. These factors are consistently associated with lower levels of IT use in Australia [, ]. These factors would limit their ability to be interested in, or successfully deal with, the addition of an unfamiliar eHealth program. We suggest that future studies of this kind might include initial screening using an e-literacy tool [ ]. This would allow assessment of participants’ needs for support to use the hardware and software, thereby increasing the likelihood of success with the eHealth program, and identification of those patients requiring continuation with the offline version of the program. It would also be useful to identify the extent to which basic IT use and/or IT use for health self-management are barriers to engagement. In a study N=2,928, adults living with chronic disease (n=538) were less likely to go online (51%) than those without such disease (n=2,367) (74%), but once online, they were avid consumers of health information [ ].
Study limitations included the small sample size. While outcome measurement was demonstrated to be feasible, the inclusion of 8 participants was too small to demonstrate any changes in health-related measures.
In summary, the pilot study demonstrated the feasibility of implementing and delivering a chronic disease management program using a Web-based patient-clinician application in a rural setting. If initial barriers to IT use can be addressed, then people with chronic conditions can be successful users of eHealth systems such as FP+goACT.
We acknowledge financial input and contribution of staff time and expertise from goACT, Country Health South Australia, and UnitingCare Wesley Port Adelaide, and thank the patients who volunteered as participants. The study was partially funded by a Faculty of Health seeding grant from Flinders University. Special thanks to Gina Kasprzyk for assisting with manuscript formatting and submission process.
Conflicts of Interest
Geoffrey Schrader and Niranjan Bidargaddi have commercial interest in goACT.
- Arnrich B, Mayora O, Bardram J, Tröster G. Pervasive healthcare: paving the way for a pervasive, user-centered and preventive healthcare model. Methods Inf Med 2010;49(1):67-73. [CrossRef] [Medline]
- Ludwig W, Wolf KH, Duwenkamp C, Gusew N, Hellrung N, Marschollek M, et al. Health-enabling technologies for the elderly--an overview of services based on a literature review. Comput Methods Programs Biomed 2012 May;106(2):70-78 [FREE Full text] [CrossRef] [Medline]
- Luxton DD, McCann RA, Bush NE, Mishkind MC, Reger GM. mHealth for mental health: Integrating smartphone technology in behavioral healthcare. Professional Psychology-Research and Practice 2011;42(6):505-512 [FREE Full text] [CrossRef]
- Chumbler NR, Haggstrom D, Saleem JJ. Implementation of health information technology in Veterans Health Administration to support transformational change: telehealth and personal health records. Med Care 2011 Dec;49 Suppl:S36-S42. [CrossRef] [Medline]
- Hall AK, Stellefson M, Bernhardt JM. Healthy Aging 2.0: the potential of new media and technology. Prev Chronic Dis 2012;9:E67 [FREE Full text] [Medline]
- Ramadas A, Quek KF, Chan CK, Oldenburg B. Web-based interventions for the management of type 2 diabetes mellitus: a systematic review of recent evidence. Int J Med Inform 2011 Jun;80(6):389-405. [CrossRef] [Medline]
- Lawn S, Schoo A. Supporting self-management of chronic health conditions: common approaches. Patient Educ Couns 2010 Aug;80(2):205-211. [CrossRef] [Medline]
- Boyd CM M, Fortin M. Future of multimorbidity research: How should understanding of multimorbidity inform health system design. Public Health Reviews 2010;32(2):451-474 [FREE Full text]
- Beatty L, Lambert S. A systematic review of internet-based self-help therapeutic interventions to improve distress and disease-control among adults with chronic health conditions. Clin Psychol Rev 2013 Jun;33(4):609-622. [CrossRef] [Medline]
- Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet 2012 Jul 7;380(9836):37-43. [CrossRef] [Medline]
- Sarela A, Bidargaddi N, Giansiracusa M. Patient Management System and Method. WO Patent 2,013,033 2013:788.
- Harvey PW, Petkov JN, Misan G, Fuller J, Battersby MW, Cayetano TN, et al. Self-management support and training for patients with chronic and complex conditions improves health-related behaviour and health outcomes. Aust Health Rev 2008 May;32(2):330-338. [Medline]
- W. Battersby M, Ah Kit J, Prideaux C, Harvey PW, Collins JP, Mills PD. Research Implementing the Flinders Model of Self-management Support with Aboriginal People who have Diabetes: Findings from a Pilot Study. Aust. J. Prim. Health 2008;14(1):66. [CrossRef]
- Crotty M, Prendergast J, Battersby MW, Rowett D, Graves SE, Leach G, et al. Self-management and peer support among people with arthritis on a hospital joint replacement waiting list: a randomised controlled trial. Osteoarthritis Cartilage 2009 Nov;17(11):1428-1433. [CrossRef] [Medline]
- Battersby MW, Beattie J, Pols RG, Smith DP, Condon J, Blunden S. A randomised controlled trial of the Flinders Program™ of chronic condition management in Vietnam veterans with co-morbid alcohol misuse, and psychiatric and medical conditions. Aust N Z J Psychiatry 2013 May;47(5):451-462. [CrossRef] [Medline]
- Lawn S, Battersby MW, Pols RG, Lawrence J, Parry T, Urukalo M. The mental health expert patient: findings from a pilot study of a generic chronic condition self-management programme for people with mental illness. Int J Soc Psychiatry 2007 Jan;53(1):63-74. [Medline]
- Ware JE, Kosinski M, Dewey JE. SF-36? health survey manual & interpretation guide. Lincoln, R.I: QualityMetric Inc; 2000.
- Andrews G, Slade T. Interpreting scores on the Kessler Psychological Distress Scale (K10). Aust N Z J Public Health 2001 Dec;25(6):494-497. [Medline]
- Petkov J, Harvey P, Battersby M. The internal consistency and construct validity of the partners in health scale: validation of a patient rated chronic condition self-management measure. Qual Life Res 2010 Sep;19(7):1079-1085. [CrossRef] [Medline]
- Rozenblum R, Donzé J, Hockey PM, Guzdar E, Labuzetta MA, Zimlichman E, et al. The impact of medical informatics on patient satisfaction: a USA-based literature review. Int J Med Inform 2013 Mar;82(3):141-158. [CrossRef] [Medline]
- Pearce C, Arnold M, Phillips CB, Trumble S, Dwan K. The many faces of the computer: an analysis of clinical software in the primary care consultation. Int J Med Inform 2012 Jul;81(7):475-484. [CrossRef] [Medline]
- Australian Government A. o. Australian: ..55.001 - Patterns of internet access in , , Bureau of Statistics: B URL: http://www.ausstats.abs.gov.au/ausstats/free.nsf/0/1B7DD59C9E8F52ECCA2573A1007EE8DA/$File/8146055001_2006.pdf [accessed 2013-11-27] [WebCite Cache]
- Newman LA, Biedrzycki K, Baum F. Digital technology access and use among socially and economically disadvantaged groups in South Australia. URL: http://ci-journal.net/index.php/ciej/article/view/639 [accessed 2014-04-28] [WebCite Cache]
- Collins SA, Currie LM, Bakken S, Vawdrey DK, Stone PW. Health literacy screening instruments for eHealth applications: A systematic review. Journal of Biomedical Informatics 2012 Jun;45(3):598-607 [FREE Full text] [CrossRef]
- Fox S. American: . Pew Internet & Life Project; 2007. E-patients with a disability or chronic disease URL: http://www.pewinternet.org/~/media//Files/Reports/2007/EPatients_Chronic_Conditions_2007.pdf.pdf [accessed 2013-11-27] [WebCite Cache]
- Montague E, Perchonok J. Health and wellness technology use by historically underserved health consumers: systematic review. J Med Internet Res 2012;14(3):e78 [FREE Full text] [CrossRef] [Medline]
|C&R: cue and response interview|
|IT: information technology|
|PIH: partners in health scale|
|P&G: problem and goals assessment|
|SMS: short message service|
Edited by G Eysenbach; submitted 06.08.13; peer-reviewed by F Grajales III; comments to author 31.10.13; revised version received 03.12.13; accepted 18.01.14; published 12.06.14Copyright
©Geoffrey Schrader, Niranjan Bidargaddi, Melanie Harris, Lareen Newman, Sarah Lynn, Leigh Peterson, Malcolm Battersby. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 12.06.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.