Published on in Vol 5, No 2 (2016): Apr-Jun

Development of the Lupus Interactive Navigator as an Empowering Web-Based eHealth Tool to Facilitate Lupus Management: Users Perspectives on Usability and Acceptability

Development of the Lupus Interactive Navigator as an Empowering Web-Based eHealth Tool to Facilitate Lupus Management: Users Perspectives on Usability and Acceptability

Development of the Lupus Interactive Navigator as an Empowering Web-Based eHealth Tool to Facilitate Lupus Management: Users Perspectives on Usability and Acceptability

Original Paper

1Division of Clinical Epidemiology, Department of Medicine, McGill University Health Centre, Montreal, QC, Canada

2Jack Digital Productions, Inc, Toronto, ON, Canada

3Division of Rheumatology, Department of Medicine, University of Manitoba, Winnipeg, MB, Canada

4Division of Rheumatology, McGill University Health Centre, Montreal, QC, Canada

5Division of Rheumatology, Department of Medicine, University of Alberta, Edmonton, AB, Canada

6Arthritis Research Centre of Canada, Vancouver, BC, Canada

7Division of Rheumatology, Department of Medicine, University of British Columbia, Vancouver, BC, Canada

8Axe Maladies Infectieuses et Immunitaires, Centre de recherche du CHU de Québec - Université Laval, Quebec City, QC, Canada

9Division of Rheumatology, Department of Medicine, CHU de Québec - Université Laval, Quebec City, QC, Canada

Corresponding Author:

Paul R Fortin, MD, MPH, FRCPC

Centre de recherche du CHU de Québec - Université Laval

Faculté de médecine

Université Laval

2705, boul. Laurier, Room H-1365

Quebec, QC, G1V 4G2

Canada

Phone: 1 418 654 2178

Fax:1 418 654 2142

Email: Paul.Fortin@crhudequebec.ulaval.ca


Background: Systemic Lupus Erythematosus (SLE) is a serious, complex, and chronic illness. Similar to most other chronic illness states, there is great interest in helping persons with SLE engage in their disease management.

Objective: The objectives of this study were to (1) develop the Lupus Interactive Navigator (LIN), a web-based self-management program for persons with SLE, and (2) test the LIN for usability and acceptability.

Methods: The LIN development platform was based on the results of preliminary comprehensive needs assessments and adapted from the Oncology Interactive Navigator, a web-based tool developed for persons with cancer. Medical researchers, writers, designers, and programmers worked with clinical experts and persons with SLE to develop content for the LIN. Usability and acceptability of the LIN was tested on individuals with SLE meeting American College of Rheumatology criteria, who were recruited from five Canadian SLE clinics. Participants were provided with access to the LIN and were asked to use it over a two-week period. Following the testing period, participants were contacted for a 30-minute telephone interview to assess usability and acceptability.

Results: The content for the LIN was subdivided into six primary information topics with interview videos featuring rheumatologists, allied health professionals, and persons with SLE. Usability and acceptability of the LIN was tested on 43 females with SLE. Of these, 37 (86%) completed telephone interviews. The average age was 43.6 (SD 15.9) years and disease duration averaged 14.1 (SD 10.8) years. Median time spent on LIN was 16.3 (interquartile range [IQR]:13.7, 53.5) minutes and median number of sessions was 2 (IQR: 1, 3). Overall, Likert ratings (0=strongly disagree; 7=strongly agree) of website usability and content were very high, with 75% scoring >6 out of 7 on all items. All participants agreed that LIN was easy to use, would recommend it to others with SLE, and would refer to it for future questions about SLE. Very high ratings were also given to relevancy, credibility, and usefulness of the information provided. Overall, 73% of the participants rated all topics helpful to very helpful. Participants who reported more prior knowledge about SLE rated items regarding improvement in knowledge and helpfulness relatively lower than persons with less prior knowledge. Most participants commented that the LIN would be very useful to those newly diagnosed with SLE. Minor revisions were recommended.

Conclusions: This study furthers the understanding of the needs in the SLE community and delivers a unique eHealth tool to promote self-management in persons with SLE. The LIN was found to be highly acceptable in content and usability. The information provided on LIN may be most helpful for individuals with less experience with the disease, such as those newly diagnosed, indicating the need to tailor the content for persons with more SLE experience.

JMIR Res Protoc 2016;5(2):e44

doi:10.2196/resprot.4219

Keywords



Systemic lupus erythematosus (SLE) is a chronic autoimmune disease associated with multi-organ involvement and characterized by frequent flares. The unpredictable nature of the illness and complexity of treatment create serious challenges in disease management to persons with SLE and their health care providers [1]. Self-management interventions are essential to meet these challenges and they must be built on sound person-centered approaches and aimed at self-empowerment strategies. In chronic illness management there is an ever increasing need for patients to play more active roles in their health care, and work in partnership with their health care providers. However, for this to occur, patients need to be equipped with a technology that will provide them with appropriate information and accessible support tools. We used qualitative research methods to better define the information and support needs of persons with SLE and health care providers [2,3]. Oncology Interactive Navigator (OIN) is a web-based tool developed to build a sense of competence around living with cancer, support autonomy, and engage patients and families as partners in care. Based on the OIN and preliminary work in SLE, we developed the Lupus Interactive Navigator (LIN). The LIN was designed to provide education and to support self-management in persons with SLE. This paper reports on the development of the LIN and the results of the testing of usability and acceptability of the LIN.


Development of the Lupus Interactive Navigator

The results of the needs assessments were organized into topic groups to form the basis of the Table of Contents and guide content development of the LIN. By adapting the OIN platform and approach, medical researchers, writers, designers and programmers worked with clinical experts and persons with SLE to outline the Table of Contents and write the first plain-language draft for the LIN. Required graphics and interview videos featuring rheumatologists, allied health professionals, and persons with SLE were produced to complement the written content.

The content for the LIN was subdivided into six primary information topics that were derived from the qualitative analysis of the results of our focus groups and surveys [2,3]. Each primary topic was subdivided with pull-down tabs for further elaboration on each topic (Table 1).

Table 1. Summary of LIN Table of Contents.
About LupusSymptom Management & TreatmentsAccessing HealthcareSupport ServicesFamily, Friends & WorkLiving Well With Lupus
What is LupusSymptoms of LupusYour Care TeamCommunity Services search tool to locate available lupus- support resources in close proximity to the user’s postal codeFamily & LupusManaging Stress & Fatigue
What Causes Lupus?Medications to Treat LupusCommunicating with Your Care Team Lupus & WorkGetting Enough Sleep
Lupus & the Immune SystemSide Effects of MedicationsCovering Medical Costs Supporting Someone With LupusThe Importance of Exercise
A Lupus DiagnosisPreventing and Managing FlaresTransitioning From Pediatric to Adult Care Resources for Family Members & FriendsDepression
PrognosisMonitoring Your LupusAccessing Care in Rural Areas  Overcoming the Emotional Hurdles of Lupus
Flares and RemissionsComplementary Therapies   Maintaining a Healthy Diet
Lupus & The BodyOther Therapies   Vaccinations
FAQs/ MythsClinical Trials   Pregnancy & Lupus
     Young People & Lupus

Usability and Acceptability of the Lupus Interactive Navigator

Participants

Individuals meeting the 1997 SLE American College of Rheumatology criteria [4] were recruited from five Canadian SLE clinics based in university health centers in Vancouver, Edmonton, Winnipeg, Montreal and Quebec City. Each center had obtained prior approval from their local research ethics board for this study. Consenting participants were provided information on how to access the LIN website and were asked to use their devices (computers, tablets, or mobile phones) to browse LIN over a two-week period. The number of log-ins and the duration of each session were recorded for each participant. Following the two-week testing period, participants were contacted for a 30-minute telephone interview to assess their opinions about the LIN and to identify areas for improvement.

Telephone Interview

Content for the telephone interview was established following discussions with members of an expert panel including a rheumatologist, a psychologist, a nurse, the developer of the OIN, and an individual with SLE. The telephone interview consisted of a four-page document including (1) a script to be used as the introduction to each interview, (2) questions to assess demographics and participant characteristics, (3) Likert scales to rate website usability, content, and perceived helpfulness, and (4) open-ended questions to assess overall acceptability and usability of the LIN and to provide recommendations and comments.

Participant characteristics included age, marital status, education, disease duration, and factors related to computer usage, including ease with using computers, time spent on the Internet, time spent searching for health information, and type of device used.

Website Usability and Content

Likert scales were used to assess website usability and content quality and quantity. Participants were asked to rate 17 items on a 7-point Likert scale (0=strongly disagree; 7=strongly agree). Participants who scored items <3 were asked to elaborate. Scores equal to or >5 were considered moderate to strong agreements. Scores equal to or <4 were considered low to no agreement.

Helpfulness

Participants were asked to rate each of the six topic sections using a 5-point Likert scale in terms of how helpful each section was to them (1=not at all helpful; 5=most helpful). Scores equal to or >4 were considered helpful to very helpful. Scores equal to or <3 were considered low to not at all helpful.

Recommendations and Comments

Four open-ended questions were asked to further assess if there was information missing, and give participants the opportunity to comment on the overall experience and provide recommendations for improvement.

Statistical Analyses

The data was transferred from the interview questionnaire to Microsoft Excel (2007). Means, medians, and percentages were calculated for continuous variables and percentages were calculated for categorical variables.


Development of the Lupus Interactive Navigator

The LIN was constructed from a Table of Contents that was developed from the results of the prior focus group studies and surveys performed in preparation for this project [2,3]. An abbreviated Table of Contents is provided in Table 1, reflecting the topics that were prioritized by the focus groups and surveys. Figure 1 provides a glimpse of some of the web-based pages that persons with SLE can access once logged into the LIN.

Figure 1. Examples of LIN web pages.
View this figure

Usability and Acceptability of the Lupus Interactive Navigator

Forty-three women with SLE were recruited. Of these, six participants did not complete the two-week follow-up telephone interview (time constraints, 2; illness, 2; could not be contacted, 2). Thirty-seven (86%) completed the telephone interviews. Median time spent on LIN was 16.3 (interquartile range [IQR]:13.7, 53.5) minutes and median number of sessions was 2 (IQR: 1, 3).

Characteristics of Participants

Table 2 describes the characteristics of the study participants. The average age was 43.6 (SD 15.9) years, disease duration averaged 14.1 (SD 10.8) years, 57% (21/37) were married, and 86% (32/37) had completed post-secondary education. Weekly reported average Internet usage was 15.8 (SD 24.6) hours with 2.8 (SD 0.9) hours used for health information. Ratings for overall experience, website usability, and content are shown in Table 3.

Table 2. Participant characteristics (N=37).

Mean (SD)n (%)
Age (years)43.6 (15.9)
Disease duration (years)14.1 (10.8)
Gender (% female)
37 (100)
Marital status (% married)
21 (57)
Education (% post-secondary)
32 (86)
Comfort with computers (% comfortable to very comfortable)
27 (73)
Internet usage per week (hours)15.8 (24.6)
Health information searches per week (hours)2.8 (0.9)
Preference for web searching

Personal Computer
24 (65)
Tablet
7 (19)
Mobile Phone
6 (16)
Table 3. Ratings of website usability and content based on 37 participants (1=strongly disagree; 7=strongly agree).
StatementMean (SD)% equal to or >5
Overall experience

I would recommend this website to others seeking information about lupus6.8 (0.5)100
Would go to this website if I had a question about lupus6.2 (1.5)89
My friends and family would benefit by accessing this website6.0 (1.8)89
Website design

Easy to learn how to use the website6.7 (0.6)100
Easy to find information on this website6.6 (0.6)97
Easy to read information6.6 (0.7)100
Easy to use the website6.6 (0.6)100
Content

Information was credible6.6 (0.8)97
Information was relevant6.6 (0.7)97
Information was useful6.5 (1.1)97
Satisfied with the amount of information5.9 (1.6)87
Improved knowledge about lupus5.8 (1.6)87
Improved knowledge about coping5.4 (1.9)78
Improved knowledge about resources5.4 (1.8)77
Will help me maintain better health habits5.3 (1.7)69
Improved knowledge about medications5.0 (1.8)68
Will be useful to help me prepare for next doctor’s visit5.0 (1.9)67
Overall Experience

All participants strongly agreed that they would recommend this website to other persons with SLE seeking information about SLE and 89% (33/37) would refer to it to answer their own future questions about SLE. Participants also agreed that family and friends would benefit from accessing the LIN.

Website Usability

All items assessing website usability received high to very high ratings. All participants were in high agreement that the website was easy to learn and use.

Content

Over 97% (36/37) of the participants were in high to very high agreement that the content was useful, credible, and relevant. Additionally, 86% (32/37) of participants were satisfied with the amount of information provided. Ratings for items relating to gains in knowledge about lupus, coping, and resources were high (77-87%). Somewhat lower ratings were given for items relating to gains in knowledge about medications, helpfulness in maintaining good health habits, and preparing for clinic visits (67-69%). Participants stated that the reason for giving lower ratings was prior knowledge about these items. Participants with disease duration <5 years had similar ratings for these items as those with disease duration >5 years. However, there were only 11 participants with short disease duration in our sample.

Helpfulness

Table 4 shows the ratings of helpfulness of each of the six major information topics provided in LIN. Overall, 73% (27/37) of the participants rated all topics helpful to very helpful.

Ratings of perceived helpfulness for each individual major topic varied across topics. The topic About Lupus (providing general information about SLE) was perceived as the most helpful (91%) and the topic Support Services (providing information about available resources) was considered least helpful (57%). Once again, lower ratings were given by those who reported prior knowledge about SLE than those with less prior knowledge (62% versus 86%).

All participants voiced enthusiasm about LIN and were eager to offer comments and recommendations to further improve this website. None of the participants reported any information missing from the content. However, 26 participants would have preferred more information about specific topics. Of these, the most frequently requested were: more information regarding current research about new medications for SLE (n=9); coping strategies including yoga, meditation, psychosocial, and complementary/alternative treatments (n=9); and adding more support resources on the resource locator for Manitoba and Alberta, including support groups and social workers (n=7).

Minor changes were recommended to improve appearance and usability of the LIN, including changes to font and facilitating drop-down menus. Recommendations to improve content included (1) more videos of physicians and youths, (2) more pictures of rashes and medications, (3) the addition of social networking tools such as a chat room or forum, (4) updates on research and new medications using podcasts, tweets, newsletters, or message boards, and (5) providing a link to show the source of the information provided in the LIN. These adaptations are being implemented.

Overall, the comments were very positive. The most frequent comment was that this website would be most useful to those newly diagnosed with SLE (n=10). Many participants spoke of looking forward to the completed version of LIN that would include a forum for discussion.

Table 4. Ratings of helpfulness of the LIN content across information topics based on 37 participants (1=not at all helpful; 5=most helpful).
Section topicMedian (IQR)% equal to or >4
About Lupus5 (4,5)91
Friends, family, and work5 (4,5)76
Symptom management and treatment5 (3,5)72
Living well with Lupus5 (3,5)71
Accessing health care4 (3,5)68
Support services4 (3,4)57

Tailored web-based programs are becoming increasingly considered as a means of empowering individuals with chronic conditions with the tools and strategies needed to promote self-management. Our study furthers the understanding of needs in the SLE community, and allowed us to develop a web-based tool to build confidence, support autonomy, and empower persons with SLE toward self-management. As SLE is an uncommon yet important disease, this is also an important tool to support health providers caring for people with SLE.

There are a number of potential limitations of our work. First, the study participants were recruited from tertiary care centers and tended to be well educated, and thus may not be entirely representative of the full spectrum of persons with SLE. Second, participants were all females and we cannot generalize these findings to males, who represent 10% of the SLE population. Third, most participants had SLE for several years and their analysis of the LIN was affected by their own experience of living with SLE for that period of time. Many participants mentioned the usefulness of the LIN for persons newly diagnosed with SLE. Several participants also perceived that the LIN would have been most useful at the time of their diagnosis, although they agreed that they still learned from the LIN and would continue to use it to answer questions in the future. This suggests that the LIN could provide different points of entry based on disease duration and experience. Lastly, accessibility of a web-based tool may be suboptimal in some geographic, demographic, or socio-economic groups. However, the LIN can be used from any mobile device such as a tablet or mobile phone.

We assessed the acceptability and usefulness of the LIN as a tool to improve empowerment and self-management in persons with SLE. These results support the value of using a multi-method design that included surveys, focus groups, an expert panel, and interviews when developing programs tailored to specific populations. It is important to acknowledge that tools such as the LIN require ongoing updates and development to respond to new information and user feedback. Other sections which we are already considering for further development include a personalized SLE Tool Box which will offer links to an electronic SLE Health Passport (personal profile to monitor aspects of health, such as blood pressure), printable information sheets, links to clinical trials, and a forum for discussions relating to SLE.

All participants agreed that the website was easy to navigate and functioned well. The quality and quantity of content were also rated highly. No topics were reported to be missing. This suggests the value of involving patients in the design phase by identifying their needs and preferences when developing eHealth websites tailored to specific populations. Nine participants suggested adding more information about research on new medications for SLE and six participants asked for more information about yoga and meditation as coping strategies. To address these needs, more information will be provided about ongoing research on SLE, and coping strategies delivered interactively via webinars with psychosocial experts are being considered.

Conclusion

As chronic disease models of care evolve toward self-management, it is increasingly important to develop and validate tools that support providers and engage patients. The LIN is an example of such a tool. It was very well received by patients, and considered easy to navigate with sufficient quantity and quality of content. The information provided on the LIN may be most helpful for individuals lacking experience with the disease, such as those newly diagnosed. Our results suggest the need to tailor the content for persons with more SLE experience.

Acknowledgments

We are thankful to all participants for their contributions in the telephone interviews for this study. We would like to acknowledge the contributions to the development of the content for LIN from our SLE patient collaborators, including Fern Davis, Wendy Singer, Claire Rodrigues, Ben Sherman, Miriam Gaudelli, and Elizabeth Vicente. We would also like to thank our colleagues from Health Care Providers, including Evelyne Vinet, Janet Pope, Monique Gignac, Lori Tucker, and Anne Cymet. We are grateful to: Kathryn Reimer, Vancouver, British Columbia; Asvina Bissonauth, Edmonton, Alberta; Mellissa Moyen, Winnipeg, Manitoba; and Alexandra GodBout, Quebec City, Quebec, for their help in coordinating the study, Jane Su for providing research assistance, and Julie Parrot for secretarial assistance.

This research was supported by Partnerships for Health System Improvement (PHSI) grant 238692 from the Canadian Institutes of Health Research (CIHR), with an in-kind contribution by Jack Digital Productions (JDP) and a partnership contribution to PHSI made by GlaxoSmithKline (GSK) Canada. Dr Fortin holds a Canada Research Chair in Systemic Autoimmune Rheumatic Diseases and is supported by Université Laval, Quebec, Canada.

Authors' Contributions

All authors contributed to the conceptual framework of this paper as well as to the development of the content of the surveys with their own expertise as rheumatologist (Paul R Fortin), psychologist (Deborah Da Costa), nurse (Carolyn Neville), and developer of the Oncology Interactive Navigator (Murray Rochon). This effort was coordinated by Davy Eng. The analysis was done by Carolyn Neville. Interpretation of the data was done by Carolyn Neville and Paul R Fortin. All authors contributed to, reviewed, and approved the paper.

Conflicts of Interest

Carolyn Neville, Deborah Da Costa, Christian Pineau, Antonio Aviña-Zubieta, and Davy Eng declare that they have no conflicts of interest. Murray Rochon has a patent copyright, trademark, and marketing rights with royalties paid to JDP and is the founder of JDP, a social innovation company that is a partner organization under the PHSI grant provided by CIHR for this work. As part of the mandate of this grant, corporations are asked to partner with researchers to help effect change in health systems. This alignment and collaboration is a criterion of the CIHR grant to extend the reach and application of innovation. JDP contributes funds and expertise to develop this tool, and retains rights to content, technology, dissemination, and licensing of the tool in all jurisdictions. Stephanie Keeling reports having participated in a Lupus Advisory Board for Eli Lilly. Paul R Fortin reports grants from the CIHR and an in-kind contribution from JDP during the conduct of this study, as well as other unrestricted funds from GSK Canada Inc., also as part of the PHSI CIHR grant partnership program. He also reports having participating on Lupus Advisory Boards for Eli Lilly, AbbVie and GSK.

References

  1. Hale ED, Treharne GJ, Lyons AC, Norton Y, Mole S, Mitton DL, et al. "Joining the dots" for patients with systemic lupus erythematosus: personal perspectives of health care from a qualitative study. Ann Rheum Dis 2006 May;65(5):585-589 [FREE Full text] [CrossRef] [Medline]
  2. Neville C, Da CD, Mill C, Rochon M, Aviña-Zubieta JA, Pineau CA, et al. The needs of persons with lupus and health care providers: a qualitative study aimed toward the development of the Lupus Interactive Navigator. Lupus 2014 Feb;23(2):176-182. [CrossRef] [Medline]
  3. Neville C, DaCosta D, Rochon M, Eng D, Fortin PR. Toward the development of a Lupus Interactive Navigator to facilitate patients and their health care providers in the management of lupus: results of web-based surveys. JMIR Res Protoc 2014;3(4):e65 [FREE Full text] [CrossRef] [Medline]
  4. Hochberg MC. Updating the American College of Rheumatology revised criteria for the classification of systemic lupus erythematosus. Arthritis Rheum 1997 Sep;40(9):1725. [CrossRef] [Medline]


CIHR: Canadian Institutes of Health Research
GSK: GlaxoSmithKline
IQR: interquartile range
JDP: Jack Digital Productions
LIN: Lupus Interactive Navigator
OIN: Oncology Interactive Navigator
PSHI: Partnerships for Health System Improvement
SLE: Systemic lupus erythematosus


Edited by G Eysenbach; submitted 16.01.15; peer-reviewed by M Jolly, J Prescott; comments to author 23.06.15; revised version received 06.01.16; accepted 07.01.16; published 30.05.16

Copyright

©Carolyn Neville, Deborah Da Costa, Murray Rochon, Christine A Peschken, Christian A Pineau, Sasha Bernatsky, Stephanie Keeling, Antonio Avina-Zubieta, Elizabeth Lye, Davy Eng, Paul R Fortin. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 30.05.2016.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.