Background: It is often only when the initial signs of exhaustion appear that caregivers first may engage in help-seeking behavior, but it is difficult for them to know which is the most appropriate formal service in their situation. Electronic health (eHealth) can support caregivers in keeping the older person they are caring for at home, but few eHealth tools designed for supporting the process of help-seeking by caregivers of functionally impaired older persons have been developed using a co-design approach.
Objective: This paper aims to describe the protocol of a project that tries to assist caregivers to target their needs and those of the older person they support early in their help-seeking process, and guide them effectively to the formal service most appropriate for their situation. This project aims to answer the following questions: (1) What type of tool can better support caregivers to identify their needs and those of the older person they are caring for and then refer them to an appropriate formal service? and (2) What information should be found in such a tool?
Methods: This study presents a description of the process of an ongoing multicenter research project based on a co-design approach, which includes 3 phases (1) identification of caregivers’ needs in terms of tools to support their help-seeking behavior, (2) development of a tool, and (3) evaluation of its usability.
Results: The project began in January 2016 with the ethics application for the 3 phases of the project. For phase 1, recruitment began in December 2016 and ended in September 2017. Phase 2 began in the spring of 2017 and ended in June 2018. All the co-design sessions have been completed. Phase 3 of the project will begin in September 2018.
Conclusions: Although there are some challenges associated with this type of methodology, the methodology still remains relevant, as it involves future users in the development of a tool, which increases the chances that the tool will meet the users' needs.
International Registered Report Identifier (IRRID): DERR1-10.2196/11634
Aging of the population leads to a reorganization of health and social services (HSS) for older persons because of the greater pressure on the HSS network. Keeping older persons in their homes as long as possible is economically and socially desirable . Moreover, this wish is shared by the older persons themselves [ ]. Nonetheless, this depends, in part, on caregivers [ ]. A caregiver, in this study, refers to anyone who provides care and services to a functionally impaired older person on a voluntary and weekly basis [ ]. Although it is gratifying for a number of caregivers, contributing to looking after older persons at home is a task that can prove demanding on a day-to-day basis. Caregivers feel poorly equipped to assume this role, which is described by some as a moral responsibility [ ]. Moreover, success in home care for older persons depends on the capacity to respond to the needs of those suffering a loss of independence [ , ]. There are many risks for the older person when the support is inadequate or when the burden is too great [ ]. Reinhard et al [ ] report such potential risks as (1) abuse, (2) medication errors, (3) negligence, and (4) conflicts with the caregiver.
Electronic health (eHealth) can support caregivers in keeping the older person they are caring for at home . Indeed, a number of arguments support the idea of turning to eHealth to help caregivers of functionally impaired older persons in their role. These include acceptability [ ], the current use of the internet [ ], fewer problems related to moves and respite [ ], reduced costs [ ], its availability at all times and in all locations [ ], the possibilities of using a variety of pedagogical modalities [ ], and the efficacy of this type of intervention [ ].
Telemedicine, tele-assistance, assistive technologies, communication-linked technologies, tracking systems, Web-based services, and mobile apps  are among the various types of eHealth tools for caregivers. Few of these tools were developed with a co-design approach. In addition, very few eHealth tools developed for caregivers have specifically focused on the process of seeking help. It is often only when the initial signs of exhaustion appear that caregivers first undertake the process of help-seeking behavior, but it is difficult for them to know which is the most appropriate formal service in their situation, without assistance from HSS professionals [ ].
With the objective of developing an eHealth tool, which supports the process of caregivers’ help-seeking behavior, a review of the literature was conducted to identify different theoretical models that could support this process.
We found a number of works bearing on modeling of the process of help-seeking [- ]. Nevertheless, there is no consensus on the greater relevance of any 1 model [ ]. Levkoff’s help-seeking behavior model for dementia seems to correspond to the process of help-seeking behavior for the caregiver until the latter contacts a care provider [ ]. Indeed, this model is specific to the help-seeking behavior for dementia and includes 4 components: the illness and the experience of symptoms, evaluation of symptoms, the decision to look for formal services, and contact with care providers. Recognizing the symptoms (either by the one being helped or by the caregiver) begins the process of help-seeking behavior. Subsequently, the caregiver must interpret the symptoms (using cognitive and sensory capacities), evaluating the degree of severity and the potential duration. The decision to seek help and to contact a care provider depends on a number of factors. To better understand the limitations of these last 2 steps, we identified in a previous study [ ] 5 categories of factors influencing the search for assistance: informational factors, factors linked to the service, experiential factors, personal factors, and relational factors. Each stage of Levkoff’s help-seeking behavior model for dementia and the comprehension of factors limiting the recourse to formal services offer a potential transition where interventions could facilitate the process of assistance.
Consistent with this perspective, the purpose of this paper is to describe the protocol of a project that aims to assist caregivers to target early in their help-seeking process their needs and those of the older person they support and guide them effectively to the formal service most appropriate to their situation. The 3 objectives of the project are (1) identifying the needs of the caregivers in terms of tools to accompany their process of help-seeking behavior, (2) developing a tool for caregivers that corresponds to the needs they have expressed, and (3) evaluating the usability of the tool.
To attain these objectives, this study is based on a participatory design, more specifically, a co-design approach. Co-design is defined as the creation of useful knowledge and actions, in this case, an eHealth tool, which involves groups experiencing the issue, even in the research process; they assume simultaneously the role of creators, decision makers, and users . Thus, caregivers, acting as designers, can intervene directly in their future eHealth tool and draw upon their knowledge to develop technologies that respect their needs and their ways of doing things [ ]. This project has 3 phases ( ). The objective of phase 1 is to identify the needs of caregivers of functionally impaired older persons. On the basis of the results from this phase, the objective of phase 2 will be to co-design an eHealth tool to support the help-seeking process of caregivers. Finally, phase 3 will be a usability study aimed to verify the results obtained with the co-design process.
The Research Sites
The study takes place in 11 regions of Québec (Côte-Nord, Mauricie, Centre-du-Québec, Capitale-Nationale, Chaudière-Appalaches, Montérégie, Bas St-Laurent, Gaspésie, Outaouais, Montréal, and Laval). The meeting places vary, depending on the availability of locations (eg, municipal or community premises or those connected to the HSS network).
Participants and Selection Criteria
The number of participants and the selection criteria for each group of participants are as follows.
- Caregivers: The objective is to recruit a total of 50 caregivers. In the context of this project, any person who provides unremunerated assistance on a sustained (weekly) basis to a functionally impaired older person will be considered a caregiver.
- Community workers: The goal is to have 30 members of community associations involved in this project. These must offer services or interact directly with caregivers of functionally impaired older persons.
- Health and social service professionals (HSSP): The objective is to involve 30 professionals from the public sector of HSS. Like the community workers, these must offer services or interact directly with caregivers of functionally impaired older persons. They may be nurses, nursing assistants, client care attendants, home care workers, occupational therapists, physiotherapists, doctors, social workers, psychologists, or others.
To have access to a diversity of perspectives, it is hoped that the participants will present a variety of characteristics, in terms of their profession (social worker, occupational therapist, physiotherapist, doctor, nurse, etc), their organization (administrative agency, association, organization, and other), and their sociodemographic attributes. A purposive sampling strategy will be used via advertising in local community centers, family medicine groups (FMGs), and community organizations. For the HSSP, direct contact will be made with the management of older persons services. The latter will target potential participants as a function of selection criteria, and the HSSP will establish contact with the research team. A network sampling approach will also be used as recruitment through advertising alone will be insufficient to reach all the types of participants targeted. Thus, community organizations (through a direct approach) and HSSP willing to recruit caregivers to participate in the study will be solicited. When caregivers express interest in participating in the study, HSSP and community workers will be asked to transmit their coordinates so that research agents could establish contact with them.
The Research Team
All stages (recruitment, data collection, and analysis) will be done by 1 or more members of the research team. The research team is made up of the study director; a researcher in gerontology (DG); 2 doctoral students (KL and MT), one of who has experience in user experience and the other in participatory studies; and finally, a research professional with expertise in qualitative research (MC).
Phase 1 (Objective 1): Identify the Needs of Caregivers in Terms of Tools to Support Their Process of Help-Seeking Behavior
A total of 2 distinct forms of data collection will be used to document caregivers’ needs for support in their process of seeking help. The first is targeted at community workers and those from the Québec HSS network. They will be consulted via an online questionnaire inspired by Levkoff’s help-seeking behavior model for dementia  (see ).
Considering that the online questionnaire is essentially composed of open-ended questions, we will use the method of analytical questioning . The NVivo software (QSR International) [ ] will be used to facilitate this analysis.
The participation of 55 HSSP or community workers (approximately 5 participants per targeted region) or a number sufficient to reach the data saturation level is envisaged. The goal is, above all, to reach data saturation.
The second form of data collection consists of semidirected individual interviews with caregivers. The interview plan covers sociodemographic data (including a profile of the use of digital tools such as the internet, electronic tablets, and mobile phone); open-ended questions also based on Levkoff’s help-seeking behavior model for dementia ; and finally, a questionnaire related to the level of literacy, the All Aspects of Health Literacy Scale (AAHLS) [ ] (see ). This measure is important to consider in the development of an eHealth instrument designed for a group, which is homogeneous in its role (in other words, all people who care for an older person) but heterogeneous in its characteristics (with widely varying ages and levels of education). The AAHLS has been validated in English for individuals aged between 18 and 65 years in face-to-face encounters but may be adapted to telephone interviews as it is a self-evaluation measure rather than a direct evaluation of capacities. With this measure, it is not a case of categorizing the levels of literacy but rather of developing a descriptive analysis of participants’ capacities [ ]. The instrument was translated into French (a free translation) and tested beforehand.
As for the online questionnaire, we will rely on analysis through analytical questioning . The NVivo software [ ] will be used to facilitate this analysis.
We expect the participation of 27 caregivers (approximately 2 to 3 participants per targeted region) or a sufficient number to reach the data saturation point.
Phase 2 (Objective 2): Develop a Tool for Caregivers That Meets the Needs They Have Expressed
In general, co-design includes the creation of a group comprising 8 to 12 people, who jointly develop an eHealth instrument over 3 to 5 co-design meetings, lasting between 90 min and a day [- ]. Nonetheless, in the context of this project, it is, on the one hand, unrealistic to develop a tool supporting the process of help-seeking behavior in merely 5 working sessions. On the other hand, it is also unrealistic to involve caregivers in all the sessions of such a process, given their onerous responsibilities and lack of available time. In addition, it is important to include the perspective of a number of regions of Québec to take account of the differences in available resources. We, therefore, opted for a different methodology, that is, each co-design session will be composed of a different group. It consists of 8 co-design sessions (with participants of the 11 administrative regions targeted by the project), which will take place over a period of 13 months. The co-design sessions will last 3 hours and will be facilitated or moderated by the research team. Each co-design session is scheduled to continue the work of the previous session until a prototype is made. We aim to have approximately 1 month between sessions to allow the research team to analyze the data and prepare for the next session based on the results of the previous session and at the same time, respect the end of funding. These working sessions will be interspersed with meetings with an advisory committee (which also includes caregivers, community workers, and HSSP) whose mandate is to guide the progression of the prototype and ensure continuity, so that the material stemming from the working sessions is truly integrated into the prototype ( ).
Co-design involves the use of tools and techniques, which combine narratives, creativity, and imagination . A variety of methods will be used (group discussions, world café, individual work, collective sessions, and mock-ups) to ensure we reach all participants based on their individual characteristics and to guarantee that power is shared within the group. This process is intended to be iterative, varying from one session to the next, to cover all the issues effectively. The collaboration of a user experience expert will be necessary to direct the planning of objectives for each session. The results of phase 1 of the project will be presented to the co-designers to fully integrate knowledge about caregivers’ needs for support in their process of seeking help.
The data will be obtained from (1) notes taken by the team, (2) artifacts produced by each group, and (3) notes taken after the working sessions via a meeting with the research team to share their impressions. The co-design sessions and those of the advisory committee will be filmed to further develop certain aspects of other methods of data collection if necessary.
An analysis by analytical questioning  will also be performed using NVivo software [ ] to meet the objectives of each session. The final form of the tool (website, mobile app, etc) is unknown as it is the co-designers who will decide on its ultimate version.
We aim to recruit 6 to 10 participants in each co-design (caregivers, community workers, and HSSP) with a majority of caregivers to ensure a strong voice from this subgroup.
Phase 3 (Objective 3): Evaluating the Tool’s Usability and User Satisfaction
The third phase is planned to gauge the instrument’s usability. This is a matter of observing potential future users accomplish tasks using the tool, with the aim of identifying any potential problems. Furthermore, 2 distinct methods will be used for the study of usability  in the context of an individual encounter with the participant in a location of their choice, for a maximum of 1 hour. The 2 methods employed are the think-aloud approach, to measure usability, and the questionnaire, to measure user satisfaction.
First, in a process of digital tool development, the think-aloud method is frequently used to reveal usability problems that the user might encounter with the tool . In general, this method aims to capture a systematic process of thinking aloud and analyze this process to gain a deeper appreciation of any problems, which could arise during the use of the digital tool [ ]. As this think-aloud method can prove difficult for participants, a trial run will take place with a task similar to that which will be actually evaluated [ ]. These will both take place after the tool is developed (phase 2).
The sessions will be filmed in a context, which includes the individual and the tool, as well as another screen, which allows the user to see directly what is happening with the tool. This will allow for the transcription of all the verbal data and permit us to associate them with the digital tool.
The transcriptions will be coded to identify step by step how the person performs the task, as well as the problems encountered. The codes will be generated through an inductive approach .
The selection of a representative sample of potential users is crucial with this type of method, which includes those with a variety of skills. Although it is generally admitted that calling upon 5 participants is sufficient for a usability study, seeking the participation of 10 individuals with diverse perspectives increases the validity of the results by 25% . Consequently, a purposive sample with 5 caregivers and 5 community workers or HSSP is our objective.
As for user satisfaction (the second method), the most common method used is the questionnaire . The standardized questionnaires used most often are those for user interaction satisfaction, the modified technology acceptance model questionnaire, and the International Business Machines Corporation (IBM) usability questionnaire [ ]. The modified technology acceptance model questionnaire was conceived in a telemonitoring context and is less relevant to this study [ ]. The questionnaire for user interaction satisfaction in its shorter version includes 20 questions with responses on a scale from 1 to 10. The purchase of a license is required. As for the IBM usability questionnaire [ ], it contains 19 questions with responses on a scale from 1 to 7. This questionnaire is designed to be administered after the performance of the task, that is, immediately after the think-aloud method. It is the latter questionnaire, which was selected for this study.
A descriptive analysis will be performed (means, percentage).
The participants will be the same who have done the think-aloud exercise. The questionnaire will be administered during the same session.
This project was approved by the Comité d'éthique de la recherche des Centres de santé et de services sociaux de la Vieille-Capitale (the Research Ethics Committee of the Health and Social Service Centres of the Old Capital). As this is a multicenter project, it also needed and received the approval of each research ethics committee of HSS network centers for the regions targeted through a formal agreement. There is no compensation offered for phase 1 of the project, as this stage does not involve any traveling. A monetary compensation of Can $20 for each participant is, however, planned for phases 2 and 3. There are no physical or moral risks to the study participants. However, it is possible that this could be inconvenient due to a required reorganization of the usual routine or supervision. Throughout the research, the raw data will be rendered anonymous before being analyzed. Only 2 research professionals will have access to the list containing the names and codes, which will be stored separately from the research material, data, and information and consent forms. All the research material, including the information and consent forms and the recordings, will be kept in a locked filing cabinet in a locked room. The digital data will be stored in encrypted files, access to which will be protected by the use of a password to which only the principal researcher and research assistants will have access. Finally, all the material and data will be kept for 5 years and then destroyed.
Peer review of the protocol required by the ethics committee is presented in.
The project began in January 2016 with the ethics application for the 3 phases of the project. Ethical approval was received in November 2016. Thus, participants could not be recruited for 11 months. For phase 1, recruitment began in December 2016 and ended in September 2017. By August 2017, 38 community workers and HSSP had completed the online survey. In addition, 15 caregivers have been interviewed. A paper is being written to present the results of phase 1.
Phase 2 began in the spring of 2017 and ended in June 2018. All the co-design sessions have been completed. A prototype has been developed and is being improved following feedback from participants in the recent co-design sessions. Moreover, 3 papers are being written to present the results of phase 2.
Phase 3 of the project will take place from September 2018 to December 2018.
Reminder of the Purpose of the Study
Keeping older persons at home largely depends on the help provided by caregivers. However, they need support to identify the needs of the older person they are assisting, their own needs, and the formal services available to meet them . The goal of this multicenter project is to develop an eHealth instrument, which will facilitate this process of looking for help. Nonetheless, this project, following the process chosen by the research team, entails certain challenges.
Challenges Met Until Now
One of the first challenges encountered was obtaining ethical approval. On the one hand, the multicenter nature of the project required obtaining a letter of support from each of the 11 organizations of the HSS network selected by the project. The presentation of the project and the different intermediaries and particularities for each organization were such that 11 months were necessary to complete the ethical process.
Another challenge was that of the recruitment of caregivers, this is, of course, a challenge common to other projects involving those kinds of persons . Although more than 30 FMGs were contacted to request the participation of caregivers, this did not result in the recruitment of any participants. In addition to the fact that we do not have the confirmation that the FMGs actually posted the study project, we hypothesize that the caregivers do not recognize themselves as a caregiver or legitimate to bear this identity [ ] and, therefore, do not feel concerned by the project unless the approach is straightforward. To date, the optimal method of recruitment has been through contact with community workers and HSSP. Nevertheless, on the one hand, this reduces the potential number of caregivers, and on the other hand, it leads to a bias in the selection process, due to the fact that these caregivers already have access to a formal service. Therefore, this is a limitation of the project, which needs to be taken into account during the analysis of the results.
Moreover, the methodology selected to develop an eHealth tool, which genuinely responds to the needs of caregivers, is based on a co-design approach. To our knowledge, few studies have employed this methodology to develop an eHealth tool for caregivers. Co-design includes future users, in this case, caregivers, in the development of the tool, as co-designers. Therefore, this implies a sharing of power with people untrained in either research or design. This is a challenge not faced by other studies led only by research teams. The sharing of discourse and decision-making power is clearly a major challenge not only for researchers but also for future users . As mentioned by Meiland [ , ], 1 of the risks of this method is that the users cannot express their own needs or ideas and instead may simply rally around the dominant figures in the group. To lessen this risk, 2 doctoral students will examine this aspect of co-design. The thesis of 1 of the doctoral students associated with this project bears on potentially unspoken elements in co-design sessions, and she will validate the data with individual interviews following the co-design sessions, if some elements of content were not raised. These potentially unspoken issues will be discussed in the working sessions with the advisory committee, to be able to take them into account, while obviously continuing to respect confidentiality. The second student’s thesis will bear, among other matters, on the hoped-for genuinely democratic process, which co-design approach can entail. Moreover, the role of the advisory committee is to ensure that the content emerging from the co-design sessions is effectively incorporated into the development of the tool and that it is not simply the preferences and expertise of researchers that prevail.
Another challenge of this project will be to ensure consistency among the different co-design sessions. Usually, the participants are the same from one session to another, which ensures fluidity between sessions and stimulates the acquisition of design skills. This will not be the case in this study. For this reason, previous group decisions should be presented at each new session to ensure participants’ understanding and consistency of decision making. In addition, the role of the advisory committee is to ensure consistency. Moreover, the choice of analyzing the data between each session is designed to also maintain this common thread.
Finally, 1 of the common challenges for all co-design projects is the design of a tool by those who do not necessarily possess any expertise in design or even basic computer skills. Among other things, 1 of the pitfalls encountered in this sense is the difficulty of envisaging new technologies or discussing abstract concepts, such as potential functionality, for example . Among the solutions used to counter these problems is the use of prototypes (light and medium fidelity) to help participants visualize what is discussed [ ].
eHealth can support caregivers of older persons in their process of seeking help. This study aims to develop this type of tool through a co-design methodology. Although there are some challenges associated with this type of methodology, it still remains relevant, because it really involves future users in the development of a tool that, in our opinion, increases the chances that it will meet their needs.
This study is carried out at the Centre d’excellence sur le vieillissement de Québec (the Québec Centre for Excellence on Aging) of the CHU of Québec-Université Laval. The funds for this study were granted by the ministère de la Famille-programme Québec Ami des Aînés (Ministry for the Family-Québec Friend of Seniors program).
Conflicts of Interest
Multimedia Appendix 1
Online questionnaire for health and social services or community workers.PDF File (Adobe PDF File), 51KB
Multimedia Appendix 2
The interview plan of semidirected individual interviews with caregivers.PDF File (Adobe PDF File), 122KB
Multimedia Appendix 3
Scientific evaluation of the protocol.PDF File (Adobe PDF File), 123KB
- Gesano G, Heins F, Naldini A. European Commission. 2009. Regional challenges in the perspective of 2020: Regional desparities and future challenges URL: https://tinyurl.com/y6qc7ea6f [accessed 2019-03-15] [WebCite Cache]
- Bossen C, Christensen LR, Grönvall E, Vestergaard LS. CareCoor: augmenting the coordination of cooperative home care work. Int J Med Inform 2013 May;82(5):e189-e199. [CrossRef] [Medline]
- Cranswick K, Dosman D. Statistics Canada. Canada; 2008. Eldercare: What we know today URL: https://marchofdimes.ca/EN/advocacy/Documents/eldercare.pdf [accessed 2019-03-15] [WebCite Cache]
- Éthier S, Boire-Lavigne AM, Garon S. [The Clinical Nurse]. 2013. [Pharmacological Treatment of Alzheimer's Disease: A Moral Responsibility Influencing the Quality of Life and the Burden of Caregivers] URL: https://tinyurl.com/y4j49tks [accessed 2019-03-22] [WebCite Cache]
- Etters L, Goodall D, Harrison BE. Caregiver burden among dementia patient caregivers: a review of the literature. J Am Acad Nurse Pract 2008 Aug;20(8):423-428. [CrossRef] [Medline]
- Institut canadien d'information sur la santé. Canadian Institute for Health Information. Ottawa; 2010. [Caring for caregivers at the heart of home care] URL: https://secure.cihi.ca/free_products/Caregiver_Distress_AIB_2010_FR.pdf [accessed 2019-03-15] [WebCite Cache]
- Reinhard SC, Given B, Petlick NH, Bemis A. Supporting family caregivers in providing care. In: Patient Safety and Quality: An Evidence-Based Handbook for Nurses. Rockville: Agency for Healthcare Research and Quality; 2008.
- Cristancho-Lacroix V, Wrobel J, Cantegreil-Kallen I, Dub T, Rouquette A, Rigaud A. A web-based psychoeducational program for informal caregivers of patients with Alzheimer's disease: a pilot randomized controlled trial. J Med Internet Res 2015;17(5):e117 [FREE Full text] [CrossRef] [Medline]
- Pot AM, Blom MM, Willemse BM. Acceptability of a guided self-help Internet intervention for family caregivers: mastery over dementia. Int Psychogeriatr 2015 Aug;27(8):1343-1354. [CrossRef] [Medline]
- Ducharme F, Dubé V, Lévesque L, Saulnier D, Giroux F. Canadian Journal of Nursing Informatics. 2011. An online stress management training program as a supportive nursing intervention for family caregivers of an elderly person URL: https://tinyurl.com/y3r64xkl [accessed 2019-03-22] [WebCite Cache]
- Dawson A, Bowes A, Kelly F, Velzke K, Ward R. Evidence of what works to support and sustain care at home for people with dementia: a literature review with a systematic approach. BMC Geriatr 2015 May 13;15:59 [FREE Full text] [CrossRef] [Medline]
- Williamson SS, Gorman PN, Jimison HB. A mobile/web app for long distance caregivers of older adults: functional requirements and design implications from a user centered design process. AMIA Annu Symp Proc 2014 Nov 14;2014:1960-1969 [FREE Full text] [Medline]
- Godwin KM, Mills WL, Anderson JA, Kunik ME. Technology-driven interventions for caregivers of persons with dementia: a systematic review. Am J Alzheimers Dis Other Demen 2013 May;28(3):216-222. [CrossRef] [Medline]
- Boots LM, de Vugt VM, van Knippenberg RJ, Kempen GI, Verhey FR. A systematic review of internet-based supportive interventions for caregivers of patients with dementia. Int J Geriatr Psychiatry 2014 Apr;29(4):331-344. [CrossRef] [Medline]
- Martínez-Alcalá CI, Pliego-Pastrana P, Rosales-Lagarde A, Lopez-Noguerola JS, Molina-Trinidad EM. Information and communication technologies in the care of the elderly: systematic review of applications aimed at patients with dementia and caregivers. JMIR Rehabil Assist Technol 2016 May 02;3(1):e6 [FREE Full text] [CrossRef] [Medline]
- Ajzen I. From Intentions to Actions: A Theory of Planned Behavior. In: Action Control. Berlin, Heidelberg: Springer; 1985:11-39.
- Andersen R, Harada N, Chiu V, Makinodan T. Application of the behavioral model to health studies of Asian and Pacific Islander Americans. Asian Am Pac Isl J Health 1995;3(2):128-141. [Medline]
- Biddle L, Donovan J, Sharp D, Gunnell D. Explaining non-help-seeking amongst young adults with mental distress: a dynamic interpretive model of illness behaviour. Sociol Health Illn 2007 Nov;29(7):983-1002 [FREE Full text] [CrossRef] [Medline]
- Dingwall R. Aspects of Illness. London: Routledge; 2001:1-182.
- Lazarus RS, Folkman S. Stress, Appraisal, and Coping. New York: Springer; 1984.
- Leventhal H, Phillips LA, Burns E. The Common-Sense Model of Self-Regulation (CSM): a dynamic framework for understanding illness self-management. J Behav Med 2016 Dec;39(6):935-946. [CrossRef] [Medline]
- Levkoff S, Levy B, Weitzman PF. The role of religion and ethnicity in the help seeking of family caregivers of elders with Alzheimer's disease and related disorders. J Cross Cult Gerontol 1999 Dec;14(4):335-356. [Medline]
- Rosenstock IM. Historical origins of the Health Belief Model. Health Educ Monogr 1974 Dec;2(4):328-335. [CrossRef]
- Wyke S, Adamson J, Dixon D, Hunt K. Consultation and illness behaviour in response to symptoms: a comparison of models from different disciplinary frameworks and suggestions for future research directions. Soc Sci Med 2013 Jun;86:79-87. [CrossRef] [Medline]
- Werner P, Goldstein D, Karpas DS, Chan L, Lai C. Help-seeking for dementia: a systematic review of the literature. Alzheimer Dis Assoc Disord 2014;28(4):299-310. [CrossRef] [Medline]
- Latulippe K, Guay M, Giguère A, Provencher V, Sévigny A, Poulin V, et al. [Promoting home support for elderly people with neurocognitive disorders: caregiver perception of the help-seeking process]. Rev Epidemiol Sante Publique 2019 Feb;67(1):43-49. [CrossRef] [Medline]
- Sanders EB, Stappers PJ. Co-creation and the new landscapes of design. CoDesign 2008 Mar;4(1):5-18. [CrossRef]
- Kyng M, Greenbaum J. Design at Work: Cooperative Design of Computer Systems. Hillsdale, New Jersey: Lawrence Erlbaum Associates; 1991.
- Paillé P, Mucchielli A. [Qualitative Analysis in Human and Social Sciences]. Paris: Armand Colin; 2012.
- QSR International. NVivo software URL: http://www.qsrinternational.com [accessed 2009-06-11] [WebCite Cache]
- Chinn D, McCarthy C. All Aspects of Health Literacy Scale (AAHLS): developing a tool to measure functional, communicative and critical health literacy in primary healthcare settings. Patient Educ Couns 2013 Feb;90(2):247-253. [CrossRef] [Medline]
- Elf M, Rystedt H, Lundin J, Krevers B. Young carers as co-designers of a web-based support system: the views of two publics. Inform Health Soc Care 2012 Dec;37(4):203-216. [CrossRef] [Medline]
- Kattelmann KK, White AA, Greene GW, Byrd-Bredbenner C, Hoerr SL, Horacek TM, et al. Development of Young Adults Eating and Active for Health (YEAH) internet-based intervention via a community-based participatory research model. J Nutr Educ Behav 2014;46(2):S10-S25. [CrossRef] [Medline]
- Khan SA, Ancker JS, Li J, Kaufman D, Hutchinson C, Cohall A, et al. GetHealthyHarlem.org: developing a web platform for health promotion and wellness driven by and for the Harlem community. AMIA Annu Symp Proc 2009 Nov 14;2009:317-321 [FREE Full text] [Medline]
- Lindsay S, Bellaby P, Smith S, Baker R. Enabling healthy choices: is ICT the highway to health improvement? Health (London) 2008 Jul;12(3):313-331. [CrossRef] [Medline]
- Smith SA, Whitehead MS, Sheats J, Mastromonico J, Yoo W, Coughlin SS. A community-engaged approach to developing a mobile cancer prevention app: the mCPA study protocol. JMIR Res Protoc 2016 Mar 02;5(1):e34 [FREE Full text] [CrossRef] [Medline]
- Winterling J, Wiklander M, Obol CM, Lampic C, Eriksson LE, Pelters B, et al. Development of a self-help web-based intervention targeting young cancer patients with sexual problems and fertility distress in collaboration with patient research partners. JMIR Res Protoc 2016 Apr 12;5(2):e60 [FREE Full text] [CrossRef] [Medline]
- Simonsen J, Robertson T. Routledge International Handbook of Participatory Design. New York: Routledge; 2012:1-300.
- Yen PY, Bakken S. Review of health information technology usability study methodologies. J Am Med Inform Assoc 2012 Jun;19(3):413-422 [FREE Full text] [CrossRef] [Medline]
- Jasper MW. The Think Aloud Method and User Interface Design. In: Ghaoui C, editor. Encyclopedia of Human Computer Interaction. Pennsylvania: IGI Global; 2005.
- Faulkner L. Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav Res Methods Instrum Comput 2003 Aug;35(3):379-383. [Medline]
- Gagnon MP, Orruño E, Asua J, Abdeljelil AB, Emparanza J. Using a modified technology acceptance model to evaluate healthcare professionals' adoption of a new telemonitoring system. Telemed J E Health 2012;18(1):54-59 [FREE Full text] [CrossRef] [Medline]
- Lewis JR. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Hum Comput Interact 1995 Jan;7(1):57-78. [CrossRef]
- Revenäs Å, Martin C, H Opava C, Brusewitz M, Keller C, Åsenlöf P. A mobile internet service for self-management of physical activity in people with rheumatoid arthritis: challenges in advancing the co-design process during the requirements specification phase. JMIR Res Protoc 2015 Sep 17;4(3):e111 [FREE Full text] [CrossRef] [Medline]
- Meiland FJ, Bouman AI, Sävenstedt S, Bentvelzen S, Davies RJ, Mulvenna MD, et al. Usability of a new electronic assistive device for community-dwelling persons with mild dementia. Aging Ment Health 2012;16(5):584-591. [CrossRef] [Medline]
- Meiland FJ, Hattink BJ, Overmars-Marx T, de Boer ME, Jedlitschka A, Ebben PW, et al. Participation of end users in the design of assistive technology for people with mild to severe cognitive problems; the European Rosetta project. Int Psychogeriatr 2014 May;26(5):769-779. [CrossRef] [Medline]
|AAHLS: All Aspects of Health Literacy Scale|
|eHealth: electronic health|
|FMG: family medicine group|
|HSS: health and social services|
|HSSP: health and social service professionals|
|IBM: International Business Machines Corporation|
Edited by G Eysenbach; submitted 19.07.18; peer-reviewed by Y Wells, Å Revenäs; comments to author 10.09.18; revised version received 14.11.18; accepted 23.01.19; published 26.04.19Copyright
©Karine Latulippe, Manon Guay, Sophie Éthier, Andrée Sévigny, Véronique Dubé, Véronique Provencher, Valérie Poulin, Anick MC Giguere, Mélanie Tremblay, Maude Carignan, Dominique Giroux. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 26.04.2019.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.