Published on 31.05.19 in Vol 8, No 5 (2019): May
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/13955, first published Mar 07, 2019.
Validation of the InnoWell Platform: Protocol for a Clinical Trial
Background: New electronic health technologies are being rapidly developed to improve the delivery of mental health care for both health professionals and consumers and better support self-management of care. We developed a Web-based platform (the InnoWell Platform) that supports the prevention, early
intervention, treatment, and continuous monitoring of mental health and maintenance of well-being in people aged 2 years and older. The platform is a customizable digital tool kit
that operates through existing service providers who utilize the
system to provide their consumers with access to evidence-based
assessments and feedback, intervention options, and outcome
monitoring. It does this by collecting, storing, and reporting
personal and health information back to consumers and their
health professionals to promote collaborative care partnerships
that aim to improve the management of mental ill health and
maintenance of well-being
Objective: The aim of this study was to describe the research protocol for a naturalistic prospective clinical trial wherein all consumers presenting for care to a traditional face-to-face or Web-based mental health service in which the InnoWell Platform is being offered as part of standard clinical care will be given the opportunity to use the platform.
Methods: The Web-based platform is a configurable and customizable digital tool that assists in the assessment, monitoring and management of mental ill health, and maintenance of well-being. It does this by collecting, storing, and reporting health information back to the person and his or her clinician to enable transformation to person-centered care. The clinical trial will be conducted with individuals aged 2 years and older presenting to participating services for care, including persons from the veteran community, Aboriginal and Torres Strait Islander people, people from culturally and linguistically diverse backgrounds, the lesbian, gay, bisexual, transgender, and intersex community, and those from broader education and workforce sectors, as well as people with disabilities, lived experience of comorbidity, complex disorders, and suicidality.
Results: Project Synergy was funded in June 2017, and data collection began in November 2018 at a youth mental health service. At the time of this publication, 5 additional services have also begun recruitment, including 4 youth mental health services and a veteran’s service. The first results are expected to be submitted in 2020 for publication.
Conclusions: This clinical trial will promote access to comprehensive, high-quality mental health care to improve outcomes for consumers and health professionals. The data collected will be used to validate a clinical staging algorithm designed to match consumers with the right level of care and reduce the rate of suicidal thoughts and/or behaviors and suicide by suggesting pathways to care that are appropriate for the identified level of need, while simultaneously enabling a timely service response.
Trial Registration: Australian New Zealand Clinical Trial Registry ACTRN12618001676202; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=374632 (Archived by WebCite at http://www.webcitation.org/78TOi5jwl)
International Registered Report Identifier (IRRID): DERR1-10.2196/13955
JMIR Res Protoc 2019;8(5):e13955
Crowdfunding campaign to support this specific research
We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.
Suggested contribution levels: $20/$50/$100
As we move further into the twenty-first century, major revolutions in technology are transforming the way we live our lives—from the way we socialize, work, access information, and receive services. The mental health sector, like many others, is undergoing immense change in the face of this revolution, whereby new technologies are being developed at a rapid pace, many of which challenge the way people receive and manage their health care . This is evident in the dramatic increase in the number of mobile apps, internet-based resources, and platforms that target mental health problems [ ]. Although it remains a major priority to develop and assess effective Web-based interventions, an equally important task is to determine how these technologies can effectively integrate with existing health services in ways that improve the delivery of mental health care for the service, consumers’ health professionals, and presenting consumers [ ].
The Australian Federal Government initiated the National Mental Health Strategy in 1992 , promoted by 5-yearly government plans outlining priority areas for investment and reform [ - ]. Despite the efforts of the last 25 years, the most recent report from the National Mental Health Commission (NMHC) continues to highlight fundamental shortcomings within the mental health system, including persistent stigma, poor experiences of care by individuals with lived experience, families and support people, delays in service provision, fragmented services, and inefficient and ineffective use of resources [ ]. The NMHC review emphasizes the key concepts of person-centered care, personalized care options, regionalization of mental health services and suicide prevention, adoption of new technologies, and systematic evaluation to drive future investments [ ]. In relation to the latter, the Fifth National Mental Health and Suicide Prevention Plan now includes 24 national key performance indicators that can be reported on to track the progress of the plan [ ], including prevalence of mental illness, changes in mental health consumers’ clinical outcomes, rates of employment and social, community, and family participation among individuals with mental illness, and rates of suicide. Technology is increasingly recognized as a way to support and drive mental health service reform. Electronic health (eHealth) is broadly defined by the World Health Organization as the use of information and communication technologies for health-related purposes, such as service delivery [ ]. Various models of eHealth services have been shown to be successful, including stand-alone systems for symptom prevention and self-help, consumer-assisted care, such as peer support, virtual clinics offering professional care, and stepped-care systems for integrated care [ ]. The Australian Government published its “E-mental health strategy for Australia” in 2012 to promote its broader mental health reform agenda, emphasizing the ability of eHealth apps, etools, and platforms to deliver evidence-based interventions on the Web as a complement to traditional face-to-face services to improve health outcomes [ ]. Importantly, eHealth services can improve access to mental health care by overcoming issues of distance, cost, and stigma.
Stage-Based Stepped Care
In addition to revolutions in technology to support service delivery, there have also been advances in service models that aim to match consumers to the right level of care (ie, right care, right time). Clinical staging models are commonly employed in medical settings for this purpose, and they have more recently been implemented in clinical psychiatry . Staging models consider the spectrum of mental ill health, and they aim to place consumers on that continuum, from those with risk factors with symptoms or impairment through to those with persistent and recurrent syndromes [ ]. The emphasis is then on matching consumers at various stages to interventions that are appropriate to that stage [ ]. As highlighted in , a staged-based stepped-care model combines the principles of clinical staging with the objectives of stepped care, including the use of low-intensity interventions for those at early stages and offering more intensive interventions to consumers at higher stages, while monitoring outcomes to increase or decrease service intensity as needs change [ ].
The Zero Suicide in Health Care International Declaration was developed collaboratively by international leaders in mental health and addiction services with the aim of making suicide a “never event” . This global initiative includes crucial recommendations and targets to promote suicide prevention worldwide, including fostering a safety-oriented culture to reduce the rates of suicide for consumers under care, employing an evidence-based approach to enhancing routine care and driving system changes that will result in improved outcomes and better care for those identified as being at risk, investing in training for health professionals aimed at improving identification, assessment, and management of suicidal thoughts and/or behaviors and risk factors thereof (eg, chronic pain, substance misuse), and systematically identifying, assessing, and monitoring suicidality in the broad consumer base for a service for the purposes of triaging individuals to the appropriate intensity of care. The abovementioned goals are synonymous with the core principles of the InnoWell Platform, which include increasing access to standardized, broad-based assessment, identifying and tracking consumer needs, matching those needs with personalized care options without having to wait for an appointment, enhancing the quality of the care provided to consumers, and supporting and guiding health professionals at all levels of experience to foster skill and professional development. Furthermore, the platform’s suicide escalation protocol is specifically designed to facilitate the detection of suicidal thoughts and/or behaviors and suggest pathways to care that are appropriate for the identified level of need, while simultaneously enabling a timely response from health professionals for those consumers reporting high suicidality [ ]. Suicide prevention was highlighted as one of the priority areas in the Fifth National Mental Health and Suicide Prevention Plan [ ]. Government agencies, service providers, and community agencies have all been identified as being key to reducing suicide rates and improving health outcomes. Despite efforts to improve suicide prevention in Australia, there has been no reduction in suicide rates over the past decade [ ].
The InnoWell Platform
Through a process of participatory design with lived experience, health professionals, and service staff (including administration and management), we have developed a Web-based platform (the InnoWell Platform) that supports the prevention, early intervention, treatment, and continuous monitoring of mental ill health and maintenance of well-being in people aged 2 years and older . The platform is a customizable digital tool kit that operates through existing service providers who utilize the system to provide their consumers with access to evidence-based assessments and feedback, intervention options, and outcome monitoring. It does this by collecting, storing, and reporting personal and health information back to consumers and their health professionals to promote collaborative care partnerships that aim to improve the management of mental ill health and maintenance of well-being. This platform uses multiple sources of information to develop a comprehensive understanding of the consumers’ needs and track their progress over time. This primarily involves Web-based self-reported psychometric measures from both consumers and their health professionals, as well as objective behavioral data collected via third-party integrations. highlights the functionality built into the InnoWell Platform.
Specifically, in relation to suicide prevention, the InnoWell Platform employs a suicide escalation protocol derived from previous work . In the current platform, suicidal thoughts and/or behaviors are assessed using 2 self-report surveys: Suicidal Ideation Attributes Scale [ ] and Columbia-Suicide Severity Rating Scale [ ]. Suicidal ideation without plan or intent in the past month triggers a pop-up for the consumer in the platform, providing details for crisis support services. Self-report of suicidal ideation with a plan and/or intent and/or a suicide attempt within the past 3 months triggers both the pop-up for the consumer and sends a notification to the consumer’s health professional, requiring a clinical care action (eg, telephone contact, action safety plan).
The primary objective of this clinical trial (Australian New Zealand Clinical Trial Registry ACTRN12618001676202) is to validate the algorithms used to derive stage-based stepped care on data collected by the platform and previously published staging criteria . To do this, 4 independent ratings of stage-based stepped care will be compared: (1) platform generated, (2) health professional, (3) multidisciplinary team via consensus, and (4) expert-clinician reference group (comprising 3 or more academic health professionals with “area of research expertise” in stage-based stepped care for mental ill health). This expert group will review the clinical data of a subset of randomly generated consumers and independently allocate clinical stage.
In accordance with the Fifth National Mental Health and Suicide Prevention Plan , the secondary objective of this clinical trial is to reduce the rate of suicidal thoughts and/or behaviors by promoting access to comprehensive services and reducing barriers to care, as well as improving service quality and evidence-based clinical interventions. It is hypothesized that use of the platform within traditional mental health services will facilitate earlier identification and rapid service response (eg, earlier appointment with a health professional) to high levels of suicidal thoughts and/or behaviors.
This paper employs a naturalistic prospective clinical trial design wherein all consumers presenting for care to a service utilizing the InnoWell Platform as part of their standard clinical care will be offered the opportunity to use the platform.
Trial Site and Participating Centers
The InnoWell Platform is a Web-based app, and all data are collected electronically. As the sponsor and locality of the research team, the University of Sydney is considered the physical trial site. At the time of this publication, participants were being recruited from the following participating centers: headspace services (Camperdown, Coffs Harbour, Lismore, and Port Macquarie in New South Wales, and Edinburgh North in South Australia) and Open Arms—Veterans and Families Counselling in Surry Hills, New South Wales. Future participating centers may include services for children and their families, adult staged-care services, older persons mental health, general practice, as well as Aboriginal and Torres Strait Islander designed and controlled services.
All consumers aged 2 years and older presenting for care to a traditional face-to-face or Web-based mental health service utilizing the platform as part of their standard clinical care will be eligible to participate in the clinical trial. This will include persons from the following populations: children and their families, young people, adults, older adults, the Veteran community, Aboriginal and Torres Strait Islander peoples, people from culturally and linguistically diverse backgrounds, the lesbian, gay, bisexual, transgender, and intersex community, and those from broader education and workforce sectors, as well as persons with disabilities, lived experience of comorbidity (including alcohol or other substance misuse), complex disorders, and/or suicidality. Owing to the nature of its research design, this clinical trial does not have defined exclusion criteria.
The clinical trial does not have an upper or lower limit on the number of participants.
It will be standard clinical care for all consumers presenting to a traditional face-to-face or Web-based mental health service utilizing the InnoWell Platform to be directed to the platform for assistance in assessment, management, and monitoring of their mental ill health and maintenance of well-being.
Opt Out Process
Parental Consent Requirements and Process
The InnoWell Platform Description
The InnoWell Platform is being embedded within traditional face-to-face and Web-based mental health services, and it is being offered to consumers presenting to those services as part of standard clinical care. It is a Web-based platform, and it can be accessed via traditional computing and mobile devices. As outlined in, the platform allows consumers to complete Web-based clinical assessments to understand their needs; explore their personalized dashboard of results, including current symptoms, level of functioning, and health history (see ); select from recommended care options (eg, fact sheets, apps, etools, and other Web-based systems) to support their mental health and well-being (see ); track their progress (in real time); share their dashboard and plan with their health professional(s) to support care.
Participants will use the platform of their own accord as part of their standard clinical care with the mental health service. No other participation is required. All survey data are part of the functionality of the platform, which participants complete as part of standard clinical care through their service. The surveys provide assessment across a range of biopsychosocial domains, including psychological distress, suicidal thoughts and/or behaviors, social and occupational functioning, depressed mood, anxiety, sleep-wake cycle, social connectedness, psychosis-like experiences, mania-like experiences, alcohol use, tobacco use, self-harm, physical health, posttraumatic stress, eating behaviors, and body image. These domains, along with the associated surveys configured in the platform, are determined by services, in conjunction with the researchers to meet the needs of their consumers.provides an example of the surveys that may be included across a sampling of biopsychosocial domains.
Completion of the surveys serves to populate a participant’s dashboard, which comprises health cards reflecting the scores (eg, mild, moderate, and high) generated from the participant’s responses (see). The abbreviations under the scores reflect the time since the survey was last completed by the participant. For example, “1M” indicates the survey was completed one month earlier, and “14m” indicates the survey was completed 14 min earlier. By clicking on a health card in their dashboard, the participants can learn more about the biopsychosocial domain (eg, This card tracks your symptoms of depression. Some signs of depression include feelings of worthlessness or losing interest in enjoyable activities.). Links to psychoeducational resources are also available for further details about symptoms and treatment options. Each health card also contains a range of different care options, commonly known as interventions, to help the participant in managing a particular area of health. Care options are divided into 2 types: clinical and nonclinical ( ). Clinical care options require a health professional’s involvement, such as individual therapy and group therapy. In contrast, a participant can immediately access and begin using nonclinical care options, such as apps, etools, or other systems, without the support of a health professional.
Given the emphasis on suicide prevention, the InnoWell Platform has been built to include immediate access to crisis support options. At any time when engaging with the platform, a participant has access to the “I need help now” button (see), which provides contact details for crisis services (eg, Lifeline, Beyond Blue, and Kids Helpline). As described previously, these support options also appear as a pop-up directly after the participant scores low, moderate, or high on the suicidal thoughts and/or behaviors health card. When a participant scores high on this health card, a notification of suicide risk is also triggered for the treating health professional requiring clinical action.
The InnoWell Platform is highly configurable, allowing each service to adapt the technology to the needs of its consumer base. Although there is a set of core biopsychosocial domains that all services will be encouraged to assess (ie, psychological distress, suicidal thoughts and/or behaviors, psychosis-like experiences, mania-like experiences, social and occupational functioning, self-harm, tobacco use, alcohol use, social connectedness, depression, anxiety, and posttraumatic stress), the measures used to evaluate these areas can be tailored to the service. Similarly, the algorithms used to derive the thresholds for each domain will be based on the most appropriate psychometrics for that population (eg, young people, veterans, and older adults). As the platform is implemented across multiple health services and accumulates more data, these algorithms will become digitally smart.
Education and Training Requirements
As stated previously, the implementation of clinical staging models is relatively new to clinical psychiatry , and therefore the education and training requirements of health professionals will need to be scoped to ensure consistency of application in each health service. As required, the training will cover the theoretical and scientific underpinnings of the model, the clinical assessment requirements, detailed criteria used to assign stage-based stepped care, the application of the model to subsyndromal, prodromal, or mixed syndromes, and the clinical utility of the model for the purposes of planning, implementing, and monitoring treatment. The method of training delivery may vary from service to service to ensure access and broad distribution.
The platform-generated assignment of stage-based stepped care derived from an algorithm calculated from data collected by the platform will be compared with that allocated by the health professional working directly with the consumer, the within-service multidisciplinary consensus team, as well as by an independent expert-clinician reference group, all of which will rely on previous published clinical staging criteria . For example, to meet criteria for Stage 2 or higher for depression, the disorder needs to have features indicative of more severe disorders, including psychomotor retardation, agitation, impaired cognitive function, severe circadian dysfunction, psychotic features, brief hypomanic periods, severe neurovegetative changes, or severe suicidality. Although a clinician will assess these features as part of standard clinical care to assign clinical stage, the platform will rely on the scores on several health cards (ie, depression, mania-like experiences, psychotic-like experiences, alcohol use, and eating behaviors and body image) for this purpose. The primary outcome will be the reliability of the ratings across these 4 methods of assigning clinical stage as assessed using Cohen kappa coefficient.
Service-level performance data regarding improvements in safety and clinical quality will be derived from the platform, with an emphasis on identification and rapid response to consumers endorsing suicidal thoughts and/or behaviors (see). Outcomes will include the percentage of consumers endorsing suicidal thoughts and/or behaviors across 4 severity levels (ie, none, low, medium, and high) at service entry, the number of suicide escalations (ie, notifications to health professionals) for a specific period and during an entire episode of care, and time between suicide escalation and an action by a health professional (eg, call to consumer, schedule follow-up appointment, and contact emergency services).
Data Collection, Management, and Security
All collected data are stored in the platform database that resides in the Google Cloud Platform (in Sydney, New South Wales) and the encrypted backup database that resides in the Amazon Web Services platform (in Sydney, New South Wales). The researchers’ access deidentified clinical trial data using straight-through digital processing methods such that a copy of clinical trial data (at any point in time) can be automatically moved from the platform database to a specified secure University of Sydney network server in one go.
This trial will be conducted in accordance with the Privacy Act of 1988 . Upon consenting to participate in the clinical trial, participants will be assigned a unique identifier (Version 4 UUID), which is automatically generated by the platform and stored within its database. A Version 4 UUID is a universally unique identifier that is generated using random numbers. Importantly, the unique identifier will be used to identify a participant in all research studies of the InnoWell Platform should they be a consumer at more than 1 participating center. In addition, researchers will assign all participants with a Study ID number within deidentified clinical trial datasets. These Study ID numbers will be maintained separately from the data collection process and used for statistical analysis purposes only. All data are backed up hourly in a secure, long-term storage on Google’s Infrastructure.
Scientific validity will be evaluated using interrater reliability statistical methods, such as Cohen kappa coefficient, to quantify the degree of agreement within and among the 4 ratings of stage-based stepped care (ie, platform-generated, health professional allocated, in-service multidisciplinary consensus, and independent expert-clinician reference group). The clinical performance, including aspects of safety, of the platform will be evaluated using aggregate data derived from clinical rating scales completed by the consumer and health professional to measure and track health domain intensity, frequency, quality, and change over time, and aggregate service-level performance data, including safety and clinical quality (eg, time to first assessment, service accessibility, wait time for clinical intervention, service efficiency, and user satisfaction). Within- and between-group analyses using multivariate statistics (eg, multivariate analyses of variance, Kruskal-Wallis test) will be computed to evaluate differences in clinical outcomes among services and among population groups. In addition, reliable change and effect-size scores will be calculated to determine clinical improvement over time for consumer data and then aggregated for service-level outcome data. Analytical validity will be assessed using trends only (ie, descriptive statistics) as a means to determine user engagement and overall effectiveness of the technical performance of the platform.
This trial has been approved by the Northern Sydney Local Health District Human Research Ethics Committee (NSLHD HREC), reference number HREC/17/HAWKE/480.
InnoWell is a for-profit-business that has built the technology platform underpinning this clinical trial. InnoWell is a joint venture between The University of Sydney and PricewaterhouseCoopers (PwC) Australia that aims to transform mental health through person-centered care. Beyond June 2020, InnoWell will support this clinical trial financially, as it represents the core research and development work necessary to continuously and iteratively evolve the platform. The first results are expected to be submitted for publication in 2020.
At its core, the InnoWell Platform is designed to promote person-centered health care and assist clinical practices that place consumers as equal partners in health care decision making. The platform is also intended to help minimize the variability in care provision between health professionals and services by supporting clinical judgement with data. In addition, the platform aims to maximize the use of available resources and minimize duplication of services and wastage of time for all users, including consumers, health professionals, and service staff.
Feasibility of Implementation With Service
Before implementing this clinical trial, a thorough assessment of the feasibility of deploying the platform within each service (or participating center) is required [, ]. This includes an understanding of the basic service attributes (eg, type of service, qualifications of health professionals, service location(s), and information and communication technology systems), as well as the identified needs of the organization that will be met by the platform. In other words, what problem(s) will the technology address? The fit of the InnoWell Platform to the values, priorities, and strategic plan for the service and the readiness of the service to adopt the technology also need to be examined. As the platform is customizable, it is necessary to identify in what way the technology needs to be modified or adapted to fit the service and its consumers. Finally, key to this process is the engagement of critical stakeholders who can drive the adoption of the platform, identify facilitators, mitigate barriers to implementation, and champion the technology among frontline staff whose practice will be most affected. The effective deployment of the platform will be supported by implementation officers embedded within the services. These people will ensure that research protocols are adhered to and report any adjustments that might be necessary; they will monitor, catalogue, and report on the progress of the implementation to key trial leads; they will collect data at the participating center, relating to facilitators or barriers of implementation from clinical and administrative staff; they will assist with preparation of and delivery of training to relevant personnel regarding information essential to site-specific implementation; they will ensure that the platform accurately and consistently reflects the research data; they will ensure that all participants’ safety and well-being are first priority, by liaising with technology specialists, the researchers, and the relevant participating center, and by following established ethical protocols.
Ongoing Development of Functionality
Qualitative and quantitative data will be gathered from all users of the platform, including consumers, as well as health professionals and service staff, to inform the iterative redevelopment of the platform, including site-specific customization of any new required functionality, as well as (re)configuration of content, questionnaires, and algorithms. Furthermore, the data collected during iterative user-testing sessions (covered under site-specific ethics approvals from relevant Human Research Ethics Committees) will help to monitor, evaluate, and provide ongoing feedback about the quality, acceptability, and usability of the platform for continuous improvement of the platform.
This clinical trial will be run in parallel with a series of participating center-specific impact evaluation studies. These adjunctive studies will focus on gathering data through Web-based questionnaires, as well as workshops and semistructured interviews with service staff (ie, health professionals, managers, and administrators) relating to the impact of embedding the InnoWell Platform in their service. Topics to be covered will include digital readiness and competence, the impact of the platform on the service, the social return on investment, and the quality, usability, and acceptability of the platform. In addition, workshops will also offer the opportunity for researchers to introduce and provide brief training to service staff relating to new functionality that will be incorporated into the platform at quarterly intervals. Separate ethics approvals will be sought for these studies.
The authors wish to acknowledge Joan Torony, Laura Ospina-Pinillos, Sarah Piper, and Kate Braunstein for their contributions to this study protocol. On June 30, 2017, the Australian Government Department of Health and InnoWell (a joint venture between The University of Sydney and PwC Australia) entered into a 3-year funding agreement to the value of Aus $30 million. This funding agreement provides for a series of collaborative research studies to design, develop, build, and evaluate the InnoWell Platform in 4 populations across the lifespan, including children and their families, young people, adults, and older adults. Beyond June 2020, InnoWell will support this clinical trial financially as it represents the core research and development work necessary to continuously and iteratively evolve the platform. Data collection will be ongoing for at least the next 10 years. InnoWell is also the manufacturer of the platform (including its database), and it is considered to be the custodian of all data collected within that database.
Authors IH, TD, and SC were integral in securing funding to support this study. The study was designed by TD, HL, LW, and AE. HL prepared the first draft of the manuscript. All authors contributed to and have approved the final manuscript.
Conflicts of Interest
IH was an inaugural Commissioner on Australia’s NMHC (2012-18). He is the codirector, Health and Policy, at the Brain and Mind Centre (BMC), The University of Sydney. The BMC operates an early-intervention youth services at Camperdown, under contract to headspace. IH has previously led community-based and pharmaceutical industry-supported (Wyeth, Eli Lily, Servier, Pfizer, and AstraZeneca) projects focused on the identification and better management of anxiety and depression. He was a member of the Medical Advisory Panel for Medibank Private until October 2017, a Board Member of Psychosis Australia Trust, and a member of Veterans Mental Health Clinical Reference group. He is the Chief Scientific Advisor to and an equity shareholder at Innowell. Innowell has been formed by The University of Sydney and PwC Australia to deliver the Aus $30 million Australian Government–funded “Project Synergy.” Project Synergy is a 3-year program for the transformation of mental health services through the use of innovative technologies.
- Piwek L, Ellis DA, Andrews S, Joinson A. The rise of consumer health wearables: promises and barriers. PLoS Med 2016 Feb;13(2):e1001953 [FREE Full text] [CrossRef] [Medline]
- Anthes E. Nature. 2016. Pocket psychiatry: mobile mental-health apps have exploded onto the market, but few have been thoroughly tested URL: https://www.nature.com/polopoly_fs/1.19694!/menu/main/topColumns/topLeftColumn/pdf/532020a.pdf?origin=ppub [accessed 2019-05-19] [WebCite Cache]
- Cross SP, Hickie I. Transdiagnostic stepped care in mental health. Public Health Res Pract 2017 Apr 27;27(2):- [FREE Full text] [CrossRef] [Medline]
- Department of Health and Family Services. 1992. National Mental Health Strategy URL: http://www.health.gov.au/internet/publications/publishing.nsf/Content/mental-pubs-i-midrev2-toc~mental-pubs-i-midrev2-2~mental-pubs-i-midrev2-2-nat [accessed 2019-02-14] [WebCite Cache]
- The Department of Health. Canberra, Australia: Commonwealth of Australia; 1992. First National Mental Health Plan URL: http://www.health.gov.au/internet/publications/publishing.nsf/Content/mental-pubs-i-midrev2-toc~mental-pubs-i-midrev2-2~mental-pubs-i-midrev2-2-fir [accessed 2019-02-14] [WebCite Cache]
- The Department of Health. Canberra, Australia: Commonwealth of Australia; 1998. Second National Mental Health Plan URL: http://www.health.gov.au/internet/publications/publishing.nsf/Content/mental-pubs-i-midrev2-toc~mental-pubs-i-midrev2-2~mental-pubs-i-midrev2-2-sec [accessed 2019-02-14] [WebCite Cache]
- The Department of Health. Canberra, Australia: Commonwealth of Australia; 2003. Third National Mental Health Plan 2003-2008 URL: http://www.health.gov.au/internet/publications/publishing.nsf/Content/mental-pubs-n-infopri2-toc~mental-pubs-n-infopri2-pt1~mental-pubs-n-infopri2-pt1-4 [accessed 2019-02-14] [WebCite Cache]
- Health Ministers of Australia. Department of Health. Canberra, Australia: Commonwealth of Australia; 2009. Fourth National Mental Health Plan - An agenda for collaborative government action in mental health 2009-2014 URL: http://www.health.gov.au/internet/main/publishing.nsf/Content/9A5A0E8BDFC55D3BCA257BF0001C1B1C/$File/plan09v2.pdf [accessed 2019-02-14] [WebCite Cache]
- National Mental Health Strategy. Canberra, Australia: Commonwealth of Australia; 2017. The Fifth National Mental Health and Suicide Prevention Plan URL: https://apo.org.au/sites/default/files/resource-files/2017/10/apo-nid114356-1220416.pdf [accessed 2019-02-14] [WebCite Cache]
- National Mental Health Commission. 2014. The National Review of Mental Health Programmes and Services Sydney URL: https://www.mentalhealthcommission.gov.au/our-reports/our-national-report-cards/2014-contributing-lives-review.aspx [accessed 2019-05-20] [WebCite Cache]
- Hickie IB. Time to implement national mental health reform. Med J Aust 2015 Jun 01;202(10):515-517. [Medline]
- World Health Organization, International Telecommunication Union. 2012. National eHealth strategy toolkit URL: https://apps.who.int/iris/handle/10665/75211 [accessed 2019-02-14] [WebCite Cache]
- Zwar N, Harris M, Griffiths R, Roland M, Dennis S, Davies G. Australian Primary Health Care Research Institute. Kensington, Australia: The University of New South Wales School of Public Health and Community Medicine; 2006. A systematic review of chronic disease management URL: https://openresearch-repository.anu.edu.au/bitstream/1885/119226/3/final_25_zwar_pdf_85791.pdf [accessed 2019-02-14] [WebCite Cache]
- Department of Health and Ageing, Australian Government. 2012. E-Mental Health Strategy for Australia URL: https://www.health.gov.au/internet/main/publishing.nsf/Content/7C7B0BFEB985D0EBCA257BF0001BB0A6/$File/emstrat.pdf [accessed 2019-02-14] [WebCite Cache]
- Hickie IB, Scott J, McGorry PD. Clinical staging for mental disorders: a new development in diagnostic practice in mental health. Med J Aust 2013 May 20;198(9):461-462. [Medline]
- Cross SP, Hermens DF, Scott EM, Ottavio A, McGorry PD, Hickie IB. A clinical staging model for early intervention youth mental health services. Psychiatr Serv 2014 Jul;65(7):939-943. [CrossRef] [Medline]
- International Initiative for Mental Health Leadership. Suicide Prevention Resource Center. Atlanta: Zero Suicide; 2016. Zero Suicide: International Declaration for Better Healthcare URL: https://zerosuicide.org/international-declaration/ [accessed 2019-02-14] [WebCite Cache]
- Iorfino F, Davenport TA, Ospina-Pinillos L, Hermens DF, Cross S, Burns J, et al. Using new and emerging technologies to identify and respond to suicidality among help-seeking young people: a cross-sectional study. J Med Internet Res 2017 Jul 12;19(7):e247 [FREE Full text] [CrossRef] [Medline]
- Australian Bureau of Statistics. Canberra: Commonweatlh of Australia; 2015. Causes of Death, Australia URL: https://www.abs.gov.au/ausstats/abs@.nsf/Lookup/by%20Subject/3303.0~2015~Main%20Features~Australia's%20leading%20causes%20of%20death,%202015~3 [accessed 2019-05-21] [WebCite Cache]
- Ospina-Pinillos L, Davenport TA, Ricci CS, Milton AC, Scott EM, Hickie IB. Developing a mental health eClinic to improve access to and quality of mental health care for young people: using participatory design as research methodologies. J Med Internet Res 2018 May 28;20(5):e188 [FREE Full text] [CrossRef] [Medline]
- van Spijker BA, Batterham PJ, Calear AL, Farrer L, Christensen H, Reynolds J, et al. The suicidal ideation attributes scale (SIDAS): community-based validation study of a new scale for the measurement of suicidal ideation. Suicide Life Threat Behav 2014 Aug;44(4):408-419. [CrossRef] [Medline]
- Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia-suicide severity rating scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry 2011 Dec;168(12):1266-1277 [FREE Full text] [CrossRef] [Medline]
- Norman SB, Cissell SH, Means-Christensen AJ, Stein MB. Development and validation of an Overall Anxiety Severity And Impairment Scale (OASIS). Depress Anxiety 2006;23(4):245-249. [CrossRef] [Medline]
- Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006 May 22;166(10):1092-1097. [CrossRef] [Medline]
- Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, et al. The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry 2003 Sep 01;54(5):573-583. [CrossRef] [Medline]
- Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001 Sep;16(9):606-613 [FREE Full text] [CrossRef] [Medline]
- Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist 1969;9(3):179-186. [CrossRef] [Medline]
- Mahoney F, Barthel D. Functional Evaluation: the Barthel Index. Md State Med J 1965 Feb;14:61-65 [FREE Full text] [Medline]
- Prins A, Bovin MJ, Smolenski DJ, Marx BP, Kimerling R, Jenkins-Guarnieri MA, et al. The Primary Care PTSD Screen for DSM-5 (PC-PTSD-5): development and evaluation within a veteran primary care sample. J Gen Intern Med 2016 Oct;31(10):1206-1211 [FREE Full text] [CrossRef] [Medline]
- Blanchard EB, Jones-Alexander J, Buckley TC, Forneris CA. Psychometric properties of the PTSD Checklist (PCL). Behav Res Ther 1996 Aug;34(8):669-673. [CrossRef] [Medline]
- Australian Government. Federal Register of Legislation. Privacy Act 1988 URL: https://www.oaic.gov.au/privacy-law/privacy-act/ [accessed 2019-02-14] [WebCite Cache]
- Meyers DC, Durlak JA, Wandersman A. The quality implementation framework: a synthesis of critical steps in the implementation process. Am J Community Psychol 2012 Dec;50(3-4):462-480. [CrossRef] [Medline]
- Mohr DC, Lyon AR, Lattie EG, Reddy M, Schueller SM. Accelerating digital mental health research from early design and creation to successful implementation and sustainment. J Med Internet Res 2017 May 10;19(5):e153 [FREE Full text] [CrossRef] [Medline]
|BMC: Brain and Mind Centre|
|eHealth: electronic health|
|NMHC: National Mental Health Commission|
Edited by G Eysenbach; submitted 07.03.19; peer-reviewed by M Yap, E Lattie; comments to author 27.04.19; revised version received 01.05.19; accepted 01.05.19; published 31.05.19
©Tracey A Davenport, Haley M LaMonica, Lisa Whittle, Amelia English, Frank Iorfino, Shane Cross, Ian B Hickie. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 31.05.2019.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.