Patients with psychosis experience significant cognitive impairments, up to 2.5 SDs below average, across a range of cognitive processes, including processing speed, working memory, verbal and visual memory, executive function, and social cognition [1,2]. These impairments impact community functioning, occupational functioning, social skills, and behavior to a greater extent than psychotic symptoms [3,4]. Cognitive problems are present early in the course of illness, have been identified before the onset of psychotic symptoms [5], and persist over time [6]. The early identification of these cognitive impairments enables early intervention to optimize clinical outcomes and support functional recovery.

Early intervention for young people experiencing psychosis is a global priority [7]. For example, in the United Kingdom, the National Institute for Health and Care Excellence recommends that all people presenting with their first episode of psychosis be referred to an early intervention in psychosis service (EIP) [8]. The remit of these services is to provide rapid assessment and tailored treatment for patients with psychosis to prevent relapse and promote recovery. The measurement of cognition as part of a comprehensive clinical assessment is recommended for patients with psychosis in national clinical guidelines across the world [8-11]. Cognitive assessment in EIPs could allow the early detection of cognitive problems and give clinical teams a broader understanding of their patients’ presentation, identify those at risk of poor outcomes, and allow for a more personalized approach to care [12]. Despite these potential benefits, formal cognitive assessments are not routinely undertaken due to constraints of staff time and training and the associated costs of available assessments due to licensing [13]. Studies have shown that patients have little insight into their own cognitive abilities, making the self-report of cognitive function unreliable, and thus more formal assessment is required [14,15].

There are numerous barriers to conducting cognitive assessments in clinical services for psychosis. Few cognitive assessments exist that were specifically designed for the clinical assessment of patients with psychosis, although there are several assessments that may be suitable candidates including the Brief Assessment of Cognition in Schizophrenia[16], Brief Cognitive Assessment[17], or the Brief Cognitive Assessment Tool for Schizophrenia[18]. In the United Kingdom, many of the cognitive assessments that are currently available to use in the National Health Service, such as the Montreal Cognitive Assessment, Mini-Mental State Examination, and Repeatable Battery for the Assessment of Neuropsychological Status, were designed to detect cognitive decline in older patients rather than the neurodevelopmental impairments associated with psychosis [11,19]. In addition, staff do not have sufficient time, training, or confidence to administer these tools and identify cognitive impairments in their patients [13,20,21]. Formal testing can be conducted by clinical psychologists, but given their responsibilities for psychological treatment, the time they have for cognitive assessment is minimal. Digital assessments with automated scoring may reduce the burden of cognitive testing for clinical staff. However, a systematic review of digital cognitive assessments for severe mental illness found that these assessments had (1) not been sufficiently validated, (2) had high licensing costs, (3) lacked normative data against which staff could benchmark performance, and (4) lacked data on acceptability among patients and clinical staff [22].

The Cardiff Online Cognitive Assessment (CONCA) was developed as a brief web-based measure of cognition specifically for use in mental health research [23,24]. The CONCA addresses most of the barriers outlined above. It can provide a measure of overall cognition in as little as 10 minutes, so it is brief to administer. It can be completed on any internet-connected device and does not require a trained professional or specialist equipment to administer. The website was codeveloped with people with lived experience of psychosis and other severe mental illness and is simple to use. It has been validated against the gold standard pen and paper research assessment for psychosis, the MATRICS Consensus Cognitive Battery [23]. Performance on the CONCA is associated with the measures of disability [23]. Published normative data are available for the CONCA [24].

The CONCA is an established research tool, but less is known about its clinical utility. We have worked with health professionals from EIPs and people with lived experience to develop new features for the CONCA that would support its use in psychiatric services, providing personalized reports for patients and clinical teams to identify cognitive impairments and help them understand their cognitive functioning. However, the CONCA needs to be assessed for clinical acceptability before it can be implemented in services. The aim of this study is to determine whether the CONCA is acceptable to young people with a history of psychosis and health professionals and whether implementation in clinical services is feasible and to support the refinement of the CONCA and design of future testing and implementation. We will also evaluate attitudes toward cognitive assessment more generally. To do this, we will assess the acceptability and usability of the CONCA through questionnaires and qualitative interviews with participants with psychosis and health professionals.

This cross-sectional study will use a mixed methods approach, where quantitative and qualitative data will be collected in parallel to address the primary research question (equal-status concurrent design [32]). Participants with psychosis will first be recruited into the quantitative arm and will be asked whether they would be interested in completing a longer follow-up interview (qualitative arm). In addition, we will invite health care workers with professional experience working in EIPs to complete the qualitative arm of the study. Consent will be received separately for the 2 arms of the study.

We will recruit a representative sample of 100 young people with a history of psychosis. The demographic composition of patients in EIPs is documented in the National Clinical Audit of Psychosis, and these data will be used as a guide during recruitment to monitor the representativeness of our sample. We will also compare the demographics of the quantitative and qualitative arms throughout recruitment. We will use a range of approaches to achieve our recruitment target, including (1) working with EIPs in Wales and England to establish and implement ways of offering potential participants the opportunity to take part, (2) liaising with voluntary organizations to promote the research, (3) attending events and conferences to raise awareness of the research, (4) inviting individuals already enrolled in previous or ongoing research studies where participants have indicated their willingness to be approached about future studies, and (5) using communication outlets (social media, website, podcasts, and blogs) to inform the public about the research. To be eligible to take part in the study, individuals must meet the following criteria:

In addition, we will recruit a minimum of 10 participants with professional experience working in EIPs to complete qualitative interviews. Participants will be recruited from a range of disciplines, including psychiatrists, psychologists, community psychiatric nurses, and occupational therapists.

We have embedded public participation involvement and engagement (PPIe) across the CONCA project lifecycle. This started with the co-design of the CONCA website with people with lived experience of severe mental illness and health professionals from an EIP. This included public contributions to the interface, logo, and graphics and the extensive testing and refinement of the website. The clinical features were also co-designed and tested by our PPIe group, resulting in substantial changes to ensure the feedback for patients and health professionals produced by CONCA was useful for these groups.

At the outset of the current project, we expanded our PPIe group to ensure a wide range of viewpoints from lived experience experts. The functions of this group are wide-ranging and include developing assessment materials, preparing patient consent forms and information sheets (ensuring lay language is used throughout), reviewing and selecting study questionnaires, and co-designing and reviewing updates to the CONCA website. The group will be part of the team developing future protocols and strategies for full implementation in clinical settings. It will also play a key role in disseminating the outputs from the project to a wider audience, including patients, carers, health care professionals, and policy makers.

We have developed a research partner role and appointed one of our most experienced PPIe members. The research partner acts as a PPIe group liaison, providing peer-to-peer support and ensuring group tasks stay on track and all members are kept fully informed and happy with their roles. Our research partner has been involved in a wide range of activities beyond those listed above, including providing training for new staff and contributing to manuscript writing and other forms of dissemination (including talks and podcasts).

We will assess the impact of our public involvement work using the Public Involvement in Research Impact Toolkit [40].

The results of this study will be disseminated within the scientific community through conference presentations and publications in peer-reviewed journals. We will update our research participants on the progress of the study through blog posts, podcasts, social media posts, hosted events, and annual reports. We will work with our public advisory group and departmental communications team to explore new ways of disseminating our findings to the public, including the National Health Service, service user groups, and charities that serve people with lived experience of psychosis.

The study will be conducted according to the guidelines of the Declaration of Helsinki. The study was approved by Wales Research Ethics Committee 2 on May 20, 2025 (16/WA/0323). Interested individuals will receive an information sheet outlining the study protocol and be given 48 hours to review this prior to screening. Interested individuals will be screened and given the opportunity to ask questions. Informed consent will be received from all participants over the phone or via a video call with a trained researcher. Consent will be received separately for the quantitative and qualitative data collection. Consent will be recorded electronically through the study website hosted on REDCap. All data will be pseudonymized with participant IDs and will not include any identifiable data. All published data, including quotes from qualitative interviews, will be anonymized to ensure participant confidentiality. All participants will be reimbursed for their time at a rate of £20 (US $27) per hour via bank transfer or gift card.

The CONCA has the potential to improve service delivery for patients with psychosis by enabling timely, reliable, and clinically informative cognitive testing to take place in clinics to support the early detection of cognitive problems, treatment planning, and predictions of prognosis. It is our intention to provide the CONCA on a not-for-profit basis to clinical teams. However, it is currently unclear how cognitive testing would fit into the care pathway for individuals with psychosis. There is a need for data on the acceptability of the CONCA and cognitive testing more generally among patients and clinicians.

The findings from our research will be reviewed with our public advisory group and will be used to identify the aspects of the CONCA that could be refined to ensure that it is usable and accessible and provides the data that clinical teams need. We will base any decision on how to move forward with testing the CONCA on our traffic light system of acceptability, along with our identified themes from the qualitative analysis. Acceptability is a multidimensional construct, and we consider each domain to be essential to the future implementation of the CONCA. Therefore, we will assess all TFA domains individually and consider them to hold equal weight. In the case of any domain of acceptability being rated red, the further testing of the CONCA will not take place before both quantitative and qualitative feedback is reviewed, the identified issues addressed, and this domain of acceptability has been remeasured. For domains rated amber, we will refine the CONCA based on our findings prior to further testing. For domains rated green, we will not make any changes in this area and move forward with testing (assuming other aspects of acceptability have been addressed).

This study will provide the groundwork for a larger hybrid effectiveness-implementation study [41]. Working with our public involvement group and health professionals, we will review the data and themes that emerged from our qualitative analysis to identify facilitators and barriers to the CONCA’s implementation and reach a consensus on the changes to service delivery we hope to achieve and how we will measure these. We will develop a protocol that measures the outcomes and impacts of interest.

A key strength of this study is the involvement of people with lived experience of psychosis and other severe mental illnesses. Our public members contributed to (1) the design of the CONCA at every stage; (2) the development of the study assessments, interview topic guides, information sheets, and consent forms; (3) our recruitment strategy; (4) the equality impact assessment for the study; and (5) the funding application process. They will also have opportunities to contribute to the analysis and dissemination of the study findings. We have applied several existing frameworks to ensure the robustness of our study design, including the CFIR, TFA, and regulatory frameworks for developing digital health technology. The use of these frameworks will ensure that we gather the evidence needed to support the future implementation and sustainability of the CONCA.

The use of a digital cognitive assessment risks excluding certain people, including those with low digital literacy, anxiety or paranoia around digital technology, lack of access to an internet-connected device, or existing cognitive impairment. We have put several mitigations in place to ensure that those who wish to take part can do so, regardless of technology access or familiarity. These include providing support to complete the study (in person or by phone) and providing a device if needed. However, there remains the possibility that people will decline to take part in the study due to the issues listed above. We will calculate completion rates as one aspect of acceptability. However, these may not accurately reflect completion in a clinical setting. Participants may be more likely to complete the tasks as part of this study, as they will have to answer questions about the tasks and will be given remuneration for their time. We will compare rates from this study with our existing data collected as part of our nonremunerated, unsupervised studies [23,24].

There is a risk of allegiance bias, as the CONCA is being evaluated by researchers who were involved in the development of the tool. To mitigate this, the qualitative interviews will be independently double coded by one of the authors (SM), a qualitative researcher who was not involved in the development of the CONCA. We have also prespecified the analyses we intend to undertake and outlined clear thresholds that we will use to define acceptability. Finally, we will ensure that negative feedback is clearly reported, including the proportions of negative responses to the acceptability questionnaire and negative appraisals of the CONCA that arise during the qualitative interviews.

Finally, our recruitment of health professionals may be skewed toward those who are receptive to or interested in the use of digital technology or cognitive assessments in their services. We will use purposive sampling to recruit participants across a range of clinical disciplines, seniority levels, and locations to capture diverse perspectives. Researchers will keep a reflective log during recruitment, which will help us monitor and adjust our strategies as needed.