+STEP is being implemented in RWHAP-funded clinics in Alabama. RWHAP-funded clinics provide medical care, medications, and essential support services to low-income persons living with HIV. In addition to providing essential care to persons living with HIV, these clinics aim to improve HIV-related health outcomes and reduce HIV transmission in their local communities [31]. Of the 9 RWHAP-funded clinics in Alabama, a total of 5 have agreed to participate in the study.

We will conduct a stepped-wedge hybrid implementation-effectiveness type 1-design study, allowing the testing of implementation strategies while simultaneously evaluating the impact of the intervention on clinical outcomes of +STEP. Key staff from the participating sites, including clinic leadership, patient representatives, and clinicians (social workers, nurses), will participate in clinic-level trainings and assessments. Each site will identify key staff and patients who will be invited to join the advisory board. Implementation outcomes will be assessed using Proctor’s Implementation Framework [32].

For aim 1, we will conduct qualitative, semi-structured interviews and surveys with key staff to assess organizational readiness and existing protocols. Specifically, interviews will explore each clinic’s current resources and protocols, team structure, screening procedures, and barriers to telehealth. Surveys will measure organizational readiness. We will also survey patients with personal MH or SUD experiences to determine the accessibility and acceptability of ePROs and telehealth. We will then implement a multicomponent intervention with ePROs, targeted training to frontline providers, and telemedicine. We will assess fidelity and process measures, including clinic adoption and patient participation, as part of routine care in community-based RWHAP clinics. For aim 2, we will use the Consolidated Framework for Implementation Research (CFIR) to conduct a qualitative evaluation of implementation strategies, barriers, and facilitators to +STEP uptake. [33] Thus, Aim 2 will allow us to develop and refine an implementation blueprint. For Aim 3, we will evaluate the intervention impact on patient and clinic outcomes using patient-reported data (eg, MH, ART adherence), use of services (ie, clinical encounters and telemedicine), and retention in care, a proximal measure of VL suppression. A timeline for implementation of this study can be found in Figure 1.

+STEP will combine 3 components in a novel, multicomponent intervention: ePROs, targeted knowledge to frontline providers and staff, and telemedicine services for the management of MH and SUD. The intervention will include ePRO surveys adapted at the clinic level based on the results of the readiness, acceptability, and accessibility assessments. The ePROs will include validated surveys of MH and SUD, and final instruments will be selected following key staff meetings in order to ensure that they meet the needs and preferences of sites. Key staff from the participating sites, including clinic leadership, patient representatives, and clinicians (social workers, nurses), will participate in clinic-level trainings and assessments. The intervention will also include ongoing targeted trainings for frontline staff emphasizing the importance of diagnosis and evidence-based treatment of MH and SUD [30,34]. We will educate participants on the role of stigma and language as barriers to MH and SUD treatment [35]. With input from clinic-level key staff, we will design training on how to respond to ePRO results, including evidence of MH and suicidal ideation, according to clinic-specific policies and procedures. Telemedicine from the University of Alabama at Birmingham (UAB) eMedicine Center allows persons living with HIV to leverage UAB’s telemedicine experience and infrastructure in 55 out of 57 counties across Alabama. Patients referred to telemedicine will have access to a central contact at UAB’s eMedicine Center who will arrange an appointment at the closest referral site.

Implementation strategies: we will identify and train a +STEP champion at each clinical site who will receive additional hands-on training on the +STEP protocols, technology, and troubleshooting [36]. Implementation champions are an established implementation strategy to influence and facilitate change within their organization [37]. +STEP champions will be identified at each site before implementation and join regular meetings with the +STEP research team to discuss ongoing challenges and successes. Additional implementation strategies to improve implementation will be identified and used during the evaluation of +STEP implementation and as additional sites initiate the intervention.

Participants include staff at RWHAP-funded clinics in Alabama and the persons living with HIV receiving care at these clinics. All adult (18 years of age or older) patients will be included in the analysis regardless of race, ethnicity, insurance status, and time in HIV care based on HIV clinic use.

For aim 1 of this study, we will collect data using a patient telephone survey, a staff survey, and qualitative interviews with key staff to understand current capacity and infrastructure to inform implementation. The patient survey measured the acceptability and accessibility of ePROs and telehealth services. The key staff survey included the organizational readiness to implement change instrument to determine perceived institutional readiness [38]. Interviews with key staff explored technological capacity and organizational readiness for change using the CFIR. Additional methodological details for aim 1 have been published in BMC Health Services Research [39]. The Implementation data will be abstracted from scheduling logs, training logs, and the electronic medical record (EMR) at each clinic site every 2 months to characterize the clinic and patient adoption and penetration of +STEP. We will supplement these reports with manual chart abstraction if needed to understand any gaps in the data. For aim 2, patients and staff who meet eligibility criteria will be invited to participate in an hour-long qualitative interview. All interviews will be designed to elucidate (1) perceptions of implementation strategies and (2) anticipated and observed barriers and facilitators to +STEP delivery. These data will be used to refine implementation over time. Research staff with expertise in qualitative research and program evaluation will lead in-depth interviews using standardized interview guides. Interview guides will elucidate contextual factors and will be informed by constructs from the 5 domains of CFIR, predominantly intervention characteristics and the inner setting domains, and the associated implementation strategies designed to target those factors. These factors may influence clinics’ ability to implement and sustain +STEP and ultimately improve outcomes. In addition, the interviews will evaluate the acceptability of +STEP, a key component of Proctor’s Implementation Framework [32]. For aim 3, clinical data will be extracted from the EMR, scheduling data, and training logs. Historical controls will be the percentage of MH and SUD diagnoses among patients and will be collected at the start of the study. We will extract ePROs, referrals for clinical encounters, visits attended and missed, and other HIV care continuum outcomes (eg, VL). We will quantify the proportion of participants with ePROs indicative of MH and SUD, and suboptimal ART adherence. We will quantify the number and proportion of clinical encounters scheduled and attended related to HIV, MH, substance use, social services, case management, and telemedicine visits.

Targeted outcomes for this study are outlined in Table 1.

The analysis process will align with a stepped-wedge study design and each aim of the study (Figure 2). Aim 1 is to conduct readiness, acceptability, and accessibility assessment and implement +STEP. Data collected during the readiness, acceptability, and accessibility assessment will be analyzed using descriptive and frequency statistics for the staff and patient survey and by a rapid qualitative analysis of qualitative interviews with key staff members from the 5 participating sites. The team will use a data reduction analysis method by coding and summarizing each transcript by code before integrating the themes across all interviews [40]. This process will elucidate each clinic’s protocol for completing annual screening and reporting of MH and SUD, clinic procedures for psychosocial service provision, including on-site services and details of referral options in the community and beyond, and the use of telemedicine if applicable.

Aim 2 is focused on describing implementation strategies addressing barriers to uptake of +STEP in 5 RWHAP clinics using CFIR. The analytic strategy for aim 2 is framework-guided rapid qualitative analysis (F-RQA) of interview transcripts [40]. We will develop an interview guide informed by the domains and constructs of CFIR and using the recommended CFIR interview questions. In alignment with F-RQA, a preliminary summary table will be developed to correspond to the domains and constructs reflected in the interview guide. Once both processes are complete, the research team will independently extract relevant data from a single transcript, including pertinent quotes, and organize them in the draft summary table. Draft summary tables from these team members will be compared to resolve discordance. A modified summary table will then be used on a second interview before finalizing the summary table, which will be used for data analysis of all subsequent interview transcripts. This analytic process will provide an in-depth understanding of implementation as it is ongoing and will allow us the opportunity to share this information with clinics during quarterly meetings with participating clinics [41].

Aim 3 includes the measurement of the impact of implementing +STEP on diagnoses, referrals, and health care use related to MH, SUD, and HIV by comparing clinical outcomes from patients receiving these interventions (ePROs and telemedicine) with historical controls. This analytic process will begin with descriptive analyses to illustrate characteristics of patients, including age, race, gender, sex, and time in HIV care for each site and overall. Historical control data will be compared to the prospectively collected ePRO data and percentages. As it will be difficult to identify certain historical values, we will note any uncollectable data and present descriptive statistics for +STEP patients alone. For all other outcomes, we will perform generalized linear mixed effects models to account for the within-clinic correlation. These models will be performed with and without covariate adjustment to determine if any potential patient population changes (eg, more persons living with HIV newly engaged in care receiving +STEP) confound the effect of STEP+ on the identification of MH diagnoses, referral to services or actual service use. We will determine if random effects are necessary and if they can be ignored, we will use logistic regression models for each outcome. For each model, all assumptions will be verified, and goodness-of-fit will be assessed.

This study received approval from the UAB’s institutional review board (300005613).

This will be the first study to evaluate the integrated implementation of 2 effective evidence-based technologies—ePROs and telemedicine—in serving people living with HIV in Alabama. We hypothesize that this study will provide foundational evidence demonstrating ePROs as an effective intervention to increase routine screening, referrals, and treatment for MH and SUDs. The results of this study will also include a refined blueprint for the implementation of ePROs at HIV clinics based on participant study–team meetings and evaluation of implementation over the course of the study.

A systematic review of ePRO randomized control trials identified consistent methodological limitations in the existing literature [14]. These limitations included lack of consensus on the structure of ePRO interventions, including how questionnaire results were provided to clinical providers, limited provider training on the interpretation of ePRO results, and a disconnect between ePROs and targeted outcomes, such as exploring the impact of ePROs on distal clinical outcomes in lieu of proximal process outcomes [14,43-45]. This study will address the existing limitations by including provider training on ePROs among persons living with HIV and the measurement of process outcomes to inform an implementation blueprint for ePROs to identify MH and SUDs in HIV clinics.

The results of this study will provide evidence for future research expanding access to ePROs for improved diagnosis linked to telemedicine access to accelerate patients along the continuum of care from MH and SUD diagnosis to treatment. We will also use study findings to tailor future implementation research to the needs of African American communities, rural residents, historically marginalized communities, and those affected by intersectional stigmas, including gay men, transgender communities, and people who use drugs. These findings will have applicability in RWHAP-funded clinics in other parts of the Deep South and regions identified as priority sites for ending the HIV epidemic, which is a national initiative to scale up science-based strategies to diagnose, treat, prevent, and respond to HIV [46]. Implementing evidence-based services to support the mental and substance use needs of persons living with HIV is foundational to accelerating overall well-being and individual and population level viral load suppression.

This study is not without potential limitations. The initiation of this study took place during the COVID-19 pandemic, which affected community partners capacity to fully engage in the early stages of the study. However, COVID-19 has increased patients’ experience and comfort with telemedicine, aiding in the transition to ePROs and telemedicine for this study. Notably, during COVID-19, several clinics developed their own telemedicine programs out of necessity rather than waiting for the +STEP implementation. This means that many clinics are already providing MH services virtually, but few, if any, are using telehealth for addiction treatment services. Additionally, our community partners participate in others research studies and may have experienced study fatigue. Further, 1 site declined participation after the study was funded, citing COVID-19–related concerns and clinical capacity issues. Issues with clinic research saturation and COVID-19–related barriers will be monitored throughout the implementation of this study to try to mitigate overburdening our partners with research tasks when possible.

Achieving the end of the HIV epidemic in the United States necessitates programs that accelerate movement across the MH and SUD care continuum from diagnosis to treatment for persons living with HIV. Scaling these services represents a path toward improved treatment outcomes with both individual health and population-level prevention benefits of sustained HIV viral suppression in the era of undetectable=untransmittable (U=U). This study will address this evidence gap through the evaluation of the implementation of +STEP to establish the necessary systems and processes to screen, identify, and better treat substance use and MH for people living with HIV.