The PSSI was developed and validated through extensive collaboration with diverse samples of students over a 2-year period. To develop a tool that was specific enough to evaluate stress and individual experiences within the social context of being a student yet broad enough to be holistically applicable to a varied student body (and therefore useful to a variety of postsecondary institutions), students who varied in age, gender, area, level, and year of study participated in the development and refinement of the tool. Per the Standards for Educational and Psychological Testing [23], the authors collected four types of evidence for validity throughout the development and validation of the tool using a three-phase mixed methods sequential exploratory study design. Overall, the PSSI demonstrated strong psychometric properties, including test–retest reliability, relationships to like constructs, and an internal structure consistent with the expectations for an index. The complete development and psychometric analysis of the PSSI is detailed elsewhere [24].

The cross-Canada, multisite release of the PSSI is a cross-sectional, repeated measures study. Data is collected via online surveys at multiple time points over the course of the academic year. Responses are linked via a unique identifier, facilitating longitudinal data analysis. In addition to the PSSI, the survey includes additional measures to facilitate a thorough analysis of the relationship between student stress and mental health. The survey consists of three sections: (1) sociodemographic characteristics, (2) stress [24,25], and (3) mental health measures evaluating psychological distress [26] and resiliency [27] (Textbox 1). In the wake of COVID-19, additional items were added to the stress section of the survey in 2020 to capture students’ experiences of stress specific to the pandemic, drawing on items developed by the American College Health Association [28] and the Mental Health Research Canada [29]. Qualtrics survey software is used as the electronic platform for the survey.

This multisite study received ethics clearance from the Queen’s University Health Sciences and Affiliated Teaching Hospitals Research Ethics Board (TRAQ #6029173).

Descriptive statistics (frequencies, measures of central tendency, and dispersion, where appropriate) will be calculated for all demographic variables to evaluate the nature of the sample.

To evaluate the validity of the PSSI, correlational analyses with like constructs will be conducted, in addition to exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Scores on the PSSI will be correlated with those on the Perceived Stress Scale [25,30], the Kessler Psychological Distress Scale [26], and the Connor–Davidson Resiliency Scale [27] in order to assess relationships to other variables as evidence for construct validity. Results of the EFA using the multisite data will be compared to those of the EFA using the pilot data. The CFA will be used to evaluate model fit and further assess the internal structure of the tool. As the PSSI is designed as an index, not a scale, there is no prior assumption for correlation between groups of stressors [31]. Further details on the analytical implications of this concerning the validation of the PSSI are detailed elsewhere [24].

Means for severity and frequency will be calculated for all stressor variables on the PSSI, with results plotted on a quadrant graph, color-coded by domain of stress (Figure 1). Results will also be plotted by individual domain of stress and can be stratified by demographics of interest, color-coded by demographic category (Figure 2). This depiction of stressors by mean severity (y-axis) and mean frequency (x-axis) will facilitate an intuitive understanding of the most severe and frequently occurring sources of stress (Figure 2, upper right-hand quadrant). Appropriate statistical tests will be conducted to determine whether the mean severity and frequency ratings for stressors are statistically significantly different. T tests for differences in means will be performed across demographic groups of interest, with corresponding 95% confidence intervals. Cumulative link mixed-effects regression analyses will be conducted to evaluate whether the mean severity for stressors has significantly changed over time (ie, over the course of the academic year across data collection time points) and across regions of Canada. Regression analyses will also be conducted to evaluate the impact of stressors on psychological distress. All statistical analyses will be conducted using R statistical software (R Foundation for Statistical Computing).

Following the completion of the study, institutional partners (coinvestigators) will get an opportunity to receive their own institution’s anonymized data for their own use. This data use agreement will create a positive community impact by allowing institutions to use the results of the PSSI for their campuses to inform improvements to their Student Wellness Services, facilitating knowledge exchange. Opportunities for knowledge translation will also be created. At the end of the survey, participants will be invited to add their names to an email list to receive a technical report of the findings of the study at the end of the study period. Several scholarly papers will be submitted to open access academic journals to ensure wide distribution of the study findings. Findings will also be disseminated through academic conferences via oral, poster, and workshop-style presentations. In addition, opportunities will be available for use of the anonymized data in student research and thesis projects.

Improved measurement of student stress will facilitate the improved targeting and alignment of mental health promotion and mental illness prevention services and support to best meet the needs of the student population. Enhancing upstream approaches targeting mental health promotion and stress reduction will help reduce not only the burden of mental health problems among the student population but also the demand currently placed on overburdened campus treatment services (eg, counseling). Available to Canadian postsecondary institutions at no cost in both English and French, the PSSI is an efficient and effective tool that provides a straightforward method of gathering data on the most severe and frequently occurring sources of stress on campus in order to support evidence-informed tailoring of campus mental health support. Implementation of the tool is flexible, with the ability to accommodate the timing of data collection in alignment with individual institution scheduling (exam periods, reading weeks, etc). The tool can also be used on its own or as an additional measure added to an existing or ongoing student mental health survey. Although the instrument’s current length may present a challenge in the latter option, a brief version of the PSSI is currently under development to facilitate easier addition onto existing survey tools.

The flexibility of this tool is a major strength. Given what we know about the impact of contextual factors and individual institutional cultures, it is not advisable to make blanket recommendations for student wellness services and mental health initiatives at the provincial or national level. Increasingly, governing bodies and leading organizations in this field (eg, the Mental Health Commission of Canada) are recommending the adoption of individualized, whole-campus approaches to student mental health and well-being that take into account the unique needs of each campus, using broad guidelines, such as those laid out in Canada’s Standard for Mental Health and Well-Being for Post-Secondary Students, as a guiding framework. The PSSI is an ideal tool for use alongside this framework; it provides institutions with an opportunity to obtain a clear road map of the most severe and frequently occurring stressors unique to their campuses and take appropriate, targeted action. As a result, gaining a representative sample of Canadian students to make generalizable recommendations is not the goal of the PSSI study. However, moving forward, making the best efforts to gain a representative sample of students at each participating institution will be a priority, as this will enable researchers to make recommendations that are more likely to have an impact on the mental health and well-being of the majority of students at an institution.

This research is subject to some practical and operational challenges. Many postsecondary institutions, particularly those that regularly participate in large-scale surveys, such as the NCHA II survey and, more recently, the Canadian Campus Well-Being Survey (CCWS) [32], are wary of oversurveying their students. Additionally, institutions that are already participating in these large-scale surveys feel they are already evaluating their students’ mental health, which can make it challenging to obtain buy-in.

While the NCHA II survey and the CCWS are valuable resources for broadly surveilling student mental health and well-being, the PSSI more specifically facilitates an in-depth analysis of potentially modifiable sources of student stress and is aimed at a tangible outcome: improving the tailoring of upstream mental health services and support to best serve students on campus. Additionally, when institutions opt for a repeated-measures longitudinal study design, the PSSI facilitates a more in-depth understanding of the timing of the need for services. Finally, our project team is open to working with institutions to avoid oversaturation of survey invitations by (1) finding survey time points throughout the academic year that do not conflict with other surveys and (2) selectively sampling students on the basis of a number of survey invitations received to date in the academic year.

Another challenge with respect to recruitment is related to the sharing of student information. Many institutions are restricted in their ability to share student contact information (eg, institutional emails) with outside investigators, while others have policies in place that restrict or prevent the recruitment of students via direct email contact. In cases like these, institutions should explore different approaches to recruiting, including (1) requesting an administrative staff member to send the recruitment notice to students via an institutional listserv or a newsletter; (2) posting through internal channels, such as campus notices and institutional research advertisement systems; and (3) reaching out to the student population through other channels, such as institutional-affiliated social media (eg, student unions). Although this flexibility in study design with respect to recruitment and sampling presents its own limitations, mainly with respect to determining representativeness of institutional samples, it is also a strength, in that it allows institutions with a variety of limitations associated with student access to participate in the project. However, the ability to make evidence-informed recommendations regarding the tailoring of campus mental health support is greatly improved by the institutions’ ability to secure a representative student sample.

The PSSI is an intuitive and evidence-informed tool that can aid postsecondary institutions in evaluating the sources of student stress and tailoring upstream mental health services to directly support the unique needs of their campuses. The cross-Canada, multisite release of the PSSI is designed to be a long-term project, with the potential to observe whether improved tailoring of upstream services and support can produce changes in the patterns of student stress. Following each project year, additional institutions will be approached to participate in the project, with the goal of reaching as many postsecondary institutions across Canada as possible. To date, only universities have been engaged. Moving forward, we will also test the PSSI for efficacy among college populations to determine whether it needs an adaptation, acknowledging that potential item adjustment and additional validation work may be warranted among this unique population of students. A brief version of the PSSI is currently under development, in addition to an adaptation of the tool to explore its use as a student-facing self-assessment, with responses to the tool mapped to useful resources for students on the basis of stressors they find to be the most severe and frequently occurring. For example, if students find exam- and assignment-related stressors to be most severe, they might be directed to studying or time management resources the institution offers.

The PSSI is available upon request to institutions at no cost in both English and French.