This study utilizes continuous, cross-sectional, national-level mental health screening via computer-assisted phone interviews, conducted in four waves on a monthly basis (between May and August 2020). This study used the QPlatform data collection system, which had integrated eligibility and sampling modules, to control the distribution of the sample [14]. All questions had to be answered for the questionnaire to be successfully submitted to the database. To ensure the quality of our mental health surveillance system, we considered all relevant attributes by evaluating the public health surveillance systems issued by the CDC [15]. The interview takes approximately 8 minutes to complete.

Participants were Arabic-speaking adults, aged ≥18 years, from Saudi Arabia. They will be recruited via a random phone number list generated from the Sharik Association for Health Research, a research participants’ database [16]. The Sharik database is a database of individuals interested in participating in health research that currently has more than 64,000 potential participants and grows on a daily basis, covering the 13 administrative regions of Saudi Arabia [16].

Participants were contacted by phone on up to three occasions. If the participant did not respond, another potential participant with a similar demographic profile (age, gender, region) was invited to participate. All data collectors received training on research ethics, data quality, and use of the data collection electronic system, as well as specific training on how to administer the screening tools used in this study.

This surveillance system used the proportional quota sampling technique to achieve an equal distribution of participants, stratified by age and gender, and region within and across the 13 administrative regions of Saudi Arabia. We used two age groups based on Saudi Arabia’s median adult age of 36 years. This led to a quota of 52 strata for this study, which may have helped increase the diversity of the sample and reduced the risk of nonprobability sampling bias.

The sample size was calculated based on the depth of the subanalysis we needed to reach, which compares the age and gender groups across regions with a medium effect size of approximately 0.3 with 80% power and 95% CI [17]. Thus, each quota required 78 participants, and a total sample of 312 per region, to form a grand total of 4056 participants per wave. Once the quota sample was achieved, participants with similar characteristics were not eligible to participate in the study and were excluded automatically via the data collection system. Quota sampling is an automated process with no human interference, as the sampling process is controlled automatically by the data collection system, which eliminates the potential for human sampling bias [14].

Data collection included general demographic variables, such as age, gender, region, educational level, and marital status. It also included variables related to COVID-19, such as employment category (eg, health care professional, security, etc), concerns and worries about COVID-19, and COVID-19 incidence in family, friends, etc. In addition, other health-related risk factors, such as a history of noncommunicable diseases, obesity, physical activity, and smoking, were collected.

The main mental health screening tool used was the Patient Health Questionnaire-9 (PHQ-9) [18-20]. The PHQ-9 was selected over other depression screening tools since (1) it has been validated for use among various age groups, including adolescents, adults, and the elderly [21,22]; (2) it has been shown to have consistent performance regardless of the mode of administration (eg, patient self-report, interviewer-administered in person or by telephone, or touch-screen devices) [21,22]; (3) it has demonstrated validity and reliability when screening for depression, anxiety, and somatic and panic disorders in a Saudi sample [20,23,24]; and (4) it has been used for mental health screening in various international surveys and surveillance systems (eg, the US CDC uses the PHQ-9 in the BRFSS and the NHANES), which also allows for international comparison [12].

Finally, anxiety was measured using the Generalized Anxiety Disorder-7 (GAD-7), which has also shown good validity and reliability in various studies [25]. The GAD-7 also demonstrated good validity for general population screening, including in the Arabic language among the Saudi population [26-29].

After the first draft of the survey was finalized, a linguistic validation was conducted via a focus group of 8 participants, who were asked to discuss and answer the survey as a group. According to the results of the focus group and feedback from the researchers and interviewers, the questionnaire was further edited, and a final version was produced. Following this, a pilot stage study with a small sample size will be conducted via phone interview to assess internal consistency and test the surveillance system operation plan.

To determine the prevalence of the high risk of depression and anxiety in our sample, we used two PHQ-9 thresholds recommended in the literature. The first threshold is a score >10, comprising pooled estimates of 10 studies with the best trade-off between sensitivity (0.89, 95% CI 0.75-0.96) and specificity (0.89, 95% CI 0.79-0.94) [30]. The second threshold is a score ≥15, which has shown the highest specificity at 0.96 (95% CI 0.94 to 0.97) [30].

In terms of the GAD-7, pooled sensitivity and specificity values appeared acceptable at a cutoff point of 8 (sensitivity: 0.83, 95% CI 0.71-0.91; specificity: 0.84, 95% CI 0.70-0.92), and cutoff scores between 7 to 10 also had similar pooled estimates of sensitivity and specificity [27]. In addition, on the GAD-7 anxiety scale, a score of ≥10 was deemed to be the optimum cutoff in the literature and according to previous studies of the Saudi population [25,29].

Data were weighted to equal the adult population in Saudi Arabia, according to the General Authority of Statistics 2017 Census Report [31]. Quantitative variables will be presented by mean and SD values if they have a normal distribution, or median and range, as appropriate, and will be compared using the t test. Categorical variables will be presented as percentages and CIs, and will be compared using the Pearson chi-square test. As this study uses automated electronic data collection, there are no missing values; the QPlatform also includes a data integrity check to prevent users from entering invalid data (eg, the maximum age is 99) [14].

The study was performed in accordance with the Declaration of Helsinki and followed the Saudi Arabia Research Ethics Standards. Consent was obtained verbally at the beginning of the phone interview. All of the obtained data are deidentified and cannot be used to identify individual participants. Ethics approval was obtained from the Sharik Association for Health Research institutional review board (approval number: 01-2020).

The first wave of the project started in the third week of May 2020. The next waves began in the third week of each month (June, July, and August). Data collection took around 2 weeks for each wave. The data analysis was completed in October 2020, and the final report is expected to be published by the end of December 2020. The results will be reported according to the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) checklist for cross-sectional studies [32].

The main study outcome will be disseminated to decision makers via a statistical dashboard developed for this project. The dashboard was updated within 72 hours after completion of data collection each month to ensure that the findings reached decision makers in a timely manner. The findings from this study will be disseminated locally and internationally through publication in peer-reviewed journals and conference presentations at the national and international levels.

Once the project is completed, data will be available upon request via the Saudi National Health Research Center.

The COVID-19 pandemic has created a complicated system of stressors affecting the general population in a multilayered manner, including the following: abrupt changes to lifestyle, uncertainties about the future, deterioration of livelihood, social isolation, imposed quarantine, stigmatization, loss of loved ones, deprivation of culturally appropriate mourning rituals, and, finally, the threat of contracting COVID-19 [4]. In addition, generalized fear and fear-induced overreactive behaviors among the public may impede infection control. Thus, monitoring mental health status during the COVID-19 pandemic can inform decision makers about any potential deterioration in mental health on a national level and among subgroups, including across regions, age groups, and gender groups [33]. It will allow decision makers to recognize issues and intervene sooner, as well as identify vulnerable populations to provide tailored mental health interventions to potentially produce better outcomes. This project is among the first large-scale mental health surveillance system in Saudi Arabia. The continuous monitoring of mental health status during the COVID-19 pandemic will assist in understanding the effect of various social and economic measures implemented to control disease transmission, as will the effects of mental health interventions. In addition to its main aim, it will provide specific, valuable lessons to learn from for the future development of surveillance systems for mental health and for other public health issues.

Upon the success of this surveillance system, it may be linked to electronic pathways to provide clinical diagnosis and telemedicine-based interventions to treat and manage clinical and subclinical mental health issues. Telemedicine-based programs can play an important role during the COVID-19 crisis, given their unique potential for scalability [34]. There is already established evidence supporting the general population’s willingness to use a mental health app and discuss their results with their doctors, which can then lead to a clinical diagnosis of mental health conditions [21,22].

As COVID-19 may develop into a cultural or societal trauma, the monitoring of mental health status in the general population plays an important role in postpandemic recovery efforts [4]. For example, knowing when there is an increase in mental health conditions and the types of these conditions in society can help in the planning and scaling of mental health services, and stimulate innovation in mental health intervention delivery. This can help increase the chances of successful recovery efforts and transition to normal life after COVID-19. This can also provide an opportunity and prepare society to deal effectively with future population-level crises. At the same time, it is a chance to increase the population’s awareness of the importance of mental health and related issues, like mental health stigmatization.

The lack of a national screening baseline in Saudi Arabia generally, and, specifically, using the same screening tools as in this project, poses a challenge to understanding the effect of the first wave of COVID-19; however, the authors assume that, with the continuous health and economic measures implemented during the study period and given the sensitivity of the screening tools to mental health changes, the accumulation of data from the four waves will provide a clear picture of the mental health effects of COVID-19.

The use of proportional quota sampling provides more statistical power to detect changes, not only at national levels but also at regional levels, which can help further in stratifying data in relation to the most affected regions and subpopulations in order to provide a more in-depth picture of the effects of COVID-19. However, we acknowledge that using nonprobability sampling involves some risk of bias. Currently, in Saudi Arabia, the only way to conduct a random representative national survey is via household interviews. However, such a method is not possible during COVID-19 restrictions and lockdowns; it is also very expensive to implement this on a monthly basis. Thus, this study also considered the cost of conducting such a project, which becomes more cost effective via quota sampling. Finally, to improve the sampling accuracy, 52 strata were used to allow for the inclusion of a more diverse sample.

This mental health surveillance system protocol provides a comprehensive approach to monitor the mental health status of the general population on a monthly basis during the COVID-19 pandemic. It was developed utilizing the highest standard of public health surveillance systems. The results of this project will provide valuable data for decision makers about mental health status changes during different phases of the epidemic in Saudi Arabia. It will also provide valuable scientific data to help in understanding the effect of such crises on mental health, since this is, to the best of our knowledge, the only study that attempts to monitor the mental health status of the general population on a monthly basis.