Published on in Vol 10 , No 10 (2021) :October

Preprints (earlier versions) of this paper are available at, first published .
Assessing the Real-time Influence of Racism-Related Stress and Suicidality Among Black Men: Protocol for an Ecological Momentary Assessment Study

Assessing the Real-time Influence of Racism-Related Stress and Suicidality Among Black Men: Protocol for an Ecological Momentary Assessment Study

Assessing the Real-time Influence of Racism-Related Stress and Suicidality Among Black Men: Protocol for an Ecological Momentary Assessment Study


1Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, United States

2Washington University at St. Louis, St. Louis, MO, United States

3Centre for Alcohol Policy Research, Melbourne, Australia

4Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University, Baltimore, MD, United States

Corresponding Author:

Leslie Adams, MPH, PhD

Department of Mental Health

Johns Hopkins Bloomberg School of Public Health

Johns Hopkins University

624 N Broadway

Baltimore, MD, 21205-1900

United States

Phone: 1 410 955 1906


Background: Suicide is the third leading cause of death among Black adults aged 18-35 years. Although men represent a majority of suicide deaths among Black adults, less is known regarding the extent to which unique cultural stressors, such as racism-related stress (eg, racial discrimination), are salient in exacerbating suicide risk among Black men. Moreover, few studies examine the daily influence of racism-related stressors on suicide outcomes using real-time smartphone-based approaches. Smartphone-based mobile health approaches using ecological momentary assessments (EMA) provide an opportunity to assess and characterize racism-related stressors as a culturally sensitive suicide risk factor among Black young adult men.

Objective: The goal of this study is to describe a protocol development process that aims to capture real-time racism-related stressors and suicide outcomes using a smartphone-based EMA platform (MetricWire).

Methods: Guided by the Interpersonal Theory of Suicide (ITS), we developed a brief EMA protocol using a multiphased approach. First, we conducted a literature review to identify brief measures previously used in EMA studies, with special emphasis on studies including Black participants. The identified measures were then shortened to items with the highest construct validity (eg, factor loadings) and revised to reflect momentary or daily frequency. Feasibility and acceptability of the study protocol will be assessed using self-report survey and qualitative responses. To protect participants from harm, a three-tier safety protocol was developed to identify participants with moderate, elevated, and acute risk based on EMA survey response to trigger outreach by the study coordinator.

Results: The final EMA protocol, which will be completed over a 7-day period, is comprised of 15 questions administered 4 times per day and a daily questionnaire of 22 items related to sleep-related impairment and disruption, as well as racism-related stress. Study recruitment is currently underway. We anticipate the study will be completed in February 2023. Dissemination will be conducted through peer-reviewed publications and conference presentations.

Conclusions: This protocol will address gaps in our understanding of Black men’s suicide outcomes in the social contexts that they regularly navigate and will clarify the temporal role of racism-related stressors that influence suicidal outcomes.

International Registered Report Identifier (IRRID): PRR1-10.2196/31241

JMIR Res Protoc 2021;10(10):e31241



In recent years, suicide completion rates among Black Americans have increased significantly [1-4]. According to the Centers for Disease Control and Prevention, in 2018, suicide emerged as the third-leading cause of death among Black adults aged 18-35 years [5]. Among Black suicide decedents, men comprise the majority (81%) [5]. In response to rising rates of suicide completion, researchers and policy makers have identified the timely recognition and mitigation of suicide risk factors among Black young adult individuals as an emerging public health priority [3,4,6]. Although previous research has identified potential therapeutic approaches for Black males at risk of suicide [7], few studies have identified distinguishable risk factors occurring in Black men’s daily social environment that may exacerbate suicidal thoughts and behaviors. To address this knowledge gap, cultural factors that affect the lived experience of Black men warrant further exploration.

Scholars assert that, among Black Americans, racial discrimination is a chronic stressor that may be more likely to result in a lower quality of life and higher psychological distress compared to their White counterparts [8-10]. Previous studies show that racism-related stressors are directly linked to poorer mental health outcomes, and are also specifically associated with fatal and nonfatal suicide outcomes in Black populations [11,12]. Goodwill and colleagues [10] found that, when compared to other sources of everyday discrimination (eg, generalized or attributed to other marginalized status such as gender or age), everyday race-based discrimination was the only type of discrimination that was significantly associated with increased rates of depressive symptoms and suicidal ideation. Although past studies examined frequent exposure to racial discrimination and its association with suicidal behaviors, authors of these studies suggest that this stressor operates dynamically over time as a function of the social environment that Black men regularly navigate. Indeed, racism is embedded in our society such that it creates dynamic subsystems that constantly reinforce one another [11,12], and thus cannot be captured at a single time point using a cross-sectional design alone. Thus, methodological approaches for examining dynamic shifts in racism-related stress exposures and suicide outcomes are needed.

The Interpersonal Theory of Suicide (ITS), developed by Thomas Joiner [13,14], has been a frequently applied framework to understand the proximal risk factors that precede suicidal behavior. This theory proposes that suicidal desire manifests from two interpersonal constructs—thwarted belongingness and perceived burdensomeness—with both being mediated by hopelessness. Additionally, ITS posits that the capability to engage in suicidal behavior is distinct from the desire to engage in that behavior [14]. To date, this model has not been applied extensively to Black men and does not adequately incorporate racism-related stressors as a potential mechanism in this behavioral process. One recent study applying the ITS model among African Americans found that hope moderated the relationship between thwarted belongingness and suicidal ideation [15]. Another study highlighted the relationship between racism and hopelessness and found that daily racial discrimination resulted in increased hopelessness among Black participants compared to other participants of varied racial and ethnic backgrounds that experience feelings of hopelessness [16]. Collectively, these studies identify racial discrimination as a unique antecedent to key risk factors related to suicide among Black Americans. Guided by these extant studies, additional research is needed to further test these explanatory mechanisms through more robust methodological designs that capture the dynamic, real-time, and longitudinal nature of racism-related stressors in the suicide experience.

Ecological momentary assessment (EMA) can be used to assess health information in real time, making this an effective approach to assess dynamic phenomena such as racism-related stressors. EMAs are used to repeatedly assess a sample’s dynamic changes in behavior and experience in real time [17,18]. EMA approaches are useful for this research as they can be accessed conveniently through smartphones, which broadens the scope of this approach’s applicability compared to paper-and-pencil or computer-assisted surveys. EMA also has noted advantages compared to other cross-sectional and longitudinal methods, such as minimizing recall bias and obtaining more accurate data, as these assessments are conducted in the subject’s natural environment where they would feel most comfortable [17,18].

Despite technological advances in smartphone-based research and EMA studies, few studies have extended this approach to assess suicide outcomes in historically racialized populations such as Black men. To address these evidence gaps, the goal of our study is to develop a theory-informed EMA protocol for suitable use with a psychiatric sample of Black men aged 18-35 years. By integrating EMAs and smartphone technology, our findings will allow researchers to further understand how racism-related stressors may play a role in young Black men’s daily life experiences and suicidal ideation and behaviors. Findings from this study will extend our understanding of the time-varying role of racism-related stressors beyond extant cross-sectional research and assess proximal factors of suicidal thought and behavior in real time.

Project Overview

The EMA study is part of a 2-year mixed methods investigation of the relationship between racism-related stress and suicidal thoughts and behaviors among Black young adult men aged 18-35 years. The larger study employs an exploratory sequential mixed methods design to adequately explore the phenomenon of rising suicide rates among Black men and integrate qualitative themes into more robust quantitative data collection processes in our EMA study at later phases [19]. In this study, we present our a priori EMA protocol development aimed at evaluating real-time assessments of suicidology among Black men. Eligible participants will complete a 7-day EMA procedure, whereby they self-report momentary suicidal thoughts and behaviors and proximal risk factors derived from our adapted ITS framework (Figure 1) using a smartphone-based app. We will also assess everyday experiences of racism-related stress and sleep patterns.

Figure 1. Adapted conceptual framework guided by Interpersonal Theory of Suicide.
View this figure

Target Population and Eligibility

Eligible participants will meet the following inclusion criteria: (1) be aged 18-35 years; (2) identify as Black or African American; (3) have a past history of suicidal thoughts or behavior; (4) be able to speak, read, and understand English sufficiently well to complete the procedures of the study; (5) have a smartphone; and (6) have an outpatient mental health provider. We will exclude those who have been diagnosed with an active psychotic disorder, those with cognitive deficits or a medical condition that precludes full understanding of study materials, and those who are currently incarcerated.

Sample Size and Recruitment Procedures

Our intended study sample for this pilot study is 50 participants, which will yield initial feasibility data for the recruitment and retention approach of our study protocol for future scalable projects. The sample size was derived from previous EMA studies focused on suicide assessment in psychiatric populations [20-22]. For this sample size and study duration, we conservatively anticipate an 80% compliance rate, defined as completion of 23 surveys over the 7-day period.

We will identify eligible participants using two purposive sampling approaches. First, we will elicit direct referrals from Johns Hopkins Hospital outpatient psychiatrists, psychiatric nurses, and clinical social workers treating patients who fit the eligibility criteria. Additionally, we will use a clinical research recruiting service (sponsored by the Johns Hopkins Institute for Clinical and Translational Research) that identifies eligible participants in EPIC electronic health record databases. We will then provide recruitment information to active patients via MyChart, a web-based patient portal that provides patients with their personal health information and medical history and allows for communication between the patient and their health care provider or health care system. Eligible participants from both recruitment approaches will be referred to contact the study coordinator, who will then verify eligibility using an online screening survey. Once eligibility is confirmed, the coordinator will schedule a brief telephone discussion with the participant to provide additional information regarding the study and initiate the informed consent and enrollment process via REDCap.

Baseline Survey

Enrolled participants will be asked to complete a brief baseline assessment via REDCap. The survey will assess demographic characteristics, such as sexual orientation, education, and socioeconomic status. We will also include validated psychosocial measures associated with affective, gender, and race-specific factors associated with suicidal thoughts and behaviors, such as anger, sadness, attributional style, and racial identity. A complete list of baseline measures is presented in Table 1. Following completion, participants will receive a 15-minute overview of the MetricWire smartphone app and EMA questions via phone or Zoom call with the study coordinator. During this time, the study coordinator will schedule prompt times during regular waking hours (eg, 8AM to 10PM), schedule a follow-up time for the participant’s exit interview, and record the contact information of the participant’s outpatient mental health provider, when available, to implement into our safety protocol.

Table 1. Overview of baseline, ecological momentary assessment, and daily diary survey measures.
VariableBaselineEcological momentary assessment
(4 times per day)
Daily diary
(once per day)

Sexual orientation

Marital status

Employment status

Education status

Racial identity (Multidimensional Inventory of Black Identity [MIBI]) [23]

Anger (Dimensions of Anger Reactions-5 item [DAR-5]) [24]

Affective emotional states (Positive Affect and Negative Affect Schedule-Expanded Form [PANAS-X]) [25]

Emotional regulation (Emotional Regulation Questionnaire [ERQ]) [26]

Generalized social anxiety (Mini Social Phobia Inventory [Mini-SPIN]) [27]

Happiness (Pemberton Happiness Index [PHI]) [28]

Callousness (Inventory of Callous-Unemotional Traits [ICU]) [29]

Grit-S scale [30]

Psychache [31]

Suicidal thoughts and behavior (Columbia Suicide and Severity Rating Scale [C-SSRS]) [32]
Hopelessness (Beck Hopelessness Scale [BHS]) [33]

Major depressive disorder (Patient Health Questionnaire-2 item [PHQ-2]) [34]

Perceived burdensomeness (Interpersonal Needs Questionnaire-Perceived Burdensomeness Subscale [INQ-PB]) [35]

Racism-related stress (Everyday Discrimination Scale [EDS]) [9]

Capability of suicide (Acquired Capability for Suicide Scale [ACSS]) [36]

Thwarted belonginess (Interpersonal Needs Questionnaire-Thwarted Belongingness Subscale [INQ-TB]) [35]

Sleep-related impairment (Patient-Reported Outcomes Measurement Information System [PROMIS]) [37]

Sleep disturbance (Patient-Reported Outcomes Measurement Information System [PROMIS]) [37]

Data Collection Procedures

After completion of the baseline survey, participants will be asked to download the MetricWire app onto their personal smartphone for the study duration. The MetricWire app is available for both iOS and Android smartphone platforms at no cost in the Apple App Store or Google Play Store, respectively. Examples of the user interface of the MetricWire app are presented in Figure 2.

Figure 2. Select screenshots from the EMA study smartphone platform (MetricWire). EMA: ecological momentary assessment.
View this figure

The MetricWire app will deliver EMA surveys at four semirandom timepoints per day during participant waking hours, which will be determined at baseline. Based on the participant-defined waking hours, the first prompt will begin 30 minutes after waking time. Each of the four daily prompts will have three push notification reminders at 20, 40, and 60 minutes after the initial prompt. If the EMA survey is not completed after 60 minutes, the survey will be marked as incomplete. To fully capture instances of racism-related stressors occurring outside of random EMA survey prompts, participants will also have the option to record event-driven entries detailing their daily experiences (Figure 2, right panel). EMA surveys were designed to take no more than 3 minutes to complete to reduce respondent burden. Once per day, we will administer a brief daily diary survey via the MetricWire app to assess everyday experiences that were not determined to occur at momentary instances, including sleep-related impairment and quality, and daily experiences with racism-related stress [9]. At the conclusion of the 7-day data collection period, the study team will conduct a qualitative semistructured exit interview with each participant, and probe the participant on issues related to question difficulty and clarity, revision of question prompts, and overall satisfaction with the study protocol and EMA surveys. We anticipate the semistructured interview to last 30-60 minutes in total. Interviews will be transcribed verbatim and used to refine the EMA study protocol.

Participant Incentives

Participants will receive $100 in total, incrementally phased throughout the duration of the study to encourage higher EMA survey completion rates. Participants will receive $20 after completing the baseline survey, $20 at the completion of day three, and $20 at the conclusion of the 7-day study duration and baseline interview. Participants will receive an additional $40 if they complete at least 80% of the EMA surveys during the study period.

Safety Protocols

Previous research has demonstrated that repeated measures of suicide do not illicit suicidal thoughts or behaviors [38]. However, considering the high risk for suicide among our target sample, and to reduce the potential harm associated with repeated questions about suicide, our team will implement several safety protocols to support the mental well-being of participants enrolled in our study. Upon enrollment, participants will receive a document outlining local and national mental health resources, including suicide crisis hotlines. Additionally, all research personnel interacting with participants will be trained in psychological first aid to assist in identifying any mental health needs that arise throughout the study. EMA responses by participants will be monitored daily by the study coordinator and discussed during weekly research team meetings. Risk will be categorized in our EMA protocol using a three-tier risk designation. Moderate risk, which is defined as any suicidal ideations (“Have you had thoughts of killing yourself?”) since the last assessment, but without any plan or intent, will result in a notification to the participant guiding them to the appropriate services and urging them to seek support with their mental health outpatient provider’s phone number. Elevated risk, defined as suicidal ideation with intent or a plan within the last 24 hours (“Have you planned out how you would do it?” and/or “When you thought about killing yourself, did you think that this was something you might actually do?”), will result in the same notification given to participants with moderate risk followed by a notification to their mental health outpatient provider. In this risk category, we will also offer to contact a local crisis response hotline on their behalf. Acute risk, defined as suicidal ideation with an action since the last assessment (“Did you do anything to try to kill yourself?”), will result in an immediate call to the local crisis response hotline made by a study team member on the participant’s behalf. Safety risk alerts are programmed in MetricWire to notify the study coordinator, who will then immediately inform outpatient providers of patient responses for follow-up.

Selection of EMA Measures

To discuss the most appropriate EMA survey measures, authors (LBA, GI, EA, AD, and SJ) met weekly from November 2020 to March 2021. Based on previous EMA feasibility studies, our goal was for the duration and length of our EMA survey to last 2-3 minutes, with 20 or fewer items [17,39]. Our weekly meetings focused on measure selection as well as the suitability of each measure for the baseline survey, the EMA questionnaire, or other aspects of data collection (eg, exit survey or daily diaries).

We first identified full and brief measures related to ITS derived from our adapted conceptual framework (Figure 1), including thwarted belongingness, perceived burdensomeness, and capability for suicide [35,39,40]. We then conducted a directed literature review of brief validated measures by searching MEDLINE (PubMed) and Google Scholar to identify additional brief measures to include in our surveys. Search strategies for each database were developed in coordination with authors (LBA and SA). This search strategy included terminology related to methods (eg, digital phenotyping, smartphone, EMA), target population (eg, Black, African American), and affective states (eg, anger, fear, and happiness) relevant to our study objectives. Priority was given to studies that focused on or included our target population in the study sample and items that were previously used in EMA studies. Additional studies were also included by examining the reference lists of included studies.

To reduce validated measures into brief EMA items for our survey, we reviewed selected measures to determine their validity and reliability in our target population. We also reviewed factor analysis studies of each measure to determine items in the overall scale that were more closely related to the measured construct, incorporating items with the highest factor loading into our EMA protocol. For instance, to briefly assess hopelessness, we selected items from the Beck Hopelessness Scale with the highest factor loadings in a previous construct validity study, yielding our retention of the items “I feel that things won’t work out” (item 14; 0.872 factor loading) and “I feel there is no use in really trying” (item 16; 0.912 factor loading) [33]. Finally, once items were selected, the wording of the questions was changed to reflect the real-time, momentary timing of the measures (eg, since the last prompt). Our final list of items is presented in Table 2.

Table 2. Ecological momentary questionnaire items and response options.
MeasureItems (Since the last prompt...)Response options
Suicidal thoughts and behaviors
  • Have you had thoughts of killing yourself?
  • Have you planned out (worked out the details of) how you would do it?
  • When you thought about killing yourself, did you think that this was something you might actually do?
  • Did you do anything to try to kill yourself?
Yes or No
Suicidal intensity
  • How intense is this feeling for you right now?
Likert scale 1-10
Depression [34]
  • I have little interest or pleasure in doing things
  • I am feeling down, depressed, or hopeless
Likert scale: 0=Not at all, 1=Some of the time, 2=Most of the time, 3=All of the time
Thwarted belongingness [35]
  • I feel close to others
  • I feel like I belong
Yes or No
Perceived burdensomeness [25]
  • I feel that people would be happier without me
  • I feel that right now people would be better off if I was gone
Yes or No
Hopelessness [33]
  • I feel that things won’t work out
  • I feel there is no use in really trying
True or false
Capability for suicide [40]
  • I could kill myself if I wanted to.
  • I am very much afraid to die.
Likert scale 1-10

Acceptability and Feasibility

Feasibility will be assessed by the following: (1) the ratio between the number of people who enroll in the study and the total number of people approached for recruitment and/or who complete a screening survey, (2) participant reports of ease of completing the EMA survey (Likert scale: 1-5), (3) percentage low compliance (defined as 50% or fewer EMA surveys completed during the 7-day period), (4) percentage of safety-related incidents reported to clinical staff (eg, acute suicide risk notifications), and (5) average length of time to complete surveys. Acceptability will be assessed using qualitative responses from semistructured exit interviews at the end of data collection. Participants will also have the option to write free-text responses reflecting upon the acceptability of the study.

Data Analysis

To address known issues with missingness associated with EMA survey compliance [17], we will include only respondents who completed 50% or more of their EMA surveys. We anticipate that our estimated sample size of 50 participants will yield 1120 completed EMA survey responses (accounting for 80% compliance), 350 daily diary responses, and 50 baseline questionnaire surveys for subsequent cross-sectional and longitudinal analyses. Descriptive statistics will be used to characterize the study population in terms of baseline characteristics and feasibility measures using means, t tests, chi-square tests (categorical outcomes), and bivariate correlations (continuous outcomes). Descriptive statistics will be summarized by EMA survey compliance (eg, <50%, ≥50%, and ≥80%). We will compute Cronbach α and item-to-total correlations of baseline survey measures. Differences in survey compliance based on baseline characteristics will also be examined using linear regression.

Our primary analysis will investigate the hypothesized mediation model in Figure 1, which will assess the influence of racism-related stressors on suicide outcomes, through the mediating influence of ITS constructs (eg, thwarted belongingness, perceived burdensomeness, and hopelessness). We will conduct multilevel mediation path models using randomly prompted EMA data in Mplus (version 8.4), accounting for the hierarchical data structure of the repeated EMA signals (level 1: within subject) nested within participants (level 2: between subjects) [41]. We will employ maximum likelihood estimation approaches to account for missing data. Tests for moderation will be conducted by using cross-level interactions in the mediation model. Once significant (P<.05) predictive, mediating, and moderating factors are identified, we will extract the following information for each significant variable to sufficiently power future multilevel intervention studies: means, variances, parameter estimates, and patterns of missingness.

Qualitative responses from respondent-driven recordings of racism-related events will be analyzed using an iterative thematic approach [42,43]. Recorded events will be professionally transcribed verbatim. Deidentified transcripts will be uploaded onto Dedoose software for subsequent analysis [44]. Final qualitative themes will enhance our understanding of daily experiences of racism among a psychiatric sample of Black men.

Research team meetings to select and modify measures for our study resulted in a 15-item EMA survey administered 4 times per day and a 22-item daily diary survey administered at the end of each day. As of July 2021, recruitment for the qualitative phase of our mixed methods study is currently underway. Inclusion of participants for the EMA phase of our study will begin as early as August 2021 and will conclude by December 2022. Complete data collection and analyses are expected to conclude by February 2023. Preliminary results are expected to be disseminated in peer-reviewed journals and presented at national conferences starting in Spring 2022. All phases of the research study have been approved by the Institutional Review Board at Johns Hopkins Bloomberg School of Public Health (#00013672).

Principal Findings

The anticipated results of the study will inform how racism-related stressors influence both proximal risk factors and suicidal thoughts and behaviors in a psychiatric sample of Black young adult men. The significance of the research provides timely explanatory evidence toward the growing trend of suicide completion among Black men, who comprise the largest percentage of deaths by suicide (81%) within the Black community [5]. The goal of this protocol is twofold: (1) to demonstrate the suitability of EMA methods in assessing real-time momentary changes of suicidality within Black men and (2) to clarify the temporal role of real-time racism-related stressors in the experiences leading to suicidal outcomes. The proposed research is the first to our knowledge to address critical research gaps in suicide research, including the consideration of racism-related stress in the theoretical and empirical application of the ITS. Additionally, our research team plans to leverage the full promise of intensive longitudinal data collection procedures using EMA and daily diary surveys among a within-group sample of Black men, an underrepresented and understudied population in suicide prevention research.


Participant burden, noncompliance, and reactivity to the protocol measures have been cited as potential limitations to EMA and smartphone-based mobile health studies [18,45]. We are encouraged by extant research demonstrating a median response rate of 75% or higher over longer periods among psychiatric patients and young adults [21,46-49]. To encourage steady compliance, participant incentives will be distributed incrementally, which has been done successfully in previous studies [45]. In the event of steady poor compliance and reduced yield of expected observations, we will leverage the following: (1) completed EMA surveys collected at earlier time points (eg, day 1 and day 2 of the 7-day study), (2) the daily diary, and (3) baseline cross-sectional survey responses. This study is also limited in its generalizability to Black men receiving psychiatric care in an academic research hospital in Baltimore, MD. Future studies should consider additional venues and settings to recruit Black men who are not engaged in psychiatric care, including but not limited to social media, advocacy groups, and peer-led and/or community-based organizations.


Despite these limitations, our proposed study has the potential to more robustly identify and assess the impact of daily racialized stressors among Black men with mental health needs. Study results will provide insights regarding the temporal influence of frequent racism-related stress, which can be clarified further and potentially mitigated in future suicide prevention research across multiple settings. Findings from this study will also generate key hypotheses for future fully powered EMA and intervention research that includes information on missingness patterns, compliance, and parameter estimates of key study variables. In addition to assessing the suitability of EMA approaches to capture daily racialized experiences and proximal suicide outcomes, our findings can be adapted to other ecologically valid contexts that may exacerbate Black young adult men’s mental health outcomes in real time, such as police killings of unarmed Black men and other direct and vicarious experiences of racial trauma [50,51]. Overall, our study will provide important insights to help bridge the gap in research regarding Black men’s suicidality and will serve as a model for future real-time smartphone-based assessments focused on this vulnerable population.


This study was funded by YIG-0-001-19 from the American Foundation of Suicide Prevention.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Peer review response from the American Foundation of Suicide Prevention.

PDF File (Adobe PDF File), 316 KB

  1. Bridge JA, Asti L, Horowitz LM, Greenhouse JB, Fontanella CA, Sheftall AH, et al. Suicide Trends Among Elementary School-Aged Children in the United States From 1993 to 2012. JAMA Pediatr 2015 Jul;169(7):673-677. [CrossRef] [Medline]
  2. Lindsey MA, Sheftall AH, Xiao Y, Joe S. Trends of Suicidal Behaviors Among High School Students in the United States: 1991-2017. Pediatrics 2019 Nov;144(5):1-10 [FREE Full text] [CrossRef] [Medline]
  3. Gordon JA, Avenevoli S, Pearson JL. Suicide Prevention Research Priorities in Health Care. JAMA Psychiatry 2020 Sep 01;77(9):885-886. [CrossRef] [Medline]
  4. Ramchand R, Gordon JA, Pearson JL. Trends in Suicide Rates by Race and Ethnicity in the United States. JAMA Netw Open 2021 May 03;4(5):e2111563 [FREE Full text] [CrossRef] [Medline]
  5. Murphy SL, Xu J, Kochanek KD, Arias E, Tejada-Vera B. Deaths: Final Data for 2018. Natl Vital Stat Rep 2021 Jan;69(13):1-83. [Medline]
  6. Emergency Task Force on Black Youth Suicide and Mental Health. Ring the Alarm: The Crisis of Black Youth Suicide in America. Congressional Black Caucus Emergency Task Force. Washington, DC: Representative Bonnie Watson Coleman; 2018.   URL: [accessed 2019-12-17]
  7. Joe S, Scott M, Banks A. What Works for Adolescent Black Males at Risk of Suicide: A Review. Res Soc Work Pract 2018 Mar;28(3):340-345 [FREE Full text] [CrossRef] [Medline]
  8. Williams DR, Williams-Morris R. Racism and mental health: the African American experience. Ethn Health 2000;5(3-4):243-268. [CrossRef] [Medline]
  9. Williams DR, Yan Y, Jackson JS, Anderson NB. Racial Differences in Physical and Mental Health: Socio-economic Status, Stress and Discrimination. J Health Psychol 1997 Jul;2(3):335-351. [CrossRef] [Medline]
  10. Goodwill JR, Taylor RJ, Watkins DC. Everyday Discrimination, Depressive Symptoms, and Suicide Ideation Among African American Men. Arch Suicide Res 2021;25(1):74-93. [CrossRef] [Medline]
  11. Williams DR, Lawrence JA, Davis BA. Racism and Health: Evidence and Needed Research. Annu Rev Public Health 2019 Apr 01;40:105-125 [FREE Full text] [CrossRef] [Medline]
  12. Lewis TT, Cogburn CD, Williams DR. Self-reported experiences of discrimination and health: scientific advances, ongoing controversies, and emerging issues. Annu Rev Clin Psychol 2015 Mar 28;11(1):407-440 [FREE Full text] [CrossRef] [Medline]
  13. Van Orden KA, Witte TK, Cukrowicz KC, Braithwaite SR, Selby EA, Joiner TE. The interpersonal theory of suicide. Psychol Rev 2010 Apr;117(2):575-600 [FREE Full text] [CrossRef] [Medline]
  14. Joiner T. Why people die by suicide. Cambridge, MA: Havard University Press; 2007.
  15. Hollingsworth D, Wingate L, Tucker R, O’Keefe V, Cole A. Hope as a Moderator of the Relationship Between Interpersonal Predictors of Suicide and Suicidal Thinking in African Americans. Journal of Black Psychology 2014 Dec 30;42(2):175-190 [FREE Full text] [CrossRef]
  16. Odafe MO, Salami TK, Walker RL. Race-related stress and hopelessness in community-based African American adults: Moderating role of social support. Cultur Divers Ethnic Minor Psychol 2017 Oct;23(4):561-569. [CrossRef] [Medline]
  17. Stone AA, Shiffman S. Capturing momentary, self-report data: a proposal for reporting guidelines. Ann Behav Med 2002;24(3):236-243. [CrossRef] [Medline]
  18. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [CrossRef] [Medline]
  19. Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs-principles and practices. Health Serv Res 2013 Dec;48(6 Pt 2):2134-2156 [FREE Full text] [CrossRef] [Medline]
  20. Kleiman EM, Turner BJ, Fedor S, Beale EE, Picard RW, Huffman JC, et al. Digital phenotyping of suicidal thoughts. Depress Anxiety 2018 Jul 10;35(7):601-608. [CrossRef] [Medline]
  21. Glenn CR, Kleiman EM, Kearns JC, Santee AC, Esposito EC, Conwell Y, et al. Feasibility and Acceptability of Ecological Momentary Assessment with High-Risk Suicidal Adolescents Following Acute Psychiatric Care. J Clin Child Adolesc Psychol 2020 Apr 02:1-17. [CrossRef] [Medline]
  22. Sedano-Capdevila A, Porras-Segovia A, Bello HJ, Baca-García E, Barrigon ML. Use of Ecological Momentary Assessment to Study Suicidal Thoughts and Behavior: a Systematic Review. Curr Psychiatry Rep 2021 May 18;23(7):41. [CrossRef] [Medline]
  23. Sellers R, Rowley S, Chavous T, Shelton J, Smith M. Multidimensional Inventory of Black Identity: A preliminary investigation of reliability and constuct validity. Journal of Personality and Social Psychology 1997 Oct;73(4):805-815. [CrossRef]
  24. Forbes D, Alkemade N, Mitchell D, Elhai JD, McHugh T, Bates G, et al. Utility of the Dimensions of Anger Reactions-5 (DAR-5) scale as a brief anger measure. Depress Anxiety 2014 Feb;31(2):166-173. [CrossRef] [Medline]
  25. Watson D, Clark LA. The PANAS-X: Manual for the positive and negative affect schedule-expanded form. Iowa City, Iowa: University of Iowa; 1999.
  26. Gross JJ, John OP. Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. J Pers Soc Psychol 2003 Aug;85(2):348-362. [CrossRef] [Medline]
  27. Connor KM, Kobak KA, Churchill LE, Katzelnick D, Davidson JR. Mini-SPIN: A brief screening assessment for generalized social anxiety disorder. Depress Anxiety 2001;14(2):137-140. [CrossRef] [Medline]
  28. Paiva BSR, de Camargos MG, Demarzo MMP, Hervás G, Vázquez C, Paiva CE. The Pemberton Happiness Index: Validation of the Universal Portuguese version in a large Brazilian sample. Medicine (Baltimore) 2016 Sep;95(38):e4915 [FREE Full text] [CrossRef] [Medline]
  29. Kimonis ER, Fanti K, Goldweber A, Marsee MA, Frick PJ, Cauffman E. Callous-unemotional traits in incarcerated adolescents. Psychol Assess 2014 Mar;26(1):227-237 [FREE Full text] [CrossRef] [Medline]
  30. Duckworth AL, Quinn PD. Development and validation of the short grit scale (grit-s). J Pers Assess 2009 Mar;91(2):166-174. [CrossRef] [Medline]
  31. Pachkowski MC, May AM, Tsai M, Klonsky ED. A Brief Measure of Unbearable Psychache. Suicide Life Threat Behav 2019 Dec;49(6):1721-1734. [CrossRef] [Medline]
  32. Posner K, Brent D, Lucas C, Gould M, Stanley B, Brown G, et al. Columbia-suicide severity rating scale (C-SSRS). New York, NY: Columbia University Medical Center; 2008.   URL: [accessed 2021-09-01]
  33. Beck AT, Weissman A, Lester D, Trexler L. The measurement of pessimism: the hopelessness scale. J Consult Clin Psychol 1974 Dec;42(6):861-865. [CrossRef] [Medline]
  34. Kroenke K, Spitzer RL, Williams JBW. The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care 2003 Nov;41(11):1284-1292. [CrossRef] [Medline]
  35. Van Orden KA, Cukrowicz KC, Witte TK, Joiner TE. Thwarted belongingness and perceived burdensomeness: construct validity and psychometric properties of the Interpersonal Needs Questionnaire. Psychol Assess 2012 Mar;24(1):197-215 [FREE Full text] [CrossRef] [Medline]
  36. Van OKA, Witte TK, Gordon KH, Bender TW, Joiner TE. Suicidal desire and the capability for suicide: tests of the interpersonal-psychological theory of suicidal behavior among adults. J Consult Clin Psychol 2008 Feb;76(1):72-83. [CrossRef] [Medline]
  37. Yu L, Buysse DJ, Germain A, Moul DE, Stover A, Dodds NE, et al. Development of short forms from the PROMIS sleep disturbance and Sleep-Related Impairment item banks. Behav Sleep Med 2011 Dec 28;10(1):6-24 [FREE Full text] [CrossRef] [Medline]
  38. Law MK, Furr RM, Arnold EM, Mneimne M, Jaquett C, Fleeson W. Does assessing suicidality frequently and repeatedly cause harm? A randomized control study. Psychol Assess 2015 Dec;27(4):1171-1181. [CrossRef] [Medline]
  39. Forkmann T, Spangenberg L, Rath D, Hallensleben N, Hegerl U, Kersting A, et al. Assessing suicidality in real time: A psychometric evaluation of self-report items for the assessment of suicidal ideation and its proximal risk factors using ecological momentary assessments. J Abnorm Psychol 2018 Nov;127(8):758-769. [CrossRef] [Medline]
  40. Ribeiro J, Witte T, Van Orden KA, Selby E, Gordon K, Bender T, et al. Fearlessness about death: the psychometric properties and construct validity of the revision to the acquired capability for suicide scale. Psychol Assess 2014 Mar;26(1):115-126 [FREE Full text] [CrossRef] [Medline]
  41. Muthén LK, Muthén BO. Mplus user’s guide. Eighth Edition. Mplus. Los Angeles, CA: Muthén and Muthén; 2019.   URL: [accessed 2019-11-15]
  42. Sundler AJ, Lindberg E, Nilsson C, Palmér L. Qualitative thematic analysis based on descriptive phenomenology. Nurs Open 2019 Jul 07;6(3):733-739 [FREE Full text] [CrossRef] [Medline]
  43. Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology 2006 Jan;3(2):77-101. [CrossRef]
  44. Dedoose. Los Angeles, CA: SocioCultural Research Consultants LLC   URL: [accessed 2021-09-01]
  45. Burke LE, Shiffman S, Music E, Styn MA, Kriska A, Smailagic A, et al. Ecological Momentary Assessment in Behavioral Research: Addressing Technological and Human Participant Challenges. J Med Internet Res 2017 Mar 15;19(3):e77 [FREE Full text] [CrossRef] [Medline]
  46. Smiley SL, Milburn NG, Nyhan K, Taggart T. A Systematic Review of Recent Methodological Approaches for Using Ecological Momentary Assessment to Examine Outcomes in U.S. Based HIV Research. Curr HIV/AIDS Rep 2020 Aug 27;17(4):333-342. [CrossRef] [Medline]
  47. Grégoire S, Chénier C, Doucerain M, Lachance L, Shankland R. Ecological momentary assessment of stress, well-being, and psychological flexibility among college and university students during acceptance and commitment therapy. Canadian Journal of Behavioural Science / Revue canadienne des sciences du comportement 2020 Jul;52(3):231-243. [CrossRef]
  48. Melcher J, Hays R, Torous J. Digital phenotyping for mental health of college students: a clinical review. Evid Based Ment Health 2020 Nov;23(4):161-166. [CrossRef] [Medline]
  49. Davidson CL, Anestis MD, Gutierrez PM. Ecological Momentary Assessment is a Neglected Methodology in Suicidology. Arch Suicide Res 2017 Jan 02;21(1):1-11. [CrossRef] [Medline]
  50. Bor J, Venkataramani AS, Williams DR, Tsai AC. Police killings and their spillover effects on the mental health of black Americans: a population-based, quasi-experimental study. Lancet 2018 Jul 28;392(10144):302-310 [FREE Full text] [CrossRef] [Medline]
  51. Smith Lee JR, Robinson MA. 'That’s My Number One Fear in Life. It’s the Police': Examining Young Black Men’s Exposures to Trauma and Loss Resulting From Police Violence and Police Killings. Journal of Black Psychology 2019 Jul 30;45(3):143-184. [CrossRef]

EMA: ecological momentary assessment
ITS: Interpersonal Theory of Suicide

Edited by T Derrick; This paper was peer reviewed by the American Foundation of Suicide Prevention. See the Multimedia Appendix for the peer-review report; submitted 16.08.21; accepted 23.08.21; published 20.10.21


©Leslie Adams, Godwin Igbinedion, Aubrey DeVinney, Enoch Azasu, Paul Nestadt, Johannes Thrul, Sean Joe. Originally published in JMIR Research Protocols (, 20.10.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.