This paper is in the following e-collection/theme issue:

RCTs - Protocols/Proposals (funded, already peer-reviewed, eHealth) (351) Web-based and Mobile Health Interventions (3243) Depression and Mood Disorders; Suicide Prevention (1338) Alcohol Abuse, Alcoholism Prevention and Recovery (294)

Published on in Vol 6, No 10 (2017): October

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/7767, first published .
Internet-Delivered Dialectical Behavioral Therapy Skills Training for Suicidal and Heavy Episodic Drinkers: Protocol and Preliminary Results of a Randomized Controlled Trial

Internet-Delivered Dialectical Behavioral Therapy Skills Training for Suicidal and Heavy Episodic Drinkers: Protocol and Preliminary Results of a Randomized Controlled Trial

Internet-Delivered Dialectical Behavioral Therapy Skills Training for Suicidal and Heavy Episodic Drinkers: Protocol and Preliminary Results of a Randomized Controlled Trial

Authors of this article:

Chelsey Wilks1 Author Orcid Image ;   Qingqing Yin1 Author Orcid Image ;   Sin Yee Ang1 Author Orcid Image ;   Brandon Matsumiya2 Author Orcid Image ;   Anita Lungu3 Author Orcid Image ;   Marsha Linehan1 Author Orcid Image
Article Authors Cited by (15) Tweetations (2) Metrics

    Protocol

    1Behavioral Research and Therapy Clinics, Department of Psychology, University of Washington, Seattle, WA, United States

    2Department of Psychology, University of Central Florida, Orlando, FL, United States

    3Lyra Health, Burlingame, CA, United States

    Corresponding Author:

    Chelsey Wilks, MS

    Behavioral Research and Therapy Clinics

    Department of Psychology

    University of Washington

    3935 University Way

    Seattle, WA, 98195

    United States

    Phone: 1 7027156241

    Email: wilksc@u.washington.edu


    Background: The need to develop effective and accessible interventions for suicidal individuals engaging in heavy episodic drinking (HED) cannot be understated. While the link between alcohol use and suicidality is a complex one that remains to be elucidated, emotion dysregulation may play a key role in alcohol-related suicide risk in these individuals.

    Objective: In the current study, an 8-week Internet-delivered dialectical behavior therapy (DBT) skills training intervention was developed and preliminarily evaluated for suicidal individuals who engage in HED to regulate emotions. The aim of the study is to evaluate the feasibility and effectiveness of the therapist-assisted and Internet-delivered intervention, and to inform the design of a subsequent full-scale study.

    Methods: The study was a pilot randomized controlled trial comparing participants receiving immediate-treatment (n=30) to waitlist controls (n=29) over a period of 16 weeks. Intervention effects will be assessed longitudinally using hierarchical linear modeling and generalized estimating equations, along with analyses of effect sizes and clinically significant change. The primary outcomes are suicidal ideation, alcohol problems, and emotion dysregulation. Secondary outcomes include alcohol-related consequences, reasons for living, skills use, and depression.

    Results: The trial is ongoing. A total of 60 individuals returned their informed consent and were randomized, of whom 59 individuals were intended to treat. A total of 50 participants in the study were retained through the 16-week enrollment.

    Conclusions: There is a dearth of evidence-based treatment for individuals presenting with high risk and complex behaviors. Furthermore, computerized interventions may provide a beneficial alternative to traditional therapies. The particular clinical features and treatment needs of suicidal individuals who also engage in HED constitute key domains for further investigation that are needed to consolidate the design of appropriate interventions for this high-risk population.

    Trial Registration: Clinicaltrials.gov NCT02932241; https://clinicaltrials.gov/ct2/show/NCT02932241 (Archived by WebCite at http://www.webcitation.org/6uJHdQsC2)

    JMIR Res Protoc 2017;6(10):e207

    doi:10.2196/resprot.7767

    Keywords

    dialectical behavioral therapy; randomized controlled trial; eMental health; suicide; heavy episodic drinking; emotion dysregulation 


    Suicide is the tenth leading cause of death across all age groups and is among the top four causes of death for Americans aged 10 to 54 years [1]. Furthermore, approximately 40% of suicides were found to be preceded by acute alcohol use [2]. Alcohol intoxication, both acute and chronic, has been identified as a uniquely salient risk factor for suicide among individuals with suicidal ideation [3-6]. These findings bring attention to the importance of attending to problematic alcohol use, and binge drinking in particular, in the management of suicide risk.

    One possible explanation for the prevalence of suicide attempts preceded by binge drinking (ie, heavy episodic drinking; HED) is that suicidal heavy drinkers lack emotion regulation capabilities [7-10]. Emotion dysregulation is associated with risk for both suicide and problematic drinking [11-13]. Furthermore, suicide risk may be particularly elevated in individuals who engage in HED to reduce acute negative affect [9]. Given the behavioral complexity of suicidal individuals who drink alcohol to regulate emotions, an alcohol-focused treatment may not be sufficient to increase coping skills and/or distress tolerance techniques. This problem suggests the need for novel treatment approaches for HED and suicide that focus on increasing emotion regulation capabilities.

    Dialectical behavior therapy (DBT) [14-16] is a behavioral intervention with strong empirical evidence in reducing suicidal behavior [17]. DBT was specifically designed for high risk, complex individuals, and consists of a combination of individual psychotherapy, group skills training, telephone coaching, and a therapist consultation team. Recent evidence has found that the DBT skill-training component alone is efficacious at reducing dysfunctional behaviors associated with emotion dysregulation [18,19], and that DBT skills usage mediates reductions in a variety of outcomes (including suicidal acts) [20]. Taken together, a DBT skills training intervention is a potent and efficient treatment package.

    Unfortunately, despite the existence of evidence-based interventions such as DBT, there remains a vast discrepancy between the need and availability of treatment for suicidal individuals with cooccurring addictive disorders. For example, the majority of those who engage in suicidal behaviors never engage in treatment [1,21]. In addition, a rare study on alcohol-dependent suicide attempters who were hospitalized following a suicide attempt found that only 6% of participants had been enrolled in psychotherapy prior to hospitalization, and only 9% went on to receive psychotherapy in the month after discharge [22]. Interestingly, while severity of suicidal ideation has been associated with low endorsement of formal treatment engagement, suicidal individuals may be more apt to utilize such nontraditional modalities, including online and Web-based interventions [23]. For these individuals, technological mediation may offer a convenient and viable means to access needed treatment.

    Technologically-assisted interventions for psychological disorders constitute the focus of a growing body of research [24-26]. Internet-delivered or computerized interventions are available to anyone with an Internet connection, and can be accessed at relatively low costs. Moreover, attitudinal barriers (eg, stigma associated with psychiatric diagnoses and attending face-to-face therapy) can be circumvented by treatment delivered anonymously in one’s home. However, although computerized interventions have shown preliminary promise in accessing and treating suicidal ideation [27,28], as well as strong evidence in reducing problematic alcohol use [29-30], they are rarely tested on high risk individuals presenting with complex and multiple disorders [31].

    To address this treatment gap, an Internet-delivered DBT skills intervention targeting the underlying mechanism of emotion dysregulation was adapted for individuals who endorse suicidal thoughts and engage in HED. The current pilot study is a proof of concept study that seeks to evaluate the feasibility, acceptability, and preliminary efficacy of a DBT skills training intervention delivered via technology (ie, Web-based portal). The following aims are: (1) to determine the feasibility of recruiting clients, administering the treatment, and retaining clients in the treatment; (2) to evaluate the safety of the treatment with respect to potential adverse events; (3) to assess the feasibility of the research methodology (eg, reliability of the measures used, feasibility of random assignment to treatment, appropriateness of the control condition); and (4) to evaluate the feasibility of using a wait-list control group in this line of research, and changes over time among individuals in such a comparison group.


    This study is a pilot randomized controlled trial (RCT) comparing an Internet-delivered Dialectical Behavioral Therapy Skills Training (iDBT-ST) to a waitlist control condition. Participants were randomized to begin the 8-week intervention either immediately or after an 8-week waiting period. Assessments included monthly batteries, weekly surveys, brief daily reports, and acceptability questionnaires, all of which were all self-assessed. The project’s primary aim is to determine whether further revisions of the iDBT-ST intervention are needed, and to inform the design of a subsequent full-scale RCT.

    Participants

    Participants were recruited from ads placed online (eg, Craigslist, Reddit) and in a local newspaper containing a brief description of the study. Interested participants were phone screened for eligibility on alcohol use severity, frequency of binge drinking episodes, suicidal ideation, emotion dysregulation, mental health treatment history, and demographic characteristics. Inclusion criteria included: (1) being 18 years or older, (2) endorsing suicidal ideation in the past month (defined as endorsing a wish to die at least once in the past 30 days), (3) engaging in at least two episodes of heavy drinking in the past month, (4) high emotion dysregulation (defined as scoring one standard deviation above the normative mean on the 16-item Difficulties in Emotion Regulation Scale [32]), and (5) residing in the United States. Exclusion criteria included: (1) currently receiving psychotherapy; (2) diagnosis of bipolar I, schizophrenia, or schizoaffective disorder; (3) non-English speaking; (4) unable to read or write; and (5) having no access to a computer connected to the Internet. Of 398 individuals who expressed initial interest, 60 of 91 eligible individuals returned the informed consent forms and were randomized into the immediate-treatment (n=31) and waitlist (n=29) groups. One person randomized to the immediate-treatment group did not complete any of the assessments, leaving 59 people included in the analyses. The phone screening process helped us prevent participants from enrolling with multiple identities.

    Ethics and Consent

    The study has been approved by the Human Subjects Division of the Institutional Review Board at the University of Washington (IRB# 50295). Through the initial phone screening, all interested individuals were briefed on the aims of the study and their rights as participants. Participants were informed that their answers to the questions were voluntary, and that they could withdraw from the study at any time. Informed consent forms (see Multimedia Appendix 1) containing details about the study, procedures, and possible risks and benefits involved were provided to all eligible participants. Prior to randomization, participants were required to indicate on the consent forms their preferred mode of communication for receiving study materials, and to return their signed consent forms to the study site. Referral resources for treatment and crisis services were sent by email to interested callers who were deemed ineligible for the study. All participants consented to have their nonidentifiable data published. Access to the dataset is restricted to the principal investigator and authorized research assistants only. Complete data from this study can be obtained by contacting the first author once data analysis has been completed. iDBT-ST is not currently available online.

    This study focuses on sensitive topics such as alcohol use and suicidal behavior, and the phone screen and outcome assessments contain questions that could potentially be distressing to participants. As a safety measure, participants were encouraged to consult with research staff whenever they felt distressed during screening and later participation. Suicide risk was also monitored and addressed in ways that are discussed later in this paper.

    Procedure

    Semistructured phone screening interviews were conducted with individuals who initiated contact via phone or email and remained interested after receiving information about the study. Phone screens were either prescheduled or conducted during the first call of contact, depending on caller preference, and were administered by trained research assistants. Eligible individuals received informed consent forms to sign and return, and were randomized once their signed forms were received at the study site.

    Following randomization into the immediate-treatment and waitlist groups, participants in both conditions received a baseline assessment, followed by identical monthly assessments in the ensuing four months. Primary monthly outcomes included suicide ideation (Scale for Suicidal Ideation [33]), severity and frequency of alcohol consumption (Alcohol Use Disorders Identification Test; AUDIT [34], and Self-Administered Web-Based Timeline Followback [35,36]), and emotion dysregulation (Difficulties in Emotion Regulation Scale [37]). Secondary outcome measures included the Reasons for Living Inventory [38], Short Inventory of (Alcohol) Problems (SIP) [39], Patient Health Questionnaire [40], and Dialectical Behavior Therapy - Ways of Coping Checklist [41]. All participants also received brief online weekly assessments on suicide ideation and alcohol consumption. Suicide risk was monitored via weekly assessments.

    Prior to treatment, participants also responded to their expectancy of outcome along with the credibility of the intervention (Credibility/Expectancies Questionnaire [42]). At the end of the treatment period, participants reported on their treatment satisfaction (Client Satisfaction Inventory-Short Form [43]) and therapeutic alliance (California Psychotherapeutic Alliance Scale [44]). Participants actively receiving treatment also received brief daily surveys about their urges to quit treatment, use of DBT skills, and engagement level.

    All assessments were administered through an online survey platform (Qualtrics [45]) made accessible to participants via Uniform Resource Locator links in scripted emails sent at scheduled timepoints. As compensation for their participation, participants received up to US $120 in Amazon gift cards upon completing each monthly survey (baseline=$15, 4-week=$20, 8-week=$25, 12-week=$30, and 16-week=$30).

    Randomization

    Eligible and consenting participants were randomized into the immediate-treatment (n=31) and waitlist groups (n=29). To control for potential covariates that may spuriously affect analytic results, an open source desktop application called MinimPy [46] was used to match participants for equal distribution between conditions on three variables. The three variables were: sex assigned at birth (Demographic Data Schedule), severity of suicide ideation (Suicide Behavior Questionnaire-Revised) and degree of disordered drinking (AUDIT).

    Managing Risk

    Suicide risk was carefully monitored in the current study. Participants were assessed at the start and end of the recruitment phone screen, as well as throughout the course of their participation. High risk of suicide during phone-screening was indicated by endorsing 4 or more points on a 7-point Likert scale, or an increase of 3 or more points from the start of screening on urge to die by suicide. Throughout the 16-week trial period, weekly questionnaires assessing suicide risk were emailed to all participants. These emails included prompts on: (1) frequency of suicidal urges in the past week, (2) intensity of suicidal urges in the past week, (3) seriousness of acting out on suicidal urges in the past week, and (4) current suicidal urge, all using 5-point Likert scales. Participants endorsing a rating of 3 or higher on any item, or a 2-point increase from the previous week, would be called by phone and assessed for suicide risk. Additionally, the number for the National Suicide Prevention Lifeline was situated next to prompts on suicidality received by all participants.

    The principal investigator was on call to intervene by phone at any time. Evidence-based procedures based on the University of Washington Risk Assessment Protocol (UWRAP) [47] were implemented by the principal investigator whenever further assessments of risk were warranted. The UWRAP guides the assessor through a suicide risk assessment procedure that evaluates the presence of a plan, access to means, likelihood of following through with a plan, being interrupted by others, et cetera. If a participant was determined to be at high risk based on this interview and the clinical judgment of the principal investigator, a safety plan was to be developed with the cooperation of the participant and the principal investigator. If a participant was unavailable by phone, a nonjudgmental caring email (see Multimedia Appendix 2) was sent, which expressed concern and encouraged participants to reach out to a suicide hotline or textline provided in the email.

    Intervention

    One primary aim of iDBT-ST is to replace maladaptive behavioral strategies with alternative strategies for coping and emotion regulation. The current intervention comprises the skill-training component alone, which is administered in a computerized format. The intervention was modified from an online DBT skills training intervention for emotion dysregulation [48].

    Participants randomized into the iDBT-ST group were immediately enrolled into the online treatment program, and received weekly sessions over a period of 8 weeks. After completing the eighth session, participants in active treatment were transitioned into a follow-up phase that entailed monthly and weekly assessments without treatment. Participants randomized into the waitlist group received repeated monthly assessments as well as weekly surveys for 8 weeks prior to receiving treatment.

    The iDBT-ST intervention was administered through an online electronic learning server (Articulate Online [49]) which consists of 8 sessions (Table 1) accessible through an access portal individualized for each participant, with one new session activated each week. The sessions begin with a weekly assessment, followed by (1) a review of the last session at weeks 2-8, (2) an introduction of the current session, (3) skills teaching, and (4) summary and consolidation. The skills were taught via videos and graphics describing the skills and examples, along with interactive activities. The intervention completion rate of each participant was also monitored through the server. If consented by participants, reminders to complete sessions were sent via their preferred method before the next session became available. Individualized assignments of skill practice were provided following the completion of each session. See Figure 1, Figure 2, and Figure 3 for screenshots of the intervention.

    Table 1. Description and function of session contents.
    SessionDBT moduleSkillsFunction
    1MindfulnessObserving, Describing, ParticipatingTo introduce the foundational skills to develop nonjudgmental awareness of the present
    2MindfulnessNonjudgmentally, One-Mindfully, EffectivelyTo teach how to practice mindfulness with skillful effectiveness
    3AddictionDialectical Drinking, Clear MindTo help learners find a middle path between oppressive sobriety and unrestrained freedom of drinking, and develop a clear mind
    4AddictionCommunity Reinforcement, Burning BridgesTo teach strategies to identify relationships and activities that aim to stop or reduce problematic drinking
    5Emotions RegulationUnderstanding EmotionsTo teach the functions of emotions, and how to describe them
    6Emotions RegulationHandling Unwanted EmotionsTo teach skills to reduce frequency and quantity of unwanted emotions
    7Emotions RegulationBuilding Mastery and Copy AheadTo teach skills to build future resilience against intense emotion
    8Distress ToleranceTIP (Temperature of face, intense exercise, paced breathing), DistractTo teach skills that help weather crises and intense negative emotions

    Sessions 3 and 4 were designed to target problematic drinking, and included the new skill Dialectical Drinking. The skill of dialectical drinking describes the abstinence violation effect (see Figure 4), goal setting, pros and cons of maintaining or changing their drinking behavior, as well as an assessment of motivation and confidence to follow-through on their drinking goal. Dialectical drinking incorporates aspects of motivational interviewing [50] and harm reduction [51] as ways to nonjudgmentally reinforce a change toward goal-oriented drinking behavior. Problematic drinking is also targeted through the DBT skills of Community Reinforcement, whereby participants identify people, activities, and places that can reinforce their drinking goal, as well as Burning Bridges, whereby participants eliminate people, activities, and places that would reinforce their problematic drinking. In burning bridges, participants learned a variety of methods to manage alcohol cravings [15,16]. See Table 2 for common alcohol reduction strategies and their DBT counterparts.

    Table 2. DBT skills that target problematic drinking.
    Alcohol Reduction StrategySkill
    Deciding to make a change

    		Goal settingDialectical Drinking

    		Decisional balanceDialectical Drinking

    		Assessment of motivation and interestDialectical Drinking

    		Abstinence violation effectDialectical Drinking and Clear Mind

    		Tracking behaviorDaily diary card
    Making a change

    		Contingency managementContingency Management and Burning Bridges

    		Craving managementBurning Bridges

    		Drink refusal strategiesDialectical Drinking
    ‎
    Figure 1. Screenshot of the session overview.
    View this figure
    ‎
    Figure 2. Screenshot of interactive activity (selecting drinking goal).
    View this figure
    ‎
    Figure 3. Screenshot of interactive activity (changing emotions).
    View this figure
    ‎
    Figure 4. New Dialectical Behavioral Therapy skill: dialectical drinking.
    View this figure
    ‎
    Figure 5. CONSORT diagram. DERS: Difficulties in Emotion Regulation Scale; iDBT: Internet-delivered Dialectical Behavioral Therapy; ITT: intention-to-treat.
    View this figure

    Confidentiality

    All information provided by participants will be strictly confidential. Answers to phone screens and online assessments that will be kept indefinitely for research purposes were coded in a nonidentifying way, and stored in password-protected files on an encrypted server accessible only to the principle investigator and trained research assistants. Confidential records linking participant names with their respective research identification number will be deleted no later than September 30th, 2018. All identifying information from ineligible individuals was deleted immediately after phone screening. Additionally, the study site is a secure research clinic equipped with noise-cancelling devices to prevent conversations with participants from being overheard. Voice messages left for participants were devoid of details about the study and other sensitive information that may compromise confidentiality. Any paper documents that contained confidential Patient Health Information are kept in a locked area in the study site where access is restricted, and will be shredded before disposal. These documents may be examined in strictly confidential checks conducted by government or university staff for legal and safety insurance.

    Participants were informed of one scenario in which confidentially may be breached. That is, if a participant reveals an imminent high risk of danger to their own or someone else’s life, research staff may address that risk to police or emergency resources.

    Power Calculation

    A power analysis was not conducted because the primary purpose of the data analyses is to describe the effect of iDBT-ST protocol treatment over time using repeated observation data in a preliminary manner. The results will be used to help determine if further research on the treatment program for suicidal heavy drinkers is necessary in larger samples.

    Analyses

    Intervention effects will be evaluated by examining change outcomes as a function of treatment condition using both hierarchical linear modeling (HLM) [52] for outcomes with a normal distribution and generalized estimating equations (GEEs) [53,54] for count outcomes. Both HLM and GEEs accommodate observations that are missing at random, thus increasing the power of analyses. Analyses will be conducted using an intent-to-treat framework, in which all randomized and available participants will be included in the analyses. To examine changes over time for the entire sample, analyses will be conducted among all participants during all assessment waves (baseline to 16-week). A set of analyses will also be conducted using the first three assessment waves (baseline to 8-week) comparing immediate-treatment to no treatment, and at each condition’s relative pretreatment, midtreatment (4-week for iDBT-ST; 12-week for waitlist), and posttreatment (8-week for iDBT-ST; 16-week for waitlist) assessment phases.

    Given the pilot nature of the study, all outcomes will be evaluated in terms of effect sizes as well as clinically significant change using Jacobson and Truax’s specifications [55]. Treatment effect sizes will be analyzed using Cohen’s d and Relative risk ratios for continuous and count outcomes, respectively. Cohen’s d will calculate within-condition effect sizes across all assessment waves. Descriptive analyses will also be conducted to examine acceptability.


    Recruitment to the study began June 17, 2016 and ended September 14, 2016. Data were collected using direct entry of online surveys tools (Qualtrics [45], Articulate Online [49]) by February 2017, and are currently undergoing analyses. The CONSORT diagram (Figure 5) presents the flow of participants during recruitment, enrollment, and participation. Of the 398 individuals who expressed interest in participating, 91 were determined to be eligible through the screening process. A total of 60 individuals returned their informed consent and were randomized, of whom 59 individuals were intended-to-treat. A total of 50 participants in the study were retained through the 16-week enrollment.


    The primary aim of this trial is to preliminarily evaluate an Internet-delivered DBT skills training intervention for suicidal and heavy episodic drinkers. Research on suicidal individuals who engage in HED is paramount to understanding and managing suicide risk, particularly as it pertains to high-risk populations who are less inclined to seek formal treatment. The set of protocols used in DBT to manage acute and chronic suicidality was translated relatively seamlessly for use in this pilot study’s Web-based approach, demonstrating their potential utility as tools for remote risk-management in computerized interventions. A concern of this treatment is the 8-week waiting period; however, waiting times are often a reality for individuals seeking assessment and treatment (eg, mean=65.4 days) [56] due to resource or staff shortages [57-60], and we believe we can answer an important question about placing high risk individuals on waiting lists. Participants were fully informed about the possibility of being randomized to an 8-week waiting list, as well as their rights to withdraw from the study at any time. Referrals to treatment and crisis services were provided whenever participation was declined or withdrawn.

    One major aim of the study was to investigate the feasibility of recruiting and retaining participants from this population. Sixty eligible individuals were recruited within three months, demonstrating the feasibility and effectiveness of the online recruitment strategy. Retention rates, particularly for waitlisted participants, were anticipated as a potential challenge, with findings in the literature suggesting an association between longer wait periods and reduced treatment motivation and retention [61,62]. To address this problem, customized reminders were sent to all participants to encourage treatment engagement and assessment completion [63]. Finally, 83.3% (50/60) of all participants were retained in the study by the end of their enrollment, suggesting that customized reminders may be an effective strategy to mitigate study dropout rates.

    The level of risk commonly attributed to such studies may be inhibitive to research. Nevertheless, grounds for the safeguarding of participant safety can be established with careful implementation of validated risk-management protocols, which equip researchers with contingencies against anticipated harm in conducting much-needed studies. In addition, the feasibility of recruiting, retaining, and monitoring participants demonstrated in this pilot study provides preliminary suggestions for the developing field of research on technologically-assisted interventions that may become beneficial alternatives to traditional therapy, or mediate adaptive help-seeking in at-risk and underserved populations.

    Acknowledgments

    This research is supported by a National Research Service Award from the National Institute on Alcohol Abuse and Alcoholism (NIAAA; F31 AA 24658-01) as well as a grant from the Alcohol and Drug Abuse Institute (ADAI-0315-2). We would like to thank the individuals who participated in the study.

    Authors' Contributions

    CW is the principal investigator of the study and contributed to the design of the study, the study protocol, and preparation of this manuscript. QY and SA are research assistants on the study and contributed to data collection and preparation of this manuscript. BM is a research assistant on the study and contributed to data collection. AL contributed to the research design. ML is the faculty sponsor for the NIAAA grant that provided funding for this study and contributed to the design of the study.

    Conflicts of Interest

    iDBT-ST was developed by the principle investigator Chelsey Wilks, and it is owned by the University of Washington. Chelsey Wilks has received compensation for DBT training. Coauthor Dr. Linehan receives royalties from Guilford Press for books she has written on DBT, and from Behavioral Tech, LLC for DBT training materials she has developed. The remaining authors declare that they have no competing interests.

    ‎

    Multimedia Appendix 1

    Informed consent.

    PDF File (Adobe PDF File), 67KB
    ‎

    Multimedia Appendix 2

    Caring email sent to those unreachable by phone.

    PDF File (Adobe PDF File), 21KB
    1. Centers for Disease Control and Prevention, National Center for Injury Prevention and Control. Suicide: consequences. 2017.   URL: https://www.cdc.gov/violenceprevention/suicide/consequences.html [accessed 2017-07-15] [WebCite Cache]
    2. Cherpitel CJ, Borges GL, Wilcox HC. Acute alcohol use and suicidal behavior: a review of the literature. Alcohol Clin Exp Res 2004 May;28(5 Suppl):18S-28S. [Medline]
    3. Han B, Compton WM, Gfroerer J, McKeon R. Prevalence and correlates of past 12-month suicide attempt among adults with past-year suicidal ideation in the United States. J Clin Psychiatry 2015 Mar;76(3):295-302 [FREE Full text] [CrossRef] [Medline]
    4. May AM, Klonsky ED. What distinguishes suicide attempters from suicide ideators? A meta-analysis of potential factors. Clin Psychol Sci Pract 2016 Feb 11;23(1):5-20. [CrossRef]
    5. Nock MK, Hwang I, Sampson NA, Kessler RC. Mental disorders, comorbidity and suicidal behavior: results from the National Comorbidity Survey Replication. Mol Psychiatry 2010 Aug;15(8):868-876 [FREE Full text] [CrossRef] [Medline]
    6. Nock MK, Kessler RC, Franklin JC. Risk factors for suicide ideation differ from those for the transition to suicide attempt: the importance of creativity, rigor, and urgency in suicide research. Clin Psychol Sci Pract 2016 Feb 11;23(1):31-34. [CrossRef]
    7. Bandura A, Caprara GV, Barbaranelli C, Gerbino M, Pastorelli C. Role of affective self-regulatory efficacy in diverse spheres of psychosocial functioning. Child Dev 2003;74(3):769-782. [Medline]
    8. Berking M, Margraf M, Ebert D, Wupperman P, Hofmann SG, Junghanns K. Deficits in emotion-regulation skills predict alcohol use during and after cognitive-behavioral therapy for alcohol dependence. J Consult Clin Psychol 2011 Jun;79(3):307-318 [FREE Full text] [CrossRef] [Medline]
    9. Gonzalez VM, Bradizza CM, Collins RL. Drinking to cope as a statistical mediator in the relationship between suicidal ideation and alcohol outcomes among underage college drinkers. Psychol Addict Behav 2009 Sep;23(3):443-451 [FREE Full text] [CrossRef] [Medline]
    10. Rajappa K, Gallagher M, Miranda R. Emotion dysregulation and vulnerability to suicidal ideation and attempts. Cogn Ther Res 2011 Nov 9;36(6):833-839. [CrossRef]
    11. Brown MZ, Comtois KA, Linehan MM. Reasons for suicide attempts and nonsuicidal self-injury in women with borderline personality disorder. J Abnorm Psychol 2002 Feb;111(1):198-202. [Medline]
    12. Conner KR, Swogger MT, Houston RJ. A test of the reactive aggression-suicidal behavior hypothesis: is there a case for proactive aggression? J Abnorm Psychol 2009 Feb;118(1):235-240 [FREE Full text] [CrossRef] [Medline]
    13. Nordström P, Schalling D, Asberg M. Temperamental vulnerability in attempted suicide. Acta Psychiatr Scand 1995 Aug;92(2):155-160. [Medline]
    14. Linehan M. Cognitive-behavioral treatment of borderline personality disorder. New York: Guilford Press; 1993.
    15. Linehan M. DBT skills training manual. New York: The Guilford Press; 2014.
    16. Linehan M. DBT skills training handouts and worksheets. New York: The Guilford Press; 2014.
    17. Ward-Ciesielski EF, Linehan MM. Psychological treatment of suicidal behaviors. In: Nock M, editor. The Oxford handbook of suicide and self-injury. Oxfordshire, UK: Oxford University Press; 2014.
    18. Linehan MM, Korslund KE, Harned MS, Gallop RJ, Lungu A, Neacsiu AD, et al. Dialectical behavior therapy for high suicide risk in individuals with borderline personality disorder: a randomized clinical trial and component analysis. JAMA Psychiatry 2015 May;72(5):475-482. [CrossRef] [Medline]
    19. Valentine SE, Bankoff SM, Poulin RM, Reidler EB, Pantalone DW. The use of dialectical behavior therapy skills training as stand-alone treatment: a systematic review of the treatment outcome literature. J Clin Psychol 2015 Jan;71(1):1-20. [CrossRef] [Medline]
    20. Neacsiu AD, Rizvi SL, Linehan MM. Dialectical behavior therapy skills use as a mediator and outcome of treatment for borderline personality disorder. Behav Res Ther 2010 Sep;48(9):832-839 [FREE Full text] [CrossRef] [Medline]
    21. Bruffaerts R, Demyttenaere K, Hwang I, Chiu W, Sampson N, Kessler RC, et al. Treatment of suicidal people around the world. Br J Psychiatry 2011 Jul;199(1):64-70 [FREE Full text] [CrossRef] [Medline]
    22. Suominen KH, Isometsä ET, Henriksson MM, Ostamo AI, Lönnqvist JK. Treatment received by alcohol-dependent suicide attempters. Acta Psychiatr Scand 1999 Mar;99(3):214-219. [Medline]
    23. Wilks CR, Coyle TN, Krek M, Lungu A, Andriani K. Suicide ideation and acceptability toward online help-seeking. Suicide Life Threat Behav 2017 May 20. [CrossRef]
    24. Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided Internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry 2017 Apr 01;74(4):351-359. [CrossRef] [Medline]
    25. Deady M, Choi I, Calvo RA, Glozier N, Christensen H, Harvey SB. eHealth interventions for the prevention of depression and anxiety in the general population: a systematic review and meta-analysis. BMC Psychiatry 2017 Aug 29;17(1):310 [FREE Full text] [CrossRef] [Medline]
    26. Newby JM, Twomey C, Yuan LSS, Andrews G. Transdiagnostic computerised cognitive behavioural therapy for depression and anxiety: a systematic review and meta-analysis. J Affect Disord 2016 Jul 15;199:30-41. [CrossRef] [Medline]
    27. Kreuze E, Jenkins C, Gregoski M, York J, Mueller M, Lamis DA, et al. Technology-enhanced suicide prevention interventions: a systematic review. J Telemed Telecare 2017 Jul;23(6):605-617. [CrossRef] [Medline]
    28. van Spijker BA, Majo MC, Smit F, van Straten A, Kerkhof AJ. Reducing suicidal ideation: cost-effectiveness analysis of a randomized controlled trial of unguided web-based self-help. J Med Internet Res 2012;14(5):e141 [FREE Full text] [CrossRef] [Medline]
    29. White A, Kavanagh D, Stallman H, Klein B, Kay-Lambkin F, Proudfoot J, et al. Online alcohol interventions: a systematic review. J Med Internet Res 2010;12(5):e62 [FREE Full text] [CrossRef] [Medline]
    30. Khadjesari Z, Murray E, Hewitt C, Hartley S, Godfrey C. Can stand-alone computer-based interventions reduce alcohol consumption? A systematic review. Addiction 2011 Feb;106(2):267-282 [FREE Full text] [CrossRef] [Medline]
    31. Wilks CR, Zieve GG, Lessing HK. Are trials of computerized therapy generalizable? A multidimensional meta-analysis. Telemed J E Health 2016 May;22(5):450-457. [CrossRef] [Medline]
    32. Bjureberg J, Ljótsson B, Tull M. Difficulties in Emotion Regulation Scale-16. PsycTESTS Dataset 2016. [CrossRef]
    33. Beck AT, Kovacs M, Weissman A. Assessment of suicidal intention: the Scale for Suicide Ideation. J Consult Clin Psychol 1979 Apr;47(2):343-352. [Medline]
    34. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption--II. Addiction 1993 Jun;88(6):791-804. [Medline]
    35. Rueger SY, Trela CJ, Palmeri M, King AC. Self-administered web-based timeline followback procedure for drinking and smoking behaviors in young adults. J Stud Alcohol Drugs 2012 Sep;73(5):829-833 [FREE Full text] [Medline]
    36. Sobell L, Sobell M. Timeline follow-back for alcohol consumption. PsycTESTS Dataset 1992. [CrossRef]
    37. Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the Difficulties in Emotion Regulation Scale. J Psychopathol Behav Assess 2004 Mar;26(1):41-54. [CrossRef]
    38. Linehan MM, Goodstein JL, Nielsen SL, Chiles JA. Reasons for staying alive when you are thinking of killing yourself: the reasons for living inventory. J Consult Clin Psychol 1983 Apr;51(2):276-286. [Medline]
    39. Miller W, Tonigan J, Longabaugh R. The drinker inventory of consequences. Albuquerque, NM: Center on Alcoholism, Substance Abuse and Addictions; 1995. DrInC: an instrument for assessing adverse consequences of alcohol abuse   URL: https://pubs.niaaa.nih.gov/publications/ProjectMatch/match04.pdf [WebCite Cache]
    40. Kroenke K, Spitzer RL, Williams JB. The PHQ-9. J Gen Intern Med 2001 Sep;16(9):606-613. [CrossRef]
    41. Neacsiu AD, Rizvi SL, Vitaliano PP, Lynch TR, Linehan MM. The dialectical behavior therapy ways of coping checklist: development and psychometric properties. J Clin Psychol 2010 Jun;66(6):563-582. [CrossRef] [Medline]
    42. Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry 2000 Jun;31(2):73-86. [Medline]
    43. LaSala M. Client satisfaction: consideration of correlates and response bias. Fam Soc 1997 Jan;78(1):54-64. [CrossRef]
    44. Gaston L. Reliability and criterion-related validity of the California Psychotherapy Alliance Scales--patient version. Psychol Assessment 1991;3(1):68-74. [CrossRef]
    45. Qualtrics. Provo, UT; 2017.   URL: http://www.qualtrics.com [accessed 2017-10-15] [WebCite Cache]
    46. Saghaei M. MinimPy. 2017.   URL: http://minimpy.sourceforge.net [accessed 2017-10-15] [WebCite Cache]
    47. Linehan MM, Comtois KA, Ward-Ciesielski EF. Assessing and managing risk with suicidal individuals. Cogn Behav Pract 2012 May;19(2):218-232. [CrossRef]
    48. Lungu A. Computerized trans-diagnostic dialectical behavior therapy skills training for emotion dysregulation. Seattle, WA: University of Washington; 2015.   URL: https:/​/digital.​lib.washington.edu/​researchworks/​bitstream/​handle/​1773/​34148/​Lungu_washington_0250E_14912.​pdf?sequence=1&isAllowed=y [accessed 2017-10-15] [WebCite Cache]
    49. Articulate. 2017.   URL: http://www.articulate.com [accessed 2017-10-15] [WebCite Cache]
    50. Miller WR, Rollnick S. Motivational Interviewing, Third Edition: Helping People Change (Applications of Motivational Interviewing). New York: Guilford Press; Sep 7, 2012.
    51. Marlatt GA, Witkiewitz K. Harm reduction approaches to alcohol use: health promotion, prevention, and treatment. Addict Behav 2002;27(6):867-886. [Medline]
    52. Raudenbush S, Bryk A. Hierarchical linear models: applications and data analysis methods. Thousand Oaks, CA: Sage Publications; 2002.
    53. Liang K, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrika 1986 Apr;73(1):13. [CrossRef]
    54. Zeger SL, Liang KY. Longitudinal data analysis for discrete and continuous outcomes. Biometrics 1986 Mar;42(1):121-130. [Medline]
    55. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991 Feb;59(1):12-19. [Medline]
    56. Carr CJA, Xu J, Redko C, Lane DT, Rapp RC, Goris J, et al. Individual and system influences on waiting time for substance abuse treatment. J Subst Abuse Treat 2008 Mar;34(2):192-201 [FREE Full text] [CrossRef] [Medline]
    57. Friedmann PD, Lemon SC, Stein MD, D'Aunno TA. Accessibility of addiction treatment: results from a national survey of outpatient substance abuse treatment organizations. Health Serv Res 2003 Jun;38(3):887-903 [FREE Full text] [Medline]
    58. Institute of Medicine, Board on Health Care Services, Committee on Crossing the Quality Chasm: Adaptation to Mental Health and Addictive Disorders. Improving the quality of health care for mental and substance-use conditions. Washington, DC: National Academies Press; 2006.
    59. NHS Digital. The National Health Service. Psychological Therapies; 2016. Annual report on the use of IAPT services   URL: http://content.digital.nhs.uk/catalogue/PUB22110/psyc-ther-ann-rep-2015-16_v2.pdf [WebCite Cache]
    60. Radnofsky L. The Wall Street Journal. 2015 Feb 16. Where are the mental-health providers? As more patients seek help, advocates scramble to expand providers?   URL: https://www.wsj.com/articles/where-are-the-mental-health-providers-1424145646 [accessed 2017-07-15] [WebCite Cache]
    61. Brown BS, Hickey JE, Chung AS, Craig RD, Jaffe JH. The functioning of individuals on a drug abuse treatment waiting list. Am J Drug Alcohol Abuse 1989;15(3):261-274. [Medline]
    62. Redko C, Rapp RC, Carlson RG. Waiting time as a barrier to treatment entry: perceptions of substance users. J Drug Issues 2006 Sep;36(4):831-852 [FREE Full text] [Medline]
    63. Gariti P, Alterman AI, Holub-Beyer E, Volpicelli JR, Prentice N, O'Brien CP. Effects of an appointment reminder call on patient show rates. J Subst Abuse Treat 1995;12(3):207-212. [CrossRef] [Medline]

    ‎
    AUDIT: Alcohol Use Disorders Identification Test
    DBT: dialectical behavior therapy
    GEE: generalized estimating equation
    HED: heavy episodic drinking
    HLM: hierarchical linear modeling
    iDBT-ST: Internet-delivered Dialectical Behavioral Therapy Skills Training
    NIAAA: National Institute on Alcohol Abuse and Alcoholism
    RCT: randomized controlled trial
    UWRAP: University of Washington Risk Assessment Protocol

    Edited by G Eysenbach; submitted 27.03.17; peer-reviewed by E Ward-Ciesielski, S Berrouiguet; comments to author 12.07.17; revised version received 03.08.17; accepted 10.09.17; published 25.10.17

    Copyright

    ©Chelsey Wilks, Qingqing Yin, Sin Yee Ang, Brandon Matsumiya, Anita Lungu, Marsha Linehan. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 25.10.2017.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.