Published on in Vol 9, No 7 (2020): July

Preprints (earlier versions) of this paper are available at, first published .
Internet-Delivered Cognitive Behavioral Therapy for Problematic Alcohol Use in a Workplace Setting: Protocol for Quantitative and Qualitative Evaluation of Feasibility and Outcomes

Internet-Delivered Cognitive Behavioral Therapy for Problematic Alcohol Use in a Workplace Setting: Protocol for Quantitative and Qualitative Evaluation of Feasibility and Outcomes

Internet-Delivered Cognitive Behavioral Therapy for Problematic Alcohol Use in a Workplace Setting: Protocol for Quantitative and Qualitative Evaluation of Feasibility and Outcomes


1Department of Psychology, Stockholm University, Stockholm, Sweden

2Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet & Stockholm Health Care Services, Stockholm County Council, Stockholm, Sweden

3Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden

4Department of Psychology, Uppsala University, Stockholm, Sweden

Corresponding Author:

David Forsström, PhD

Department of Psychology

Stockholm University

Frescati Hagväg 8

Stockholm, 10691


Phone: 46 708112319


Background: Internet-based cognitive behavioral therapy (ICBT) for mental health issues has been successfully implemented in routine health care settings, and research indicates that ICBT can also be applied to decrease problematic alcohol use in workplace settings. However, studies investigating the feasibility of implementing ICBT in a workplace setting have been lacking.

Objective: The current study aims to investigate the feasibility of delivering ICBT for problematic alcohol use within an employee assistance program (EAP).

Methods: The study has a quantitative naturalistic design, quantitively comparing ICBT and face-to-face treatment, and allowing for qualitative interviews with employees and employers. Recruitment of participants follows a five-session in-person psychological assessment at an EAP regarding an employee’s presumed problematic alcohol consumption. All assessed employees referred to ICBT or face-to-face treatment will be offered participation in the study. Interviews will be held with employees and their employer representatives following ICBT to elucidate both stakeholders’ experience and perception of ICBT and its context. Outcome comparisons between ICBT and face-to-face treatment will be assessed quantitatively using a Reliable Change Index and analysis of variance. Thematic analysis and Grounded Theory will be used to analyze the interview material.

Results: The study is set to begin in April 2020 and to end in September 2021. The aim is to recruit up to 150 participants to the quantitative part of the study and 45 participants (15 employees and 30 employer representatives) to the qualitative part of the study.

Conclusions: The current study will provide knowledge that is lacking and urgently needed on how to implement ICBT for problematic alcohol use in a workplace setting.

International Registered Report Identifier (IRRID): PRR1-10.2196/18693

JMIR Res Protoc 2020;9(7):e18693



Problematic alcohol use causes harm both to the individual and to significant others, as well as generates considerable societal costs [1]. Alcohol consumption has declined in high-income countries, in parallel with substantial increases in lower-middle-income countries, although the overall prevalence of problematic alcohol use is still worryingly high [2]. In Sweden, 20% of men and 13% of women are considered hazardous drinkers [3]. Costs to society due to alcohol have been estimated to exceed one percent of the gross national product in high- and middle-income countries [1]. About half of all societal alcohol-related costs comprise loss of production at the workplace due to factors such as absence and reduced work capacity. Other common consequences of problematic alcohol use among employees are accidents, injuries, and increased healthcare costs [4-6]. The many negative consequences of hazardous alcohol use among employees are often presented as arguments for employers to implement alcohol prevention measures, capitalizing on the potential of the workplace to serve as a platform for primary, secondary, and tertiary prevention [7], since only one-fifth of individuals with alcohol use disorder seek treatment for their problems [8]. In Sweden, employment covers over two-thirds of the population between the ages of 15 and 74 [9]. Given that adults spend a large proportion of the day at the workplace, exposure to preventive interventions can be maximized [6]. To this end, employee assistance programs (EAP) have been developed to provide early and easily accessible help for employees [7].

Internet interventions in the form of internet-delivered cognitive behavior therapy (ICBT) have been studied for more than 20 years, and research shows that, for mood and anxiety disorders, they are often as effective as face-to-face psychotherapy [10]. Although some of these interventions have been developed as public health interventions, accessible to the general public, many have been developed as clinical alternatives to regular psychotherapy, and there are now several examples of clinics offering therapist-guided ICBT as an integrated part of routine health care [11]. Although there are fewer studies on ICBT for problematic alcohol use compared to ICBT for mood and anxiety disorders, the literature suggests that ICBT is also beneficial for this population [12]. A recent individual patient data meta-analysis demonstrated that internet interventions for problematic alcohol use are effective in reducing alcohol consumption, with guided interventions being more effective than unguided ones [13]. Studies on internet interventions for problematic alcohol use have mainly been conducted in general population samples [14], although there are successful examples of internet interventions conducted in clinical settings [15]. Further, a handful of studies have been conducted in workplace settings; for example, a six-week internet intervention specifically tailored to employees resulted in significant reductions in weekly standard units regardless of whether the employee received guidance from a psychologist or not [16], while a fully self-guided internet intervention with 62 modules, showed significant reductions over time in alcohol consumption. However, there were no significant differences in comparison to a self-help booklet [17]. Although these studies suggest that ICBT can be successfully used in a workplace setting, there are, to our knowledge, no studies on the feasibility of ICBT for employees at a site that provides EAP. Offering ICBT at sites using EAP has several advantages compared to face-to-face CBT. Since ICBT is available online anytime, the employee does not need to leave the workplace to receive treatment, thus reducing travel time and expenses associated with face-to-face treatment. If production loss due to treatment is cut, the employer might be more prone to pay for treatment and help the employee, particularly in smaller businesses and those not affiliated with an EAP provider [18]. Studies on the feasibility of ICBT at sites providing EAP, from both quantitative and qualitative perspectives, are needed in order to promote a greater understanding of how internet interventions might be provided in this context, possibly increasing the likelihood of successful dissemination of internet interventions in workplace settings in Sweden and elsewhere. Also, introducing ICBT at an EAP has several advantages compared to face-to-face treatment: lesser absenteeism from work due to reduced travel, less attrition from the more easily accessed treatment, and the employer might be more prone to cover treatment costs since cutting travel time means less production loss.


This study aims to investigate the feasibility of providing ICBT for employees with problematic alcohol use at Alna Sweden, a provider of EAP in Sweden. In order to determine feasibility, both quantitative and qualitative approaches will be used. The quantitative aspect of the study concerns evaluating ICBT in comparison with face-to-face treatment. The following research questions will be addressed:

  1. What changes in alcohol consumption and mental health occur over time among employees who receive ICBT or face-to-face treatment for problematic alcohol use?
  2. In what way do alcohol and mental health outcomes differ between employees exposed to ICBT as compared to face-to-face treatment?

The following research questions will be investigated in qualitative interviews among those receiving ICBT:

  1. The employee perspective:
    1. What does the employee perceive as positive or negative about receiving ICBT for problematic alcohol use?
    2. Does the employee experience any specific influence of the workplace setting on receiving ICBT; if so, how is it expressed?
  2. The employer perspective:
    1. How does the employer perceive possible effects of ICBT on employee functioning in the workplace during and after treatment?
    2. To what extent does the employer perceive ICBT as a feasible intervention for problematic alcohol use in the workplace setting?


In the current research project, employees who undergo an assessment at Alna Sweden and who are referred to psychotherapy for problematic alcohol use will be offered participation in the quantitative naturalistic study. Those who are recommended ICBT will also be offered participation in a qualitative study (see Figure 1 for an overview).

During the study, Alna will offer ICBT administered by treatment providers (psychologists and psychotherapists) working for Alna. The providers will receive training in ICBT delivery before the start of the study.

Figure 1. Flowchart for recruitment procedure.
View this figure

Treatment Setting

Alna Sweden is an organization that was founded in 1961 by the central trade unions and employers’ organizations. The Alna EAP offers prevention, assessment, and treatment of alcohol and drug use problems among employees at organizations and companies all over Sweden. Alna conducts around 150 employee assessments per year. Usually, these assessments are initiated based on employer concern about an employee’s current alcohol or drug use. The Alna assessment, which is carried out by licensed psychologists, consists of a comprehensive mapping of the employee’s current problems and resources as well as an assessment of the employee’s treatment needs. In the majority of cases, the assessment leads to recommendations for further treatment, usually in the form of 10-15 sessions of face-to-face CBT based on relapse prevention [19]. In the vast majority of cases, the employer chooses to follow the recommendation for referral to treatment and also finances the treatment. With Sweden being a sparsely populated country, employees who receive treatment often live at great geographical distances from the nearest Alna Sweden treatment provider, resulting in significant workplace absenteeism in the form of travel time, aside from any absenteeism due to the actual session time.

Recruitment Procedure

Recruitment will take place following the Alna assessment of employee needs. The assessment begins with a session where the employee participates together with an employer representative (usually the manager or personnel from human resources). The focus of this initial session is on the employee’s alcohol consumption, which has, in some way, affected work performance. The employee then undergoes a comprehensive psychological assessment over 3-4 subsequent sessions, which, in addition to alcohol consumption and other addictive behaviors, also covers mental and physical health, social relations, economic aspects, and motivation for change. Blood samples are taken in parallel to the psychological assessment.

Naturalistic Study

Towards the end of the assessment, all employees referred for psychological treatment (both face-to-face and ICBT) will be invited to participate in the study by the Alna assessment psychologist. If the employee consents, the appropriate treatment (face-to-face or ICBT) will be proposed for the employer. If the employer approves the cost, the employee will be referred to the chosen treatment, and written informed consent will be obtained at the last assessment. The participants will then be contacted by the researchers and be asked to respond to an online survey, accessed via an e-mail link.

Qualitative Study

In cases where the treatment provider considers ICBT a suitable for the employee, it will be presented as a treatment alternative requiring participation in post-treatment interviews. After that, the procedure is the same as in the naturalistic study. Hence, if the employer agrees to cover the cost for ICBT, and informed consent is collected, the participants will be contacted by the researchers and be asked to respond to the online survey, accessed via an e-mail link. The participants in the qualitative study will also receive information about the interview. These participants will be included in the naturalistic (responding to the survey) and the qualitative study (participating in the interviews). Up to 30 participants will be recruited for the qualitative study.


Inclusion Criteria

All employees who have undergone the Alna assessment and have been referred to face-to-face treatment or ICBT are eligible to participate in the naturalistic study. Those who have been referred to ICBT are also eligible for inclusion in the qualitative study. ICBT will only be available to employees agreeing to participate in the qualitative study. All employers with employees who have been referred to ICBT will be offered participation in the part of the qualitative study that concerns employers.

Exclusion Criteria

For the naturalistic study, exclusion criteria are drug use (information collected during the assessment) and suicidality (information collected during assessment and treatment).

Study Design

Naturalistic Study

All employees undergoing an Alna assessment and who are referred to psychological treatment, either regular face-to-face or ICBT, will be offered participation in the naturalistic study. Informed written consent will be provided at the final assessment session. Those who agree to participate will be provided a link to an online survey for pre-treatment measurement. A follow-up evaluation will take place immediately after completion of treatment (face-to-face psychotherapy or ICBT) and after another six and 12 months. Data collected at the start of the Alna assessment will be included retroactively, to allow evaluation of possible behavior changes during the assessment. Every employee that is offered treatment at Alna will be asked to participate in the study. Since Alna carries out approximately 150 assessments per year, the goal is to recruit all of the assessed employees. The recruitment process will go on for a year and a half if needed.

Qualitative Interview Study

In the qualitative study, employees referred to ICBT and their employers will be asked to participate in interviews, the former targeting the employee’s experiences of ICBT and the later targeting employer perceptions. A total of 45 participants will be recruited, with up to 30 employees and up to 15 employer representatives. Semi-structured interviews will take place within two months following treatment conclusion. Interview guides will be based on the research objectives presented. A panel of researchers with a background in addiction and/or internet-delivered treatment will be asked to review the interview guides to ensure that the relevant areas are covered. The employees and employer representatives who agree to participate in the study will receive the interview questions in advance to be able to reflect on the topics included, thus, increasing the possibility of describing their experiences of treatment accurately. The interviews will mainly be conducted via telephone or video meetings since participants are recruited from all over Sweden, but may also be carried out face-to-face. All of the interviews will be recorded and transcribed verbatim.

Platform and Login Procedure for the Internet-Delivered Treatment

The web-based treatment platform that will be used to deliver ICBT will require a secure, two-factor identification bank-issued national e-identification login. This identification process ensures that the right person receives the treatment and that unauthorized persons cannot access the treatment or stored data.

Outcome Measures

Online Survey Questionnaires
Timeline Followback

A seven-day Timeline Followback questionnaire (TLFB) [20,21] will be used to measure preceding week alcohol consumption, as measured in standard units. TLFB can be used during different measures of time, eg, one or two weeks. The user has to specify how much alcohol he/she has consumed each day during the specified period.

Alcohol Use Disorders Identification Test

The Alcohol Use Disorders Identification Test (AUDIT) will be used to measure problematic alcohol use [22]. AUDIT has 10 items. The minimum score is 0, and the maximum score is 40. Eight of the questions have an item response range from 0 to 4, ranging from “Never” to “Almost every day.” Two questions have an item response in three steps (0, 2, and 4), ranging from “Never” to “Almost every day.” The instrument has a one-factor solution.

Patient Health Questionnaire-9

The Patient Health Questionnaire-9 is a nine-item instrument that measures depression, including a final item measuring suicidal thoughts. The instrument has excellent internal consistency (Cronbach α=.89) and good test-retest correlation (.84) [23]. The instrument has a single-factor solution. The minimum score is 0, and the maximum is 27 points [23]. Item responses range from 0 (“Not at all”) to 3 (“Nearly every day”).

Generalized Anxiety Disorder-7

The Generalized Anxiety Disorder-7 is a short instrument designed to measure anxiety. Its internal consistency is excellent (Cronbach α=.92), and it has good test-retest reliability (intraclass correlation .83) [24]. The questionnaire contains seven questions and has a single-factor solution. It is a self-report measure, with a minimum score of 0 and a maximum score of 21 points, with an item range of 0 (“Not at all”) to 3 (“Nearly every day”) [24].

The World Health Organization-Five Well-Being Index

The World Health Organization-Five Well-Being Index is an internationally validated instrument focused on well-being, consisting of five items. Good internal consistency was observed in a Swedish general population sample (Cronbach α=.83). The minimum score is 0, and the maximum score is 15 [25]. Item responses range from 0 (“All of the time”) to 3 (“Never”).

Blood Samples

Blood samples for two alcohol markers, carbohydrate-deficient transferrin (CDT) and Phosphatidylethanol (B-PEth), will be taken at the start of the assessment and then once a month during treatment. B-PEth and CDT are indicators of alcohol intake. Both markers can detect low levels of alcohol intake. The diagnostic sensitivity was 99% for B-PEth, and for CDT, the sensitivity varied based on intake from 40% for low intake to 90% for very high intake. Specificity is very high for PEth (99%) and is lower for CDT [26].

Internet-Delivered Treatment

The ICBT program to be used in this study has been evaluated in previous studies in problematic alcohol use [27,28]. It is based on CBT and relapse prevention and includes 13 modules, each consisting of text and a worksheet with practical exercises. The program also includes an alcohol diary. In the current study, the program will be used together with guidance from a psychologist/psychotherapist both through written platform messages and via three video sessions. For details about treatment content, see [27].

Ethical Considerations

As with all psychological treatment, there is a small risk that participants in internet-delivered treatment deteriorate [29]. As an additional safety measure, employees participating in ICBT will respond to questions on suicidal ideation every week and will be monitored weekly for alcohol consumption and mood changes. Among those receiving ICBT, the therapist and employee will meet via weekly video sessions three times during treatment. If a participant deteriorates during ICBT, Alna will offer support face-to-face and via telephone and, if necessary, alternative treatment, and the employer will be informed, consistent with Alna’s standard procedure. During the interviews, the participants will have the opportunity to reflect and reason about their process, which can create awareness of their treatment and perhaps lead to further positive effects of the treatment, which can, in turn, promote healthier behaviors and promote overall well-being.

Another ethical issue is data security. All databases containing personal data will be encrypted to minimize the risk of a breach. In addition, all the servers where data is stored will be encrypted and require a one-time password to be made available for analysis. Furthermore, data will be handled according to the European Union General Data Protection Regulation. All recorded interviews and associated transcripts will be stored on Stockholm University’s encrypted database. The audio files will not contain identifying information (name, workplace, etc). Also, no names or social security numbers will be used in the online survey tool and database (Qualtrics) where self-assessment forms are completed; research participants will identify themselves with a code assigned to them by the researchers.

The issues stated above were addressed in an ethical application to the Swedish Ethical Review authority, which approved (Ref. 2019-04183).

Planned Analysis

Since the study has a mixed methods design, both quantitative and qualitative methods will be applied.

Quantitative Analysis

The quantitative data will be analyzed by using the Reliable Change Index, identifying clinically significant change on an individual level [30]. The significance level to calculate the Reliable Change Index was set at P<.05. Analysis of variance or generalized estimating equations will be used to analyze outcome data. Within- and between-group effect sizes also will be calculated.

Qualitative Analysis

The interviews will be carried out by the first and second authors. Interview length will vary between 45-60 minutes and will be transcribed ad verbatim. The participants will not be allowed to double-check and confirm the answers given in the interview. The main reason for this is that the participants will receive the questions before the interview and will thus be able to prepare answers. The interviews will be analyzed by using thematic analysis [31] and Grounded Theory [32,33]. Both the first and second authors will code the data. The transcripts from the employees and the employer representatives will be analyzed using inductive thematic analysis. The six steps proposed will be used in the analytic endeavor covering helping and hindering factors [31]. Grounded Theory will be applied to describe the process of attending ICBT in a workplace setting [34]. The coders will have an ongoing discussion about when saturation of the model is met. The focus will be to build a model mirroring the process that the different participants underwent during treatment.

Attrition Management

Employees who do not complete ICBT will be included in both the quantitative and qualitative analyses to ensure a robust analysis of the outcomes of the treatments. Also, face-to-face non-completers will be included in the analysis. Comparisons between baseline characteristics of the attrition group and treatment completers will be reported. If an employee participating in the qualitative part of the project declines to participate in the interview, an additional participant will be recruited.

The results from this study will yield an understanding of ICBT in a workplace setting and of whether it could be helpful for employees; an understanding of the employer representative will also be gained.

Recruitment started in April 2020 and is expected to continue until September 2021. Manuscripts for publication will be drafted after that, one focusing on the quantitative outcomes and three focusing on the qualitative analyses. Quantitative results are expected to be submitted at the end of 2021, and the qualitative data will be submitted for publication in spring 2022.

The workplace offers unique opportunities to reach people with problematic alcohol use. Internet-delivered treatment offered within the context of an EAP has several advantages over face-to-face treatment that could stand to benefit both employees (ie, reduced travel time and travel expenses, increased anonymity) and employers (ie, lower production loss). However, proper scientific evaluations are critical before this form of treatment can be meaningfully implemented into such organizations on a broader scale.

Strengths and Limitations

There are several strengths to the current project. First, although there are a handful of studies conducted on internet-delivered treatment in the workplace [16,17], this is the first study on internet-delivered treatment conducted within the context of an EAP. The current study will, therefore, have important implications for EAPs and similar organizations that are interested in implementing internet-delivered treatment, possibly as an alternative to face-to-face treatment. Further, this is also, to our knowledge, the first study to investigate the internet-delivered treatment of problematic alcohol use using a “mixed methods” approach, ie, applying both quantitative and qualitative methods. Thus, the quantitative evaluations of the treatment will be complemented with qualitative interviews, providing insight into the diversity of experiences and viewpoints among employees and employers involved in the internet-delivered treatment. Finally, outcomes of internet-delivered and face-to-face treatment will be compared in terms of drinking and overall mental health.

Some study limitations are apparent a priori. The quantitative study is a naturalistic one, and the results will indicate possible trends in results, but without the possibility of assessing causality. Also, the qualitative study will consist of a convenience sample from the quantitative cohort, possibly resulting in a biased selection. However, some of the helping and hindering factors associated with delivering ICBT in a workplace context can serve as a starting point for future studies and serve as a foundation for future implementation. Also, the participants might exaggerate treatment gains and positive aspects of the treatment since it is financed by their employer. Special attention will be focused on this aspect during the interviews. Attrition can be a problem in any study investigating treatment effects and is especially common in internet interventions. However, non-completers will be included in the analysis to ensure that attrition is taken into account when reporting outcomes. Another limitation to be taken into account is the probable effect of the assessment procedure. As the Alna assessment with its five separate sessions is quite comprehensive, a positive change in the employee’s consumption, mood, and other symptoms is expected to occur even before the start of treatment. As mentioned, a pre-assessment data collection point has been included to allow evaluation of the impact that the assessment might have.

Authors' Contributions

DF is the author of the study protocol. KS is a co-author of the study protocol and the project’s principal investigator. AHB and CS are co-authors, and CS and AHB developed the internet-delivered treatment modules. All authors actively participated in the design of the study and in shaping the final version of the protocol.

Conflicts of Interest

Author AHB is a co-owner of a company, TeleCoach AB, aiming to disseminate digital interventions. The company is not currently active. The study is funded by AFA Insurance, grant number 180008, and by The Swedish Retail Monopoly (Systembolaget) Research Council, grant number FO 2019-0025. Author AHB was supported in this current work by the Swedish Research Council (grant no. K2012-61P-22131-01-6). The development and evaluation of the ICBT intervention offered in this study were initially funded by an earlier AFA Insurance grant to author AHB, grant no. 110248. The funding bodies had no role in study design, data collection, analysis, data interpretation, or writing manuscripts.

The study is funded by AFA Insurance, grant number 180008, and by The Swedish Retail Monopoly (Systembolaget) Research Council, grant number FO 2019-0025. Author AHB was supported in this current work by the Swedish Research Council (grant no. K2012-61P-22131-01-6). The development and evaluation of the ICBT intervention offered in this study were initially funded by an earlier AFA Insurance grant to author AHB, grant no. 110248. The funding bodies had no role in study design, data collection, analysis, data interpretation, or writing manuscripts.

The remaining authors declare no conflict of interest.

  1. Rehm J, Mathers C, Popova S, Thavorncharoensap M, Teerawattananon Y, Patra J. Global burden of disease and injury and economic cost attributable to alcohol use and alcohol-use disorders. The Lancet 2009 Jun;373(9682):2223-2233. [CrossRef]
  2. Manthey J, Shield KD, Rylett M, Hasan OSM, Probst C, Rehm J. Global alcohol exposure between 1990 and 2017 and forecasts until 2030: a modelling study. The Lancet 2019 Jun;393(10190):2493-2502. [CrossRef]
  3. Folkhälsomyndigheten. Folkhälsan i Sverige årsrapport 2018. Folkhälsomyndigheten 2018;Retrieved from Östersund [FREE Full text]
  4. Ames GM, Grube JW, Moore RS. The relationship of drinking and hangovers to workplace problems: an empirical study. J. Stud. Alcohol 1997 Jan;58(1):37-47. [CrossRef]
  5. Mangione TW, Howland J, Amick B, Cote J, Lee M, Bell N, et al. Employee drinking practices and work performance. J. Stud. Alcohol 1999 Mar;60(2):261-270. [CrossRef]
  6. Pidd K. , Berry, J. G., Harrison, J. E., Roche, A. M., Driscoll, T. R., & Newson, R. S. Alcohol and work: Australian Institute of Health and Welfare. Canberra: Media and Publishing Unit; 2006:A.
  7. Levy Merrick ES, Volpe-Vartanian J, Horgan CM, McCann B. Alcohol & Drug Abuse: Revisiting Employee Assistance Programs and Substance Use Problems in the Workplace: Key Issues and a Research Agenda. PS 2007 Oct;58(10):1262-1264. [CrossRef]
  8. Rehm J, Allamani A, Elekes Z, Jakubczyk A, Manthey J, Probst C, et al. Alcohol dependence and treatment utilization in Europe – a representative cross-sectional study in primary care. BMC Fam Pract 2015 Jul 29;16(1). [CrossRef]
  9. Labour Force Survey. Statistics Sweden. 2018.   URL: https:/​/www.​​en/​finding-statistics/​statistics-by-subject-area/​labour-market/​labour-force-surveys/​labour-force-surveys-lfs/​ [accessed 2020-03-01]
  10. Andersson G, Titov N, Dear BF, Rozental A, Carlbring P. Internet‐delivered psychological treatments: from innovation to implementation. World Psychiatry 2019 Jan 02;18(1):20-28. [CrossRef]
  11. Titov N, Dear B, Nielssen O, Staples L, Hadjistavropoulos H, Nugent M, et al. ICBT in routine care: A descriptive analysis of successful clinics in five countries. Internet Interv 2018 Sep;13:108-115 [FREE Full text] [CrossRef] [Medline]
  12. Hadjistavropoulos HD, Mehta S, Wilhelms A, Keough MT, Sundström C. A systematic review of internet-delivered cognitive behavior therapy for alcohol misuse: study characteristics, program content and outcomes. Cognitive Behaviour Therapy 2019 Oct 10:1-20. [CrossRef]
  13. Riper H, Hoogendoorn A, Cuijpers P, Karyotaki E, Boumparis N, Mira A, et al. Effectiveness and treatment moderators of internet interventions for adult problem drinking: An individual patient data meta-analysis of 19 randomised controlled trials. PLoS Med 2018 Dec 18;15(12):e1002714. [CrossRef]
  14. Sundström C, Blankers M, Khadjesari Z. Computer-Based Interventions for Problematic Alcohol Use: a Review of Systematic Reviews. Int J Behav Med 2017 Oct;24(5):646-658 [FREE Full text] [CrossRef] [Medline]
  15. Kiluk BD, Nich C, Buck MB, Devore KA, Frankforter TL, LaPaglia DM, et al. Randomized Clinical Trial of Computerized and Clinician-Delivered CBT in Comparison With Standard Outpatient Treatment for Substance Use Disorders: Primary Within-Treatment and Follow-Up Outcomes. Am J Psychiatry 2018 Sep 01;175(9):853-863 [FREE Full text] [CrossRef] [Medline]
  16. Boß L, Lehr D, Schaub MP, Paz Castro R, Riper H, Berking M, et al. Efficacy of a web-based intervention with and without guidance for employees with risky drinking: results of a three-arm randomized controlled trial. Addiction 2017 Dec 04;113(4):635-646 [FREE Full text] [CrossRef]
  17. Brendryen H, Johansen A, Duckert F, Nesvåg S. A Pilot Randomized Controlled Trial of an Internet-Based Alcohol Intervention in a Workplace Setting. Int J Behav Med 2017 Oct;24(5):768-777. [CrossRef] [Medline]
  18. Berman A, Nielsen C, Ahlström J, Sundström C, Forsström D, Sundqvist K. Employer attitudes towards providing internet treatment to employees with problematic alcohol use. Manuscript in preparation 2021.
  19. Marlatt GA, George WH. Relapse Prevention: Introduction and Overview of the Model. British journal of addiction 1984 Sep;79(3):261-273. [CrossRef]
  20. Hoeppner BB, Stout RL, Jackson KM, Barnett NP. How good is fine-grained Timeline Follow-back data? Comparing 30-day TLFB and repeated 7-day TLFB alcohol consumption reports on the person and daily level. Addictive Behaviors 2010 Dec;35(12):1138-1143. [CrossRef]
  21. Sobell L, Sobell MB. Timeline follow-back. In: Measuring alcohol consumption. New York: Springer; 1992:41-72.
  22. Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. The Alcohol Use Disorders Identification Test (AUDIT) Manual: Guidelines for Use in Primary Care. Department of Mental Health and Substance Dependence. World Health Organization / Department of Mental Health and Substance Dependence. 2001.   URL: https:/​/apps.​​iris/​bitstream/​handle/​10665/​67205/​WHO_MSD_MSB_01.​6a.​pdf;jsessionid=FF60C8E9D5BEECC63E56EB08FD875F09?sequence=1
  23. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9. J Gen Intern Med 2001 Sep;16(9):606-613. [CrossRef]
  24. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A Brief Measure for Assessing Generalized Anxiety Disorder. Arch Intern Med 2006 May 22;166(10):1092. [CrossRef]
  25. Löve J, Andersson L, Moore CD, Hensing G. Psychometric analysis of the Swedish translation of the WHO well-being index. Qual Life Res 2013 Jun 7;23(1):293-297. [CrossRef]
  26. Aradottir S, Asanovska G, Gjerss S, Hansson P, Alling C. PHosphatidylethanol (PEth) concentrations in blood are correlated to reported alcohol intake in alcohol-dependent patients. Alcohol Alcohol 2006;41(4):431-437. [CrossRef] [Medline]
  27. Sundström C, Kraepelien M, Eék N, Fahlke C, Kaldo V, Berman AH. High-intensity therapist-guided internet-based cognitive behavior therapy for alcohol use disorder: a pilot study. BMC Psychiatry 2017 May 26;17(1). [CrossRef]
  28. Sundström C, Eék N, Kraepelien M, Fahlke C, Gajecki M, Jakobson M, et al. High- versus low-intensity internet interventions for alcohol use disorders: results of a three-armed randomized controlled superiority trial. Addiction 2020 May;115(5):863-874. [CrossRef]
  29. Rozental A, Boettcher J, Andersson G, Schmidt B, Carlbring P. Negative Effects of Internet Interventions: A Qualitative Content Analysis of Patients' Experiences with Treatments Delivered Online. Cognitive Behaviour Therapy 2015 Feb 23;44(3):223-236. [CrossRef]
  30. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991 Feb;59(1):12-19. [CrossRef] [Medline]
  31. Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology 2006 Jan;3(2):77-101. [CrossRef]
  32. Glaser BG, Strauss AL. Discovery of grounded theory: Strategies for qualitative research. Oxfordshire: Routledge; 2017.
  33. Pidgeon N, Henwood K. Using grounded theory in psychological research. Oxfordshire: Taylor & Francis; 1997.
  34. Corbin JM, Strauss A. Grounded theory research: Procedures, canons, and evaluative criteria. Qual Sociol 1990;13(1):3-21. [CrossRef]

B-PEth: Phosphatidylethanol
CBT: cognitive behavioral therapy
CDT: carbohydrate-deficient transferrin
EAP: employee assistance program
ICBT: internet-based cognitive behavioral therapy
TFLB: timeline followback

Edited by G Eysenbach; submitted 12.03.20; peer-reviewed by N Yoshinaga; comments to author 03.04.20; revised version received 28.05.20; accepted 03.06.20; published 15.07.20


©David Forsström, Christopher Sundström, Anne H Berman, Kristina Sundqvist. Originally published in JMIR Research Protocols (, 15.07.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.