Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, December 24 through Wednesday, December 26 inclusive. We apologize in advance for any inconvenience this may cause you.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 24.01.17 in Vol 6, No 1 (2017): January

This paper is in the following e-collection/theme issue:


    Effects of Video Game Training on Behavioral and Electrophysiological Measures of Attention and Memory: Protocol for a Randomized Controlled Trial

    1Studies on Aging and Neurodegenerative Diseases Research Group, Department of Basic Psychology II, Universidad Nacional de Educación a Distancia, Madrid, Spain

    2Facultad de Derecho, Department of Social Work, Universidad Nacional de Educación a Distancia, Madrid, Spain

    3Cajal Institute, Neurodegeneration Group, Departament of Translational Neurobiology and Biomedicine Research Center for Neurodegenerative Diseases, Consejo Superior de Investigaciones Científicas, Madrid, Spain

    4Facultad de Psicología, Departamento Methodology of the Behavioral Sciences, Universidad Nacional de Educación a Distancia, Madrid, Spain

    Corresponding Author:

    Soledad Ballesteros, PhD

    Studies on Aging and Neurodegenerative Diseases Research Group

    Department of Basic Psychology II

    Universidad Nacional de Educación a Distancia

    Facultad de Psicología

    Juan del Rosal, 10



    Phone: 34 91398 62 27

    Fax:34 91770 53 65



    Background: Neuroplasticity-based approaches seem to offer promising ways of maintaining cognitive health in older adults and postponing the onset of cognitive decline symptoms. Although previous research suggests that training can produce transfer effects, this study was designed to overcome some limitations of previous studies by incorporating an active control group and the assessment of training expectations.

    Objective: The main objectives of this study are (1) to evaluate the effects of a randomized computer-based intervention consisting of training older adults with nonaction video games on brain and cognitive functions that decline with age, including attention and spatial working memory, using behavioral measures and electrophysiological recordings (event-related potentials [ERPs]) just after training and after a 6-month no-contact period; (2) to explore whether motivation, engagement, or expectations might account for possible training-related improvements; and (3) to examine whether inflammatory mechanisms assessed with noninvasive measurement of C-reactive protein in saliva impair cognitive training-induced effects. A better understanding of these mechanisms could elucidate pathways that could be targeted in the future by either behavioral or neuropsychological interventions.

    Methods: A single-blinded randomized controlled trial with an experimental group and an active control group, pretest, posttest, and 6-month follow-up repeated measures design is used in this study. A total of 75 cognitively healthy older adults were randomly distributed into experimental and active control groups. Participants in the experimental group received 16 1-hour training sessions with cognitive nonaction video games selected from Lumosity, a commercial brain training package. The active control group received the same number of training sessions with The Sims and SimCity, a simulation strategy game.

    Results: We have recruited participants, have conducted the training protocol and pretest assessments, and are currently conducting posttest evaluations. The study will conclude in the first semester of 2017. Data analysis will take place during 2017. The primary outcome is transfer of benefit from training to attention and working memory functions and the neural mechanisms underlying possible cognitive improvements.

    Conclusions: We expect that mental stimulation with video games will improve attention and memory both at the behavioral level and in ERP components promoting brain and mental health and extending independence among elderly people by avoiding the negative personal and economic consequences of long-term care.

    Trial Registration: NCT02796508; (archived by WebCite at

    JMIR Res Protoc 2017;6(1):e8



    Crowdfunding campaign to support this specific research

    We help JMIR researchers to raise funds to pursue their research and development aimed at tackling important health and technology challenges. If you would like to show your support for this author, please donate using the button below. The funds raised will directly benefit the corresponding author of this article (minus 8% admin fees). Your donations will help this author to continue publishing open access papers in JMIR journals. Donations of over $100 may also be acknowledged in future publications.

    keyboard with crowdfunding key instead of enter key

    Suggested contribution levels: $20/$50/$100



    Neurocognitive frailty is the biggest threat to successful aging [1]. There is overwhelming evidence that the number of inflammatory mediators increases vastly in pathological aging [2] and in healthy aging as well [3]. This inflammation has a negative impact on cognition [4]. C-reactive protein (CRP), an acute-phase protein of hepatic origin that increases following interleukin-6 secretion by macrophages and T cells, has been identified as a hallmark of systemic inflammation, and it can be assessed by noninvasive methods in saliva [5]. A key challenge that faces the aging society is to find new approaches to understand the aging mind and brain that could enhance successful, optimal aging [6]. Another major challenge is to understand the factors that could reduce or delay the negative consequences of age-related cognitive decline [7]. The idea behind this randomized controlled trial (RCT) is that cognitive abilities could be strengthened by interventions that promote positive brain plasticity [8].

    Normal aging is associated with gray and white matter shrinkage. The lateral prefrontal cortex, cerebellum, and medial temporal lobe system including hippocampus are affected. Minimal reduction occurs in the entorhinal and occipital cortices [1,9,10]. These brain changes are associated with declines in several important cognitive functions, including processing speed, executive functions, working memory, and episodic memory [11-14]. However, other crystallized abilities such as general knowledge, verbal abilities [15-17], and implicit memory [18,19] are mostly preserved. Older adults with mild cognitive impairment [20] and Alzheimer disease patients have shown preserved implicit memory despite huge deteriorations in episodic memory [21,22]. Although behavioral priming for repeated pictures is spared in older adults, reduced neural activation, which is a signature of implicit memory, is affected. The relationship between brain function and behavior found in young adults is altered in older adults, although these age-related changes do not affect behavioral facilitation. These findings have implications for the notion that automatic processes, previously considered preserved with age, are susceptible to the effects of aging at the neural level. The age-invariant behavioral facilitation with stimulus repetition is observed as a result of more sustained neural processing of visual stimuli in older adults as a form of compensatory neural activity [23].

    Electrophysiological studies have also found significant age-related event-related potential (ERP) changes in brain activity associated with memory retrieval in spite of similar performance in young and older adults [24]. Elders compensate for their lower level of parieto-occipital functioning as shown by smaller P300 amplitude at posterior sites by recruiting frontal sites as a mode of brain adaptation [25]. In touch, despite similar behavioral performance in a recognition memory task involving familiar 3D objects, young and older adults recruited different neural resources to perform the task. Age-related differences were found in brain oscillations, as measured by event-related spectral perturbations (ERSPs), suggesting the recruitment of additional neural resources as shown by greater alpha and beta power reductions in older adults [26]. Despite similar behavior performance, normal aging was found to affect ERPs and oscillatory brain activity during an incidental speeded haptic symmetry detection priming task. However, the young adults showed more positive amplitude than the older adults in the alpha and beta bands from stimulus onset [27]. All these neural results suggest that the older brain adapts in order to maintain the same level of performance as the younger brain both in explicit and implicit memory tasks.

    Neural plasticity exists at several levels of the neural substrate [28,10], although not to the same degree in older as in younger adults [15,29,30]. These findings suggest that the aging brain retains some neuroplasticity, which can be influenced by the individual’s behavior. The prolonged mismatch between functional organismic supplies and environmental demands produces cognitive plasticity and underlines the capacity of the brain to implement behavioral flexibility [31]. Although there are personal factors, human behavior can change with appropriate training as the brain reorganizes in response to the environment [32]. Based on the idea of neuroplasticity, different types of interventions have been developed to ameliorate cognitive and functional declines by strengthening social networking using new information and communication technology (ICT) [33-35] and cognitive skills training [36,37] and promoting an active lifestyle [38,39] and physical activity training [40,41].

    As people age, they experience declines in attentional control, mediated by the dorsolateral prefrontal cortex, and in long-term memory functions, mediated by the medial temporal lobe and the hippocampus. These areas suffer the highest degree of age-related atrophy [9]. Moreover, the prefrontal cortex facilitates the organization and contextualization of incoming information and interacts with the hippocampus during working memory implementation [42,43]. This relationship is strengthened with age [44]. These findings are especially relevant due to the existing links between these basic cognitive abilities and everyday functioning. The malfunction of these basic abilities is a significant predictor of older adult difficulties with the instrumental activities of daily living, leading to loss of independence [45,46]. Therefore, it is of vital importance to pursue the question of whether cognitive decline can be reversed or delayed through cognitive training interventions [47].

    Video games and other computerized programs are receiving increasing interest from cognitive and neuroscientists to investigate the possibility of transfer to untrained tasks [48-50]. Researchers are increasingly using new technology, including cognitive training platforms and video games, to investigate their impact on cognition [48-52]. Computer-based interventions have the advantage that they can be easily used by elderly people living either at home or in nursing homes and could be a good alternative to traditional training programs [53]. This RCT aims to assess the effectiveness of training older adults with digital nonaction video games.

    Two challenges must be overcome in order to develop an effective cognitive aging intervention [54-55]: (1) transferring training gains to untrained tasks and (2) designing interventions that encourage compliance. Older adults prefer games that involve mental challenge [56-57], while studies with young adults have shown that fast-paced action games result in broader transfer effects. A “first-person shooter” video game is not an appropriate choice for older adults [58]. Nonaction video games have potential advantages as they are enjoyable, low-cost, and can be self-administered. Recent results from a systematic review [53] and meta-analyses [59-61] suggest that training elders with video games improves information processing, with unexpected larger effects in old-older adults than in young-older adults. Moreover, the results of a recent meta-analysis of action video game training showed that healthy adults benefit from training in overall and specific cognitive domains, but young adults benefit more than older adults [62]. These findings underscore the potential of video game training as an effective intervention tool for cognitive improvement. Results of studies on executive function and working memory are less consistent. It is possible that nonaction video games are not an effective means of improving or maintaining these functions in older adults. Games provide an enjoyable way of passing the time and of giving meaning to the day [56]. In short, video games can offer important benefits to older adults, bearing in mind that intervention compliance is a key factor in longitudinal training studies [54].

    A previous RCT conducted in our laboratory investigated the effects of nonaction video game training on a series of cognitive functions that decline with age and subjective well-being. Two groups of older adults participated in the study: an experimental group that received the training and a noncontact control group. Groups were similar at baseline on demographics, vocabulary, global cognition, and depression status. The results showed improvements in the video game–trained group and no change in the passive control group in processing speed, attention, and immediate and delayed visual recognition memory and a trend to improve in 2 dimensions of the Well-being Scale (affection and assertivity) [63]. However, visuospatial working memory and executive control (shifting strategy) functions did not improve [49,64,65].

    A recent longitudinal intervention study conducted to investigate the effects of video game training in healthy older adults showed that 15 1-hour training sessions with 6 nonaction video games produced significant improvements on 2 visuospatial working memory tasks and on episodic and short-term memory tasks. Some of these gains were maintained over a 3-month follow-up period [52]. In both previous studies, experimental groups were compared with passive control groups. To better attribute training-related improvement to the intervention and to avoid placebo effects [66], the current RCT compares performance on a series of attentional and visuospatial working memory tasks of an experimental group trained with selected nonaction video games from the commercial Lumosity computerized training program ( with that of an active control group carrying out the same number of training sessions with The Sims, a simulation strategy game in which the player takes control of the life of a character in everyday activities, and SimCity, a life simulation game in which the player is the mayor of a city that he or she must develop. Both groups used a mobile tablet device during the training sessions. These video games were chosen to train the active control group because this group should also play with engaging and challenging video games the same training hours, potentially equating the social contact experienced during training by experimental and active-control groups.

    Training expectation is an important issue in cognitive training studies [51,67]. To address this issue, participants report their expectations (increase or decrease) regarding their task performance for any assessment task on a 5-point Likert-type scale. After training sessions 1, 8, and 16 (final), participants respond to training feedback questions about engagement and motivation for each training game. The objective was to find out whether both groups were similarly engaged and motivated during training.

    In sum, the growth of ICT-based tools, along with their progressive implementation in all social groups, offers a great opportunity to develop low-cost preventive intervention programs able to reach the entire population. This can contribute to improving the quality of life of elderly people, with a substantial reduction in health care costs related to the loss of autonomy and independence in this population group [68]. In this RCT we investigate not only possible cognitive improvement in healthy older adults in selected cognitive domains that decline with aging but also possible neural changes of training using electrophysiological methods at pre- and posttraining and 6-month follow-up. The study also explores neuroinflammatory mechanisms underlying possible cognitive training-induced effects using noninvasive saliva-testing methods.

    Objectives and Hypotheses

    The study has 3 main complementary objectives:

    1. To examine the behavioral and electrophysiological effects of training older adults with nonaction video games on a series of cognitive tasks designed to assess attentional functions (mainly response inhibition, distraction, and alertness) and to maintain and update verbal and visuospatial working memory. We are also interested in investigating the sustainability of the transfer effects after a 6-month no-contact period.

    2. To explore whether motivation, engagement, or expectations account for possible training-related improvements.

    3. To examine whether inflammatory mechanisms assessed with noninvasive measurement of CRP in saliva impair cognitive training-induced effects. Inflammatory parameters in the participants obtained by noninvasive saliva-testing methods will be analyzed in biochemical assays to study their possible correlations with cognitive abilities.

    We hypothesize that participants in the Lumosity group will improve selective attention assessed with oddball and Stroop tasks and working memory assessed with Corsi blocks and n-back tasks in comparison with participants in the active control group. From an electrophysiological perspective, we also hypothetize that in the oddball task the cognitive video game–trained group will improve both the ability to return attention to the relevant task after having been distracted by the novel stimulus (reorientation negativity [RON]) and the ability of the brain to pay attention to the novel stimulus (P300).

    Intervention studies conducted with older adults have focused mostly on training a given cognitive function and then measuring the improvement in that function [69,29] and less often on possible changes in neural activity after training [70,71]. Based on the idea that the older human brain still has some plasticity (the ability to change in response to external stimulation), our main hypothesis is that training older adults with appropriate, adapted, and motivating nonaction video games will transfer to cognitive functions that decline with age, such as attention and working memory, by improving these pillars of cognition, which are crucial to maintaining independent living and cognitive health in old age.


    Overview of the Study Design

    A 2-arm, parallel-design RCT [72] was designed to evaluate the effectiveness of video game training to promote cognitive and brain health in older adults. Figure 1 shows the Consolidated Standards of Reporting Trials flow diagram of the study. This RCT is being conducted in Madrid, Spain, with an allocation ratio of 1:1 to evaluate the influence of training with nonaction video games on attention and memory functions. The design was a single-blind design. Eligible participants were randomized using a computer algorithm into intervention (cognitive nonaction video game training) or active control (life-simulation games) groups. Researchers were not blind to treatment allocation. The Universidad Nacional de Educación a Distancia (UNED) Institutional Review Board approved the study protocol. All participants provided written informed consent.

    Figure 1. The Consolidated Standards of Reporting Trials flow diagram.
    View this figure

    Eligibility and Exclusion Criteria

    All participants live independently with normal or corrected-to-normal hearing and vision and are free of neurological or psychiatric disorders or traumatic brain injury. To determine their eligibility, each participant completed a screening battery consisting of the Mini-Mental State Examination (cut-off score 26) [73] to rule out possible cognitive impairment, the Yesavage Depression Scale (cut-off score less than 5) [74], and the Information subscale of the WAIS-III scale (normal score) [75]. Exclusion criteria were a diagnosis of dementia, cognitive impairment (score of <26 on the Mini-Mental State Examination), depression, less than 20/60 vision with or without correction, inability to complete the study activities, communication problems, or current plans to move to another city. All participants were healthy volunteers.

    Sample Size

    The sample size is based on the number of observations needed to compare the 2 groups of gamers, those trained with Lumosity and those trained with The Sims. As we do not have standard deviations of the scores in our main dependent variables, we used G*Power 3.1 (Department of Psychology) to compute the number of participants, using analysis of variance as a statistical test. For this, using a power of .80, effect size of 0.50, an alpha level of .05, and 2 groups within the F test family, we obtained a required total sample size of 57. With a dropout rate of 10%, a total of 63 participants would be required. Rounding up the numbers, we would need more than 64 participants (32×2). As the flow diagram shows, the final number of participants matches these a priori computations closely: 38 participants were assigned to the experimental group (8 lost at posttest) and 37 to the control group (12 lost at posttest).


    Participants were randomly assigned to 1 of the 2 parallel groups, either the intervention video game training group or the active control group (see Figure 1). The pretest, posttest, and 6-month follow-up assessments are conducted at the UNED Department of Basic Psychology II by one of the authors with the assistence of other members of the group. The training sessions were carried out at the UNED Associate Center, Escuelas Pías, Madrid, and lasted 8 to 10 weeks. A total of 138 participants were recruited from flyers, advertisements, by word of mouth, and from UNED’s special program for the elderly screened for eligibility. Finally, 75 older adults (age range 55 to 84 years) met the requirements for participation in the study and signed the consent form and were randomly assigned to the experimental or the active control groups before carrying out the laboratory tasks. The 2 groups do not differ significantly in age, years of education, global cognition, depression, memory, or verbal abilities.

    Electroencephalograph Acquisition

    While performing the experimental tasks, continuous electroencephalograph (EEG) activity is recorded using a NuAmps amplifier (Neuroscan Inc) located inside a soundproof, electrically shielded room. A 34-channel elasticized Quik-Cap with Ag/AgCl sintered electrodes (Neuroscan Inc) is used to record EEG data from scalp electrodes positioned according to the extended international 10-20 system (American Medical EEG Association, 1991). To control for the influence of ocular artifacts, vertical and horizontal electrooculograms are recorded in 2 bipolar channels. Eye blinks and vertical eye movements are monitored via electrodes located below and on the supraorbital ridge of the left eye. Horizontal artifacts are monitored via electrodes on the outer canthus of each eye. Linked mastoids (A1, A2) are used as reference, and participants are grounded to the AFz electrode. All data will be digitized using a NuAmps amplifier in continuous recording mode. Sampling rate will be 250 Hz, and all channels will be online band-pass filtered (0.1-70 Hz) and notch filtered (50 Hz) to eliminate power line artifacts. Analysis of the EEG recordings will be performed using the EEGLAB toolbox [76] and ERPLAB plugin for EEGLAB [77] both running under MATLAB environment (The MathWorks Inc). Continuous data will be filtered offline using a digital Butterworth filter (0.1-40 Hz; 12 dB per octave roll-off), an infinite impulse response filter that achieves a given filtering characteristic using less memory and fewer calculations than a similar finite impulse response filter. After filtering, data will be separated into baseline corrected and nonoverlapping epochs time-locked to the target onset (in both Stroop and oddball tasks) ranging from 200 ms before to 1000 ms after the onset of the target with the prestimulus interval (200 ms) as baseline period. Epochs containing high amplitude/frequency and muscle or other irregular artifacts will be removed by visual inspection. Only artifact-free epochs from correct trials will be selected for averaging. The existence of blinks and other ocular movements will not be a criterion for epoch rejection. This kind of artifact will be eliminated using Infomax Independent Component Analysis (ICA) decomposition [78-82]. We will use the default extended-mode runica training parameters [83], an extension of the original algorithm [78]. This extended mode allows a wider range of source signals (both super- and sub-Gaussian) while maintaining simplicity. Stopping weight change will be set to 1e–7. This rather conservative criterion for stopping learning lengthens ICA training, enabling cleaner and more reliable decompositions, particularly with more than 33 channels and limited number of epochs. After submitting epochs to ICA decomposition, artifactual components will be removed by inspection of their scalp topography and spectral power [84,27].

    General Procedure

    Participants in the study were randomly assigned to the cognitive nonaction video game training group or the noncognitive game training active control group. The introduction of an active control group is necessary to avoid placebo effects [54]. Based on the results of our meta-analytic study [61], we use training regimes that are not too long to avoid loss of motivation, and simple, nonaction games that appeal more to elders. According to the temporal discount hypothesis [85], future rewards are less valuable than inmediate rewards. In each session, the trainees play 10 nonaction video games from Lumosity, described below.

    The main question examined in our study is whether group (experimental group, active control group) interacts with testing session (pretest, posttest, and follow-up) with regard to performance on a series of cognitive tasks. At least 2 measures for each cognitive domain are acquired to examine transfer of training to untrained tasks demanding attention and working memory. We selected these cognitive domains because these functions deteriorate with aging and tax functions that are critical for independent living. To explore the underlying neural mechanisms of successful transfer of training gains to attentional mechanisms (alert, distraction, and inhibitory effects) and executive control (spatial working memory), electrophysiological data (ERPs) are recorded at pretraining (T1), posttraining (T2), and 6-month follow-up (T3).

    All the methodological designs of the primary outcome measures have been constructed using the rules of counterbalancing and stimulus rotation. Response keys are counterbalanced across conditions. The computerized tasks have been programmed using E-Prime 2.0 (Psychology Software Tools Inc). All the statistical analyses of the behavioral results will be performed using SPSS (IBM Corp) and results will be considered significant at P<.05, with Bonferroni-corrected post hoc tests performed as appropriate. Continuous EEG activity are recorded in our laboratory with thin electrodes from 34 scalp sites using a NuAmps amplifier as mentioned before.

    After randomization and initial assessment (baseline), participants were invited to attend the University Center of Escuelas Pias in Madrid to perform the training sessions in small groups. Trained and active control groups followed 16 training sessions carried out on different hours and days that lasted approximately 10 to 12 weeks.

    Table 1 presents a short summary of the video games played by the experimental (trained) group. During the training sessions, participants in the experimental group play 10 nonaction video games selected from Lumosity.

    The active control group carried out 16 training sessions with The Sims and SimCity BuildIt. Table 2 presents a short summary of these video games.

    Table 1. Short description of the 10 video games played by the experimental group.
    View this table
    Table 2. Life simulation games from Electronic Arts Inc played by the active control group.
    View this table

    Ethical Issues

    This clinical trial is registered on the database [NCT02796508] [72]. The UNED Ethical Review Board approved the trial. All the participants gave their written informed consent before the study started and were informed of their right to terminate participation at any time. The work described has not been published previously.

    Measurement of C-Reactive Protein in Saliva by Enzyme-Linked Immunosorbent Assay

    Several parameters influencing inflammation (eg, infections, diabetes) are obtained from the participants: height and weight are recorded to obtain the body mass index (gross obesity could increase inflammation), drugs ingested (anti-inflammatories, antibiotics, antioxidants), possible infections and when they happened (last month, last week, or today), smoking habit (which may increase CRP levels in saliva), and defective oral health (eg, bleeding gums). Participants are asked not to eat or smoke at least 30 minutes before saliva collection. Following a mouth rinse with water, 1 mL of saliva is collected with a straw into a tube containing 2% ethylenediaminetetraacetic acid as preservative. Samples are stored at −80ºC until assayed. Assessment of CRP levels is performed with an enzyme-linked immunosorbent assay (ELISA) obtained from Salimetrics according to the manufacturer instructions. A saliva sample collected from participants at pretest, posttest, and follow-up assessments will be analyzed with ELISA in order to correlate the quantity of CRP with task performance.

    Primary Outcomes

    Effects of Video Game Training on Attentional Networks: Behavioral and Electrophysiological Results
    Oddball Task

    The capacity to suppress irrelevant information and to concentrate on the relevant task [86] is negatively affected by aging. The question is whether the effects of training with cognitive video games are transferable to untrained tasks (transfer effect). Despite the great appeal of video games as a way to improve perceptual and cognitive abilities, evidence of their efficacy is mixed [49,50,52,64,87-88]. However, the results of several recent meta-analytic studies [59-62] suggest that video game training can be moderately effective in healthy older adults but that its positive effects are moderated by several variables including the complexity of the games, the age of the participants, the duration of the training program, and the cognitive processes assessed.

    Previous studies indicate that deviance distraction occurs because deviant sounds violate the cognitive system’s expectations [89]. Attention capture has been studied from an electrophysiological perspective; the distractor is characterized by a pattern of 3 brain responses [90,91]: (1) mismatch negativity (MMN) and enhanced N1 when the distractor deviates considerably from the repetitive background, (2) P3a (novelty P3), and (3) RON. The MMN response reflects the preattentive detection of an unexpected change in the auditory context and results from the comparison between a memory trace for past acoustic stimuli and the current auditory signal [92]. The P3a response represents the involuntary orientation of attention toward the novel sound [93] and results from an attentional interruption involving frontal areas [94]. RON is also observed when participants are performing a primary task and must redirect their attention toward that task [95]. In this RCT, we undertake electrophysiological recordings to explore the underlying neural mechanisms of successful transfer of training to attentional performance in the oddball task. We expect that the cognitive video game–trained group will improve both the ability to return attention to the relevant task after having been distracted by the novel stimulus (RON) and the ability of the brain to pay attention to the novel stimulus (P300). In our lab, we previously investigated the effect of novelty in young adults using a haptic oddball paradigm consisting of processing textured surfaces [96]. We do not expect this pattern of results in the active control group and thus predict a group × session interaction.

    Stroop and Negative Priming Task

    Cognitive processes that involve top-down control mechanisms decline with aging but more automatic processes do not [20,22]. The Stroop interference effect reflects the extra time needed to resolve the conflict generated by the irrelevant word meaning in the incongruent condition. One view is that suppression processes relying on executive control are engaged in preventing the irrelevant dimension from taking control of the response [97]. In this study, we investigate the effect of training older adults with nonaction video games on inhibition processing using both behavioral and electrophysiological responses. The task has been designed to assess training-related behavioral and neural changes in Stroop interference and in negative priming (NP). NP (a measure of distractor inhibition) and the standard Stroop effect are assessed in the same task. In the standard NP procedure, participants are presented with pairs of prime and probe displays containing 2 stimuli, the to-be-responded target and the to-be-ignored distractor. In the critical trials, participants must respond to a target that served as a distractor in the previous prime display (the ignored repetition condition). The common finding is that reaction times to targets in the ignored repetition condition are slower than in the control condition, in which the distractor in the prime display is not repeated as the target in the probe display [98-101]. The aim is to investigate whether training older adults improves control, effortful inhibition (Stoop interference), to a greater extent than automatic passive inhibition (NP). The experimental task uses ERPs in combination with the Stroop and NP before and after training to examine the neural correlates of inhibition [102]. Responses for the Stroop analysis will be coded as a function of the congruency between the color and the meaning of the stimulus. Congruent trials are those in which the color of the word coincides with the color in which it is presented. Incongruent trials are those in which the color word does not coincide with the color in which it is displayed. We will also code trials according to the congruency of the previous trial (N−1) in order to compute the NP effect for each trial. The design for the NP effect consists of Group (younger, older adults), Session (pretraining, posttraining, follow-up), and Type of intervention (experimental, active control) as between-participants factors and Repetition (ignored repetition and control) as within-participants factors. Responses for NP analyses will be coded as a function of the relationship between the color of the current target word and the color denoted by the word in the previous trial (distractor). Thus, the ignored repetition trials are those in which the word in the preceding trial denoted the color of the word of the current stimulus. Control trials are those in which both the target (color) and the distractor (word) in the current trial are different from the target and distractor in the previous trial. The ignored repetition condition is always an incongruent trial preceded by an incongruent trial. The aim is to investigate whether the Stroop interference effect in older adults decreases after training while NP does not change. An important addition to the behavioral measures will be the ERP recording while performing the task before and after training to investigate brain activity changes after training.

    Effects of Training on Spatial Working Memory

    To investigate whether training transfers to improvements in spatial working memory, the participants perform a computerized Corsi blocks task. Recent meta-analytic studies conducted with trainees from childhood to older adults [60] and with older adults [61] found negligible effects of video game training on executive functions. The absence of improvement after training may depend on the specific kind of video games used. Studies that used first-person shooter action games reported benefits after training [103,104]. This type of game requires great perceptual abilities, preparedness for unpredictability, and strong emphasis on peripheral visual processing [105]. However, older adults do not like this type of game [55]. Previous findings from our lab yielded mixed results. One study [49] showed no transfer to working memory tasks, while a second study [52] showed that the trainees’ performance improved significantly after training in 2 visuospatial working memory tasks, the Corsi blocks and the jigsaw puzzle. Our results contrast with those of Nouchi et al [88] who found improvements in executive functions after training for 5 weeks. The ineffectiveness of training in spite of the fact that several of the nonaction video games mimic working memory tasks is in line with the findings of Boot and colleagues [54]. Due to these mixed results, the aim of this RCT is to find out whether training effects transfer to the spatial working memory of older adults.

    Corsi Blocks

    The original task [106] consists of a set of 9 identical blocks (3 x 3 x 3 cm) irregularly positioned on a wooden board (23 x 28 cm). The participant is required to point to the blocks in their presentation order. The length of the block sequences increases until recall is no longer correct. Numerous variations have been employed. Here, we use a computerized version with 4 difficulty levels (2, 3, 4, and 5 cubes) with 10 trials per level. The task consists of reproducing the pattern of cubes just presented on the computer screen by writing down the order in which the cubes appeared on a response sheet. The score is derived from the number of sequences reproduced correctly divided by the total number of sequences in the corresponding level (correct/total sequences).

    Assessing Working Memory Updating

    Transfer to working memory after training is assessed with the n-back task [107]. We use a computerized version of the task to assess memory updating. In this task, participants indicate whether each visual stimulus in a list matches a stimulus that occurred 1, 2, or 3 stimuli back by pressing a response key with their right hand (counterbalancing index and middle fingers to respond “yes” and “no”).

    In sum, the primary outcome measures of this RCT are better performance at posttest than at pretest on a series of tasks: (1) Stroop-negative priming task, (b) oddball task, (3) n-back task, and (4) Corsi blocks.

    Secondary Outcomes

    Improved game performance by the experimental group and the active control group between training session number 1 and 16 (final) is a secondary outcome measure. Efficacy of training will be shown by better performance in the trained video games across the training sessions. Another secondary outcome measure, maintained level of motivation and engagement, will be assessed with a questionnaire administered at training sessions 1, 8, and 16.


    All analyses will be performed with the SPSS (IBM Corp) program. Statistical significance is considered as a P value of <.05. Analyses of variance will be conducted with 2 groups (experimental and active control) at 3 time points (pretest [baseline], posttest [postintervention], and follow-up [after 6 months without contact]). Electrophysiological data will be analyzed using EEGLAB/ERPLAB.

    The preparatory phase for using the games has been completed. License to use the games has been granted by Lumosity. Participants have been recruited, pretested, and trained. The final results from this RCT are expected by the end of 2017.


    The benefits of this RCT will be at several levels including in-depth knowledge derived from a series of carefully planned behavioral and brain imaging studies conducted to test a series of hypotheses on cognitive and brain aging. This cognitive and brain intervention study conducted in an increasingly active area of research could lead to exciting prospects in the medium and long term by exploring ways to keep older adults (mind and brain) healthy and active longer.

    The findings could help prevent the negative impact of mild cognitive impairment and could have an important impact on society due to the increasing number of older adults and the associated number of neurodegenerative diseases. Cognitive decline reduces the capacity to live an independent life with associated personal, family, and social costs. Preventing the negative impact of cognitive decline could have an important effect on limited social and health care resources.


    The study is supported by a grant from the Spanish Ministry of Economy and Competitiveness (grant #PSI2013-41409R) to SB and from the Council of Madrid (S-BIO/0170/2006 and P2010/BMD-2349) to MLC and SB. ER is supported by an Formación de Personal Investigador fellowship (Spanish Ministry of Economy and Competitiveness) associated with grant #PSI2013-41409R.

    The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Lumosity provided free access to the video game training platform for the participants in this clinical trial. None of the authors has any commercial/financial connections with Lumosity. The authors thank the UNED Associated Center Escuelas Pías, Madrid, for providing space to conduct the training sessions.

    Authors' Contributions

    SB is the principal investigator and conceptualized the design of the proposal (with some help from JM) and wrote the article. SB and JM prepared the protocol registration of the clinical trial. ER enrolled the participants, conducted the training sessions, and collected the data with some help from AP, PT, and JM. AP and JM prepared the experimental tasks. JMR provided statistical support and contributed to sample size calculation. MC will analyze the saliva samples for CRP assessment. All authors reviewed the manuscript.

    Conflicts of Interest

    None declared.


    1. Park D, Reuter-Lorenz P. The adaptive brain: aging and neurocognitive scaffolding. Annu Rev Psychol 2009;60:173-196 [FREE Full text] [CrossRef] [Medline]
    2. Akiyama H, Barger S, Barnum S, Bradt B, Bauer J, Cole GM, et al. Inflammation and Alzheimer's disease. Neurobiol Aging 2000;21(3):383-421 [FREE Full text] [Medline]
    3. Bodles AM, Barger SW. Cytokines and the aging brain—what we don't know might help us. Trends Neurosci 2004 Oct;27(10):621-626. [CrossRef] [Medline]
    4. Hokkanen L, Launes J. Neuropsychological sequelae of acute-onset sporadic viral encephalitis. Neuropsychol Rehabil 2007;17(4-5):450-477. [CrossRef] [Medline]
    5. Desai GS, Mathews ST. Saliva as a non-invasive diagnostic tool for inflammation and insulin-resistance. World J Diabetes 2014 Dec 15;5(6):730-738 [FREE Full text] [CrossRef] [Medline]
    6. Baltes P. A psychological model of successful aging. 2005 Presented at: Keynote Lecture, World Congress of GerontologyBrazil; 2005; Brazil.
    7. Salthouse T. Consequences of age-related cognitive declines. Annu Rev Psychol 2012;63:201-226 [FREE Full text] [CrossRef] [Medline]
    8. Hertzog C, Kramer A, Wilson R, Lindenberger U. Enrichment effects on adult cognitive development: can the functional capacity of older adults be preserved and enhanced? Psychol Sci Public Interest 2008 Oct;9(1):1-65. [CrossRef] [Medline]
    9. Raz N. Aging of the brain and its impact on cognitive performance: Integration of structural and functional findings. In: Craik FIM, Salthouse TA, editors. Handbook of Aging and Cognition. New York: Psychology Press; 2000:1-90.
    10. Raz N, Lindenberger U, Rodrigue KM, Kennedy KM, Head D, Williamson A, et al. Regional brain changes in aging healthy adults: general trends, individual differences and modifiers. Cereb Cortex 2005 Nov;15(11):1676-1689 [FREE Full text] [CrossRef] [Medline]
    11. Baltes P, Lindenberger U. Emergence of a powerful connection between sensory and cognitive functions across the adult life span: a new window to the study of cognitive aging? Psychol Aging 1997 Mar;12(1):12-21. [Medline]
    12. Hoyer W, Verhaeghen P. Memory aging. In: Birren JE, Schaie KW, editors. Handbook of the Psychology of Aging. 6th edition. San Diego: Elsevier; 2006:209-232.
    13. Nilsson L. Memory function in normal aging. Acta Neurol Scand Suppl 2003;179:7-13. [Medline]
    14. Salthouse TA. The processing-speed theory of adult age differences in cognition. Psychol Rev 1996 Jul;103(3):403-428. [Medline]
    15. Bialystok E, Craik F. Lifespan Cognition: Mechanisms of Change. Oxford: Oxford University Press; 2006.
    16. Park DC, Lautenschlager G, Hedden T, Davidson NS, Smith AD, Smith PK. Models of visuospatial and verbal memory across the adult life span. Psychol Aging 2002 Jun;17(2):299-320. [Medline]
    17. Hedden T, Gabrieli JDE. Insights into the ageing mind: a view from cognitive neuroscience. Nat Rev Neurosci 2004 Feb;5(2):87-96. [CrossRef] [Medline]
    18. Mitchell DB, Bruss PJ. Age differences in implicit memory: conceptual, perceptual, or methodological? Psychol Aging 2003 Dec;18(4):807-822. [CrossRef] [Medline]
    19. Wiggs CL, Weisberg J, Martin A. Repetition priming across the adult lifespan—the long and short of it. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn 2006;13(3-4):308-325. [CrossRef] [Medline]
    20. Ballesteros S, Mayas J, Reales J. Cognitive function in normal aging and in older adults with mild cognitive impairment. Psicothema 2013 Feb;25(1):18-24. [CrossRef] [Medline]
    21. Ballesteros S, Reales J, Mayas J, Heller M. Selective attention modulates visual and haptic repetition priming: effects in aging and Alzheimer's disease. Exp Brain Res 2008 Aug;189(4):473-483. [CrossRef] [Medline]
    22. Ballesteros S, Reales J. Intact haptic priming in normal aging and Alzheimer's disease: evidence for dissociable memory systems. Neuropsychologia 2004;42(8):1063-1070. [CrossRef] [Medline]
    23. Ballesteros S, Bischof G, Goh J, Park D. Neural correlates of conceptual object priming in young and older adults: An event-related fMRI study. Neurobiol Aging 2013;34:1254-1264. [CrossRef]
    24. Osorio A, Ballesteros S, Fay S, Pouthas V. The effect of age on word stem cued recall: a behavioral and electrophysiological study. Brain Res 2009:56-68. [CrossRef] [Medline]
    25. Osorio A, Fay S, Pouthas V, Ballesteros S. Ageing affects brain activity in highly educated older adults: An ERP study using a word-stem priming task. Cortex 2010 Apr;46(4):522-534. [CrossRef] [Medline]
    26. Sebastián M, Reales J, Ballesteros S. Aging affects event-related potentials and brain oscillations: A behavioral and electrophysiological study using a haptic recognition memory task with familiar objects. Neuropsychologia 2011;49:3967-3980. [CrossRef]
    27. Sebastián M, Ballesteros S. Effects of normal aging on event-related potentials and oscillatory brain activity during a haptic repetition priming task. Neuroimage 2012 Mar;60(1):7-20. [CrossRef] [Medline]
    28. Pascual-Leone A, Amedi A, Fregni F, Merabet LB. The plastic human brain cortex. Annu Rev Neurosci 2005;28:377-401. [CrossRef] [Medline]
    29. Li S, Schmiedek F, Huxhold O, Röcke C, Smith J, Lindenberger U. Working memory plasticity in old age: practice gain, transfer, and maintenance. Psychol Aging 2008 Dec;23(4):731-742. [CrossRef] [Medline]
    30. Li S, Brehmer Y, Shing YL, Werkle-Bergner M, Lindenberger U. Neuromodulation of associative and organizational plasticity across the life span: empirical evidence and neurocomputational modeling. Neurosci Biobehav Rev 2006 Jan;30(6):775-790. [CrossRef] [Medline]
    31. Lövdén M, Bäckman L, Lindenberger U, Schaefer S, Schmiedek F. A theoretical framework for the study of adult cognitive plasticity. Psychol Bull 2010 Jul;136(4):659-676. [CrossRef] [Medline]
    32. Bavelier D, Green CS, Pouget A, Schrater P. Brain plasticity through the life span: learning to learn and action video games. Annu Rev Neurosci 2012;35:391-416. [CrossRef] [Medline]
    33. Ballesteros S, Peter C, Waterworth EL, Waterworth J. The role of ICT and networking in healthy aging. 2012 Presented at: The 5th ACM International Conference on Pervasive Technologies Related to Assistive Environments; 2012; New York.
    34. Waterworth J, Ballesteros S, Peter C. User-sensitive home based systems for successful ageing. 2009 Presented at: 2nd International Conference on Human System Interaction – HSI 2009; 2009; Catania p. 542.
    35. Peter C, Kreiner A, Schröter M, Kim H, Bieber G, Öhberg F, et al. AGNES: Connecting people in a multimodal way. J Multimodal User Interfaces 2013 Apr 22;7(3):229-245. [CrossRef]
    36. Hertzog C. Use it or lose it: an old hypothesis, new evidence, an ongoing controversy. In: Bosworth H, Hertzog C, editors. Cognition and Aging: Research Methodologies and Empirical Advances. Washington: American Psychological Association; 2009.
    37. Jones S, Nyberg L, Sandblom J, Stigsdotter NA, Ingvar M, Magnus PK, et al. Cognitive and neural plasticity in aging: general and task-specific limitations. Neurosci Biobehav Rev 2006;30(6):864-871. [CrossRef] [Medline]
    38. Ballesteros S, Mayas J, Reales J. Effects of a long-term physically active lifestyle on cognitive functioning in older adults. Current Aging Science 2013;6:189-198.
    39. Muiños M, Palmero F, Ballesteros S. Peripheral vision, perceptual asymmetries and visuospatial attention in young, young-old and oldest-old adults. Exp Gerontol 2016 Mar;75:30-36. [CrossRef] [Medline]
    40. Colcombe S, Kramer A, Erickson K, Scalf P, McAuley E, Cohen N. Cardio-vascular fitness, cortical plasticity, aging. Proc Natl Acad Sci 2004;101:3321. [CrossRef]
    41. Hötting K, Röder B. Beneficial effects of physical exercise on neuroplasticity and cognition. Neurosci Biobehav Rev 2013 Nov;37(9 Pt B):2243-2257. [CrossRef] [Medline]
    42. Baddeley A. Working memory: looking back and looking forward. Nat Rev Neurosci 2003 Oct;4(10):829-839. [CrossRef] [Medline]
    43. Spaniol J, Davidson PS, Kim AS, Han H, Moscovitch M, Grady CL. Event-related fMRI studies of episodic encoding and retrieval: meta-analyses using activation likelihood estimation. Neuropsychologia 2009 Jul;47(8-9):1765-1779. [CrossRef] [Medline]
    44. Dennis N, Kim H, Cabeza R. Age-related differences in brain activity during true and false memory retrieval. J Cogn Neurosci 2008 Aug;20(8):1390-1402 [FREE Full text] [CrossRef] [Medline]
    45. Burdick DJ, Rosenblatt A, Samus QM, Steele C, Baker A, Harper M, et al. Predictors of functional impairment in residents of assisted-living facilities: the Maryland Assisted Living study. J Gerontol A Biol Sci Med Sci 2005 Feb;60(2):258-264. [Medline]
    46. Owsley C, Sloane M, McGwin G, Ball K. Timed instrumental activities of daily living tasks: relationship to cognitive function and everyday performance assessments in older adults. Gerontology 2002;48(4):254-265. [Medline]
    47. Ball K, Edwards JD, Ross LA. The impact of speed of processing training on cognitive and everyday functions. J Gerontol B Psychol Sci Soc Sci 2007 Jun;62 Spec No 1:19-31. [Medline]
    48. Anguera JA, Boccanfuso J, Rintoul JL, Al-Hashimi O, Faraji F, Janowich J, et al. Video game training enhances cognitive control in older adults. Nature 2013 Sep 05;501(7465):97-101 [FREE Full text] [CrossRef] [Medline]
    49. Ballesteros S, Prieto A, Mayas J, Toril P, Pita C, Ponce de León L, et al. Brain training with non-action video games enhances aspects of cognition in older adults: a randomized controlled trial. Front Aging Neurosci 2014 Oct;6:277 [FREE Full text] [CrossRef] [Medline]
    50. Basak C, Boot WR, Voss MW, Kramer AF. Can training in a real-time strategy video game attenuate cognitive decline in older adults? Psychol Aging 2008 Dec;23(4):765-777 [FREE Full text] [CrossRef] [Medline]
    51. Mozolic JL, Long AB, Morgan AR, Rawley-Payne M, Laurienti PJ. A cognitive training intervention improves modality-specific attention in a randomized controlled trial of healthy older adults. Neurobiol Aging 2011 Apr;32(4):655-668 [FREE Full text] [CrossRef] [Medline]
    52. Toril P, Reales JM, Mayas J, Ballesteros S. Video game training enhances visuospatial working memory and episodic memory in older adults. Front Hum Neurosci 2016 May;10:206. [CrossRef] [Medline]
    53. Kueider A, Parisi J, Gross A, Rebok G. Computerized cognitive training with older adults: a systematic review. PLoS One 2012;7(7):e40588 [FREE Full text] [CrossRef] [Medline]
    54. Boot WR, Simons DJ, Stothart C, Stutts C. The pervasive problem with placebos in psychology: why active control groups are not sufficient to rule out placebo effects. Perspect Psychol Sci 2013 Jul;8(4):445-454. [CrossRef] [Medline]
    55. Buitenweg JIV, Murre JMJ, Ridderinkhof KR. Brain training in progress: a review of trainability in healthy seniors. Front Hum Neurosci 2012;6:183. [CrossRef] [Medline]
    56. Nap H, de KY, Ijselsteijn W. Senior gamers: preferences, motivations and needs. Gerontechnology 2009;8:247-262. [CrossRef]
    57. Pearce C. The Truth About Baby Boomer Gamers: A Study of Over-Forty Computer Game Players. Games and Culture 2008 Feb 13;3(2):142-174. [CrossRef]
    58. McKay SM, Maki B. Attitudes of older adults toward shooter video games: An initial study to select an acceptable game for training visual processing. Gerontechnology 2010 Jan 01;9(1):5-17. [CrossRef] [Medline]
    59. Lampit A, Hallock H, Valenzuela M. Computerized cognitive training in cognitively healthy older adults: a systematic review and meta-analysis of effect modifiers. PLoS Med 2014 Nov;11(11):e1001756 [FREE Full text] [CrossRef] [Medline]
    60. Powers K, Brooks P, Aldrich N, Palladino M, Alfieri L. Effects of video-game play on information processing: Meta-analytic investigation. Psychonom Bull Rev 2013;20:1055-1079. [CrossRef]
    61. Toril P, Reales J, Ballesteros S. Video game training enhances cognition of older adults: a meta-analytic study. Psychol Aging 2014 Sep;29(3):706-716. [CrossRef] [Medline]
    62. Wang P, Liu H, Zhu X, Meng T, Li H, Zuo X. Action video game training for healthy adults: a meta-analytic study. Front Psychol 2016 Jun;7:907 [FREE Full text] [CrossRef] [Medline]
    63. Nieboer A, Lindenberg S, Boomsma A, Bruggen A. Dimensions Of Well-Being And Their Measurement: The Spf-Il Scale. Soc Indic Res 2005 Sep;73(3):313-353. [CrossRef]
    64. Ballesteros S, Mayas J, Prieto A, Toril P, Pita C, Ponce de León L, et al. A randomized controlled trial of brain training with non-action video games in older adults: results of the 3-month follow-up. Front Aging Neurosci 2015 Apr;7:45 [FREE Full text] [CrossRef] [Medline]
    65. Mayas J, Parmentier FBR, Andrés P, Ballesteros S. Plasticity of attentional functions in older adults after non-action video game training: a randomized controlled trial. PLoS One 2014 Mar;9(3):e92269 [FREE Full text] [CrossRef] [Medline]
    66. Boot WR, Blakely DP, Simons DJ. Do action video games improve perception and cognition? Front Psychol 2011;2:226 [FREE Full text] [CrossRef] [Medline]
    67. Baniqued PL, Allen CM, Kranz MB, Johnson K, Sipolins A, Dickens C, et al. Working memory, reasoning, and task switching training: transfer effects, limitations, and great expectations? PLoS One 2015 Nov;10(11):e0142169 [FREE Full text] [CrossRef] [Medline]
    68. Ballesteros S, Toril P, Mayas J, Reales J, Waterworth J. An ICT social network in support of successful ageing. Gerontechnology 2014;13(1):37-46. [CrossRef]
    69. Buschkuehl M, Jaeggi S, Hutchison S, Perrig-Chiello P, Däpp C, Müller M, et al. Impact of working memory training on memory performance in old-old adults. Psychol Aging 2008 Dec;23(4):743-753. [CrossRef] [Medline]
    70. Dahlin E, Nyberg L, Bäckman L, Neely AS. Plasticity of executive functioning in young and older adults: immediate training gains, transfer, and long-term maintenance. Psychol Aging 2008 Dec;23(4):720-730. [CrossRef] [Medline]
    71. Hampstead BM, Stringer AY, Stilla RF, Giddens M, Sathian K. Mnemonic strategy training partially restores hippocampal activity in patients with mild cognitive impairment. Hippocampus 2012 Aug;22(8):1652-1658 [FREE Full text] [CrossRef] [Medline]
    72. Attention and Memory Training With Video Games in Old Age (AGEGAME).   URL: [accessed 2017-01-03] [WebCite Cache]
    73. Folstein MF, Folstein SE, McHugh PR. “Mini-mental state.” A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 1975 Nov;12(3):189-198. [Medline]
    74. Yesavage J, Brink T, Rose T, Lum O, Huang V, Adey M, et al. Development and validation of a geriatric depression screening scale: a preliminary report. J Psychiatr Res 1982;17(1):37-49. [Medline]
    75. Wechsler D. WAIS-III : Wechsler Adult Intelligence Scale, Administration and Scoring Manual, 3rd Edition. San Antonio: Psychological Corporation and Harcourt Brace; 1999.
    76. Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods 2004 Mar;134(1):9-21. [CrossRef] [Medline]
    77. Lopez-Calderon J, Luck SJ. ERPLAB: an open-source toolbox for the analysis of event-related potentials. Front Hum Neurosci 2014 Apr;8:213 [FREE Full text] [CrossRef] [Medline]
    78. Bell AJ, Sejnowski TJ. An information-maximization approach to blind separation and blind deconvolution. Neural Comput 1995 Nov;7(6):1129-1159. [Medline]
    79. Jung T, Makeig S, McKeown MJ, Bell AJ, Lee T, Sejnowski TJ. Imaging brain dynamics using independent component analysis. In: Proc IEEE Inst Electr Electron Eng. 2001 Jul 1 Presented at: Proceedings of the IEEE; 2001; Columbus p. 1107-1122   URL: [CrossRef]
    80. Makeig S, Bell A, Jung T, Sejnowski T. Independent component analysis of electroencephalographic data. Adv Neural Inform P Sys 1996;8:145-151.
    81. Makeig S, Jung T, Bell AJ, Ghahremani D, Sejnowski TJ. Blind separation of auditory event-related brain responses into independent components. P Natl Acad Sci USA 1997 Sep 30;94(20):10979-10984. [CrossRef]
    82. Onton J, Delorme A, Makeig S. Frontal midline EEG dynamics during working memory. Neuroimage 2005;27(2):341-356. [CrossRef]
    83. Lee T, Girolami M, Sejnowski TJ. Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources. Neural Comput 1999 Feb 15;11(2):417-441. [Medline]
    84. Jung TP, Makeig S, Stensmo M, Sejnowski TJ. Estimating alertness from the EEG power spectrum. IEEE Trans Biomed Eng 1997 Jan;44(1):60-69. [CrossRef] [Medline]
    85. Cameron TE, Hockley WE. The revelation effect for item and associative recognition: familiarity versus recollection. Mem Cognit 2000 Mar;28(2):176-183. [Medline]
    86. Hasher L, Zacks R. Working memory, comprehension, and aging: A review and a new view. In: Bower GH, editor. The Psychology of Learning and Motivation. New York: Academic Press; 1988:193-225.
    87. Green CS, Bavelier D. Exercising your brain: a review of human brain plasticity and training-induced learning. Psychol Aging 2008 Dec;23(4):692-701 [FREE Full text] [CrossRef] [Medline]
    88. Nouchi R, Taki Y, Takeuchi H, Hashizume H, Akitsuki Y. Brain training game improves executive functions and processing speed in the elderly: a randomized controlled trial. PLoS ONE 2012;7. [Medline]
    89. Bendixen A, Schröger E, Winkler I. I heard that coming: event-related potential evidence for stimulus-driven prediction in the auditory system. J Neurosci 2009;26:8447-8451.
    90. Schröger E. On the detection of auditory deviations: a pre-attentive activation model. Psychophysiology 1997 May;34(3):245-257. [Medline]
    91. Schröger E, Wolff C. Behavioral and electrophysiological effects of task-irrelevant sound change: a new distraction paradigm. Brain Res Cogn Brain Res 1998 Jul;7(1):71-87. [Medline]
    92. Winkler I, Cowan N. From sensory to long-term memory: evidence from auditory memory reactivation studies. Exp Psychol 2005;52(1):3-20. [CrossRef] [Medline]
    93. Friedman D, Cycowicz Y, Gaeta H. The novelty P3: an event-related brain potential (ERP) sign of the brain's evaluation of novelty. Neurosci Biobehav Rev 2001 Jun;25(4):355-373. [Medline]
    94. Opitz B, Rinne T, Mecklinger A, von Cramon DY, Schröger E. Differential contribution of frontal and temporal cortices to auditory change detection: fMRI and ERP results. Neuroimage 2002 Jan;15(1):167-174. [CrossRef] [Medline]
    95. Berti S, Schröger E. A comparison of auditory and visual distraction effects: behavioral and event-related indices. Brain Res Cogn Brain Res 2001 Jan;10(3):265-273. [Medline]
    96. Muñoz F, Reales J, Sebastian M, Ballesteros S. Modulation of attention during tactile roughness perception; revisiting the P300 component in the somatosensory system. Brain Res 2014:59-68.
    97. Kane MJ, Conway AR, Miura TK, Colflesh GJ. Working memory, attention control, and the N-back task: a question of construct validity. J Exp Psychol Learn Mem Cogn 2007 May;33(3):615-622. [CrossRef] [Medline]
    98. Tipper S, Cranston M. Selective attention and priming: inhibitory and facilitatory effects of ignored primes. Q J Exp Psychol A 1985 Nov;37(4):591-611. [Medline]
    99. Tipper SP. Does negative priming reflect inhibitory mechanisms? A review and integration of conflicting views. Q J Exp Psychol A 2001 May;54(2):321-343. [CrossRef] [Medline]
    100. Buchner T. Performance management theory: A look from the performer's perspective with implications for HRD. Hum Resources Develop Intern 2007 Mar;10(1):59-73. [CrossRef]
    101. Andrés P, Guerrini C, Phillips LH, Perfect TJ. Differential effects of aging on executive and automatic inhibition. Dev Neuropsychol 2008;33(2):101-123. [CrossRef] [Medline]
    102. Mayas J, Fuentes LJ, Ballesteros S. Stroop interference and negative priming (NP) suppression in normal aging. Arch Gerontol Geriatr 2012;54(2):333-338. [CrossRef] [Medline]
    103. Green CS, Bavelier D. Action video game modifies visual selective attention. Nature 2003 May 29;423(6939):534-537. [CrossRef] [Medline]
    104. Green CS, Bavelier D. Effect of action video games on the spatial distribution of visuospatial attention. J Exp Psychol Hum Percept Perform 2006 Dec;32(6):1465-1478 [FREE Full text] [CrossRef] [Medline]
    105. Green C, Li R, Bavelier D. Perceptual learning during action video game playing. Top Cogn Sci 2010;2:201-216.
    106. Milner B. Interhemispheric differences in the localization of psychological processes in man. Br Med Bull 1971 Sep;27(3):272-277. [Medline]
    107. Cohen J, Forman S, Braver T, Casey B, Servan-Schreiber D, Noll D. Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI. Hum Brain Mapp 1994;1(4):293-304. [CrossRef] [Medline]


    CRP: C-reactive protein
    EEG: electroencephalograph
    ELISA: enzyme-linked immunosorbent assay
    ERP: event-related potential
    ERSP: event-related spectral perturbation
    ICA: Independent Component Analysis
    ICT: information and communication technology
    MMN: mismatch negativity
    NP: negative priming
    RCT: randomized controlled trial
    RON: reorientation negativity
    UNED: Universidad Nacional de Educacion a Distancia

    Edited by G Eysenbach; submitted 28.08.16; peer-reviewed by J Anguera, M Välimäki, C Tziraki; comments to author 05.12.16; revised version received 13.12.16; accepted 18.12.16; published 24.01.17

    ©Soledad Ballesteros, Julia Mayas, Eloisa Ruiz-Marquez, Antonio Prieto, Pilar Toril, Laura Ponce de Leon, Maria L de Ceballos, José Manuel Reales Avilés. Originally published in JMIR Research Protocols (, 24.01.2017.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.