Abstract
Bilingualism and its cognitive impacts have drawn increasing interest. Recently, inconsistencies in the findings have raised discussions on what might have caused such discrepancies and how evidence should be evaluated. This review tries to shed new light onto the reasons for the inconsistencies by taking a novel perspective. Motivated by the finding that bilingualism affects response time distribution profiles, particularly findings that suggest bilinguals have fewer long responses, we investigated the relation between maximum response times allowed/included in the analysis of an experiment and the finding of a bilingual advantage. We reviewed 68 experiments from 33 articles that compared monolingual and bilingual speakers’ performance in three commonly used non-verbal interference tasks (Simon, Spatial Stroop and Flanker). We found that studies that included longer responses in their analysis were more likely to report a bilingualism effect. We conclude that seemingly insignificant details such as the data trimming procedure can have a potential impact on whether an effect is observed. We also discuss the implication of our findings and suggest the usefulness of more fine-grid analytical procedures.
Similar content being viewed by others
Recent years have seen an ever-increasing interest in bilingualism, especially in how the bilingual experience leads to cognitive changes (Kroll & Bialystok, 2013). One of the key discoveries was the finding that the two languages of a bilingual speaker are always active, even if the speaker is using only one language in a particular situation (BijeljacBabic, Biardeau, & Grainger, 1997; Colome, 2001; Spivey & Marian, 1999; Wu & Thierry, 2010). Therefore, bilingual experience requires that the speaker constantly monitors and controls language choice. But the soaring interest in bilingualism rather stems from reports that the constant demand on control processes appears to lead to a bilingual cognitive control advantage (for a review see Bialystok et al., 2009). Possibly the most exciting finding was that the onset of dementia appears to be later for bilingual speakers than for monolingual speakers (Alladi et al., 2013; Bialystok, Craik, & Freedman, 2007), suggesting that bilingualism provides a cognitive reserve. Another reason for the interest in bilingualism is the fact that evidence regarding the bilingual cognitive advantage is inconclusive. Quite a large number of studies have reported a bilingual advantage in cognitive control. But recent developments in the field have suggested that the evidence concerning the bilingual advantage, especially in non-verbal inhibition tasks, is far from conclusive (de Bruin et al., 2015; Hilchey & Klein, 2011; Paap, 2014; Paap & Greenberg, 2013).
Evidence for and against bilingual advantage
Early studies investigating speakers’ cognitive control abilities have reported a bilingual advantage. These studies utilized the Simon task (Simon & Rudell, 1967)—a task in which participants have to respond to a stimulus feature (e.g. respond according to the colour of a stimulus, left hand for red, and right hand for blue). The position of the stimulus could be either compatible or incompatible with the response hand. In this paradigm, responses are typically slower when stimulus position and response hand are incompatible. Bilingual speakers outperformed monolingual speakers in this task: they showed smaller stimulus congruency effects and/or overall faster response times (Bialystok, Craik et al., 2005; Bialystok, Craik, Klein, & Viswanathan, 2004; Bialystok, Martin, & Viswanathan, 2005). Using other variants of the Simon task (e.g. Spatial Stroop task, Bialystok, 2006) or paradigms that also require interference inhibition/conflict resolution (e.g. Flanker task, Eriksen & Eriksen, 1974), such bilingual advantage over monolingual performance has been reported many times over the years since the first report (e.g. Costa, Hernandez, Costa-Faidella, & Sebastian-Galles, 2009; Costa, Hernandez, & Sebastian-Galles, 2008; Kapa & Colombo, 2013; Tao, Marzecova, Taft, Asanowicz, & Wodniecka, 2011).
But the evidence is not consistent. While a bilingual advantage is often found, this is not always the case (for a review see Hilchey & Klein, 2011). Most strikingly, in a recent comprehensive study, Paap and Greenberg (2013) did not find any evidence for the bilingual advantage. They conducted a series of non-verbal conflict tasks that had commonly been used in previous studies, including the Simon task, with monolingual and bilingual college students. Bilingual speakers were neither less vulnerable in the conflict condition nor faster overall. On the contrary, the only group difference pointed to a bilingual disadvantage.
These inconsistent findings have raised serious discussions about the nature of the bilingualism effect and thought-provoking debates on how the evidence should be evaluated (e.g. Kroll & Bialystok, 2013; Paap, 2014; Valian, 2015). Several reviews have drawn attention to the published and non-published null results regarding the bilingualism effect, arguing that one should not over-evaluate the significance of positive findings, and should not under-evaluate the meaning of null results. Others discussed methodological issues (Paap, Johnson, & Sawi, 2015), such as the appropriateness of using covariates to control for additional factors, and the convergent validity of tasks used to measure executive control, i.e. the lack of significant correlations between standard measures of inhibition. The series of discussions provided a great chance to reflect on the current status in this research field, and more importantly on where the field is heading. Bearing that in mind, one constructive way to enhance our understanding of the consequences of bilingualism is to understand what factor(s) drives the divergence of results. The focus of this article is to contribute to the discussion from a novel perspective, i.e. the impact of seemingly trivial data trimming procedures.
Factors that potentially drive the inconsistency
In order to shed light onto the reasons for the inconsistencies in the literature, it is important to understand how other factors might interact with speakers’ cognitive control ability. Quite a number of factors have been pointed out. It was evident from the beginning that bilingual research is challenging due to the diversity of speakers’ linguistic profiles and experiences (Bialystok, 2001; Grosjean, 1998). Depending on their life experience, one bilingual speaker can differ from another in many ways. Such heterogeneity in linguistic experiences has been shown to have led to diverse cognitive consequences, such as level of language proficiency (e.g. Mishra, Hilchey, Singh, & Klein, 2012), stage of second language acquisition (early bilingual vs. late bilingual, Kalia, Wilbourn, & Ghio, 2014), the degree of bilingualism (dominant vs. balanced bilingual, Goral, Campanelli, & Spiro, 2015), pattern of language use, varying experience with frequent language switch (Soveri, Rodriguez-Fornells, & Laine, 2011), the similarity between a bilingual speakers’ two languages (Coderre & van Heuven, 2014, but see Paap et al., 2015a) and multilingualism (Poarch & van Hell, 2012). In addition, there are factors that are closely related to bilingualism or factors that drive the different language experiences, which at the same time are related to general cognitive performances. These include social and economic status (SES) (Morton & Harper, 2007), different cultural backgrounds (Yang, Yang, & Lust, 2011) and immigration status. Last but not least there are factors that affect one’s general executive functioning and that probably affect monolingual and bilingual speakers in the same way, such as age, education, exercise, music training, active video game experience and others (for an overview see Valian, 2015). These latter factors emphasize that cognitive control can be trained in other ways than by being bilingual, and that the populations of monolinguals and bilinguals can substantially overlap with regards to their performance in cognitive tasks. Such an overlap would also explain why the bilingualism effect has not been found in every study.
A new proposal
Another reason for the inconclusiveness of the literature might be the nature of the bilingual cognitive effect, which is better described as a mixture of effects rather than a single effect. For instance, Hilchey and Klein (2011) differentiated between two patterns of bilingual advantage, namely an inhibitory control advantage (i.e. bilinguals showing a reduced conflict effect), and an overall response speed advantage. This distinction suggests two routes through which bilingual experience could affect cognitive control: inhibitory control and attentional control. While enhanced inhibitory control ability should help to resolve conflict, resulting in a reduced conflict effect, enhanced attentional control should help to maintain task goals, leading to an overall speed advantage. Due to the general impurity of cognitive control tasks, a specific task does not provide a pure measure of a single control ability, but draws on many aspects of cognitive control. Some tasks might be more sensitive to participants’ inhibitory control ability and some to their attentional control ability. Therefore, depending on the task, one might observe a result pattern rather consistent with a bilingual inhibitory control advantage and/or bilingual attentional control advantage.
Tse and Altarriba (2012) utilized a novel analytical approach to the bilingual advantage effect. They performed an ex-Gaussian analysis to investigate response time distributions of bilingual speakers’ performance in a Colour Stroop task. Response times in cognitive experiments typically present themselves in a positively skewed distribution, which can be approximated by an ex-Gaussian distribution (Heathcote, Popiel, & Mewhort, 1991), i.e. a convolution of a Gaussian distribution (the mean of which is captured by the parameter μ) and an exponential distribution (the mean and variance of which are captured by the parameter τ). While the Gaussian component (the parameter μ) can be understood as the main body of the distribution, the exponential component (the parameter τ) captures the tail of the distribution, i.e. extremely slow responses. Tse and Altarriba (2012) suggested that the parameters of ex-Gaussian models of response time distributions in a Colour Stroop experiment are differentially sensitive to inhibitory control and attentional control. They argued that inhibitory control ability modulates the Gaussian component (μ) because differences in inhibitory control would affect the ease one resolves the competition between the two conflicting responses, leading to an overall shift of the response distribution in the conflict condition as compared to the no-conflict condition. In contrast, attentional control ability modulates the tail of the distribution (τ) because lapses of attention should lead to extreme long responses independent of condition. They found that more proficient speakers in L1/L2 showed a smaller interference effect in μ, and also smaller τ, independent of condition. This result is important, first because it proposes a way to disentangle the contribution of inhibitory and attentional control, and second because it suggests that what is usually treated as unwanted responses (τ) conveys important information.
One other study that has utilised the ex-Gaussian approach to examine response time distributions is Calabria, Hernandez, Martin, and Costa (2011). They re-analysed results from an attentional network task (ANT) originally reported in Costa et al. (2008) and Costa et al. (2009). In the original studies, they tested participants’ attentional networks using the ANT, which generates measurements for three attentional networks: an alerting network, an orienting network and an executive network. In their re-analysis, they focused on the executive network, or more specifically, on response times for trials with conflict stimuli versus trials with non-conflict stimuli (regardless of cue type). Results revealed an overall speed advantage for bilinguals in both the Gaussian (μ) and exponential (τ) components of the response distributions. Also, for an experiment that contained only 25 % inconsistent trials, i.e. under high monitoring demands, monolinguals had significant longer distribution tails (larger τ) in the incongruent compared to the congruent condition. This congruency effect was absent for bilinguals. These results suggest that the conflict effect in interference tasks is at least partially located in the tail of response distributions.
These observations lead to a new proposal that we investigated in the present study, namely that one reason for observing or not observing the bilingual advantage might be how the data was handled with regards to slow responses. In a traditional central tendency analysis, the typical procedure is to trim extreme responses, treating them as outliers. This is problematic if long responses are most sensitive to the experimental manipulation and/or group differences, as in studies where group/condition differences only emerged in the tail of response distributions (e.g. Epstein et al., 2011; Hervey et al., 2006). In other words, if a difference resides in the tail of the response distribution, by trimming the tail one also trims the potential to observe an effect. For instance, Leth-Steensen, Elbaz, and Douglas (2000) investigated response time distributions in a four-choice reaction time task for a group of children diagnosed with attention deficit hyperactivity disorder (ADHD) and a matched group with typical developing children. Using an ex-Gaussian analysis, they found that the two groups’ performances differed only in the τ parameter (the distribution tails), not in the main part of the response time distribution. The authors concluded that data trimming in this situation is equivalent to an artificial elimination of effects.
Meta-analysis
In what follows, we present a new perspective on previous studies that compared monolingual and bilingual performance in non-verbal inhibition tasks, investigating their data trimming procedures. If bilingual advantages are at least partly located in the tails of response distributions, i.e. in the slow responses as in Calabria et al. (2011), then one would expect that cutting off slow responses would reduce the chance of finding such advantages. We focused on three non-linguistic inhibition tasks that have been used most intensely to investigate the bilingual advantage: the Simon task, the Spatial Stroop task and the Flanker task (the latter sometimes embedded in an ANT). To ensure comparability, some variations of the tasks were excluded (e.g. the Simon task with a delay component in Martin-Rhee & Bialystok, 2008). We found 68 experiments taken from 33 articles (see Table 1). Within these 68 experiments, 23 (34 %) reported data trimming procedures, 4 reported excluding very short responses but did not report trimming of response distribution tails, 1 stated explicitly that long responses were not trimmed, and the remaining 40 did not mention whether or not they trimmed the data. For the purpose of our analyses, we treated the latter studies as ones that did not trim the data.
Two issues need to be pointed out. First, for studies that did trim the data, the practices differed. While some studies rejected long responses using standard deviations (e.g. 2.5 SD in Paap & Greenberg, 2013, which was approximately 700 ms after stimulus onset), others used a specific time cut-off (e.g. response times above 1700 ms). For comparison purposes, we translated cut-offs based on standard deviations into time cut-offs (using reported means and standard deviations). Second, for studies that did not trim the data, there was a big variation in terms of the maximum time allowed for making a response. For example, in Kousaie and Phillips (2012) 750 ms were allowed for making a response, meaning that in this particular design it was not possible to observe responses slower than 750 ms. This is equivalent to trimming the data at 750 ms. For these reasons, we focused on maximum response times being included in analyses (Fig. 1). For studies that did report a data trimming procedure, this is either the explicitly stated cut-off time or the response time (RT) calculated by the mean and SD. For studies that did not report a data trimming procedure, this was the maximum time allowed for making a response. For simplicity reasons, we will refer to both types of trimming as the maximum RT allowance.
We acknowledge that data trimming and varying maximum time allowances are not the same. Different maximum time allowances, but not data trimming, can lead to different response strategies. For example, participants might not monitor their response accuracy as thoroughly in an experiment with a response allowance of 1000 ms compared to an experiment with a response allowance of 5000 ms and data trimming at 1000 ms. However, in none of the 16 studies in the long allowance group data was trimming applied, which means that this cannot have affected our results.
Some of the studies reviewed were not included into further analysis because there was not adequate information about either the maximum time allowed or how the data was treated (the 3rd study in Bialystok, Martin, et al., 2005, all studies in Gathercole et al., 2014, Yang et al., 2011, and Mohades et al., 2014). Carlson and Meltzoff (2008) was not included either because they did not report RTs. This led to 58 studies being included in our statistical analysis.
Figure 1 shows the number of experiments that did and did not find a bilingual advantage for the various maximum times allowed. A clear pattern emerges: the shorter the maximum RT allowance, the less likely that a bilingualism effect was found. In order to statistically test whether observing a bilingualism effect depends on the maximum time allowed, we grouped the experiments into three types of maximum time allowance: short allowance (below 1000 ms), medium allowance (1001–3000 ms) and long allowance (above 3001 ms; see Table 2). A chi-square test of independence confirmed that the result patterns differed for the three allowance groups, χ2 (2, N = 58) = 21.99, P < .001. Thus, consistent with our hypothesis, studies with short RT allowance were more likely to report no group difference whereas studies with longer allowance were more likely to report a bilingualism effect.
In a meta-analysis of the bilingual advantage literature, Donnelly, Brooks, & Homer (2015) reported an effect of research laboratory. They suggested that this effect might be due to laboratory differences in, for instance, access to bilingual populations. In our long allowance group (>3001 ms), many studies are from the same research group. In fact, 14 out of 16 data points are from a research group around one particular author. In order to rule out that the current result is driven by a potential effect of laboratory, we excluded all data points from this laboratory. This led to two data points in the long allowance group. We therefore focussed on the short and medium allowance group, which both constituted a mixed contribution from different laboratories, meaning that the new result could not have been driven by any laboratory effect. This analysis confirmed our original result. The likelihood of observing a bilingualism effect depended on RT allowance, χ2 (1, N = 42) = 12.14, P < .001, with the medium allowance group being more likely to observe a bilingualism effect than the short allowance group.
As introduced, it has been pointed out that the age of the participants might play a role in whether a bilingualism effect can be detected or not. More specifically, bilingual elderly have been found to show the cognitive control advantage more consistently than other age groups. In addition, elderly and children respond on average much slower than adults. It might therefore be that our result arose because the group with long response allowances consisted of studies with very young and very old populations. We therefore tested the relationship between maximum response time allowance and the likelihood of finding a bilingualism effect in children, adults and elderly participants separately (see Table 2). A chi-square test of independence showed that while the relationship was not significant for children, χ2 (2, N = 10) = 2.86, P = .24, it was significant for adults, χ2 (2, N = 37) = 13.40, P = .001, and was marginally significant for elderly participants, χ2 (2, N = 11) = 5.29, P = .071. The non-significant result for the children was likely driven by limited power due to small numbers, especially in the short allowance category. Nevertheless, descriptively 83 % (5 out of 6) of the studies in the long allowance group versus 66 % (2 out of 3) in the medium allowance group showed a bilingualism effect. This result pattern is consistent with the conclusion that studies with longer response allowances are more likely to show a bilingualism advantage. Similarly in the elderly group, studies with longer allowances are more likely to report a bilingualism effect descriptively. The marginal effect seems again be due to a small sample size. In summary, it appears that data trimming reduces the likelihood of observing a bilingualism effect regardless of age group. Also, the very robust finding for adults showed that our overall result is not driven by the results for children or older participants who tend to respond much slower than adult participants.
Discussion
Based on the assumption that the effect of bilingualism on cognitive control resides at least partly in the tail of response distributions, we investigated a potential relationship between data trimming procedures adopted and the likelihood of observing a bilingualism effect by reviewing 68 experiments reported in 33 articles that compared monolingual and bilingual speakers using non-verbal interference tasks. We found that studies that included longer responses in their analysis were more likely to report a bilingualism effect, either in the form of overall response speed advantage or in the form of reduced interference effect. And this was also the case when the potential effect of laboratory was eliminated. This is consistent with earlier findings that the bilingualism effect emerges partially in the tail of response distributions (Abutalebi et al., 2015; Calabria et al., 2011; Tse & Altarriba, 2012). It appears that, when these prolonged responses were trimmed or not recorded, group differences might have also been eliminated.
A further analysis showed that the general result pattern was true for studies testing children, adults and elderly alike, even though significantly so only for adults, suggesting that data trimming might be problematic independent of the age of the participants and therefore independent of the average response times or the cognitive abilities of the participants. It also showed that the overall result pattern was not caused by studies with participant groups with very long responses times. There is unfortunately an insufficient number of studies and/or information about the participants in studies published to date to test whether data trimming procedure affects results independent of other factors that have been suggested to interact with the bilingual advantage (such as SES, immigrant status, language dominance, age of language acquisition, language usage, etc.) Future studies will need to disentangle the relevance of and the potential interplay of all these factors.
This review provides some practical implications for future endeavours. Employing a more fine-grid investigation approach might be useful, particularly in situations where effects are subtle. As pointed out, one fruitful alternative to traditional approaches of analysis is the ex-Gaussian analysis of response time distributions (Abutalebi et al., 2015; Calabria et al., 2011). For instance, Abutalebi et al. (2015) reported that a group of bilingual elderly showed advantage in the τ component in the incongruent condition and the μ component in the congruent condition in a Flanker task, supporting the notion that bilingual speakers have enhanced attentional control. It has to be pointed out, though, that one needs to be cautious when interpreting the results from ex-Gaussian parameters in terms of underlying cognitive processes, because there is no one-to-one mapping between cognitive processes and those parameters (Matzke & Wagenmakers, 2009).
An alternative approach to the ex-Gaussian analysis is a delta plot analysis, which examines condition effects as a function of RT, and which has been used in analysing conflict tasks such as the Simon task and the Colour Stroop task (Ridderinkhof, 2002a, 2002b; Ridderinkhof, Wildenberg, Wijnen, & Burle, 2004). In delta plot analyses, responses for each condition are grouped into bins according to their RTs. Condition differences are then calculated and plotted for these bins. Delta plots prototypically have a positive slope due to effect sizes being larger for slower responses (Roelofs, Piai, & Garrido Rodriguez, 2011). If one condition requires more inhibition than the other, the difference between conditions does not linearly increase with RT, but is reduced instead, resulting in ‘levelling-off’ of the delta plot in longer RTs. The levelling-off has been explained by inhibition building up slowly (Ridderinkhof, 2002a). The extent to which the plots level off can effectively reflect the amount of inhibition involved. The stronger the inhibition is applied, the smaller the slope of the plot. For example, Ridderinkhof (2002b) observed that, in a Simon task, delta plots for participants with smaller Simon effect, who are believed to have more efficient inhibitory control, levelled off more than those with larger Simon effect. Because a delta plot analysis is most useful within the discussion of inhibitory control, this approach could be used to test whether inhibition was applied equally fast and to the same degree in monolinguals and bilinguals.
In conclusion, the current review adds to the discussion about the reality of the bilingualism cognitive advantage in that seemingly insignificant details such as data trimming and maximum time allowed for response might have a significant influence on the findings. Therefore, it is important to take these into account in order to fully judge the evidence for and against a bilingual cognitive effect, next to other factor already pointed out in the literature. In addition, future studies are encouraged to report in detail how data were handled, and possibly use more fine-grid analyses of RT data to shed light onto the effect of bilingualism on speakers’ cognitive control abilities.
References
Abutalebi, J., Guidi, L., Borsa, V., Canini, M., Della Rosa, P. A., Parris, B. A., & Weekes, B. S. (2015). Bilingualism provides a neural reserve for aging populations. Neuropsychologia, 69, 201–210. doi:10.1016/j.neuropsychologia.2015.01.040
Alladi, S., Bak, T. H., Duggirala, V., Surampudi, B., Shailaja, M., Shukla, … Kaul, S. (2013). Bilingualism delays age at onset of dementia, independent of education and immigration status. Neurology, 81(22), 1938–1944.
Bialystok, E. (2001). Bilingualism in development: Language, literacy, and cognition. Cambridge, UK: Cambridge University Press.
Bialystok, E. (2006). Effect of bilingualism and computer video game experience on the Simon task. Canadian Journal of Experimental Psychology-Revue Canadienne de Psychologie Experimentale, 60(1), 68–79.
Bialystok, E., Craik, F. I. M., Grady, C., Chau, W., Ishii, R., Gunji, A., & Pantev, C. (2005a). Effect of bilingualism on cognitive control in the Simon task: Evidence from MEG. NeuroImage, 24(1), 40–49.
Bialystok, E., Craik, F. I. M., Green, D. W., & Gollan, T. H. (2009). Bilingual minds. Psychological Science in the Public Interest, 10(3), 89–129.
Bialystok, E., Craik, F. I. M., Klein, R., & Viswanathan, M. (2004). Bilingualism, aging, and cognitive control: Evidence from the Simon task. Psychology and Aging, 19(2), 290–303.
Bialystok, E., Craik, F. I. M., & Freedman, M. (2007). Bilingualism as a protection against the onset of symptoms of dementia. Neuropsychologia, 45(2), 459–464. doi:10.1016/j.neuropsychologia.2006.10.009
Bialystok, E., Craik, F., & Luk, G. (2008). Cognitive control and lexical access in younger and older bilinguals. Journal of Experimental Psychology-Learning Memory and Cognition, 34(4), 859–873.
Bialystok, E., & DePape, A.-M. (2009). Musical expertise, bilingualism, and executive functioning. Journal of Experimental Psychology-Human Perception and Performance, 35(2), 565–574. doi:10.1037/a0012735
Bialystok, E., Martin, M. M., & Viswanathan, M. (2005b). Bilingualism across the lifespan: The rise and fall of inhibitory control. International Journal of Bilingualism, 9(1), 103–119. doi:10.1177/13670069050090010701
BijeljacBabic, R., Biardeau, A., & Grainger, J. (1997). Masked orthographic priming in bilingual word recognition. Memory & Cognition, 25(4), 447–457.
Blumenfeld, H. K., & Marian, V. (2014). Cognitive control in bilinguals: Advantages in Stimulus-Stimulus inhibition. Bilingualism-Language and Cognition, 17(3), 610–629. doi:10.1017/s1366728913000564
Calabria, M., Hernandez, M., Martin, C. D., & Costa, A. (2011). When the tail counts: The advantage of bilingualism through the ex-Gaussian distribution analysis. Frontiers in Psychology, 2, 8. doi:10.3389/fpsyg.2011.00250
Carlson, S. M., & Meltzoff, A. N. (2008). Bilingual experience and executive functioning in young children. Developmental Science, 11(2), 282–298. doi:10.1111/j.1467-7687.2008.00675.x
Coderre, E. L., & van Heuven, W. J. B. (2014). The effect of script similarity on executive control in bilinguals. Frontiers in Psychology, 5, 1070. doi: 10.3389/fpsyg.2014.01070
Colome, À. (2001). Lexical activation in bilinguals’ speech production: Language-specific or language-independent? Journal of Memory and Language, 45(4), 721–736.
Costa, A., Hernandez, M., Costa-Faidella, J., & Sebastian-Galles, N. (2009). On the bilingual advantage in conflict processing: Now you see it, now you don't. Cognition, 113(2), 135–149.
Costa, A., Hernandez, M., & Sebastian-Galles, N. (2008). Bilingualism aids conflict resolution: Evidence from the ANT task. Cognition, 106(1), 59–86.
de Bruin, A., Treccani, B., & Della Sala, S. (2015). Cognitive Advantage in Bilingualism: An Example of Publication Bias? Psychological Science, 26(1), 99–107. doi:10.1177/0956797614557866
Donnelly, S., Brooks. P.J., & Homer, B.D. (2015). Examining the bilingual advantage on conflict resolution tasks: A meta-analysis. In Noelle, D. C., Dale, R., Warlaumont, A. S., Yoshimi, J., Matlock, T., Jennings, C. D., & Maglio, P. P. (Eds.) (2015). Proceedings of the 37th Annual Meeting of the Cognitive Science Society, 596-601. Austin, TX: Cognitive Science Society.
Emmorey, K., Luk, G., Pyers, J. E., & Bialystok, E. (2008). The source of enhanced cognitive control in bilinguals: Evidence from bimodal bilinguals. Psychological Science, 19(12), 1201–1206. doi:10.1111/j.1467-9280.2008.02224.x
Engel de Abreu, P., Cruz-Santos, A., Tourinho, C. J., Martin, R., & Bialystok, E. (2012). Bilingualism enriches the poor: Enhanced cognitive control in low-income minority children. Psychological Science, 23(11), 1364–1371. doi:10.1177/0956797612443836
Epstein, J. N., Langberg, J. M., Rosen, P. J., Graham, A., Narad, M. E., Antonini, … Altaye, M. (2011). Evidence for higher reaction time variability for children with ADHD on a range of cognitive tasks including reward and event rate manipulations. Neuropsychology, 25(4), 427–441. doi: 10.1037/a0022155
Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon identification of a target letter in a nonsearch task. Perception & Psychophysics, 16(1), 143–149.
Gathercole, V. C. M., Thomas, E. M., Kennedy, I., Prys, C., Young, N., Guasch, … Jones, L. (2014). Does language dominance affect cognitive performance in bilinguals? Lifespan evidence from preschoolers through older adults on card sorting, Simon, and rnetalinguistic tasks. Frontiers in Psychology, 5, 14. doi: 10.3389/fpsyg.2014.00011
Goral, M., Campanelli, L., & Spiro, A. (2015). Language dominance and inhibition abilities in bilingual older adults. Bilingualism-Language and Cognition, 18(1), 79–89. doi:10.1017/s1366728913000126
Grady, C. L., Luk, G., Craik, F. I. M., & Bialystok, E. (2015). Brain network activity in monolingual and bilingual older adults. Neuropsychologia, 66, 170–181. doi:10.1016/j.neuropsychologia.2014.10.042
Grosjean, F. (1998). Studying bilinguals: Methodological and conceptual issues. Bilingualism: Language and Cognition, 1(02), 131–149. doi:10.1017/S136672899800025X
Heathcote, A., Popiel, S. J., & Mewhort, D. J. K. (1991). Analysis of response-time distributions—an example using the stroop task. Psychological Bulletin, 109(2), 340–347. doi:10.1037/0033-2909.109.2.340
Hervey, A. S., Epstein, J. N., Curry, J. F., Tonev, S., Arnold, L. E., Conners, … Hechtman, L. (2006). Reaction time distribution analysis of neuropsychological performance in an ADHD sample. Child Neuropsychology, 12(2), 125–140. doi: 10.1080/09297040500499081
Hilchey, M. D., & Klein, R. M. (2011). Are there bilingual advantages on nonlinguistic interference tasks? Implications for the plasticity of executive control processes. Psychonomic Bulletin & Review, 18(4), 625–658.
Kalia, V., Wilbourn, M. P., & Ghio, K. (2014). Better early or late? Examining the influence of age of exposure and language proficiency on executive function in early and late bilinguals. Journal of Cognitive Psychology, 26(7), 699–713. doi:10.1080/20445911.2014.956748
Kapa, L. L., & Colombo, J. (2013). Attentional control in early and later bilingual children. Cognitive Development, 28(3), 233–246. doi:10.1016/j.cogdev.2013.01.011
Kirk, N. W., Fiala, L., Scott-Brown, K. C., & Kempe, V. (2014). No evidence for reduced Simon cost in elderly bilinguals and bidialectals. Journal of Cognitive Psychology (Hove, England), 26(6), 640–648. doi:10.1080/20445911.2014.929580
Kousaie, S., & Phillips, N. A. (2012). Conflict monitoring and resolution: Are two languages better than one? Evidence from reaction time and event-related brain potentials. Brain Research, 1446, 71–90. doi:10.1016/j.brainres.2012.01.052
Kousaie, S., Sheppard, C., Lemieux, M., Monetta, L., & Taler, V. (2014). Executive function and bilingualism in young and older adults. Frontiers in Behavioral Neuroscience, 8:250. doi: 10.3389/fnbeh.2014.00250
Kroll, J. F., & Bialystok, E. (2013). Understanding the consequences of bilingualism for language processing and cognition. Journal of Cognitive Psychology, 25(5), 497514. doi:10.1080/20445911.2013.799170
Leth-Steensen, C., Elbaz, Z. K., & Douglas, V. I. (2000). Mean response times, variability, and skew in the responding of ADHD children: A response time distributional approach. Acta Psychologica, 104(2), 167190. doi:10.1016/s0001-6918(00)00019-6
Linck, J. A., Hoshino, N., & Kroll, J. F. (2008). Cross-language lexical processes and inhibitory control. The Mental Lexicon, 3(3), 349–374. doi:10.1075/ml.3.3.06lin
Luk, G., Anderson, J. A. E., Craik, F. I. M., Grady, C., & Bialystok, E. (2010). Distinct neural correlates for two types of inhibition in bilinguals: Response inhibition versus interference suppression. Brain and Cognition, 74(3), 347–357. doi:10.1016/j.bandc.2010.09.004
Martin-Rhee, M. M., & Bialystok, E. (2008). The development of two types of inhibitory control in monolingual and bilingual children. Bilingualism: Language and Cognition, 11(1), 81–93.
Marzecova, A., Asanowicz, D., Kriva, L., & Wodniecka, Z. (2013). The effects of bilingualism on efficiency and lateralization of attentional networks. Bilingualism: Language and Cognition, 16(3), 608–623. doi:10.1017/s1366728912000569
Matzke, D., & Wagenmakers, E. J. (2009). Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis. Psychonomic Bulletin & Review, 16(5), 798–817. doi:10.3758/pbr.16.5.798
Mishra, R. K., Hilchey, M. D., Singh, N., & Klein, R. M. (2012). On the time course of exogenous cueing effects in bilinguals: Higher proficiency in a second language is associated with more rapid endogenous disengagement. Quarterly Journal of Experimental Psychology, 65(8), 1502–1510. doi:10.1080/17470218.2012.657656
Mohades, S. G., Struys, E., Van Schuerbeek, P., Baeken, C., Van De Craen, P., & Luypaert, R. (2014). Age of second language acquisition affects nonverbal conflict processing in children: An fMRI study. Brain and Behavior, 4(5), 626–642. doi:10.1002/brb3.246
Morton, J. B., & Harper, S. N. (2007). What did Simon say? Revisiting the bilingual advantage. Developmental Science, 10(6), 719–726.
Nicolay, A. C., & Poncelet, M. (2013). Cognitive advantage in children enrolled in a second-language immersion elementary school program for three years. Bilingualism: Language and Cognition, 16(3), 597–607. doi:10.1017/s1366728912000375
Paap, K. R. (2014). The role of componential analysis, categorical hypothesising, replicability and confirmation bias in testing for bilingual advantages in executive functioning. Journal of Cognitive Psychology, 26(3), 242–255. doi:10.1080/20445911.2014.891597
Paap, K. R., Darrow, J., Dalibar, C., & Johnson, H. A. (2015a). Effects of script similarity on bilingual advantages in executive control are likely to be negligible or null. Frontiers in Psychology, 5, 1539. doi: 10.3389/fpsyg.2014.01539
Paap, K. R., & Greenberg, Z. I. (2013). There is no coherent evidence for a bilingual advantage in executive processing. Cognitive Psychology, 66(2), 232–258. doi:10.1016/j.cogpsych.2012.12.002
Paap, K. P., Johnson, H. A., & Sawi, O. (2015b). Bilingual advantages in executive functioning either do not exist or are restricted to very specific and undetermined circumstances. Cortex, 69, 265–278.
Pelham, S. D., & Abrams, L. (2014). Cognitive advantages and disadvantages in early and late bilinguals. Journal of Experimental Psychology-Learning Memory and Cognition, 40(2), 313–325. doi:10.1037/a0035224
Poarch, G. J., & van Hell, J. G. (2012). Executive functions and inhibitory control in multilingual children: Evidence from second-language learners, bilinguals, and trilinguals. Journal of Experimental Child Psychology, 113(4), 535–551. doi:10.1016/j.jecp.2012.06.013
Ridderinkhof, K. R. (2002a). Activation and suppression in conflict tasks: Empirical clarification through distributional analyses. In W. Prinz & B. Hommel (Eds.), Common mechanisms in perception and action, attention & performance (Vol. XIX, pp. 494–519). Oxford: Oxford University Press.
Ridderinkhof, K. R. (2002b). Micro- and macro-adjustments of task set: Activation and suppression in conflict tasks. Psychological Research-Psychologische Forschung, 66(4), 312–323.
Ridderinkhof, K. R., van der Wildenberg, W. P. M., Wijnen, J., & Burle, B. (2004). Response inhibition in conflict tasks is revealed in delta plots. Cognitive Neuroscience of Attention, 2004, 369–377.
Roelofs, A., Piai, V. r., & Garrido Rodriguez, G. (2011). Attentional inhibition in bilingual naming performance: Evidence from delta-plot analyses. Frontiers in Psychology, 2, 184. doi:10.3389/fpsyg.2011.00184
Salvatierra, J. L., & Rosselli, M. (2011). The effect of bilingualism and age on inhibitory control. International Journal of Bilingualism, 15(1), 26–37. doi:10.1177/1367006910371021
Simon, J. R., & Rudell, A. P. (1967). Auditory S-R compatibility—effect of an irrelevant cue on information processing. Journal of Applied Psychology, 51(3), 300–304.
Soveri, A., Rodriguez-Fornells, A., & Laine, M. (2011). Is there a relationship between language switching and executive functions in bilingualism? Introducing a within-group analysis approach. Frontiers in Psychology, 2, 8. doi:10.3389/fpsyg.2011.00183
Spivey, M. J., & Marian, V. (1999). Cross talk between native and second languages: Partial activation of an irrelevant lexicon. Psychological Science, 10(3), 281–284.
Tao, L., Marzecova, A., Taft, M., Asanowicz, D., & Wodniecka, Z. (2011). The efficiency of attentional networks in early and late bilinguals: The role of age of acquisition. Frontiers in Psychology, 2, 19. doi:10.3389/fpsyg.2011.00123
Tse, C. S., & Altarriba, J. (2012). The effects of first- and second-language proficiency on conflict resolution and goal maintenance in bilinguals: Evidence from reaction time distributional analyses in a Stroop task. Bilingualism: Language and Cognition, 15(3), 663–676. doi:10.1017/s1366728912000077
Valian, V. (2015). Bilingualism and cognition. Bilingualism: Language and Cognition, 18(1), 3–24. doi:10.1017/s1366728914000522
Wu, Y. J., & Thierry, G. (2010). Chinese-English bilinguals reading English hear Chinese. Journal of Neuroscience, 30(22), 7646–7651.
Yang, S. J., Yang, H. J., & Lust, B. (2011). Early childhood bilingualism leads to advances in executive attention: Dissociating culture and language. Bilingualism: Language and Cognition, 14(3), 412–422. doi:10.1017/s1366728910000611
Yudes, C., Macizo, P., & Bajo, T. (2011). The influence of expertise in simultaneous interpreting on non-verbal executive processes. Frontiers in Psychology, 2, 9. doi:10.3389/fpsyg.2011.00309
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhou, B., Krott, A. Data trimming procedure can eliminate bilingual cognitive advantage. Psychon Bull Rev 23, 1221–1230 (2016). https://doi.org/10.3758/s13423-015-0981-6
Published:
Issue Date:
DOI: https://doi.org/10.3758/s13423-015-0981-6