Introduction
In everyday life, it is quite usual to do more than one thing at a time. For instance, people phone while biking or driving a car. Also, things like making breakfast, doing laundry, or shopping often require us to do multiple tasks simultaneously. Thus, multi-tasking is omnipresent in our daily life. Unfortunately, it usually comes with a performance cost (for a current review see Koch et al.,
2018).
In the cognitive dual-tasking literature, different sources for these performance costs are discussed. At least three currently dominant classes of models aim to explain these dual-task costs: Bottleneck models, capacity sharing models, and strategic models. From the perspective of bottleneck models, the response selection process is thought to be structurally limited, repressing one task until the response selection process of the other task has finished (Pashler,
1994). In contrast to these models, in capacity sharing models, it is supposed that the response selection can run in parallel, but a limited pool of central resources has to be shared between both tasks which again causes a processing limitation at the response selection stage (Kahneman,
1973; Navon & Miller,
2002; Telford,
1931; Tombu & Jolicoeur,
2003; Welford,
1952). According to the third alternative, strategic models, it is assumed that parallel processing is possible, but serial processing of the two tasks reflects a strategic adaptation to avoid crosstalk between them (Logan & Gordon,
2001; Meyer & Kieras,
1997).
Despite crucial differences, such as the assumption of strictly serial processing versus the possibility of parallel processing, these classes of models mainly focus on processing limitations during the response selection stage as the source of dual-task interference. Recently, the focus on dual-task costs changed a little, by asking how dual-tasks are represented. It is by no means clear whether the participants handle the two tasks as two isolated task-sets or whether they integrate them into one single task-set (Künzell et al.,
2018; Schneider & Logan,
2014). In support of such task-integration, it has been shown that the preceding trial shapes the processing of the next trial (De Jong,
1995; Luria & Meiran,
2006). Other observations suggest that even the elements of the two tasks presented in a dual-tasking trial become associated (Schmidtke & Heuer,
1997). It may in fact be natural that the two tasks are not represented separately. The goal of the current study is to contribute further to the understanding of the processes underlying such task integration within dual-tasking trials.
Task integration in dual tasking
The understanding of the term “Task-Integration” differs among researchers. For example, Ruthruff et al. (
2006) and also Schubert et al. (
2017) compare dual-tasking costs (the size of the PRP-effect) after single-task or dual-task training. They found better performance for dual-task training compared to single-task training. Based on these findings, they interpret this beneficial practice effect of dual-task training as task-integration by assuming that participants rely their dual-task performance on a conjoint response selection process (Ruthruff et al.,
2006) or that it enhances the task-scheduling processes (Strobach et al.,
2014).
A second indicator for task-integration can be observed when changing the task order from trial
n-1 to trial n (De Jong,
1995; Kübler et al.,
2022; Luria & Meiran,
2006). Such task-order changes come along with prolonged response times in trial
n. These findings suggest that the participants seem to represent not only the two tasks of a dual-tasking trial, but also their particular task order.
Our understanding of task integration is similar to this second form, but importantly, we focus on the element-level rather than the task-order level. If the elements of both tasks are contingently combined it facilitates dual-tasking. In most dual-tasking experiments, however, the stimuli of the two tasks are randomly combined such that task integration might not help dual-tasking, but rather contributes to interference costs (Ewolds et al.,
2021). To emphasize this difference, we will term this kind of integration
across-task integration.
Two different strands of dual-tasking research point to the participants’ tendency to integrate the elements across the two tasks. The first line of studies combines an implicit sequence learning task with a second task in which stimuli and responses follow a random rather than a predictable sequence (Schmidtke & Heuer,
1997; Schumacher & Schwarb,
2009). In most of these experiments, the serial reaction time task (SRTT) had been used. In the SRTT, first introduced by Nissen and Bullemer (
1987), the participants see four marked locations on the screen which are mapped to respective response keys. In each trial, a stimulus appears at one location on the screen and the participants have to press the assigned response key. Unbeknownst to the participants, the marked screen locations follow a regular and repeating sequence. Implicit learning is a generally robust phenomenon (e.g., Reber,
1993). For instance, the meta-analysis of Oliveira et al. (
2023) found that reliability of the SRTT was not significantly affected by factors such as participants’ age, sequence type and variant of computing the index of procedural learning. Yet, sequence learning is often found to be hampered in dual-tasking (Halvorson et al.,
2013; Hsiao & Reber,
2001; Röttger et al.,
2019,
2021; Schmidtke & Heuer,
1997; Schumacher & Schwarb,
2009). To account for the hampered implicit learning effects in dual-tasking, Schmidtke and Heuer (
1997) suspected that the stimuli of both tasks are associated. Participants learn a sequence encompassing a sequence element of the SRTT followed by a random element of the second task. Thus, the random elements of the second task then interrupt the learning of the predictable sequence within the SRTT. To test this assumption more directly, Röttger et al. (
2019) trained the participants with a SRTT and a tone-discrimination task. Stimuli of both tasks were always presented concurrently. Importantly, half of the SRTT locations were consistently paired with one specific tone while for the other half, the relation between the SRTT-location and the tones varied randomly. The results revealed that implicit learning was preserved for the fixed, but hampered for the variable SRTT-tone combinations.
1 This suggests that the stimuli of both tasks within trials had to be associated, before the participants then could account for the sequential predictability across trials. Thus, at least when implicit learning under dual-tasking is considered, the findings seem to point to the assumption that participants integrate the elements of both tasks within each trial (for further evidence see Ewold et al.,
2021; Röttger et al.,
2021).
The second line of research used a different logic to test for across-task integration. The crucial assumption here is that when the participants would associate the elements of the two tasks one should expect to find enhanced performance if the stimulus–response bindings (
S–
R bindings) of both tasks repeat from trial
n−1 to trial n than when only one repeats while the other changes. This logic has been frequently used in research of feature binding in action control and task switching (cf. Frings et al.,
2020; Hommel,
1998; Koch et al.,
2018). The assumption is that the repeating stimulus or response might lead to an automatic reactivation (or sustaining activation) of the settings from the previous trial. Yet, in case of a partial repetition (one task repeats, while the other changes) this echo from trial
n−1 might interfere with the processing of the current trial.
Pelzer et al. (
2021) used this logic and observed approximately 50 ms shorter response times when both
S‐
R bindings repeated from trial
n−1 to trial n than when only one
S‐
R binding repeated.
2 These costs were robust over multiple blocks of practice. The authors assumed that the participants associate the elements of the two tasks and store them together in one single memory episode (Logan,
1988). To further test this assumption, in a second experiment they consistently paired the stimuli of the two tasks. Here, the impact of trial
n−1 on RT disappeared across practice. Instead, the participants learned the contingencies between the two tasks over training which then superseded the after-effect of the preceding trial. The modulating influence of learning on the impact of trial
n−1 on RT hence suggests that episodes stored in long-term memory are involved. Additional evidence for the storage of such episodes encompassing the stimulus–response pairings of both tasks in a dual-task trial stem from Zhao et al. (
2020). They reported across-task integration effects with a lag of four trials (i.e., three intervening trials). Taken together, the findings of these studies suggest that the participants in dual-tasking experiments do indeed store the elements of both tasks in a conjoint memory episode.
In a second study, Pelzer et al. (
2022) trained participants with two tasks, only one of which had a fixed
S‐
R binding.
3 The rationale for this manipulation was that a variably assigned target stimulus could not elicit a specific response. If, however, the consideration is correct that the
S‐
R bindings of both tasks are stored conjointly in one single memory episode, the re-occurrence of the fixed
S‐
R binding should suffice to re-activate the entire episode (Frings et al.,
2020), in particular, the responses to both tasks. The findings revealed evidence for across-task integration effects. Additionally, in another condition in which both tasks contained variable
S–
R bindings, no across-task integration effects were obtained. Thus, it seems as if the fixed
S–
R binding of at least one task is needed to retrieve both tasks’ responses.
Overall, the reported findings of Pelzer et al., (
2021,
2022) suggest that the elements of the two tasks in dual-tasking experiments are associated across tasks and are stored conjointly, meaning that the two tasks are not represented as isolated task-sets. This might be a rather rational consequence of the instruction in dual-tasking experiments (Gozli et al.
2019; Halvorson et al.,
2013). Usually, the participants are told to perform the two tasks within one trial, both requiring a response. The trial ends only after having completed both tasks before the next trial starts (Dreisbach,
2012). It is thus conceivable that storing conjoint memory episodes is simply the consequence of presenting the two tasks within one single trial, as is, for example, proposed for automatization of single tasks (Logan,
1988; Logan & Etherton,
1994). As an alternative, however, it might be that storing the two S-R bindings into one single conjoint memory episode presupposes that the stimuli of both tasks appear in temporal proximity. Consequently, if, for instance, the two stimuli are temporally separated by relatively long SOAs, the participants might adopt a more separate representation of the two tasks (Miller et al.,
2009; Schumacher & Schwarb,
2009) which then reduces or even eliminates the tendency to associate the task elements across tasks.
In line with this perspective, Schumacher and Schwarb (
2009) have shown that implicit sequence learning in dual-tasking is preserved when the two task stimuli are separated by long stimulus-onset asynchronies (SOA) of 800 ms, but hampered when the SOA was set to zero. Taking the reduced implicit learning effect with short SOAs as an indicator for across-task integration and the preserved learning effect as an indicator for a lack of across-task integration (cf. Röttger et al.,
2021), this would suggest that long SOAs reduce the tendency to associate the elements across tasks and to store them as conjoint memory episodes. However, Schumacher and Schwarb (
2009) only manipulated the long or short SOAs between participants, leading to diverging interpretations. On the one hand, it is conceivable that the long SOAs prevent participants' tendency to store the elements of the two tasks in a conjoint memory episode by provoking a separate representation of the two tasks. On the other hand, storage of conjoint memory episodes may occur as an inevitable consequence of presenting the two tasks within a single trial (Logan,
1988), regardless of SOA length. A long SOA may only reduce the influence of the retrieved memory episodes on task processing in the current trial (Koob et al.,
2021).
The present study
The current experiments aimed to better understand the mechanisms underlying across-task integration in dual tasking. According to the findings of Schumacher and Schwarb (
2009), one possibility to hinder such integration of the two tasks’ elements seems to be to separate the presentation of the two stimuli by long SOAs. However, presenting the two stimuli with only long SOAs does not elucidate how exactly this happens. Therefore, we built in the current study on an experimental set-up of Mattes et al. (
2021) and Miller et al. (
2009) who manipulated the participants’ temporal expectancies by manipulating the frequencies of short and long SOAs (Jentzsch & Sommer,
2002; Miller et al.,
2009). The participants received either frequently short SOAs (short frequent condition, SF), or frequently long SOAs (long frequent condition, LF) that were intermixed in both conditions with few medium and few long or short SOAs, respectively.
On the one hand, presenting many long SOAs may reduce the tendency to store the elements of the two tasks within one single memory episode, because it provokes a more separate representation of the two tasks. If this were the case, the across-task integration effects at all SOA levels in the LF condition should be smaller than those in the SF condition. On the other hand, long SOAs may affect the retrieval of the memory episodes. If the stimuli are separated by a long SOA, the retrieval of the conjoint memory episode might be weakened. This, in turn, reduces its influence on task processing in the current trial (Koob et al.,
2021). If the latter were the case, we should find across-task integration effects at short, but probably not at long SOAs irrespectively of whether the participants receive many short or many long SOAs during training.
We conducted two experiments with the design of Pelzer et al., (
2022, Experiment 1), and manipulated the SOA distributions between participants. The second experiment was a conceptual replication of the first one with slight changes to more precisely test the findings of Experiment 1.
General discussion
The current study aimed at testing whether the generation of conjoint memory episodes is an inevitable consequence of presenting two tasks within a single trial (Logan,
1988). Alternatively, it is conceivable that providing frequent long SOAs can lead participants to represent the two tasks separately and as such reduce or even fully prevent participants to generate conjoint memory episodes (Schumacher & Schwarb,
2009). For this purpose, we manipulated the distribution of different SOAs (100 ms, 300 ms, or 800 ms) by presenting either frequent short (SF condition) or frequent long SOAs (LF condition) (Miller et al.,
2009). This design made it possible to investigate the effect of SOA on across-task integration on two levels: On one hand, we can test whether a preceding short as compared to a preceding long SOA modulates across-task integration in the current trial. On the other hand, it is possible to investigate if a high frequency of long SOAs reduces across-task integration as it leads to a more separate representation of the two tasks (Schumacher & Schwarb,
2009). This is plausible if one assumes that participants likely register the frequent length of the temporal gap between the presentation of the two stimuli and in turn adapt their processing strategy. With frequent long SOAs, they may tend to enter their responses immediately after generating it. In contrast, experiencing a frequent short temporal gap between the two stimuli might provoke a tendency to postpone entering the response to the first stimulus until the second stimulus had been presented.
Experiments 1 and 2 yielded two important results: First, in both experiments, the SOA distribution influenced the participants’ processing strategies. The RTs in the VST increased with SOA length and this increase was steeper in the SF than in the LF conditions. The ADT reflected the reversed pattern; the RTs decreased with SOA length and this was more pronounced in the LF than in the SF conditions. Furthermore, the IRIs were shorter in the SF condition compared to the LF condition. Together, this pattern of results is consistent with the assumption that the frequency distribution of the SOAs modulated the processing strategy.
Second, the interaction between the VST and the ADT-sequences, as the indicator for across-task integration, was overall significant. The interaction was affected by the length of the SOA. It diminished in both conditions with increasing length of the SOA. Most importantly, for short SOAs, the across-task integration effects were of rather the same size in both conditions, meaning that the frequent long SOAs in the LF condition did not hinder the participants from storing the stimuli of both tasks in one conjoint memory episode. However, at the medium SOA level the across-task integration effects largely differed between the two conditions. While the effects were still large in the SF condition, they almost vanished in the LF condition.
With the test phase, additionally introduced after the training in Experiment 2, we could exclude that this difference in the across-task integration effects at the medium SOA level were caused by differences in the SOA transitions (more short-to-medium transitions in the SF and more long-to-medium transitions in the LF condition). With identical distributions of SOAs in the test phase, both conditions showed substantial across-task integration effects at the medium SOA level. This interaction effect was modulated by the respective SOA distribution during training. Yet, it was not affected by the respective SOA of the preceding trial. Even when a long SOA in trial n−1 preceded the medium SOA in trial n, the participants of both conditions produced large across-task integration effects. In combination with the observation that in both experiments, the interaction between the VST and the ADT-sequences was present at the short SOA level irrespective of SOA distribution, this points to the ubiquity of encoding the two tasks’ elements conjointly.
Taken together, the current findings are in line with the assumption that in dual tasking the storage of the elements of both tasks in conjoint memory episodes itself seems to be a rather basic process which does not depend on the length of the SOA or on the respective processing strategy. Rather, it seems to be an inevitable consequence of presenting two tasks within one single trial (Logan,
1988). This fits with former findings from implicit sequence learning in dual-tasking showing that the participants need to associate the two tasks’ elements before they then can exploit the regularity built into the stimulus- and response sequence of one of the two tasks (Röttger et al.,
2019,
2021; Schmidtke & Heuer,
1997). Even when the participants kept the two tasks more separate, as was likely the case in the current LF condition, this does not prevent this common storage. However, it seems to help reducing the influence of the reactivated conjoint memory episode. In case of frequent short SOAs, an even longer SOA is needed to overcome the influence of the reactivated memory episode on the current task processing (Koob,
2021; Logan & Gordon,
2001).
However, it is important to point out a potentially problematic aspect of our pattern of results. Our findings concerning across-task integration were solely based on the facilitation effect when both
S–
R bindings repeated. We found negligible effects when the
S–
R bindings of both tasks changed from trial
n−1 to trial n. This is at odds, with partial repetition costs usually found in single task experiments of action control (cf. Hommel,
1998,
2006). The assumption underlying these single-task experiments is that the partial repetition costs result from the binding of feature codes in an event file. These feature codes can or cannot overlap across tasks. If an event file already occupies a feature code, the creation of the next event file is delayed leading to costs in the case of a partial repetition. If the two tasks do not overlap in their features (full switch), a new event file is immediately generated resulting in shorter response times. However, in a recently published paper, Koch et al. (
2023) argued that alternatively the shorter RTs in case of a full switch could result from expectancy effects. Usually, these paradigms use only two-choice discrimination tasks. This implies that for full switches, participants can detect that nothing repeats and very quickly decide to press the respective other keys for both tasks. The findings of Koch et al. (
2023) supported this conjecture. When using four different response alternatives the full switch benefit was substantially reduced. Since we used three response alternatives in our VST such a bias toward pressing the respective other response-key does not work. This might have contributed to the fact that we found benefits for full repetition, but not the full switch of the S-R bindings.
The lack of a full-switch benefit may also suggest reconsidering the interpretation of our across-task integration effects for another reason. While participants benefit from the repetition of both
S–
R bindings, it is less clear whether the repetition of only one
S–
R binding has a cost in our experiments. Alternatively, one could assume that when both
S–
R bindings repeat it leads to the retrieval of the episode from the preceding trial, whereas in trials with only one repeating
S–
R binding, no such retrieval occurs at all. According to Hintzman (
1990) or Jamieson and Mewhort (
2009), one option is to assume that the strength of the echo of the memory episode depends on the similarity between the content of the memory episode and the current stimulus combination. This would imply that if both
S-
R bindings repeat from trial
n−1 to trial
n, the memory episode leads to a strong echo. If only one
S-
R binding repeats while the respective other changes, the echo of the reactivated memory episode is probably too weak to facilitate task processing (Hintzman,
1990; Jamieson & Mewhort,
2009). A too week echo, does not result in the retrieval of the episode and thus in no interference-based costs. The same would be true if both stimuli change from trial
n−1 to trial
n.
This also might explain why we found no across-task integration effects at long SOAs. In trials with long SOAs the single stimulus might already activate the respective memory episode, but according to the above consideration, the strength of the echo of the memory episode might be weaker compared to trials with short SOAs. It is also conceivable that the echo of the memory episode fades out rather quickly (Koob et al.,
2021; Logan & Gordon,
2001). This would also weaken its effect on the response generation in trials with long SOAs. Though speculative, these considerations might be suited to explain the current findings.
So far, we have argued that the RT-difference between the repetition of both versus only one S-R binding indicates that both S-R bindings were stored as a conjoint memory episode. However, as mentioned above, this assumption relies only on the response repetition benefit that drove the obtained interactions between the VST and the ADT-sequences. This raises the question whether alternative assumptions can explain the observed benefit when both S-R bindings repeat without attributing this effect to the storage of memory episodes.
For instance, Houghton and Hartley (
1995) suggest a “repetition mode” to explain how doubling of reactions in typing can be solved which is a severe problem for models of serial order. Based on analysis of typing errors, the authors provide some evidence that such a repetition mode is used. For instance, a common typing error in words with double letters is that the doubling is shifted to a different letter [diiferent leeter], as if “doubling” was something one could switch on and off (see also Mattler,
2005, for a similar proposal).
Transferred to the found interaction between the VST and the ADT-sequences which was based on the strong benefit when both tasks’ elements repeat, this would imply that the participants simply detect that both stimuli are the same as in the preceding trial. The “repetition mode” can thus be used. If only one stimulus repeated, this repetition mode (“just repeat everything”) cannot be used. One could argue that such a view is somewhat different from the encoding of conjoint episodes. All that is needed is to detect whether there is or is no change of elements in the two tasks. The repetition benefit of the two S-R bindings would then reflect that the repetition mode cannot be easily switched on or off for only one of the two tasks within a trial. Rather, it is effective only when the stimuli of both tasks repeat, which means that, similar to our across-task integration assumption, the participants seem to represent the stimuli of both tasks as belonging together.
Furthermore, repetition effects that span longer than a single trial do not seem to be attributable to such a mechanism. For instance, Zhao et al. (
2020) observed episodic effects spanning four trials. Thus, it is unlikely that the current finding could be fully attributed to such a “repetition mode” while leaving nothing for episodic encoding and retrieval. In addition, the findings of Pelzer et al. (
2021), already mentioned in the Introduction section, does not fit well with such an explanation. They found that when the participants were trained with contingent pairings of the elements of the two tasks the after-effect of the trial
n−1 pairing vanished. This suggests that the participants have acquired memory episodes of the contingent task pairings which can supersede the influence of the most recently generated memory episode (in trial
n−1). Furthermore, also the observations of Röttger et al. (
2021) corroborate the assumption of conjoint memory episodes. In a dual-tasking experiment, they trained the participants with a second-order sequence (e.g., 3 4 2 1 2 3 1 4; numbers 1–4 denoting stimulus positions from left to right) and a tone discrimination task. In one condition, the target stimuli were consistently paired with one particular tone (e.g., the “3” always appeared with a high tone), while in the other condition, the first “3” within the sequence was consistently combined with a high and the second “3” with a low tone. The results revealed implicit sequence learning effects in the first condition, but not in the second condition. The authors concluded that the participants had to learn the associations between the respective SRT-stimulus and the tone before they could exploit the sequential regularity built into the SRT-stimuli.
One last point, important to discuss is the relation between across-task integration on the level of stimuli and responses versus on the level of (sub)task-sets as observed by Kübler et al., (
2018,
2021), Strobach et al. (
2021) or Hirsch et al. (
2021). The focus of these experiments differs from our focus on the level of task-elements. These authors investigate on a more abstract task-set level the effects of changing task-order sets or task-pair sets. For instance, Kübler et al. (
2021) or also Strobach et al. (
2021) have shown that task-order switches led to additional costs in dual-tasking (see also Luria & Meiran,
2006). This fits with our observation that the participants do not handle the two tasks in dual-tasking as isolated task-sets. Rather, they seem to use a structure of task control that encompasses the (sub)task-sets and their order. While this work suggests across-task integration on the task-set level and our work suggests across-task integration on the element level (stimuli and responses), it is a further issue to test to what extent these two levels operate in separation. For instance, Kübler et al. (
2021) assume that task-set order switch costs result from an abstract representation of the task-order sets actively represented in working memory. These representations are thought to contain no information about the specific task components. Rather, the specific task elements are assumed to be maintained separately in working memory. Using task order as an example, Kübler et al. (
2022) suggest that bridging across the representations of the two tasks relevant in a dual-task trial may occur at different levels rather independently. They used different tasks with visual and auditory stimuli. In each dual tasking trial both modalities occurred. Participants were faster in trials in which the task order at the level of modalities was the same as in the preceding trial (i.e., again visual task first, auditory second) compared to trials which contained a switch. This effect of task order was observed, irrespective of whether the specific auditory or visual task also repeated from one trial to the next. This might suggest that across-task integration can take place independently on different levels of task representations. Future work on dual-tasking should further address the coupling vs. independence of across-task integration on the level of task representations on the one and the level of task elements (i.e. stimuli and responses) on the other side.