Neuroimaging techniques like functional magnetic resonance imaging (fMRI) are widely used in research regarding the interaction of the language and the motor system . Nevertheless, behavioural experiments, especially dual task experiments, still play an essential role, as they are inexpensive and readily available . Dual task experiments compare the performance of participants while engaging in two tasks simultaneously with their performance in only one of the two tasks. Thus, they help to understand higher cognitive functions and more specifically the lateralisation of the human brain. To explore the interaction of the motor and the language system, different studies investigate the mutual influence of a language task with different semantic word categories and a simultaneously performed motor task [3, 4, 5, 6, 7, 8]. However, the comparison of the results is challenging due to various experimental settings, groups of participants, a large variety of language tasks and task languages as well as differing complexity and type of motor tasks. Furthermore, lateralisation effects in the interaction of the motor and the language system have been investigated in fMRI studies [9, 10], but rarely in behavioural experiments . Implementing a Divided Visual Field Paradigm helps to investigate hemispheric differences. Therefore, the stimuli are presented on either the left or the right visual half-field only and thus are first processed by just one, the contralateral, hemisphere .
We here present a software solution for a dual task experiment that integrates a Divided Visual Field Paradigm. While commercial software like E-Prime® (Psychology Software Tools, Inc.) is available for behavioural experiments, open source software is not only more cost-effective, but also offers different additional opportunities. Our software DiViDu enables researchers, students as well as the interested community to reuse and modify the software for future experiments and thus helps to expand the knowledge in this research field. It enables the replication of our experimental setup, as well as the modification and adaption by modifying the settings as well as the source code. Moreover, the raw empirical data can be shared in an anonymised way. Thus, researchers can collect a large pool of data for retrospective meta-studies.
In the following, we describe the experimental setup, the implementation, the requirements as well as the full range of adaption potential.
We developed DiViDu for a dual task experiment, where participants perform either a lexical decision task only (single task) or simultaneously with a complex one-handed tapping task (dual task) (cf.,  for an overview). The participants perform the tapping task either with their right or left hand, while responding to the lexical decision task with the other hand. Furthermore, all stimuli are presented in the right visual field (RVF) and the left visual field (LVF) (divided visual field paradigm) (cf., Figure 1). The word stimuli contain of hand-related (H) [e.g., clap, write], as well as foot-related (F) action verbs [e.g., run]. We further subdivided the category of hand-related actions words into a group of unimanual (H1) and a group of bimanual (H2) hand-related actions words. The verbs in category H1 describe actions normally performed with only one hand [e.g., write], while the verbs in category H2 describe actions normally performed with both hands simultaneously [e.g., clap].
Every lexical decision sequence consists of the presentation of a fixation cross (800 ms) and a stimulus (180 ms), a response period (3000 ms maximum) and an interstimulus interval (1200 ms) (cf., Figure 4).
The complex one-handed tapping task consists of six steps (2-3-4-5-2-5) with the index (2), middle (3), ring (4) and little (5) finger of the right or left hand.
The participants enter the lexical decision response (word/pseudoword) as well as the complex tapping task sequence on a regular, but rotated, keyboard (cf., Figure 1). In our experiment, one-half of the participants (group R) performed the tapping task with the right and responded to the lexical decision task with the left hand. We recorded F11 (word) and F12 (pseudoword) key inputs for the lexical decision response, as well as F4, F3, F2 and F1 key inputs for the tapping input. The other half of the participants (group L) performed the tapping task with the left hand and the response to the lexical decision with the right hand. We recorded F2 (word) and F1 (pseudoword) key inputs for the lexical decision response, as well as F9, F10, F11 and F12 for the tapping input. Furthermore, we recorded the reaction time for the lexical decision responses as well as the sequence of the tapping keys and the intertap intervals, reflecting the period between key down of one of the tapping keys and key down of the next tapping key. We subdivided the experiment into different parts, separated by breaks. The participants determine the length of the breaks. Moreover, the participants initiate the start of the entire experiment as well as the continuation of the experiment after a break. In our experiment, we defined breaks after every 80 stimuli presentation. At the beginning of the experiment, as well as when changing task condition (from a dual task condition to single task condition or the reverse), participants see an instruction screen for 3000 ms (cf., Figure 2).
In addition to the main experiment, our participants performed a training task (cf., Figure 3), a dual task setting with a tapping task and a non-verbal task. Therefore, the software displays a yellow or red bar instead of a word or pseudoword. We instructed our participants to respond according to the colour but not the position of the bar. During the training task, the response ‘yellow’ is entered with the word key, while the response ‘red’ is entered with the pseudoword key. We implemented the training task to accustom the participants to a dual task, as well a visual field experimental setting.
We implemented DiViDu using the most straightforward programming technology to ensure that scientists with limited programming experience can understand and change the source code. We use the programming language Visual Basic in the Visual Studio 2017 framework. Visual Studio has a very convenient debugging interface, which allows less experienced programmers to experience a direct connection between the current state of graphical user interface and the position in the source code.
Our software has a global state. The main loop iterates through a trial list until the end of the list is reached. The three data sources, the keystrokes for the tapping input and the lexical decision input, as well the information from the trial list, are written into a joint log file.
In addition to state altering keypress events, we use a stopwatch control to record the duration between the keystrokes (reaction time for the lexical decisions and intertap intervals for the tapping). Furthermore, we use a stopwatch (timer) to advance the state in between the sequence. The flow diagram of our software DiViDu is shown in Figure 4.
We defined the stimuli, as well as the presentation settings and the task condition for each stimulus in four different trial lists (cf., Table 1). Our original German trial lists are provided via GitHub. Table 1 shows exemplarily a section of the trial list in English. The trial list includes the stimuli (1) and the visual field setting (2) [LVF/RVF]. Furthermore, it specifies the stimulus type (3) [pseudoword (TRUE)/word (FALSE)], the task condition (4) [dual task condition (TRUE)/single task condition (FALSE)] the semantic word categories (5), as well as the subcategories (6).
|Stimulus (1)||VisualField (2)||Pseudoword (3)||Tapping (4)||Wordcategory (5)||SubCategory (6)|
The software provides a separate CSV output file for each participant. The output table (cf., Table 2) includes the date and time of the experiment conduct and a comment (2) which signalises the instruction period at the beginning of a new task condition. Thus, row 2 reflects no lexical decision results, but the key input (tapping sequence and intertap intervals) during the instruction period. The following columns reflect the stimuli information including the stimulus type (3), the visual field setting (4), the task condition (5), the table includes the stimuli (6), the word category (7) as well as the subcategory (7). Finally, it contains the correctness of the response (correct/incorrect/timeOver) (10) and the reaction time (11). Thus, ‘timeOver’ reflects a missing response after a defined response period, in our experimental setup 3000 ms.
|Comment (2)||PseudoWord (3)||VisualField (4)||Task (5)||Stimulus (6)||WordCategory (7)||SubCategory (8)||Response (10)||ReactionTime (11)|
Moreover, a column TappingKeys (12) display the key inputs for the tapping sequence. In addition, the column intertap interval (13) shows the intertap intervals, reflecting the tapping frequency.
We provide a test trial list in English, which allows developers to perform a manual test with overall 20 stimuli. The test trial lists will automatically be installed with the software, the setup covers all possible states of our software so that the user can quickly ensure the integrity and stability of the software. The only requirement for this test is a break-distance setting smaller than the stimuli number (e.g., 5), to reach and test the break state. After every modification of the source code, the user should carefully check the following physical parameters of the experimental setup: (1) Correct size of the stimuli on the screen with respect to the screen resolution and the physical dimensions of the screen and (2) Correct timing of the experimental trials and the recording of the time periods and (e.g., with a high-speed camera).
Windows 7, 8, 10
Visual Studio 2017 (Visual Basic)
To collect valid data for scientific purposes, users should ensure the following requirements and provide the following equipment. To download and use the software, users need a Windows PC and a screen with a minimal size of 15-inch. After the start of the software, users have to specify their screen size in the settings. The software is preconfigured for a 1280 × 1024 px (non-curved) screen. Furthermore, the reaction time of the screen should be considered for the precision of the presentation setup. and a chin rest is needed to ensure a constant distance between the eyes of the participants and the screen. The software is preconfigured a distance of 60 cm between eyes and screen. See  for recommendations regarding the position of stimuli presentation (visual angle) and presentation period in divided visual field experiments. Additionally, an input device (number pad or regular keyboard) is needed. Again, the delay of the keyboard should be considered for the precision of the reaction time for the lexical decision input as well as the intertap intervals. Furthermore, a low-stimulus environment (i.e., appropriate seating, quiet, well-tempered room) as well as controlled light condition, preferably dimmed room with a single light source on the ground, is essential for reliable participants performance.
Compiled for target framework .NET 4.6.1 (however other target frameworks are selectable).
CsvHelper (v2.16.3) from NuGet developed by Josh Close (Apache 2 and Microsoft Public Licence).
Behavioural experiments regarding the interaction of the motor and the language system include various language and motor task. The language tasks comprise lexical decision , , reading , naming , verbal fluency  and verbal memory tasks . Similarly, the complexity of the motor task highly various between the experiments including only one  or both hands . Furthermore, the task and stimuli language, the experimental setup as well as the used software differs between the experiments [4, 5, 6, 7, 8], . Open Source software allows researchers to reproduce results, as well as to modify only one or a few aspects of an experimental setting to produce comparable results. In the following, we will describe the reuse potential of our experiment by adapting, the trial lists, the settings as well as the source code.
The modifications of the trial lists allows users to modify the stimuli type and language.
Furthermore, the adaption of the settings (cf., Figure 5) at the beginning of the experiment, allows users to modify the software to their specific needs regarding timing of the presentation sequence, the number and location of the input keys and the labels of the instruction screens. The settings from the last usage remain stored as defaults for the next usage. Thus, it is easy to perform a sequence of experiments with identical settings.
The user can specify the input keys, for the tapping task as well as for the language task, in number and location. Thus, the software allows a large variety of tapping tasks, ranging from a simple one-finger tapping to a complex tapping sequences with up to five fingers. As DiViDu records the tapping sequence, the experimental setup allows not only the analysis of the tapping frequency, but also the analysis of errors in the tapping order.
For the language tasks, binary decisions, as well as decisions with more than two response keys can be performed. If the experimental design includes two groups that perform the tasks with different hands, the user can define the tapping hand at the beginning of the experiment.
To easily adapt the experiments for participants with different languages and different tasks, users can specify the labels for the start, break and final instruction as well as for the task instruction.
Moreover, the user can define the duration of the individual states in the presentation sequence (task instruction, fixation cross-presentation, stimulus presentation, response screen as well as the interstimulus interval).
The instructor can define the time between the start of the software and the beginning of the experiment, as well as the break duration. Alternatively, the instructor can choose an extended period and let the participant start the experiment, as well as initiate the continuation of the experiment after a break of desired length, by pressing the ESC key. Furthermore, the number of stimuli to be performed between two breaks can be defined accordingly to the entire number of stimuli and the complexity of the dual task setting.
The software structure allows additional experimental setups for a large variety of behavioural experiments. In the following, we present some possible adaption for future research.
Instead of a here performed lexical decision task, the software structure provides the opportunity for a large variety of language tasks in dual task designs. Tasks include reading tasks either silently or aloud. A divided visual field paradigm, due to the stimuli location as well as the short presentation period, limits the stimuli to words. Presenting the stimuli in a central location (excluding a divided visual field paradigm) allows reading tasks with phrases or sentences. Furthermore, semantic as well as phonological decision task can be implemented by adapting the input keys and the stimuli. Moreover, by implementing pictures instead of verbal stimuli, a naming task can be implemented. A more challenging adaption includes speech recording or audio output for verbal memory or speech comprehension tasks.
We here describe a dual task experiment with a complex one-handed tapping task. As mentioned above, multiple different one-hand tapping tasks can be implemented by adapting the settings at the beginning of the experiment. Furthermore, the adaption of the source code, as well as the usage of alternative input devices, allow a huge variety of different motor tasks. These include motor tasks with other body parts (i.e., feet). Language tasks that do not require key input (e.g., reading, verbal fluency, verbal memory tasks), allow motor task input with both hands or feet.
The implementation of pictures instead of word stimuli, can either be used for naming tasks , or non-verbal tasks. Thus, the experiment is not limited to investigating the interaction of the language and the motor system, but can also be used for other research fields.
Our software uses a divided visual field paradigm and thus presents all stimuli in the LVF and RVF. Minor adaption of the software allows the presentation of stimuli in both visual field or a central presentation (excluding divided visual field paradigm).
We here use a simple fixation cross to ensure the central fixation prior to the stimulus presentation in the LVF or RVF, and instruct the participants to fixate the fixation cross. The presentation of a letter or digit, which participants report afterwards, increases the central fixation rate, but can also interact with the following task .
In conclusion, our software DiViDu offers a variety of possibilities for neuropsychological research experiments. By adapting the settings as well as the source code, it allows users with and without programming skills to adapt the software to their specific needs. Furthermore, as freely available software, it helps researchers to replicate the experiments of other research groups as well as to investigate other fields, but comparable experimental setups.
Users are encouraged to report issues on GitHub and make pull request.
The authors have no competing interests to declare.
Pulvermüller, F 2013 “Semantic embodiment, disembodiment or misembodiment? In search of meaning in modules and neuron circuits.” Brain Lang., 127(1): 86–103. Oct. DOI: https://doi.org/10.1016/j.bandl.2013.05.015
Bourne, V 2006 “The divided visual field paradigm: Methodological considerations.” Laterality Asymmetries Body, Brain, Cogn., 11(4): 373–393. Jul. DOI: https://doi.org/10.1080/13576500600633982
Boulenger, V, Roy, A C, Paulignan, Y, Deprez, V, Jeannerod, M and Nazir, T A 2006 “Cross-talk between Language Processes and Overt Motor Behavior in the First 200 msec of Processing.” J. Cogn. Neurosci., 18(10): 1607–1615. Oct. DOI: https://doi.org/10.1162/jocn.2006.18.10.1607
Nazir, T A, Boulenger, V, Roy, A, Silber, B, Jeannerod, M and Paulignan, Y 2008 “Language-induced motor perturbations during the execution of a reaching movement.” Q. J. Exp. Psychol., 61(6): 933–943. Jun. DOI: https://doi.org/10.1080/17470210701625667
Postle, N, Ashton, R, McFarland, K and de Zubicaray, G I 2013 “No specific role for the manual motor system in processing the meanings of words related to the hand.” Front. Hum. Neurosci., 7(11). Jan. DOI: https://doi.org/10.3389/fnhum.2013.00011
Rodriguez, A D, McCabe, M L, Nocera, J R and Reilly, J 2012 “Concurrent Word Generation and Motor Performance: Further Evidence for Language-Motor Interaction.” PLoS One, 7(5): e37094. May. DOI: https://doi.org/10.1371/journal.pone.0037094
Shebani, Z and Pulvermüller, F 2013 “Moving the hands and feet specifically impairs working memory for arm- and leg-related action words.” Cortex, 49(1): 222–231. Jan. DOI: https://doi.org/10.1016/j.cortex.2011.10.005
Strozyk, J V, Dudschig, C and Kaup, B 2017 “Do I need to have my hands free to understand hand-related language? Investigating the functional relevance of experiential simulations.” Psychol. Res. DOI: https://doi.org/10.1007/s00426-017-0900-8
Hauk, O and Pulvermüller, F 2011 “The lateralization of motor cortex activation to action-words.” Front. Hum. Neurosci., 5(November): 149 Jan. DOI: https://doi.org/10.3389/fnhum.2011.00149
Willems, R M, Toni, I, Hagoort, P and Casasanto, D 2009 “Body-specific motor imagery of hand actions: neural evidence from right- and left-handers.” Front. Hum. Neurosci., 3(39): 1–9. DOI: https://doi.org/10.3389/neuro.09.039.2009
Fargier, R, Ménoret, M, Boulenger, V, Nazir, T A and Paulignan, Y 2012 “Grasp It Loudly! Supporting Actions with Semantically Congruent Spoken Action Words.” PLoS One, 7(1): p. e30663. Jan. DOI: https://doi.org/10.1371/journal.pone.0030663
Lovseth, K and Ann, R 2010 “Brain and Cognition Examining lateralized semantic access using pictures.” Brain Cogn., 72(2): 202–209. DOI: https://doi.org/10.1016/j.bandc.2009.08.016