Open naturalistic neural datasets

EEG/MEG (and fNIRS) recordings during natural speech, music and video

On this page, you can find an overview of publicly available datasets of neural recordings (mainly EEG and MEG) of participants exposed to natural, continuous stimuli: competing speech (to decode selective auditory attention), single-talker speech, music or video.

In case your publicly available dataset is not mentioned, please contact me.

Use the search box and filters to narrow the list, click a column header to sort, and click a dataset to see the full reference and experimental details.

ParadigmLinks
2012Competing speech333016.5EEG 128-channel BioSemi512 HzEnglish
Reference
A. J. Power, J. J. Foxe, E.-J. Forde, R. B. Reilly, and E. C. Lalor, “At what time is the cocktail party? A late locus of selective attention to natural speech,” European Journal of Neuroscience, vol. 35, pp. 1497–1503, 2012
Participants
33, young, normal hearing
Stimuli
English fictional stories

Competing speech

Amount of data
30 min (30 trials x 1 min) per participant
Sex of competing talkers
male-male
Location of competing talkers
90/-90 degrees
Acoustic conditions
dichotic
Comments
used in seminal O'Sullivan paper
LalorNatSpeech2015Single speech196019.0EEG 128-channel BioSemi512 HzEnglish
Reference
G. M. Di Liberto, J. A. O’Sullivan, and E. C. Lalor, “Low-Frequency Cortical Entrainment to Speech Reflects Phoneme-Level Processing,” Current Biology, vol. 25, no. 19, pp. 2457–2465, 2015 and M. P. Broderick, A. J. Anderson, G. M. Di Liberto, M. J. Crosse, and E. C. Lalor, “Electrophysiological Correlates of Semantic Dissimilarity Reflect the Comprehension of Natural, Narrative Speech,” Current Biology, vol. 28, no. 5, pp. 803–809.e3, 2018
Participants
19, young, normal-hearing
Stimuli
English fictional stories

Single speech

Amount of data
60 min (20 trials x 180 s) per participant
Sex of talker
male
LalorRevSpeech2015Single speech1072.312.1EEG 128-channel BioSemi512 HzEnglish
Reference
G. M. Di Liberto, J. A. O’Sullivan, and E. C. Lalor, “Low-Frequency Cortical Entrainment to Speech Reflects Phoneme-Level Processing,” Current Biology, vol. 25, no. 19, pp. 2457–2465, 2015
Participants
10, young, normal-hearing
Stimuli
English fictional stories, reversed

Single speech

Amount of data
72.3 min (28 trials x 155 s) per participant
Sex of talker
male
Comments
same stimuli as dataset above, but reversed
2016Competing speech760.7MEG 157-channel1000 HzEnglish
Reference
S. Akram, A. Presacco, J. Z. Simon, S. A. Shamma, and B. Babadi, “Robust decoding of selective auditory attention from MEG in a competing-speaker environment via state-space modeling,” NeuroImage, vol. 124, pp. 906–917, 2016
Participants
7, young, normal hearing
Stimuli
English fictional stories

Competing speech

Amount of data
6 min (2 conditions x 3 repetitions x 1 min) per participant
Sex of competing talkers
male-female
Location of competing talkers
90/-90 degrees
Acoustic conditions
dichotic
Comments
instructed attention switches 1 time per trial
KUL AAD2017Competing speech167219.2EEG 64-channel BioSemi8192 HzDutch
Reference
W. Biesmans, N. Das, T. Francart, and A. Bertrand, “Auditory-Inspired Speech Envelope Extraction Methods for Improved EEG-Based Auditory Attention Detection in a Cocktail Party Scenario,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 25, no. 5, pp. 402–412, 2017
Participants
16, young, normal hearing
Stimuli
Dutch short stories

Competing speech

Amount of data
72 min (8 trials x 6 min + 12 trials x 2 min) per participant
Sex of competing talkers
male-male
Location of competing talkers
90/-90 degrees
Acoustic conditions
dichotic and HRTF-filtered in anechoic room
DTU AAD2017Competing speech185015.0EEG 64-channel BioSemi512 HzDanish
Reference
S. A. Fuglsang, T. Dau, and J. Hjortkjær, “Noise-robust cortical tracking of attended speech in real-world acoustic scenes,” NeuroImage, vol. 156, pp. 435–444, 2017
Participants
18, young, normal hearing
Stimuli
Danish fictional stories

Competing speech

Amount of data
50 min (60 trials x 50 s) per participant
Sex of competing talkers
male-female
Location of competing talkers
60/-60 degrees
Acoustic conditions
HRTF-filtered in anechoic, mildly, and highly reverberant room
Comments
EOG available
2018Competing speechSingle speech2616 + 810.4MEG 157-channelEnglish
Reference
C. Brodbeck, L. E. Hong, and J. Z. Simon, “Rapid Transformation from Auditory to Linguistic Representations of Continuous Speech,” Current Biology, vol. 28, no. 24, pp. 3976–3983.e5, 2018
Participants
26, normal hearing
Stimuli
English audiobooks

Competing speech

Amount of data
16 min (4 trials x 4 repetitions x 1 min) per participant
Sex of competing talkers
male-female
Location of competing talkers
NA
Acoustic conditions
NA

Single speech

Amount of data
8 min (8 trials x 1 min) per participant
Sex of talker
male and female
MOUS2018Single speech1028.414.3MEG 275-channel1200 HzDutch
Reference
N. H. L. Lam, A. Hultén, P. Hagoort, and J.-M. Schoffelen, "Robust neuronal oscillatory entrainment to speech displays individual variation in lateralisation," Language, Cognition and Neuroscience, no. 33, vol. 8, pp. 943-954, 2018 + various other papers
Participants
102, young, healthy
Stimuli
Dutch sentences

Single speech

Amount of data
around 8.4 min (120 sentences x 2.8-6 s) per participant
Sex of talker
female
Comments
fMRI also available. Also resting-state and reading available
2019Single speech4912.410.1EEG 61-channel actiCAP500 HzEnglish
Reference
J. R. Brennan, and J. T. Hale, "Hierarchical structure guides rapid linguistic predictions during naturalistic listening," PLoS ONE, vol. 14, no. 1, e0207741, 2019
Participants
49, young
Stimuli
English audiobook

Single speech

Amount of data
12.4 min per participant
Sex of talker
female
Comments
no mention of medical conditions of participants
MAD-EEG2019Music8314.1EEG 20-channel B-Alert X24 headset256 Hz
Reference
G. Cantisani, G. Trégoat, S. Essid, G. Richard, "MAD-EEG: an EEG dataset for decoding auditory attention to a target instrument in polyphonic music," Speech, Music and Mind (SMM), Satellite Workshop of Interspeech 2019, Vienna, Austria, 2019
Participants
8, young, normal hearing, non-professional musicians
Stimuli
Polyphonic music mixture (14 solos, 40 duets, 24 trios)

Music

Amount of data
30-32 min (78 stimuli x 4 repetitions x 6 s) per participant
Instruments
various instruments
Location of sources
NA
Acoustic conditions
Speakers at 45/-45 degrees, convex weighting of instruments in the mixture
Comments
EOG, EMG, ECG, head motion acceleration available / single instrument available
2019Competing speech18206.0EEG 64-channel actiCAP1000 HzEnglish
Reference
O. Etard, M. Kegler, C. Braiman, A.E. Forte, and T. Reichenbach, “Decoding of selective attention to continuous speech from the human auditory brainstem response,” NeuroImage, vol. 200, pp. 1-11, 2019
Participants
18, young, normal hearing
Stimuli
English audiobooks

Competing speech

Amount of data
20 min (2 trials x 4 parts x 2.5 min) per participant
Sex of competing talkers
male-female
Location of competing talkers
90/-90 degrees
Acoustic conditions
dichotic
2019Single speech12408.0EEG 64-channel actiCAP1000 HzEnglish
Reference
O. Etard, and T. Reichenbach, "Neural speech tracking in the theta and in the delta frequency band differentially encode clarity and comprehension of speech in noise," Journal of Neuroscience, vol. 39, no. 29, pp. 5750-5759, 2019
Participants
12, young, normal-hearing
Stimuli
English audiobooks

Single speech

Amount of data
40 min (4 noise levels x 4 parts x 2.5 min) per participant
Sex of talker
male and female
Comments
4 levels of babble noise. Also EEG data of participants listening to Dutch available (0% speech comprehension)
2019Competing speech54.50.4MEG 157-channel1000 HzEnglish
Reference
A. Presacco, S. Miran, B. Babadi, and J. Z. Simon, “Real-Time Tracking of Magnetoencephalographic Neuromarkers during a Dynamic Attention-Switching Task,” in Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4148–4151, 2019
Participants
5, young, normal hearing
Stimuli
English fictional stories

Competing speech

Amount of data
4.5 min (3 trials x 90 s) per participant
Sex of competing talkers
male-female
Location of competing talkers
90/-90 degrees
Acoustic conditions
dichotic
Comments
at-will attention switches 1-3 times per trial
diliBach2020Music207525.0EEG 64-channel BioSemi512 Hz
Reference
G. M. Di Liberto, C. Pelofi, R. Bianco, P. Patel, A. D. Mehta, J. L. Herrero, A. de Cheveigné, S. Shamma, and N. Mesgarani, "Cortical encoding of melodic expectations in human temporal cortex," eLife, vol. 9, e51784, 2020
Participants
20, 10 musicians (expert pianists) + 10 non-musicians
Stimuli
Monophonic Bach melodies (piano, synthesized from MIDI)

Music

Amount of data
75 min (10 pieces x 150 s x 3 repetitions) per participant
Instruments
piano (monophonic)
2020Competing speechSingle speech4426.7 + 13.329.3EEG 64-channel BioSemi512 HzDanish
Reference
S. A. Fuglsang, J. Märcher-Rørsted, T. Dau, J. Hjortkjær, "Effects of Sensorineural Hearing Loss on Cortical Synchronization to Competing Speech during Selective Attention," Journal of Neuroscience, vol. 40, no. 12, pp. 2562-2572, 2020
Participants
44, 22 hearing impaired + 22 normal hearing
Stimuli
Danish audiobooks

Competing speech

Amount of data
26.7 min (32 trials x 50 s) per participant
Sex of competing talkers
male-female
Location of competing talkers
90/-90 degrees
Acoustic conditions
HRTF-filtered
Comments
single-talker, ERPs, EFRs, resting-state also available / in-ear EEG for 19 of 44 participants / EOG available

Single speech

Amount of data
13.3 min (16 trials x 50 s) per participant
Sex of talker
male and female
Comments
dual-talker, ERPs, EFRs, resting-state also available / in-ear EEG for 19 of 44 participants
2020Single speech17257.1EEG 32-channel BioSemi2048 HzEnglish
Reference
F. J. Vanheusden, M. Kegler, K. Ireland, C. Georga, D. M. Simpson, T. Reichenbach, and S. L. Bell, “Hearing Aids Do Not Alter Cortical Entrainment to Speech at Audible Levels in Mild-to-Moderately Hearing-Impaired Subjects,” Frontiers in Human Neuroscience, vol. 14, no. 109, 2020
Participants
17, older, hearing impaired, hearing aid users
Stimuli
English audiobook

Single speech

Amount of data
25 min (8 trials x approx. 3 min) per participant
Sex of talker
female
Comments
trials aided and unaided by hearing aid
2020Single speech13408.7EEG 64-channel actiCAP1000 HzEnglish
Reference
H. Weissbart, K. D. Kandylaki, and T. Reichenbach, “Cortical Tracking of Surprisal during Continuous Speech Comprehension,” Journal of Cognitive Neuroscience, vol. 32, no. 1, pp. 155–166, 2020
Participants
13, young, normal-hearing
Stimuli
English short stories

Single speech

Amount of data
40 min (15 trials x approx. 2.6 min) per participant
Sex of talker
male
2021Music2120.77.2EEG 64-channel64 Hz
Reference
G. Marion, G. M. Di Liberto, and S. A. Shamma, "The Music of Silence: Part I: Responses to Musical Imagery Encode Melodic Expectations and Acoustics," Journal of Neuroscience, vol. 41, no. 35, pp. 7435-7448, 2021
Participants
21, professional musicians
Stimuli
Bach chorale melodies (4), synthesized with a Fender Rhodes sound

Music

Amount of data
20.7 min listening (44 trials x approx. 28 s) + the same amount of imagery per participant
Instruments
Fender Rhodes (monophonic)
Comments
Also a musical imagery condition (44 trials), not counted in the totals. Shared EEG is downsampled to 64 Hz
2021Competing speech302412.0EEG 255-channel SynAmps RT1000 HzDutch
Reference
A. Mundanad Narayanan, R. Zink, and A. Bertrand, “EEG miniaturization limits for stimulus decoding with EEG sensor networks,” Journal of Neural Engineering, vol. 18, no. 5, p. 056042, 2021
Participants
30, young, normal hearing
Stimuli
Dutch fictional stories

Competing speech

Amount of data
24 min (4 trials x 6 min) per participant
Sex of competing talkers
male-male
Location of competing talkers
90/-90 degrees
Acoustic conditions
HRTF-filtered
2021Single speech38148.293.9EEG 2-channel (FCz referenced to both earlobes), BrainVision EP-Preamp + actiCHamp10000 HzEnglish
Reference
M. J. Polonenko and R. K. Maddox, "Exposing distinct subcortical components of the auditory brainstem response evoked by continuous naturalistic speech," eLife, vol. 10, e62329, 2021
Participants
38, young (18-32 years), normal hearing
Stimuli
English audiobooks, re-synthesized as "peaky" speech (and unaltered speech)

Single speech

Amount of data
128 min per experiment (120 x 64 s epochs); 3 experiments with 22, 11 and 11 participants, 6 participants took part in two experiments per participant
Sex of talker
male and female
Comments
Designed for auditory brainstem responses to speech; passive listening (no task), diotic and dichotic presentation via insert earphones
2021Competing speech203010.0EEG 24-channel EasyCap GmbH/SMARTING250 HzGerman
Reference
L. Straetmans, B. Holtze, S. Debener, M. Jaeger, and B. Mirkovic, “Neural tracking to go: auditory attention decoding and saliency detection with mobile EEG,” Journal of Neural Engineering, vol. 18, no. 6, p. 066054, 2021
Participants
20, young, normal hearing
Stimuli
German audiobooks + natural salient events

Competing speech

Amount of data
30 min (6 trials x 5 min) per participant
Sex of competing talkers
male-male
Location of competing talkers
45/-45 degrees
Acoustic conditions
HRTF-filtered, recorded in public cafeteria without other people
Comments
3 trials during walking, 3 trials sitting / salient environmental sounds added
2022Music1722.46.3EEG 4-channel Ag/AgCl electrodes (Multitrode, BrainProducts)5000 Hz
Reference
O. Etard, R. B. Messaoud, G. Gaugain, and T. Reichenbach, “No Evidence of Attentional Modulation of the Neural Response to the Temporal Fine Structure of Continuous Musical Pieces,” Journal of Cognitive Neuroscience, vol. 34, no. 3, pp. 411-424, 2022
Participants
17, young, normal hearing
Stimuli
Music (Bach's Two-Part Inventions)

Music

Amount of data
22.4 min (7 stimuli of 11.2 min in total x 2 repetitions) per participant
Instruments
piano-guitar
Location of sources
NA
Acoustic conditions
dichotic
Comments
single instrument available
MEG-MASC2022Single speech2712054.0MEG 208-channel1000 HzEnglish
Reference
L. Gwilliams, J.-R. King, A. Marantz, and D. Poeppel, "Neural dynamics of phoneme sequences reveal position-invariant code for content and order," Nature Communications, 13, 6606, 2022
Participants
27, young, normal-hearing
Stimuli
English fictional stories

Single speech

Amount of data
120 min (2 sessions x 1 hour) per participant
SparrKULee2023Single speech85140198.3EEG 64-channel BioSemi8192 HzDutch
Reference
L. Bollens, B. Accou, H. Van hamme, and T. Francart, "SparrKULee: A Speech-Evoked Auditory Response Repository from KU Leuven, Containing the EEG of 85 Participants", Data, vol. 9, no. 8, 94, 2024
Participants
85, young, normal-hearing
Stimuli
Flemish audiobooks and podcasts

Single speech

Amount of data
130-150 min (8 -10 trials x 15 min) per participant
Sex of talker
male and female
2023Single speech137516.2EEG 64-channel BioSemi1024 HzEnglish
Reference
I. Calderón De Palma, L. S. Lopez, and A. Lopez Valdes, "Effects of spectral and temporal modulation degradation on intelligibility and cortical tracking of speech signals," Proc. Interspeech 2023, Dublin, Ireland, pp. 5192-5196, 2023
Participants
13, young (20-30 years), normal hearing
Stimuli
English audiobook ("The Old Man and the Sea"), clean and spectro-temporally degraded

Single speech

Amount of data
75 min (25 trials x 3 min) per participant
Sex of talker
male
Comments
5 conditions: clean speech, 2 spectral and 2 temporal modulation degradations. Data in CND format
2023Single speech6735.940.1EEG 64-channel (infants) or 128-channel (adults) EGI Geodesic Sensor Net1000 HzEnglish
Reference
G. M. Di Liberto, A. Attaheri, G. Cantisani, R. B. Reilly, Á. Ní Choisdealbha, S. Rocha, P. Brusini, and U. Goswami, "Emergence of the cortical encoding of phonetic features in the first year of life," Nature Communications, vol. 14, 2023
Participants
67, 50 infants (each recorded at 4, 7 and 11 months) + 17 adults
Stimuli
English nursery rhymes (sung or chanted, audio-visual), infant-directed speech

Single speech

Amount of data
infants: at least 13.7 min per session, 3 sessions; adults: 20.6 min (18 nursery rhymes x 3 repetitions) per participant
Sex of talker
female
Comments
Longitudinal infant cohort. Preprocessed EEG in CND format; the raw recordings are not shared
NJU AAD2023Competing speech216422.4EEG 32-channel EMOTIV Epoc Flex Saline128 HzMandarin
Reference
Y. Zhang, H. Ruan, Z. Yuan, H. Du, X. Gao, and J. Lu, "A Learnable Spatial Mapping for Decoding the Directional Focus of Auditory Attention Using EEG," 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, pp. 1-5, 2023 and Y. Zhang, J. Lu, F. Chen, H. Du, X. Gao, and Z. Lin, "Multi-Class Decoding of Attended Speaker Direction Using Electroencephalogram and Audio Spatial Spectrum," IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 33, 2025
Participants
21, normal hearing
Stimuli
Chinese news programs

Competing speech

Amount of data
64 min (32 trials x 2 min) per participant
Sex of competing talkers
male-female
Location of competing talkers
random pairs from +-135/120/90/60/45/30/15 degrees
Acoustic conditions
loudspeaker array
Comments
per trial, random pairs of the competing speaker directions are taken. EEG sampled at 1024 Hz internally, down-sampled to 128 Hz by the headset
ASA2024Competing speech20248.0EEG 64-channel Easycap500 HzMandarin
Reference
Z. Lin, T. He, S. Cai, and H. Li, "ASA: An Auditory Spatial Attention Dataset with Multiple Speaking Locations," Interspeech 2024, Kos, Greece, 2024
Participants
20, normal hearing
Stimuli
Mandarin stories

Competing speech

Amount of data
24 min (20 trials x 1-1.5 min) per participant
Sex of competing talkers
male-female
Location of competing talkers
90/-90, -60/60, -45/45, -30/30, -5/5 degrees
Acoustic conditions
HRTF-filtered through headphones
2024Single speech5118.515.7EEG 32-channel actiCHamp (Brain Products)Russian
Reference
A. Rogachev and O. Sysoeva, "Neural tracking of natural speech in children in relation to their receptive speech abilities," Cognitive Systems Research, vol. 86, 2024
Participants
51, children (3-8 years)
Stimuli
Russian children's stories (with video)

Single speech

Amount of data
18.5 min (4 stories of 3-5.6 min) per participant
Sex of talker
female
Comments
Preschool Language Scales (PLS-5) receptive speech scores included. Data in CND format
AV-GC-AAD2024Competing speech138017.3EEG 64-channel BioSemi8192 HzDutch
Reference
I. Rotaru, S. Geirnaert, N. Heintz, I. Van de Ryck, A. Bertrand, and T. Francart, "What are we really decoding? Unveiling biases in EEG-based decoding of the spatial focus of auditory attention," Journal of Neural Engineering, vol. 21, no. 1, 016017, 2024
Participants
13, young, normal hearing
Stimuli
Dutch science-outreach podcasts

Competing speech

Amount of data
80 min (2 blocks x 4 conditions x 10 min) per participant
Sex of competing talkers
male-male
Location of competing talkers
90/-90 degrees
Acoustic conditions
HRTF-filtered in anechoic room
Comments
Per condition, a different audio-visual condition is used (moving video, moving target noise, no visuals, static video). EOG also available. Per trial (=condition), there is one switch in attention after 5 minutes
2024Competing speech184012.0EEG 2-channel in-ear (reference FT7)256 HzEnglish
Reference
M. Thornton, D. Mandic, and T. Reichenbach, "Comparison of Linear and Nonlinear Methods for Decoding Selective Attention to Speech From Ear-EEG Recordings," IEEE Access, vol. 13, pp. 127614-127625, 2025
Participants
18, young, normal hearing
Stimuli
English audiobooks

Competing speech

Amount of data
40 min (16 trials x 150 s) per participant
Sex of competing talkers
male-female
Location of competing talkers
NA
Acoustic conditions
diotic via headphones
2024Competing speech164010.7EEG 64-channel NeuSen Wireless scalp + 20-channel cEEGrid (TMSi SAGA)1000 Hz (scalp), 500 Hz (cEEGrid)Mandarin
Reference
Y. Yan, X. Xu, H. Zhu, P. Tian, Z. Ge, X. Wu, J. Chen, "Auditory Attention Decoding in Four-Talker Environment with EEG,". In Proceedings of Interspeech 2024, Kos, Greece, pp. 432-436, 2024 and H. Zhu et al., "Using Ear-EEG to Decode Auditory Attention in Multiple-speaker Environment," 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Hyderabad, India, pp. 1-5, 2025
Participants
16, young, normal hearing
Stimuli
Chinese stories

Competing speech

Amount of data
40 min (40 trials x 60 s) per participant
Sex of competing talkers
male-female (4 speakers)
Location of competing talkers
-90/-30/+30/+90
Acoustic conditions
4 loudspeakers in anechoic room
Comments
4-competing speaker paradigm; scalp and around-ear EEG (cEEGrid) recorded simultaneously; original stimuli available upon request (2301111611@stu.pku.edu.cn), only envelopes available
2024Video1974.423.6EEG 64-channel BioSemi + 4 EOG2048 Hz
Reference
Y. Yao, A. Stebner, T. Tuytelaars, S. Geirnaert, and A. Bertrand, "Identifying temporal correlations between natural single-shot videos and EEG signals," Journal of Neural Engineering, vol. 21, no. 1, 016018, 2024
Participants
19, young, normal or corrected-to-normal vision
Stimuli
Muted natural single-shot videos (YouTube) + a Mr. Bean episode

Video

Amount of data
63 min (13 single-shot videos), plus 24 min (Mr. Bean) for 9 of the 19 participants per participant
Comments
Passive viewing of muted videos
Ear-SAAD2025Competing speech156015.0EEG 29-channel scalp + 3-channel EOG + 19-channel around-ear EEG + 12-channel in-ear EEG1000 HzDanish
Reference
S. Geirnaert, S. L. Kappel, and P. Kidmose, "A direct comparison of simultaneously recorded scalp, around-ear and in-ear EEG for neural selective auditory attention decoding to speech," Scientific Reports, vol. 15, 41655, 2025.
Participants
15, young, normal hearing
Stimuli
Danish popularizing lectures

Competing speech

Amount of data
60 min (6 trials x 10 min) per participant
Sex of competing talkers
male-male
Location of competing talkers
60/-60 degrees
Acoustic conditions
HRTF-filtered
Comments
All EEGs were simultaneously recorded. Video of attended speaker was present in half of the trials
EventAAD2025Competing speech24208.0EEG 32-channel scalp + 2 x 6-channel in-ear-EEG (TMSi Mobita)1000 HzDanish
Reference
N. D. T. Nguyen, K. Mikkelsen, and P. Kidmose, "Cognitive component of auditory attention to natural speech events," Frontiers in Human Neuroscience, vol. 18, 1460139, 2024 and N. D. T. Nguyen, H. Phan, S. Geirnaert, K. Mikkelsen, and P. Kidmose, "AADNet: An End-to-End Deep Learning Model for Auditory Attention Decoding," IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 33, pp. 2695-2706, 2025
Participants
24, normal hearing
Stimuli
Danish audiobook and radio news excerpts, synthesized (Google Text-to-Speech)

Competing speech

Amount of data
20 min (paradigm 4, 40 trials x approx. 30 s) per participant
Sex of competing talkers
male and female (randomly selected synthetic voices)
Location of competing talkers
60/-60 degrees
Acoustic conditions
loudspeakers at 1 m in listening room (reverberation time 0.4 s)
Comments
EventAAD dataset; scalp and ear-EEG recorded simultaneously. Also three event-based paradigms: single-talker word oddball, competing word streams, and competing stories with target words
2025Single speech504134.2EEG 64-channel actiCAP/BrainAmp (experiment 1) or BioSemi (experiment 2)1000 Hz (experiment 1), 1024 Hz (experiment 2)English
Reference
G. Piazza, S. Carta, E. Y. J. Ip, J. Pérez-Navarro, M. Kalashnikova, C. D. Martin, and G. M. Di Liberto, "Are you talking to me? How the choice of speech register impacts listeners' hierarchical encoding of speech," Imaging Neuroscience, vol. 3, imag_a_00539, 2025
Participants
50, young; 25 L2 learners of English (L1 Spanish) + 25 native English speakers
Stimuli
English stories in three speech registers (native-directed, slow native-directed, L2 accommodation)

Single speech

Amount of data
approx. 41 min (3 stories of 11-15 min) per participant
Sex of talker
female
LPP multi-talker2025Competing speechSingle speech2520 + 2016.7EEG 64-channel actiCAP500 HzMandarin
Reference
Q. Wang, Q. Zhou, Z. Ma, N. Wang, T. Zhang, Y. Fu, and J. Li, "Le Petit Prince (LPP) multi-talker: Naturalistic 7 T fMRI and EEG dataset," Scientific Data, vol. 12, no. 829, 2025
Participants
25, young
Stimuli
Mandarin audiobook ("The Little Prince")

Competing speech

Amount of data
20 min (2 trials x 10 min) per participant
Sex of competing talkers
male-female (synthesized)
Location of competing talkers
NA
Acoustic conditions
insert earphones
Comments
fixation on crosshair; also fMRI available and single-talker data

Single speech

Amount of data
20 min (2 trials x 10 min) per participant
Sex of talker
male and female (synthesized)
Comments
also dual-speaker data available
2025Music318041.3EEG 24-channel mBrainTrain Smarting250 Hz
Reference
M. M. Winchester, K. Reynolds, C. Nebo, I. C. Scott, and G. M. Di Liberto, "Where is the melody? Spontaneous attention orchestrates melody formation during polyphonic music listening," eLife (reviewed preprint), 2025
Participants
31, young (19-30 years), 8 with musical training
Stimuli
Polyphonic classical piano music (32 MIDI pieces; original, pitch-inverted and monophonic versions)

Music

Amount of data
approx. 80 min (32 pieces x approx. 150 s) per participant
Instruments
piano (polyphonic, two voices)
Comments
Uninstructed (spontaneous) attention during polyphonic music listening, followed by a melody identification task. Data in CND format
2025Competing speech164010.7EEG 64-channel NeuSen Wireless scalp + 20-channel cEEGrid (TMSi SAGA)1000 Hz (scalp), 500 Hz (cEEGrid)Mandarin
Reference
Y. Yan, X. Xu, H. Zhu, S. Li, B. Wang, X. Wu, and J. Chen, "Overestimated performance of auditory attention decoding caused by experimental design in EEG recordings," in Proceedings of Interspeech 2025, Rotterdam, The Netherlands, pp. 1053-1057, 2025
Participants
16, young, normal hearing
Stimuli
Chinese stories

Competing speech

Amount of data
40 min (40 trials x 60 s) per participant
Sex of competing talkers
male-female (4 speakers)
Location of competing talkers
-90/-30/+30/+90
Acoustic conditions
4 loudspeakers in anechoic room
Comments
Intentional non-block design was used. Same stimuli as Yan et al. (Interspeech 2024).
2025Video196620.9EEG 64-channel BioSemi + 4 EOG + eye tracking (Pupil Labs Neon)2048 Hz
Reference
Y. Yao, W. De Swaef, S. Geirnaert, and A. Bertrand, "EEG-Based Decoding of Selective Visual Attention in Superimposed Videos," IEEE Journal of Biomedical and Health Informatics, vol. 29, no. 10, pp. 7248-7261, 2025
Participants
19, young, normal or corrected-to-normal vision
Stimuli
Natural videos (single objects and two superimposed objects), no audio

Video

Amount of data
approx. 66 min (28 min single-object + 38 min superimposed-object videos) per participant
Comments
Selective visual attention to one of two superimposed objects (each video watched with attention to different objects); eye-tracking data included
NJU cEEGrid AAD2025Competing speech9831.551.5EEG 16-channel cEEGrid (OpenBCI CytonDaisy)125 HzMandarin
Reference
Y. Zhang, Z. Song, J. Lu, F. Chen, and Z. Lin, "Auditory Attention Decoding from Ear-EEG Signals: A Dataset with Dynamic Attention Switching and Rigorous Cross-Validation," arXiv, 2025 (arXiv:2510.19174)
Participants
98, students, self-reported normal hearing
Stimuli
Mandarin news programs (CCTV)

Competing speech

Amount of data
31.5 min (63 trials x 30 s) per participant
Sex of competing talkers
female-male-male (3 speakers)
Location of competing talkers
3 out of 5 directions (0, +-60, +-120 degrees)
Acoustic conditions
loudspeaker array
Comments
3 competing speakers; cued attention switches within trials (7 task types). cEEGrids around both ears
ChineseEEG-22026Single speech816221.6EEG 128-channel EGI HydroCel Geodesic Sensor Net1000 HzMandarin
Reference
S. Chen, B. Li, C. He, D. Li, M. Wu, X. Shen, S. Wang, X. Wei, X. Wang, H. Wu, and Q. Liu, "An EEG Dataset for Multimodal Semantic Alignment and Neural Decoding during Reading and Listening," Scientific Data, vol. 13, 148, 2026
Participants
8, young (18-25 years), normal hearing
Stimuli
Mandarin novels ("The Little Prince", "Garnett Dream"), read aloud by other participants

Single speech

Amount of data
approx. 2.7 hours (21.6 hours in total over 8 participants, 4-5 runs each) per participant
Sex of talker
male or female (4 participants each)
Comments
ChineseEEG-2. Also EEG of 4 other participants reading the same texts aloud (10.7 hours, recorded at 250 Hz)
MAESTRO2026Competing speech1652.514.0EEG 32-channel ANT Neuro + eye tracking (Tobii Pro Glasses 3), egocentric video, head IMU500 HzEnglish
Reference
K. M. N. Hassan, A. Alavi, and D. S. Williamson, "MAESTRO: a Multimodal Auditory-attention Egocentric Speech-TRacking Open corpus," arXiv, 2026 (arXiv:2609.31898)
Participants
16, young (18-30 years)
Stimuli
English audiobooks (LibriSpeech) + domestic background noise (CHiME-Home)

Competing speech

Amount of data
52.5 min (105 trials x 30 s) per participant
Sex of competing talkers
male and female (4 talkers per trial, 420 different speakers)
Location of competing talkers
4 talkers at +-22.5 and +-67.5 degrees, 2 noise sources at +-135 degrees
Acoustic conditions
loudspeakers in a quiet room, attended-talker SNR 0-18 dB
Comments
4 competing talkers + background noise; participants could move their eyes and head freely. Simultaneous eye gaze, pupillometry, egocentric video and head motion.
KUL-AAD-NFB2026Competing speech116411.7EEG 64-channel BioSemi1024 HzDutch
Reference
I. Rotaru, S. Geirnaert, N. Heintz, A. Bertrand, and T. Francart, "When feedback backfires: investigating neurofeedback effects in a closed-loop auditory attention decoding paradigm," bioRxiv, 2026
Participants
11, normal hearing (19-66 years)
Stimuli
Flemish science-outreach podcasts

Competing speech

Amount of data
56-64 min (8 trials x 8 min) + 20 min calibration for some participants per participant
Sex of competing talkers
male-male
Location of competing talkers
+-14 degrees (loudspeakers at 1.4 m)
Acoustic conditions
loudspeakers
Comments
Closed-loop AAD with neurofeedback: open-loop, visual feedback, auditory feedback and pseudo-feedback conditions; cued attention switches every 2 or 4 min. 11 of the 19 participants are shared; preprocessed EEG (64 Hz) also included
AASD2026Competing speech186018.0EEG 64-channel (Neuroscan)500 HzMandarin
Reference
X. Wang, Y. Ding, Y. Ban, L. Wang, and F. Chen, "An Open Non-Invasive EEG Dataset for Spontaneous Auditory Attention Switch Decoding," Scientific Data, vol. 13, 883, 2026
Participants
18, young (18-27 years), normal hearing
Stimuli
Mandarin narrative speech (AISHELL corpus)

Competing speech

Amount of data
60 min (60 trials x 60 s) per participant
Sex of competing talkers
male-female
Location of competing talkers
90/-90 degrees
Acoustic conditions
HRTF-filtered via headphones
Comments
Spontaneous (self-initiated) attention switches, marked with button presses; passive-listening control block also available
2026Single speech8608.0fNIRS Artinis Brite (16 long- + 2 short-separation channels per device)100 HzEnglish
Reference
J. Wilroth, N. S. Silva, A. Tafakkor, B. de Avo Mesquita, E. Y. J. Ip, B. Lau, J. Hannah, and G. M. Di Liberto, "Investigating neural speech processing with functional near infrared spectroscopy: considerations for temporal response functions," bioRxiv, 2026
Participants
8, adults (25-43 years)
Stimuli
English podcast dialogues (adult-adult and adult-child)

Single speech

Amount of data
approx. 60 min (28 dialogues) per participant
Comments
fNIRS (no EEG); raw fNIRS and CND-formatted data