Effects of subliminal emotional facial expressions on language comprehension as revealed by event-related brain potentials
Loading...
Official URL
Full text at PDC
Publication date
2025
Advisors (or tutors)
Editors
Journal Title
Journal ISSN
Volume Title
Publisher
Nature Research
Citations
Exportar
Citation
Rubianes, M., Jiménez-Ortega, L., Muñoz, F., Drijvers, L., Almeida-Rivera, T., Sánchez-García, J., Fondevila, S., Casado, P., & Martín-Loeches, M. (2025). Effects of subliminal emotional facial expressions on language comprehension as revealed by event-related brain potentials. Scientific Reports, 15(1). https://doi.org/10.1038/S41598-025-06037-2
Abstract
Emotional facial expressions often take place during communicative face-to-face interactions. Yet little is known as to whether natural spoken processing can be modulated by emotional expressions during online processing. Furthermore, the functional independence of syntactic processing from other cognitive and affective processes remains a long-standing debate in the literature. To address these issues, this study investigated the influence of masked emotional facial expressions on syntactic speech processing. Participants listened to sentences that could contain morphosyntactic anomalies while a masked emotional expression was presented for 16 ms (i.e., subliminally) just preceding the critical word. A larger Left Anterior Negativity (LAN) amplitude was observed for both emotional faces (i.e., happy and angry) compared to neutral ones. Moreover, a larger LAN amplitude was found for angry faces than for happy faces. Finally, a reduced P600 amplitude was observed only for angry faces when compared to neutral faces. Collectively, the results presented here indicate that first-pass syntactic parsing is influenced by emotional visual stimuli even under masked conditions and that this effect extends also to later linguistic processes. These findings constitute evidence in favor of an interactive view of language processing as integrated within a complex and integrated system for human communication.
Description
This study was supported by \u201CMinisterio de Ciencia, Investigaci\u00F3n y Universidades, Programa Estatal de Investigaci\u00F3n Cient\u00EDfica y T\u00E9cnica de Excelencia, Spain (Grant number: PSI2017-82357-P)\u201D, \u201CMinisterio de Ciencia e Innovaci\u00F3n (Grant numbers: PID2021-123421NB-I00; PID2021-124227NB-I00), and by \u201CMinisterio de Ciencia, Innovaci\u00F3n y Universidades, (Grant number: FPU18/02223)\u201D.
Referencias bibliográficas:
• D.J. Chwilla Context effects in language comprehension: The role of emotional state and attention on semantic and syntactic processing Front. Hum. Neurosci. 16 1014547 10.3389/fnhum.2022.1014547
• Hinojosa, J. A, Moreno, E. & Ferré., P. Affective neurolinguistics: Towards a framework for reconciling language and emotion. Language, Cognition and Neuroscience, 35 (7), 813–839. https://doi.org/10.1080/23273798.2019.1620957 (2019).
• A.B. Satpute K.A. Lindquist At the neural intersection between language and emotion Affective Sci. 2 2 207 220 10.1007/s42761-021-00032-2
• K.A. Lindquist L.F. Barrett A functional architecture of the human brain: emerging insights from the science of emotion Trends Cogn. Sci. 16 11 533 540 10.1016/j.tics.2012.09.005
• L. Pessoa L. Medina P.R. Hof E. Desfilis Neural architecture of the vertebrate brain: implications for the interaction between emotion and cognition Neurosci. Biobehav. Rev. 107 296 312 10.1016/j.neubiorev.2019.09.021
• L. Drijvers J. Holler The multimodal facilitation effect in human communication Psychon. Bull. Rev. 30 2 792 801 10.3758/s13423-022-02178-x
• A.D. Friederici The brain basis of language processing: from structure to function Physiol. Rev. 91 4 1357 1392 10.1152/physrev.00006.2011
• Friederici, A. D. Language in Our Brain: The Origins of a Uniquely Human Capacity. MIT Press. (2017).
• Urbach, T. P, & Kutas, M. Cognitive Electrophysiology of Language. In Shirley-AnnS. Rueschemeyer, and & M. Gareth Gaskell (Eds.), The Oxford Handbook of Psycholinguistics, (2nd ed.). Oxford Academic. https://doi.org/10.1093/oxfordhb/9780198786825.013.40 (2018)
• L. Jiménez-Ortega J. Espuny P.H. de Tejada C. Vargas-Rivero M. Martín-Loeches Subliminal Emotional Words Impact Syntactic Processing: Evidence from Performance and Event-Related Brain Potentials Front. Hum. Neurosci. 11 192 10.3389/fnhum.2017.00192
• M. Martín-Loeches F. Muñoz P. Casado A. Melcón C. Fernández-Frías Are the anterior negativities to grammatical violations indexing working memory? Psychophysiology 42 5 508 519 10.1111/j.1469-8986.2005.00308.x
• H.H. Kolk D.J. Chwilla M. van Herten P.J. Oor Structure and limited capacity in verbal working memory: a study with event-related potentials Brain Lang. 85 1 1 36 10.1016/s0093-934x(02)00548-5
• I. Bornkessel-Schlesewsky M. Schlesewsky Toward a Neurobiologically Plausible Model of Language-Related Negative Event-Related Potentials Front. Psychol. 10 298 10.3389/fpsyg.2019.00298
• D. Tanner J.G. Van Hell ERPs reveal individual differences in morphosyntactic processing Neuropsychologia 56 289 301 10.1016/j.neuropsychologia.2014.02.002
• M. Maran A.D. Friederici E. Zaccarella Syntax through the looking glass: A review on two-word linguistic processing across behavioral, neuroimaging and neurostimulation studies Neurosci. Biobehav. Rev. 142 10.1016/j.neubiorev.2022.104881 104881
• M. Leckey K.D. Federmeier The P3b and P600(s): Positive contributions to language comprehension Psychophysiology 57 7 10.1111/psyp.13351 e13351
• C. Aurnhammer F. Delogu H. Brouwer M.W. Crocker The P600 as a continuous index of integration effort Psychophysiology 10.1111/psyp.14302
• J. Sassenhagen C.J. Fiebach Finding the P3 in the P600: Decoding shared neural mechanisms of responses to syntactic violations and oddball targets Neuroimage 200 425 436 10.1016/j.neuroimage.2019.06.048
• J.V. Haxby E.A. Hoffman M.I. Gobbini The distributed human neural system for face perception Trends Cogn. Sci. 4 6 223 233 1:STN:280:DC%2BC2sbitF2nsA%3D%3D 10.1016/s1364-6613(00)01482-0
• M. Bernstein Y. Erez I. Blank G. Yovel An Integrated Neural Framework for Dynamic and Static Face Processing Sci. Rep. 8 1 7036 2018NatSR..8.7036B 1:CAS:528:DC%2BC1cXhslyjsL3M 10.1038/s41598-018-25405-9
• B. Deen R. Saxe N. Kanwisher Processing communicative facial and vocal cues in the superior temporal sulcus Neuroimage 10.1016/j.neuroimage.2020.117191
• A.W. Young S. Frühholz S.R. Schweinberger Face and Voice Perception: Understanding Commonalities and Differences Trends Cogn. Sci. 24 5 398 410 10.1016/j.tics.2020.02.001
• M.V. Peelen A.P. Atkinson P. Vuilleumier Supramodal representations of perceived emotions in the human brain J. Neurosci. 30 30 10127 10134 1:CAS:528:DC%2BC3cXhtVahsr%2FJ 10.1523/JNEUROSCI.2161-10.2010
• Lettieri, G, Handjaras, G, Cappello, E. M, Setti, F, Bottari, D, Bruno, V, Diano, M, Leo, A, Tinti, C, Garbarini, F, Pietrini, P, Ricciardi, E, & Cecchetti, L. Dissecting abstract, modality-specific and experience-dependent coding of affect in the human brain. Science advances, 10 (10), eadk6840. https://doi.org/10.1126/sciadv.adk6840 (2024).
• M. Visser E. Jefferies K.V. Embleton M.A. Lambon Ralph Both the middle temporal gyrus and the ventral anterior temporal area are crucial for multimodal semantic processing: distortion-corrected fMRI evidence for a double gradient of information convergence in the temporal lobes J. Cogn. Neurosci. 24 8 1766 1778 10.1162/jocn_a_00244
• J. Hung X. Wang X. Wang Y. Bi Functional subdivisions in the anterior temporal lobes: a large scale meta-analytic investigation Neurosci. Biobehav. Rev. 115 134 145 10.1016/j.neubiorev.2020.05.008
• B. Pascual J.C. Masdeu M. Hollenbeck N. Makris R. Insausti S.L. Ding B.C. Dickerson Large-scale brain networks of the human left temporal pole: a functional connectivity MRI study Cereb. Cortex 25 3 680 702 10.1093/cercor/bht260
• L. Batterink H.J. Neville The human brain processes syntax in the absence of conscious awareness J. Neurosci. 33 19 8528 8533 1:CAS:528:DC%2BC3sXns1GgsLk%3D 10.1523/JNEUROSCI.0618-13.2013
• L. Batterink C.M. Karns Y. Yamada H. Neville The role of awareness in semantic and syntactic processing: an ERP attentional blink study J. Cogn. Neurosci. 22 11 2514 2529 10.1162/jocn.2009.21361
• L. Jiménez-Ortega E. Badaya P. Casado S. Fondevila D. Hernández-Gutiérrez F. Muñoz J. Sánchez-García M. Martín-Loeches The Automatic but Flexible and Content-Dependent Nature of Syntax Front. Hum. Neurosci. 10.3389/fnhum.2021.651158
• D. Hernández-Gutiérrez F. Muñoz Z. Khosrowtaj W. Sommer L. Jiménez-Ortega R. Abdel Rahman J. Sánchez-García P. Casado S. Fondevila J. Espuny M. Martín-Loeches How the speaker’s emotional facial expressions may affect language comprehension Language Cogn. Neurosci. 10.1080/23273798.2022.2130945
• J. Espuny L. Jiménez-Ortega P. Casado S. Fondevila F. Muñoz D. Hernández-Gutiérrez M. Martín-Loeches Event-related brain potential correlates of words’ emotional valence irrespective of arousal and type of task Neurosci. Lett. 670 83 88 1:CAS:528:DC%2BC1cXisVSlu7o%3D 10.1016/j.neulet.2018.01.050
• J. Espuny L. Jiménez-Ortega D. Hernández-Gutiérrez F. Muñoz S. Fondevila P. Casado M. Martín-Loeches Isolating the effects of word’s emotional valence on subsequent morphosyntactic processing: An event-related brain potentials study Front. Psychol. 9 2291 10.3389/fpsyg.2018.02291
• C. Hinchcliffe L. Jiménez-Ortega F. Muñoz D. Hernández-Gutiérrez P. Casado J. Sánchez-García M. Martín-Loeches Language comprehension in the social brain: Electrophysiological brain signals of social presence effects during syntactic and semantic sentence processing Cortex 130 413 425 10.1016/j.cortex.2020.03.029
• J.A. Hinojosa J. Albert U. Fernández-Folgueiras G. Santaniello C. López-Bachiller M. Sebastián A.J. Sánchez-Carmona M.A. Pozo Effects of negative content on the processing of gender information: an event-related potential study Cogn. Affect. Behav. Neurosci. 14 4 1286 1299 10.3758/s13415-014-0291-x
• Jiménez-Ortega, L, Casado-Palacios, M, Rubianes, M, Martínez-Mejias, M, Casado, P, Fondevila, S, Hernández-Gutiérrez, D, Muñoz, F, Sánchez-García, J, & Martín-Loeches, M. The bigger your pupils, the better my comprehension: an ERP study of how pupil size and gaze of the speaker affect syntactic processing. Social cognitive and affective neuroscience, 19 (1), nsae047. https://doi.org/10.1093/scan/nsae047 (2024).
• M. Martín-Loeches A. Fernández A. Schacht W. Sommer P. Casado L. Jiménez-Ortega S. Fondevila The influence of emotional words on sentence processing: electrophysiological and behavioral evidence Neuropsychologia 50 14 3262 3272 10.1016/j.neuropsychologia.2012.09.010
• C. Poch T. Diéguez-Risco N. Martínez-García P. Ferré J.A. Hinojosa I hates Mondays: ERP effects of emotion on person agreement Language Cogn. Neurosci. 38 10 1451 1462 10.1080/23273798.2022.2115085
• M.W. Verhees D.J. Chwilla J. Tromp C.T. Vissers Contributions of emotional state and attention to the processing of syntactic agreement errors: evidence from P600 Front. Psychol. 6 388 10.3389/fpsyg.2015.00388
• K. Maquate J. Kissler P. Knoeferle Speakers’ emotional facial expressions modulate subsequent multi-modal language processing: ERP evidence Language Cogn. Neurosci. 10.1080/23273798.2022.2108089
• M. Rubianes L. Drijvers F. Muñoz L. Jiménez-Ortega T. Almeida-Rivera J. Sánchez-García S. Fondevila P. Casado M. Martín-Loeches The self-reference effect can modulate language syntactic processing even without explicit awareness: An electroencephalography study J. Cogn. Neurosci. 36 3 460 474 10.1162/jocn_a_02104
• J. Holler S.C. Levinson Multimodal language processing in human communication Trends Cogn. Sci. 23 8 639 652 10.1016/j.tics.2019.05.006
• F. Pulvermüller Y. Shtyrov O. Hauk Understanding in an instant: Neurophysiological evidence for mechanistic language circuits in the human brain Brain Lang. 110 2 81 94 10.1016/j.bandl.2008.12.001
• McClelland, J. L, St, John, M., Taraban, R. Sentence comprehension: A parallel distributed processing approach. Language and Cognitive Processes, 4, 287–336. https://doi.org/10.1080/01690968908406371 (1989).
• M. Díaz-Lago I. Fraga C. Acuña-Fariña Time course of gender agreement violations containing emotional words J. Neurol. 36 79 93 10.1016/j.jneuroling.2015.07.001
• I. Fraga I. Padrón C. Acuña-Fariña M. Díaz-Lago Processing gender agreement and word emotionality: New electrophysiological and behavioural evidence J. Neurol. 44 203 222 10.1016/j.jneuroling.2017.06.002
• A. Hohlfeld M. Martín-Loeches W. Sommer The nature of morphosyntactic processing during language perception. Evidence from an additional-task study in Spanish and German Int. J. Psychophysiol. 143 9 24 10.1016/j.ijpsycho.2019.06.016
• I. Padrón I. Fraga C. Acuña-Fariña Processing gender agreement errors in pleasant and unpleasant words: An ERP study at the sentence level Neurosci. Lett. 10.1016/j.neulet.2019.134538
• F. Ferreira C. Clifton Jr The independence of syntactic processing J. Mem. Lang. 25 348 368 10.1016/0749-596X(86)90006-9
• Fodor, J. D. On modularity in syntactic processing. Journal of Psycholinguistic Research, 17, 125–168. https://doi.org/10.1007/BF01067069 (1988).
• M.D. Hauser N. Chomsky W.T. Fitch The faculty of language: what is it, who has it, and how did it evolve? Science 298 5598 1569 1579 2002Sci..298.1569H 1:CAS:528:DC%2BD38Xosl2ku70%3D 10.1126/science.298.5598.1569
• R.C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory Neuropsychologia 9 1 71 113 10.1016/0028-3932(71)90067-4
• Faul, F, Erdfelder, E, Buchner, A, & Lang, A. G. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behavior research methods, 41 (4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149 (2009).
• D. Hernández-Gutiérrez F. Muñoz J. Sánchez-García W. Sommer R. Abdel Rahman P. Casado L. Jiménez-Ortega J. Espuny S. Fondevila M. Martín-Loeches Situating language in a minimal social context: how seeing a picture of the speaker’s face affects language comprehension Soc. Cognitive Affect. Neurosci. 16 5 502 511 10.1093/scan/nsab009
• D.S. Ma J. Correll B. Wittenbrink The Chicago face database: A free stimulus set of faces and norming data Behav. Res. Methods 47 4 1122 1135 10.3758/s13428-014-0532-5
• M. Olszanowski G. Pochwatko K. Kuklinski M. Scibor-Rylski P. Lewinski R.K. Ohme Warsaw set of emotional facial expression pictures: a validation study of facial display photographs Front. Psychol. 5 1516 10.3389/fpsyg.2014.01516
• T.Z. Ramsøy M. Overgaard Introspection and subliminal perception Phenomenol. Cogn. Sci. 3 1 23 10.1023/B:PHEN.0000041900.30172.e8
• M.R. Ionescu Subliminal perception of complex visual stimuli Roman. J. Ophthalmol. 60 4 226 230 PMID: 29450354
• A.J. Bell T.J. Sejnowski An information-maximization approach to blind separation and blind deconvolution Neural Comput. 7 6 1129 1159 1:STN:280:DyaK28%2Fkt1eqtg%3D%3D 10.1162/neco.1995.7.6.1129
• R. Oostenveld P. Fries E. Maris J.M. Schoffelen FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data Comput. Intell. Neurosci. 10.1155/2011/156869
• E. Maris R. Oostenveld Nonparametric statistical testing of EEG- and MEG-data J. Neurosci. Methods 164 1 177 190 10.1016/j.jneumeth.2007.03.024
• Cohen, J. Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates. (1988).
• M. Eimer A. Gosling S. Nicholas M. Kiss The N170 component and its links to configural face processing: a rapid neural adaptation study Brain Res. 1376 76 87 1:CAS:528:DC%2BC3MXhvFektbY%3D 10.1016/j.brainres.2010.12.046
• S. Schindler M. Bruchmann T. Straube Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170 Neurosci. Biobehav. Rev. 10.1016/j.neubiorev.2023.105399
• C. Joyce B. Rossion The face-sensitive N170 and VPP components manifest the same brain processes: the effect of reference electrode site Clin. Neurophysiol. 116 11 2613 2631 10.1016/j.clinph.2005.07.005
• M.K. Tanenhaus M.J. Spivey-Knowlton K.M. Eberhard J.C. Sedivy Integration of visual and linguistic information in spoken language comprehension Science 268 5217 1632 1634 1995Sci..268.1632T 1:CAS:528:DyaK2MXmtlarurw%3D 10.1126/science.7777863
• P. Hagoort The core and beyond in the language-ready brain Neurosci. Biobehav. Rev. 81 194 204 10.1016/j.neubiorev.2017.01.048
• Fridlund, A. J. Human facial expression: An evolutionary view. Academic Press Inc. (1994).
• A. Öhman P. Juth D. Lundqvist Finding the face in a crowd: Relationships between distractor redundancy, target emotion, and target gender Cogn. Emot. 24 7 1216 1228 10.1080/02699930903166882
• A. Öhman D. Lundqvist F. Esteves The face in the crowd revisited: a threat advantage with schematic stimuli J. Pers. Soc. Psychol. 80 3 381 396 10.1037/0022-3514.80.3.381
• J.B. Wormwood K.S. Quigley L.F. Barrett Emotion and threat detection: The roles of affect and conceptual knowledge Emotion 22 8 1929 1941 10.1037/emo0000884
• N. Burra D. Kerzel Task Demands Modulate Effects of Threatening Faces on Early Perceptual Encoding Front. Psychol. 10 2400 10.3389/fpsyg.2019.02400
• M. Gong L.J. Smart The anger superiority effect revisited: a visual crowding task Cogn. Emot. 35 2 214 224 10.1080/02699931.2020.1818552
• D.V. Becker H. Rheem Searching for a face in the crowd: Pitfalls and unexplored possibilities Atten. Percept. Psychophys. 82 2 626 636 10.3758/s13414-020-01975-7
• M. Tamietto B. de Gelder Neural bases of the non-conscious perception of emotional signals Nat. Rev. Neurosci. 11 10 697 709 1:CAS:528:DC%2BC3cXhtFSisbvF 10.1038/nrn2889
• D. Zhang Y. Liu L. Wang H. Ai Y. Luo Mechanisms for attentional modulation by threatening emotions of fear, anger, and disgust Cogn. Affect. Behav. Neurosci. 17 1 198 210 10.3758/s13415-016-0473-9
• J.A. Hinojosa F. Mercado L. Carretié N170 sensitivity to facial expression: A meta-analysis Neurosci. Biobehav. Rev. 55 498 509 1:STN:280:DC%2BC2MbislyrtQ%3D%3D 10.1016/j.neubiorev.2015.06.002
• S. Schindler F. Bublatzky Attention and emotion: An integrative review of emotional face processing as a function of attention Cortex 130 362 386 10.1016/j.cortex.2020.06.010
• N. Molinaro H.A. Barber M. Carreiras Grammatical agreement processing in reading: ERP findings and future directions Cortex 47 8 908 930 10.1016/j.cortex.2011.02.019
• L. Carretié J. Albert S. López-Martín M. Tapia Negative brain: An integrative review on the neural processes activated by unpleasant stimuli Int. J. Psychophysiol. 1 57 63 10.1016/j.ijpsycho.2008.07.006
• F. Barros S.C. Soares M. Rocha P. Bem-Haja S. Silva D. Lundqvist The angry versus happy recognition advantage: the role of emotional and physical properties Psychol. Res. 87 1 108 123 10.1007/s00426-022-01648-0
• de Valk, J. M, Wijnen, J. G, & Kret, M. E. Anger fosters action. Fast responses in a motor task involving approach movements toward angry faces and bodies. Frontiers in psychology, https://doi.org/10.3389/fpsyg.2015.01240 (2015).
• S.B. Klein A role for self-referential processing in tasks requiring participants to imagine survival on the savannah J. Exp. Psychol. Learn. Mem. Cogn. 38 5 1234 1242 10.1037/a0027636
• N. van de Meerendonk H.H. Kolk C.T. Vissers D.J. Chwilla Monitoring in language perception: mild and strong conflicts elicit different ERP patterns J. Cogn. Neurosci. 22 1 67 82 10.1162/jocn.2008.21170
• S. Coulson M. Kutas Getting it: human event-related brain response to jokes in good and poor comprehenders Neurosci. Lett. 316 2 71 74 1:CAS:528:DC%2BD3MXovF2it7k%3D 10.1016/s0304-3940(01)02387-4
• L. Jiménez-Ortega M. Martín-Loeches P. Casado A. Sel S. Fondevila P.H. de Tejada A. Schacht W. Sommer How the emotional content of discourse affects language comprehension PLoS ONE 10.1371/journal.pone.0033718
• Kissler, J. Affective neurolinguistics: a new field to grow at the intersection of emotion and language? – Commentary on Hinojosa et al., 2019. Language, Cognition and Neuroscience, 35(7), 850–857. https://doi.org/10.1080/23273798.2019.1694159 (2019).
• J.A. Hinojosa E.M. Moreno P. Ferré On the limits of affective neurolinguistics: a “universe” that quickly expands Language Cogn. Neurosci. 35 7 877 884 10.1080/23273798.2020.1761988
• C. Herbert Where are the emotions in written words and phrases? Commentary on Hinojosa, Moreno and Ferré: Affective neurolinguistics: Towards a framework for reconciling language and emotion (2019) Language Cogn. Neurosci. 35 7 844 849 10.1080/23273798.2019.1660798
• M. Bayer A. Schacht Event-related brain responses to emotional words, pictures, and faces - a cross-domain comparison Front. Psychol. 5 1106 10.3389/fpsyg.2014.01106