The Acquisition of New Word Meaning by Auditory-Motor Associations in a Trial-and-Error Learning Paradigm

  • Борис Владимирович Чернышев National Research University Higher School of Economics
  • Анастасия Юрьевна Николаева Moscow State University of Psychology and Education
  • Андрей Олегович Прокофьев Moscow State University of Psychology and Education
  • Александра Михайловна Разоренова National Research University Higher School of Economics
  • Никита Борисович Тюленев National Research University Higher School of Economics
  • Татьяна Александровна Строганова Moscow State University of Psychology and Education
Keywords: embodied cognition, action words, learning, cortical plasticity, MEG, speech

Abstract

According to embodied cognition theory, speech is largely based on the body motor and sensory experience. The question that is crucial for our understanding of the origin of language is how our brain transforms sensory-motor experience into word meaning. We have developed an auditory-motor experimental procedure that allowed investigating neural underpinning of word meaning acquisition by way of associative "trial-and-error" learning that mimics important aspects of natural word learning. Participants were presented with eight pseudowords; four of them were assigned to specific body part movements during the course of learning – through commencing actions by one of a participant’s left or right extremities and receiving a feedback. The other pseudowords did not require actions and thus were used as controls. Magnetoencephalogram was recorded during passive listening to the pseudowords before and after the learning. The cortical sources of the magnetic evoked responses were reconstructed using distributed source modeling. The learning of novel word meaning through word-action associations selectively increased neural specificity for these words in the auditory parabelt areas responsible for spectrotemporal analysis, as well as in articulatory areas, both located in the left hemisphere. The extent of neural changes was linked to the degree of language learning, specifically implicating the physiological contribution of the left perisylvian cortex in the speech learning success.

Downloads

Download data is not yet available.

References

1. Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617-645. https://doi.org/10.1146/annurev.psych.59.103006.093639

2. Borovsky, A., Kutas, M., & Elman, J. (2010). Learning to use words: Event-related potentials index singleshot contextual word learning. Cognition, 116(2), 289-296. https://doi.org/10.1016/j.cognition.2010.05.004

3. Colunga, E., & Smith, L. B. (2005). From the lexicon to expectations about kinds: A role for associative learning. Psychological Review, 112(2), 347-382. https://doi.org/10.1037/0033-295x.112.2.347

4. Davis, M. H., & Gaskell, M. G. (2009). A complementary systems account of word learning: neural and behavioural evidence. Philosophical Transactions of the Royal Society B-Biological Sciences, 364(1536), 3773-3800. https://doi.org/10.1098/rstb.2009.0111

5. Dollaghan, C. (1985). Child meets word: “fast mapping” in preschool children. Journal of Speech and Hearing Research, 28(3), 449-454.

6. Gaskell, M. G., & Dumay, N. (2003). Lexical competition and the acquisition of novel words. Cognition, 89(2), 105-132. https://doi.org/10.1016/s0010-0277(03)00070-2

7. Hickok, G., & Poeppel, D. (2007). Opinion - The cortical organization of speech processing. Nature Reviews Neuroscience, 8(5), 393-402. https://doi.org/10.1038/nrn2113

8. MacGregor, L. J., Pulvermüller, F., van Casteren, M., & Shtyrov, Y. (2012). Ultra-rapid access to words in the brain. Nature Sommunications, 3, 711. https://doi.org/10.1038/ncomms1715

9. Majerus, S., Van der Linden, M., Collette, F., Laureys, S., Poncelet, M., Degueldre, C., ... Salmon, E. (2005). Modulation of brain activity during phonological familiarization. Brain and Language, 92(3), 320-331. https://doi.org/10.1016/j.bandl.2004.07.003

10. Mestres-Misse, A., Camara, E., Rodriguez-Fornells, A., Rotte, M., & Munte, T. F. (2008). Functional neuroanatomy of meaning acquisition from context. Journal of Cognitive Neuroscience, 20(12), 2153-2166. https://doi.org/10.1162/jocn.2008.20150

11. Mestres-Misse, A., Rodriguez-Fornells, A., & Munte, T. F. (2007). Watching the brain during meaning acquisition. Cerebral Cortex, 17(8), 1858-1866. https://doi.org/10.1093/cercor/bhl094

12. Myachykov, A., Scheepers, C., Fischer, M. H., & Kessler, K. (2014). TEST: A Tropic, Embodied, and Situated Theory of Cognition. Topics in Cognitive Science, 6(3), 442-460. https://doi.org/10.1111/tops.12024

13. Paulesu, E., Vallar, G., Berlingeri, M., Signorini, M., Vitali, P., Burani, C., ... Fazio, F. (2009). Supercalifragilisticexpialidocious: How the brain learns words never heard before. NeuroImage, 45(4), 1368-1377. https://doi.org/10.1016/j.neuroimage.2008.12.043

14. Preissler, M. A. (2008). Associative learning of pictures and words by low-functioning children with autism. Autism, 12(3), 231-248. https://doi.org/10.1177/1362361307088753

15. Pulvermüller, F. (1999). Words in the brain’s language. Behavioral and Brain Sciences, 22(2), 253-279. https://doi.org/10.1017/s0140525x9900182x

16. Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6(7), 576-582. https://doi.org/10.1038/nrn1706

17. Pulvermüller, F., Moseley, R. L., Egorova, N., Shebani, Z., & Boulenger, V. (2014). Motor cognitionmotor semantics: Action perception theory of cognition and communication. Neuropsychologia, 55, 71-84. https://doi.org/10.1016/j.neuropsychologia.2013.12.002

18. Scott, S. K., & Johnsrude, I. S. (2003). The neuroanatomical and functional organization of speech perception. Trends in Neurosciences, 26(2), 100-107. https://doi.org/10.1016/S0166-2236(02)00037-1

19. Scott, S. K., & Wise, R. J. S. (2004). The functional neuroanatomy of prelexical processing in speech perception. Cognition, 92(1-2), 13-45. https://doi.org/10.1016/j.cognition.2002.12.002

20. Sharon, T., Moscovitch, M., & Gilboa, A. (2011). Rapid neocortical acquisition of long-term arbitrary associations independent of the hippocampus. Proceedings of the National Academy of Sciences of the United States of America, 108(3), 1146-1151. https://doi.org/10.1073/pnas.1005238108

21. Shtyrov, Y. (2012). Neural bases of rapid word learning. Neuroscientist, 18(4), 312-319. https://doi.org/10.1177/1073858411420299

22. Shtyrov, Y., Butorina, A., Nikolaeva, A., & Stroganova, T. (2014). Automatic ultrarapid activation and inhibition of cortical motor systems in spoken word comprehension. Proceedings of the National Academy of Sciences of the United States of America, 111(18), E1918-E1923. https://doi.org/10.1073/pnas.1323158111

23. Shtyrov, Y., Nikulin, V. V., & Pulvermüller, F. (2010). Rapid cortical plasticity underlying novel word learning. Journal of Neuroscience, 30(50), 16864-16867. https://doi.org/10.1523/jneurosci.1376-10.2010
Published
2018-11-05
How to Cite
ЧернышевБ. В., НиколаеваА. Ю., ПрокофьевА. О., РазореноваА. М., ТюленевН. Б., & СтрогановаТ. А. (2018). The Acquisition of New Word Meaning by Auditory-Motor Associations in a Trial-and-Error Learning Paradigm. Psychology. Journal of the Higher School of Economics, 15(2), 257-267. https://doi.org/10.17323/1813-8918-2018-2-257-267
Section
Neurocognitive Aspects of Language Function and Use