Multimodal Grounding for Language Processing
By: Researcher
Disclaimer: The provided code links for this paper are external links. Science Nest has no responsibility for the accuracy, legality or content of these links. Also, by downloading this code(s), you agree to comply with the terms of use as set out by the author(s) of the code(s).
Please contact us in case of a broken link from here
| Authors | Lisa Beinborn, Teresa Botschen, Iryna Gurevych |
| Journal/Conference Name | COLING 2018 8 |
| Paper Category | Artificial Intelligence |
| Paper Abstract | This survey discusses how recent developments in multimodal processing facilitate conceptual grounding of language. We categorize the information flow in multimodal processing with respect to cognitive models of human information processing and analyze different methods for combining multimodal representations. Based on this methodological inventory, we discuss the benefit of multimodal grounding for a variety of language processing tasks and the challenges that arise. We particularly focus on multimodal grounding of verbs which play a crucial role for the compositional power of language. |
| Date of publication | 2018 |
| Code Programming Language | Python |
| Comment |
Copyright Researcher 2022