|
|
Computer Science Department Colloquium
Embodied Computational Metacognition
Speaker:
Nikhil Krishnaswamy, Assistant Professor, Department of Computer Science, Colorado State University
When: 11:00AM ~ 11:50AM, Monday April 11, 2022
Where: CSB 130
Abstract: Metacognition is defined as an actor's awareness and understanding of its own thought processes and the patterns underlying them. More simply it may be called "thinking about thinking." A metacognitive agent is one that analyzes its own model of the environment and world, including the individual concepts it considers therein, figures out when it needs to be updated, how, and why. While modern AI has demonstrated success at many tasks, the state of the art methods (usually large neural networks) do not easily or organically adapt to accommodate new concepts. In this talk, I discuss how three different AI techniques—machine learning, symbolic reasoning, and embodied simulation—come together to enable rapid bootstrapping of methods for novel concept detection, physical reasoning about objects and events, and language grounding, with fewer resources than typically required by state of the art methods in natural language understanding and multimodal reasoning.
First I will introduce methods for creating virtual and mixed-reality environments and agents to operate within them. Second, I will discuss how one such agent explores its own environment, using a simple example of object reasoning inspired by infant and toddler learning, and demonstrate how embodied simulation, reinforcement learning, and high-dimensional embedding spaces can be exploited to rapidly detect changes in the environment that require the agent's underlying model to be updated. Subsequently, I will discuss how the resulting vector representations can be used to explore where in a neural network abstract properties pertaining to objects, events, and affordances "reside," can be isolated, and how they can be used compositionally. Finally I will demonstrate how representations from two entirely distinct models can be correlated with each other, such as a word with an object, using an example of assigning linguistic labels to acquired concepts, and determining when words are used in different senses, grounded to the environment.
Bio: Nikhil Krishnawamy is an Assistant Professor of Computer Science at Colorado State. His research straddles the boundaries of Artificial Intelligence, Natural Language Processing, Cognitive Science, and Human-Computer Interaction. He earned his Ph.D. at Brandeis University in 2017, followed by a 3-year postdoc funded by the DARPA Communicating with Computers (CwC) program. His main research interests are: using computational methods to examine human cognition and linguistic processing, including statistical, symbolic, neural, and simulation methods; and examining the properties of high-dimensional embedding spaces for representation. His research has been funded by DARPA and NSF, and has appeared at top AI and NLP conferences, including AAAI and ACL venues. He won a best demo award at ICAT-EGVE 2020, the merger of two of the premier conferences in virtual environments, and has served on the program committee for top conferences in AI, NLP, and Cognitive Science, including AAAI, AACL, ACL, CogSci, COLING, EACL, EMNLP, IWCS, NAACL-HLT, and more.
|