Cynthia Matuszek
Cynthia Matuszek

Affiliated Faculty, Faculty

My primary research interests are in robotics and natural language processing; in my work, I combine these interests to support research in human-robot interaction, or HRI. My work focuses on the problem of grounded language acquisition: extracting semantically meaningful representations of human language by mapping those representations to the noisy, unpredictable physical world in which robots operate. More specifically, I work on combining probabilistic, grammar-based natural language processing with machine learning to transform human communication into a formal language that a robot can understand. I have looked at using this kind of language learning to learn how to follow navigation instructions or learn more about the world from human users by learning to extend a world model in tandem with learning a language parsing model.

Cynthia Matuszek

Publications

2023

  1. K. Darvish, E. Raff, F. Ferraro, and C. Matuszek, "Multimodal Language Learning for Object Retrieval in Low Data Regimes in the Face of Missing Modalities", Article, Transactions on Machine Learning Research, October 2023, 260 downloads.

2022

  1. G. Y. Kebe, L. E. Richards, E. Raff, F. Ferraro, and C. Matuszek, "Bridging the Gap: Using Deep Acoustic Representations to Learn Grounded Language from Percepts and Raw Speech", InProceedings, Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI-22), June 2022, 281 downloads.

2021

  1. N. Pillai, C. Matuszek, and F. Ferraro, "Neural Variational Learning for Grounded Language Acquisition", InProceedings, IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), August 2021, 290 downloads.
  2. N. Pillai, C. Matuszek, and F. Ferraro, "Measuring Perceptual and Linguistic Complexity in Multilingual Grounded Language Data", InProceedings, 34th International FLAIRS Conference (FLAIRS-34), May 2021, 508 downloads.
  3. M. Murnane, P. Higgins, M. Saraf, F. Ferraro, C. Matuszek, and D. Engel, "A Simulator for Human-Robot Interaction in Virtual Reality", InProceedings, Conference on Virtual Reality and 3D User Interfaces, Abstracts and Workshops (VRW), March 2021, 711 downloads.
  4. P. Higgins, G. Y. Kebe, K. Darvish, D. Engel, F. Ferraro, and C. Matuszek, "Towards Making Virtual Human-Robot Interaction a Reality", InProceedings, 3rd International Workshop on Virtual, Augmented, and Mixed-Reality for Human-Robot Interactions (VAM-HRI), March 2021, 767 downloads.

2020

  1. N. Pillai, E. Raff, F. Ferraro, and C. Matuszek, "Sampling Approach Matters: Active Learning for Robotic Language Acquisition", InProceedings, IEEE BigData BDML, December 2020, 932 downloads.
  2. A. T. Nguyen, L. E. Richards, G. Y. Kebe, E. Raff, K. Darvish, F. Ferraro, and C. Matuszek, "Practical Cross-modal Manifold Alignment for Grounded Language", Article, arXiv:2009.05147 [cs.CV], September 2020, 403 downloads.
  3. P. Jenkins, R. Sachdeva, G. Y. Kebe, P. Higgins, K. Darvish, E. Raff, D. Engel, J. Winder, F. Ferraro, and C. Matuszek, "Presentation and Analysis of a Multimodal Dataset for Grounded Language Learning", Article, arXiv:2007.14987 [cs.RO], July 2020, 407 downloads.

2019

  1. C. Kery, N. Pillai, C. Matuszek, and F. Ferraro, "Building Language-Agnostic Grounded Language Learning Systems", InProceedings, 28th International Conference on Robot and Human Interactive Communication (Ro-Man), October 2019, 516 downloads.
  2. M. Murnane, M. Breitmeyer, F. Ferraro, C. Matuszek, and D. Engel, "Learning from Human-Robot Interactions in Modeled Scenes", InProceedings, ACM SIGGRAPH 2019 Posters, July 2019, 412 downloads.
  3. M. Murnane, M. Breitmeyer, F. Ferraro, and C. Matuszek, "Learning from Human-Robot Interactions in Modeled Scenes", InProceedings, ACM SIGGRAPH 2019 Posters, July 2019, 405 downloads.
  4. C. Kery, F. Ferraro, and C. Matuszek, "¿Es un plátano? Exploring the Application of a Physically Grounded Language Acquisition System to Spanish", NAACL Combined Workshop on Spatial Language Understanding and Grounded Communication for Robotics, June 2019, 497 downloads.
  5. N. Pillai, F. Ferraro, and C. Matuszek, "Deep Learning for Category-Free Grounded Language Acquisition", NAACL Workshop on Spatial Language Understanding and Grounded Communication for Robotics, June 2019, 427 downloads.

2018

  1. N. Pillai, F. Ferraro, and C. Matuszek, "Optimal Semantic Distance for Negative Example Selection in Grounded Language Acquisition", Workshop on Models and Representations for Natural Human-Robot Communication (Robotics: Science and Systems), June 2018, 495 downloads.

2016

  1. P. K. Das, A. L. Kashyap, G. Singh, C. Matuszek, T. Finin, and A. Joshi, "Semantic knowledge and privacy in the physical web", InProceedings, Proceedings of the 4th Workshop on Society, Privacy and the Semantic Web - Policy and Technology (PrivOn2016) co-located with 15th International Semantic Web Conference (ISWC 2016), October 2016, 2278 downloads.