Cynthia Matuszek
Cynthia Matuszek

Affiliated Faculty, Faculty

My primary research interests are in robotics and natural language processing; in my work, I combine these interests to support research in human-robot interaction, or HRI. My work focuses on the problem of grounded language acquisition: extracting semantically meaningful representations of human language by mapping those representations to the noisy, unpredictable physical world in which robots operate. More specifically, I work on combining probabilistic, grammar-based natural language processing with machine learning to transform human communication into a formal language that a robot can understand. I have looked at using this kind of language learning to learn how to follow navigation instructions or learn more about the world from human users by learning to extend a world model in tandem with learning a language parsing model.

Cynthia Matuszek

Publications

2021

  1. N. Pillai, C. Matuszek, and F. Ferraro, "Neural Variational Learning for Grounded Language Acquisition", InProceedings, IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), August 2021, 67 downloads.
  2. N. Pillai, C. Matuszek, and F. Ferraro, "Measuring Perceptual and Linguistic Complexity in Multilingual Grounded Language Data", InProceedings, 34th International FLAIRS Conference (FLAIRS-34), May 2021, 222 downloads.
  3. M. Murnane, P. Higgins, M. Saraf, F. Ferraro, C. Matuszek, and D. Engel, "A Simulator for Human-Robot Interaction in Virtual Reality", InProceedings, Conference on Virtual Reality and 3D User Interfaces, Abstracts and Workshops (VRW), March 2021, 240 downloads.
  4. P. Higgins, G. Y. Kebe, K. Darvish, D. Engel, F. Ferraro, and C. Matuszek, "Towards Making Virtual Human-Robot Interaction a Reality", InProceedings, 3rd International Workshop on Virtual, Augmented, and Mixed-Reality for Human-Robot Interactions (VAM-HRI), March 2021, 382 downloads.

2020

  1. N. Pillai, E. Raff, F. Ferraro, and C. Matuszek, "Sampling Approach Matters: Active Learning for Robotic Language Acquisition", InProceedings, IEEE BigData BDML, December 2020, 363 downloads.
  2. A. T. Nguyen, L. E. Richards, G. Y. Kebe, E. Raff, K. Darvish, F. Ferraro, and C. Matuszek, "Practical Cross-modal Manifold Alignment for Grounded Language", Article, arXiv:2009.05147 [cs.CV], September 2020, 141 downloads.
  3. P. Jenkins, R. Sachdeva, G. Y. Kebe, P. Higgins, K. Darvish, E. Raff, D. Engel, J. Winder, F. Ferraro, and C. Matuszek, "Presentation and Analysis of a Multimodal Dataset for Grounded Language Learning", Article, arXiv:2007.14987 [cs.RO], July 2020, 154 downloads.

2019

  1. C. Kery, N. Pillai, C. Matuszek, and F. Ferraro, "Building Language-Agnostic Grounded Language Learning Systems", InProceedings, 28th International Conference on Robot and Human Interactive Communication (Ro-Man), October 2019, 255 downloads.
  2. M. Murnane, M. Breitmeyer, F. Ferraro, C. Matuszek, and D. Engel, "Learning from Human-Robot Interactions in Modeled Scenes", InProceedings, ACM SIGGRAPH 2019 Posters, July 2019, 160 downloads.
  3. M. Murnane, M. Breitmeyer, F. Ferraro, and C. Matuszek, "Learning from Human-Robot Interactions in Modeled Scenes", InProceedings, ACM SIGGRAPH 2019 Posters, July 2019, 171 downloads.
  4. C. Kery, F. Ferraro, and C. Matuszek, "¿Es un plátano? Exploring the Application of a Physically Grounded Language Acquisition System to Spanish", NAACL Combined Workshop on Spatial Language Understanding and Grounded Communication for Robotics, June 2019, 290 downloads.
  5. N. Pillai, F. Ferraro, and C. Matuszek, "Deep Learning for Category-Free Grounded Language Acquisition", NAACL Workshop on Spatial Language Understanding and Grounded Communication for Robotics, June 2019, 213 downloads.

2018

  1. N. Pillai, F. Ferraro, and C. Matuszek, "Optimal Semantic Distance for Negative Example Selection in Grounded Language Acquisition", Workshop on Models and Representations for Natural Human-Robot Communication (Robotics: Science and Systems), June 2018, 271 downloads.

2016

  1. P. K. Das, A. L. Kashyap, G. Singh, C. Matuszek, T. Finin, and A. Joshi, "Semantic knowledge and privacy in the physical web", InProceedings, Proceedings of the 4th Workshop on Society, Privacy and the Semantic Web - Policy and Technology (PrivOn2016) co-located with 15th International Semantic Web Conference (ISWC 2016), October 2016, 1925 downloads.