Observing another’s affective state and adjusting one’s behavior to respond to it, is the basic functionality of empathy. To enable robots to do this, they need a mechanism to learn how to provide the most appropriate empathic behavior through …
Allowing humans to communicate through natural language with robots requires connections between words and percepts. The process of creating these connections is called symbol grounding and has been studied for nearly three decades. Although many …
We investigate the utility of audiovisual dialog systems combined with speech and video analytics for real-time remote monitoring of depression at scale in uncontrolled environment settings. We collected audiovisual conversational data from …
To enable natural human-robot collaboration robots need to understand natural language, which in turn requires mechanisms to ground language by connecting words to corresponding percepts. This paper, presents an unsupervised online grounding …
In this paper, a grounding framework is proposed that combines unsupervised and supervised grounding by extending an unsupervised grounding model with a mechanism to learn from explicit human teaching. To investigate whether explicit teaching …
Using conversational speech and video technologies in conjunction with signal processing and machine learning algorithms can allow patients to interact with an engaging virtual agent in the comfort of their homes, producing various …
Natural human-robot interaction requires robots to link words to objects and actions through grounding. Although grounding has been investigated in previous studies, not many considered grounding of synonyms and the majority of employed models only …
Simultaneous Localization And Mapping (SLAM) has received considerably attention in the mobile robotics community for more than 25 years. Most SLAM algorithms have been developed for and successfully tested in static environments. Previous studies …
We present NEMSI, a cloud-based multimodal dialog system designed to have naturalistic interactions with individuals for the purpose of screening neurological or mental conditions. The system has been used by thousands of people capturing audio and …