1

On the Utility of Audiovisual Dialog Technologies and Signal Analytics for Real-time Remote Monitoring of Depression Biomarkers

We investigate the utility of audiovisual dialog systems combined with speech and video analytics for real-time remote monitoring of depression at scale in uncontrolled environment settings. We collected audiovisual conversational data from …

Enhancing Unsupervised Language Grounding through Online Learning

To enable natural human-robot collaboration robots need to understand natural language, which in turn requires mechanisms to ground language by connecting words to corresponding percepts. This paper, presents an unsupervised online grounding …

Enhancing Unsupervised Natural Language Grounding through Explicit Teaching

In this paper, a grounding framework is proposed that combines unsupervised and supervised grounding by extending an unsupervised grounding model with a mechanism to learn from explicit human teaching. To investigate whether explicit teaching …

Leveraging Multimodal Dialog Technologies & AI/ML for Patient Health Diagnosis, Monitoring, and Intervention

Using conversational speech and video technologies in conjunction with signal processing and machine learning algorithms can allow patients to interact with an engaging virtual agent in the comfort of their homes, producing various …

A Cross-Situational Learning based Framework for Grounding of Synonyms in Human-Robot Interactions

Natural human-robot interaction requires robots to link words to objects and actions through grounding. Although grounding has been investigated in previous studies, not many considered grounding of synonyms and the majority of employed models only …

Action Learning and Grounding in Simulated Human Robot Interactions (Extended Abstract)

Evaluation of SLAM Algorithms for Highly Dynamic Environments

Simultaneous Localization And Mapping (SLAM) has received considerably attention in the mobile robotics community for more than 25 years. Most SLAM algorithms have been developed for and successfully tested in static environments. Previous studies …

NEMSI: A Multimodal Dialog System for Screening of Neurological or Mental Conditions

We present NEMSI, a cloud-based multimodal dialog system designed to have naturalistic interactions with individuals for the purpose of screening neurological or mental conditions. The system has been used by thousands of people capturing audio and …

Towards Visual Behavior Detection in Human-Machine Conversations

In this paper, we investigate how multiple conversational behaviors can be detected by automatically analyzing facial expressions in video recordings of users talking to a dialog system. To this end, we recorded a video corpus of human-machine …

Evaluation of Word Representations in Grounding Natural Language Instructions through Computational Human-Robot Interaction

In order to interact with people in a natural way, a robot must be able to link words to objects and actions. Although previous studies in the literature have investigated grounding, they did not consider grounding of unknown synonyms. In this paper, …