Robots for Social and Emotional Learning

Inclusive Sensing and Engagement

Evaluating children's engagement with the robot through thermal imaging.

In this project, we present a multi-modal exploration of the stages of engagement, with a focus on developing modes of perception and engagement measures that are inclusive of diverse children (e.g. ethnically, neurologically). This exploration was made possible through a Robot Operating System (ROS) setup with visual, thermal, and audible sensors to collect data while children interacted during a passive and active activity with the robot, Haru. Currently, we are exploring preliminary results and using social behavior annotation tools to achieve a more holistic understanding of how a multimodal approach can increase our ability to approach engagement estimation in a non-invasive, contextualized, and embodied way. This system is envisioned as a foundational component of future social robot design, with the aim of improving the accessibility and inclusivity of robotic systems to be able to support interactions with a wide variety of children with diverse learning and interaction styles.

Interested in Joining?

Are you interested in learning more about our lab? If you are feel free to reach out on our Contact page. We'd love for you to join our lab!