JingJing Luo (VI), Melinda Xu (VI), Victoria Xie(V), Alessio Pasini (V), Max Li (IV), Connor Francis (IV), Matthew Gilsenan (IV)
Project Summary
The EmotiMate project involves an AI emotional companion device that evaluates and interprets users’ emotions. It can initiate and maintain conversations, and is designed to be a digital companion for the elderly. Through this project, we aim to mitigate elderly loneliness, a prevalent issue across the senior community. We hope to eventually implement this device across various communities such as elderly homes, senior centers, and veteran homes.
Project Goals
This year, we are planning to expand this device to be able to recognize live emotions during conversations and generate conversation based on more accurate detection. We also hope that our device can recognize emotional patterns through spoken dialogue, particularly in tonal inflections. Lastly, we are planning to create an avatar such that users can participate in a face to face interaction.
- Augmenting the system such that emotions can be recognized during a conversation and in real time
- Increase the sophistication and quality of the conversation provided by the companion
- Implement a face-to-face interaction functionality using a digital avatar
- Increase sophistication to emotion recognition with audio by picking up tonal inflections
Faculty Advisor
Dr. Jolly
