Angela Lee L&S Social Sciences
EQVision: Affective Tracking of Multiple Characters in Context
This research aims to develop a computer vision model to continuously track emotions of multiple characters within videos, taking into consideration facial expressions, body language, and contextual information in real-time. Aiming to fill the gap between current models and human analysis of emotions, this project will explore various image segmentation techniques for the model to best learn how to identify and differentiate between characters, such as the superpixel feature pooling method that splits images according to similar features (Ren et al., 2024). In addition, the model will factor in environmental cues, as research shows the significance of context in perceiving emotion, allowing the model to accurately identify emotions even if the central character is no longer in frame (Chen and Whitney, 2019). To track data continuously, a time encoder will enable the model to learn temporal connections between frames. By developing a model for continuous and context-integrated emotion analysis, my goal is to bring computer vision one step closer to understanding and capturing the complexities of human behavior and emotion perception.
Message To Sponsor
Hello, thank you for sponsoring my research this summer and providing me the opportunity to explore independent research as an undergraduate. This was truly an invaluable opportunity that has solidified my goals in pursuing a career in research and academia. I am continuing my SURF research project and extending it into a Psychology honors thesis. I greatly appreciate your support, and I am more than excited to continue learning as a researcher!