Immersive Emotions

Immersive Emotions is an interactive installation that visualizes the participants' latent emotions using biosignals. It consists of a glove equipped with various biosensors and a hub that detects body movement and combines all the data into a visualization.

The project was accepted to the ACM MobileHCI Conference 2022 and also selected to be a part of the Jacobs Design Showcase 2022.

Process

The sensors used in this project include a PPG heart rate sensor, a GSR sensor, a camera, and an all-in-one sensor comprising a temperature sensor, an accelerometer, and a gyroscope.

All sensors except the camera are embedded into a glove, which allows participants to move their hands and fingers freely.

The visualization is designed to be abstract and to be interpreted by the participants themselves. This captures the fuzzy nature of human emotions. It is animated by a particle system regulated by frequency-modulated sine waves. The radius, color, and speed of the particles, as well as the overall particle arrangement, are all directly mapped from the input biosignals.

Here is a technical demo of the installation.

The associated research paper is available at https://dl.acm.org/doi/10.1145/3528575.3551430.