Affective Visualization in Virtual Reality: An Integrative Review
A cluster of research in Affective Computing suggests that it is possible to infer some characteristics of users’ affective states by analyzing their electrophysiological activity in real-time. However, it is not clear how to use the information extracted from electrophysiological signals to create...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2021-08-01
|
| Series: | Frontiers in Virtual Reality |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frvir.2021.630731/full |
| _version_ | 1829499084782698496 |
|---|---|
| author | Andres Pinilla Andres Pinilla Jaime Garcia William Raffe Jan-Niklas Voigt-Antons Jan-Niklas Voigt-Antons Robert P. Spang Sebastian Möller Sebastian Möller |
| author_facet | Andres Pinilla Andres Pinilla Jaime Garcia William Raffe Jan-Niklas Voigt-Antons Jan-Niklas Voigt-Antons Robert P. Spang Sebastian Möller Sebastian Möller |
| author_sort | Andres Pinilla |
| collection | DOAJ |
| description | A cluster of research in Affective Computing suggests that it is possible to infer some characteristics of users’ affective states by analyzing their electrophysiological activity in real-time. However, it is not clear how to use the information extracted from electrophysiological signals to create visual representations of the affective states of Virtual Reality (VR) users. Visualization of users’ affective states in VR can lead to biofeedback therapies for mental health care. Understanding how to visualize affective states in VR requires an interdisciplinary approach that integrates psychology, electrophysiology, and audio-visual design. Therefore, this review aims to integrate previous studies from these fields to understand how to develop virtual environments that can automatically create visual representations of users’ affective states. The manuscript addresses this challenge in four sections: First, theories related to emotion and affect are summarized. Second, evidence suggesting that visual and sound cues tend to be associated with affective states are discussed. Third, some of the available methods for assessing affect are described. The fourth and final section contains five practical considerations for the development of virtual reality environments for affect visualization. |
| first_indexed | 2024-12-16T08:26:45Z |
| format | Article |
| id | doaj.art-448be48b9a73404187b40e30aaf48113 |
| institution | Directory Open Access Journal |
| issn | 2673-4192 |
| language | English |
| last_indexed | 2024-12-16T08:26:45Z |
| publishDate | 2021-08-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Virtual Reality |
| spelling | doaj.art-448be48b9a73404187b40e30aaf481132022-12-21T22:37:59ZengFrontiers Media S.A.Frontiers in Virtual Reality2673-41922021-08-01210.3389/frvir.2021.630731630731Affective Visualization in Virtual Reality: An Integrative ReviewAndres Pinilla0Andres Pinilla1Jaime Garcia2William Raffe3Jan-Niklas Voigt-Antons4Jan-Niklas Voigt-Antons5Robert P. Spang6Sebastian Möller7Sebastian Möller8Quality and Usability Lab, Institute for Software Technology and Theoretical Computer Science, Faculty of Electrical Engineering and Computer Science, Technische Universität Berlin, Berlin, GermanyUTS Games Studio, Faculty of Engineering and IT, University of Technology Sydney UTS, Sydney, NSW, AustraliaUTS Games Studio, Faculty of Engineering and IT, University of Technology Sydney UTS, Sydney, NSW, AustraliaUTS Games Studio, Faculty of Engineering and IT, University of Technology Sydney UTS, Sydney, NSW, AustraliaQuality and Usability Lab, Institute for Software Technology and Theoretical Computer Science, Faculty of Electrical Engineering and Computer Science, Technische Universität Berlin, Berlin, GermanyGerman Research Center for Artificial Intelligence (DFKI), Berlin, GermanyQuality and Usability Lab, Institute for Software Technology and Theoretical Computer Science, Faculty of Electrical Engineering and Computer Science, Technische Universität Berlin, Berlin, GermanyQuality and Usability Lab, Institute for Software Technology and Theoretical Computer Science, Faculty of Electrical Engineering and Computer Science, Technische Universität Berlin, Berlin, GermanyGerman Research Center for Artificial Intelligence (DFKI), Berlin, GermanyA cluster of research in Affective Computing suggests that it is possible to infer some characteristics of users’ affective states by analyzing their electrophysiological activity in real-time. However, it is not clear how to use the information extracted from electrophysiological signals to create visual representations of the affective states of Virtual Reality (VR) users. Visualization of users’ affective states in VR can lead to biofeedback therapies for mental health care. Understanding how to visualize affective states in VR requires an interdisciplinary approach that integrates psychology, electrophysiology, and audio-visual design. Therefore, this review aims to integrate previous studies from these fields to understand how to develop virtual environments that can automatically create visual representations of users’ affective states. The manuscript addresses this challenge in four sections: First, theories related to emotion and affect are summarized. Second, evidence suggesting that visual and sound cues tend to be associated with affective states are discussed. Third, some of the available methods for assessing affect are described. The fourth and final section contains five practical considerations for the development of virtual reality environments for affect visualization.https://www.frontiersin.org/articles/10.3389/frvir.2021.630731/fullvirtual realityaffectemotionelectrophysiologyvisual designvisualization |
| spellingShingle | Andres Pinilla Andres Pinilla Jaime Garcia William Raffe Jan-Niklas Voigt-Antons Jan-Niklas Voigt-Antons Robert P. Spang Sebastian Möller Sebastian Möller Affective Visualization in Virtual Reality: An Integrative Review Frontiers in Virtual Reality virtual reality affect emotion electrophysiology visual design visualization |
| title | Affective Visualization in Virtual Reality: An Integrative Review |
| title_full | Affective Visualization in Virtual Reality: An Integrative Review |
| title_fullStr | Affective Visualization in Virtual Reality: An Integrative Review |
| title_full_unstemmed | Affective Visualization in Virtual Reality: An Integrative Review |
| title_short | Affective Visualization in Virtual Reality: An Integrative Review |
| title_sort | affective visualization in virtual reality an integrative review |
| topic | virtual reality affect emotion electrophysiology visual design visualization |
| url | https://www.frontiersin.org/articles/10.3389/frvir.2021.630731/full |
| work_keys_str_mv | AT andrespinilla affectivevisualizationinvirtualrealityanintegrativereview AT andrespinilla affectivevisualizationinvirtualrealityanintegrativereview AT jaimegarcia affectivevisualizationinvirtualrealityanintegrativereview AT williamraffe affectivevisualizationinvirtualrealityanintegrativereview AT janniklasvoigtantons affectivevisualizationinvirtualrealityanintegrativereview AT janniklasvoigtantons affectivevisualizationinvirtualrealityanintegrativereview AT robertpspang affectivevisualizationinvirtualrealityanintegrativereview AT sebastianmoller affectivevisualizationinvirtualrealityanintegrativereview AT sebastianmoller affectivevisualizationinvirtualrealityanintegrativereview |