Automatic Generation of Immersive Audio Based on User Feedback
Participants: Sungyoung Kim, Rai Sato, Minjae Kim, Kangeun Lee
Research Sponsor: National Research Foundation | Duration: 2023 - 2026
Research Summary:This research project focuses on advancing immersive auditory acoustic technologies. We aim to gather data and reconstruct spatial audio effects based on biometric feedback measuring immersiveness. Our spatialization process includes enhancing spatial sound experiences through reverb generation and developing an automated audio panning system. Additionally, we evaluate the impact of these sound effects and immersive auditory technologies, designed around user interactions, on their effectiveness in increasing immersion in personal broadcasting and audio-centered content. By understanding how these technologies enhance user engagement and immersion, we seek to significantly improve experiences in various media environments.
Relevant Publications
Subjective Evaluation on the Sense of “Being There” using Augmented reality Room Acoustic Estimator (ARAE) Platform
Augmented Reality-Based Auditory Training and its impact on the quality of hearing
Participants: Sungyoung Kim, Rai Sato, Pooseung Koh, Kangeun Lee
Research Sponsor: National Research Foundation | Duration: 2024 - 2029
Research Summary: This research initiative aims to develop a gamified augmented reality (AR) based auditory selective attention training application to improve speech perception in noise and sound localization abilities in order to combat the side effects of hearing loss. The project involves collaboration with Hanrim Sacred Heart Hospital and University of Iowa. The ultimate goal is to create an accessible, sustainable, and user-optimized training game that can be integrated into daily life.
Specifically, the project aims to:
- Improve auditory selective attention through interactions with augmented sounds integrated into the user's real living spaces.
- Investigate how enhanced auditory selective attention impacts speech perception in noise and sound localization.
- Develop a personalized training manager system that provides customized content for each user.
- Incorporate multi-user gamification elements to increase the effectiveness of the training.
Relevant Publication
A New Technical Ear Training Game and Its Effect on Critical Listening Skills
Real-time XR Interface Technology Development for Environmental Adaptation
Participants: Sungyoung Kim, Rai Sato, Minjae Kim, Jongho Lee
Research Sponsor: Institute for Information & Communication Technology Planning & Evaluation | Duration: 2024 - 2026
Research Summary: This research initiative aims to develop a metaverse economic platform that seamlessly integrates real and virtual environments through the use of XR glasses, transcending spatial limitations via meta-objects. By generating and managing meta-objects with various inherent attributes, the project focuses on providing immersive audiovisual and haptic feedback based on users' gestures and subtle movements. Our specific contributions to this project involve the advancement of sound and spatial audio implementation within the XR real-time interface.
Quantitative Assessment of Acoustical Attributes and Listener Preferences in Binaural Renderers
Participants: Sungyoung Kim, Rai Sato, Jieun Han, Palavat Komkris, Sungjoon Kim
Research Sponsor: | Duration: 2022 - 2025
Research Summary: This research initiative aims to explore the influence of individual neuro-cognitive profiles on the immersive auditory experience, focusing on how these profiles may explain variations in auditory selective attention and perceived immersion. A pilot study has been conducted to indicate a link between a listener's social orientation and auditory selective attention. Building on this, we plan to investigate how these factors contribute to the overall immersive experience. The significance of this research lies in its potential to uncover the relationship between measurable individual differences and their impact on key auditory processes, as well as to develop a method for identifying these differences in relation to auditory selective attention and immersion. Additionally, the project seeks to address the lack of experimental data regarding the effect of individual differences on immersive multimodal experiences. By understanding virtual interactions through the lens of an individual's cognitive framework, we can better tailor communication affordances and enhance user satisfaction within virtual environments.
Relevant Publication
Quantitative Assessment of Acoustical Attributes and Listener Preferences in Binaural Renderers
Presentation of Aural Heritage with 6DoF Audio
Participants: Sungyoung Kim, Rai Sato, Pooseung Koh, Kyungtaek Oh
Research Summary: This project focuses on the preservation and revitalization of aural heritage through innovative recording techniques and virtual reality (VR) technologies. Our team is dedicated to capturing aural heritage using advanced microphone recording methods, aiming to recreate six degrees of freedom (6DoF) audio environments. This approach allows users to experience aural heritage in VR with unprecedented realism and immersion, moving freely within the virtual environment as if they were physically present in the original locations.
This project not only serves as a vital tool for cultural preservation but also paves the way for future innovations in immersive media. The outcomes of this research have the potential to influence a wide range of applications, from educational programs to interactive entertainment, enhancing the way people connect with and experience aural heritage.