Audio RESCUE: Realistic Audio for RESponders in Complex Undetermined Environments

The role of first responders is more important than ever. In the case of firefighters, the greatest challenges in search and rescue tasks are: disorientation, tracking team members, and low visibility. Despite methods to overcome these challenges, firefighters are still plagued by getting lost in buildings, disorientation, miscommunication of locations and spaces, and not being able to identify paths. Using 3D sound within this context is the most promising solution because responders’ hands are often occupied and visual display can increase cognitive load.

Our research pursues a novel research program to create a fundamental understanding of how to move 3D audio research from the laboratory and into the real world. Working closely with Gainesville Fire Rescue (GFR) as the testbed application domain, the project team will evaluate using 3D audio to support a search and rescue mission. The PI and team will evaluate firefighters’ performance and use the results to inform data-driven and empirically validated 3D sound design guidelines that address the following challenges:

• Realistic 3D sound rendering: Rendering 3D sound is challenging, due to the individualistic nature of 3D sound filters, sound delivery hardware, and perceptual qualities of sounds.
• Change detection: In real-world contexts, a user must be able to quickly detect 3D sound changes, however, limited literature exists in this area.
• Effects of competing sounds: Real-world scenarios are filled with background noise that may hinder the listener from accurately distinguishing a 3D sound of interest.

3D Audio Interfaces for Sensing Museum Exhibits 3d

In an effort to make the museum experience more immersive and interactive, we have partnered with the UF Library and Museum Studies Department to develop a 3D Audio system that allows museum visitors to hear content (such as aural histories or ambient sounds) as they approach a display. The 3D audio is updated in real-time as the user moves around the library.

Soccer for Players with Visual Impairments 3d

Many people with visual impairments actively play soccer, however the task of making the game accessible is met with significant challenges, such as detecting the positions of players, the ball, and targets on the field. This project aims to discover methods to help persons with visual impairments play soccer more efficiently and safely using headphone-rendered spatial audio, an on-person computer, and sensors to create 3D sound that represents the objects on the field in real-time.