US20240259753
2024-08-01
Electricity
H04S7/303
Spatial audio techniques enhance the listening experience on wearable devices like headphones and earbuds. By utilizing binaural rendering, these technologies aim to create an immersive soundscape, making audio playback feel as if it originates from a well-placed three-dimensional speaker system rather than the headphones themselves. This approach allows users to enjoy a more realistic audio experience, resembling that of their actual living room.
The technology can be integrated into a media playback system that includes both wearable devices and traditional playback devices like soundbars. Users can seamlessly switch between listening modes, such as private headphone use or out-loud playback on a soundbar. Binaural rendering ensures that the audio experience remains consistent, providing a similar quality whether the user is listening privately or publicly.
For audio-visual content, such as movies or television shows, the technology offers improved multi-modal congruence. This means that the audio appears to come from the screen regardless of the listener's head orientation. By ensuring that audio playback feels natural and synchronized with visual elements, both music and audiovisual experiences are significantly enhanced.
Instead of relying on lengthy direct measurements of binaural room impulse responses (BRIRs), the technology synthesizes these responses for real-time rendering. By analyzing impulse response measurements quickly and with less sensitivity to noise, the system adapts existing binaural filters to match the acoustic characteristics of the user's environment. This process results in a more efficient and effective audio experience without compromising sound quality.
To improve accuracy in sound placement, the system tracks user head orientation using an inertial measurement unit (IMU). By anchoring this IMU to the playback device, it prevents drift and ensures that sounds are perceived accurately relative to their source. Time-of-flight measurements between the playback device and microphones on the headphones help determine the listener's orientation, thereby maintaining an immersive audio experience even when users shift their attention away from the screen.