BINAURAL TECHNOLOGY FOR VIRTUAL REALITY

Tobias Lentz

Cite this publication as

Tobias Lentz, BINAURAL TECHNOLOGY FOR VIRTUAL REALITY (2008), Logos Verlag, Berlin, ISBN: 9783832598105

36
accesses

Description / Abstract

The use of non-intrusive virtual environments is gaining more and more importance but was focused mainly on addressing the visual sense. However, the human perception consists not only of visual input and thus it would be worthwhile to create multi-modal and interactive virtual environments.

This thesis describes the techniques required to include the acoustic component into a virtual environment and furthermore the implementation of a software system, which takes advantage of these techniques to create complex acoustical scenes in real time. The system is based on the binaural technology. It features spatially distributed sound sources which are utilized to create an environment that is as authentic as possible. This comprises a description of the source, including its relevant angle-, distance- and time- dependent radiation, the sound distribution in the virtual scene (room acoustics), the perception-related consideration of all sound field components, as well as the exact reproduction of the artificial sound at the ears of the user.

The focus of this thesis is put on the reproduction technology. In this context, an approach for dynamic crosstalk cancellation is presented, which enables a loudspeaker-based reproduction. The required filters are processed in real time on the basis of the position data and measured transfer functions of the outer ear. Furthermore the integration of this spatial audio system into a five-sided Virtual Reality display system is described and evaluated.

Table of content

  • BEGINN
  • 1 Introduction
  • 1.1 Organization of document
  • 2 Virtual Sources
  • 2.1 Source Directivity
  • 2.2 Near-field
  • 3 Binaural Synthesis
  • 3.1 HRTF Measurement
  • 3.2 Near-field HRTFs
  • 3.3 Dynamic Aspects
  • 4 Crosstalk Cancellation
  • 4.1 Static Solution
  • 4.2 Dynamic Solution
  • 5 Evaluation
  • 5.1 Measurements
  • 5.2 Influence of Misalignment
  • 5.3 Influence of Reflections
  • 6 Interactive VR-System
  • 6.1 Technical environment
  • 6.2 Audio Server
  • 6.3 Performance
  • 7 Validation
  • 7.1 Auditory stimuli
  • 7.2 Visual and Auditory Stimuli
  • 8 Summary

More of this series

    Related titles

      More of this author(s)