innovative system architecture for spatial volumetric acoustic seeing

Eugene Levin*, Aleksandr V. Sergeyev

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Situational awareness is a critical issue for the modern battle and security systems improvement of which increases human performance efficiency. There are multiple research project and development efforts based on omni-directional (fish-eye) electro-optical and other frequency sensor fusion systems implementing head-mounted visualization systems. However, the efficiency of these systems is limited by the human eye-brain system perception limitations. Humans are capable to naturally perceive the situations in front of them, but interpretation of omni-directional visual scenes increases the user's mental workload, increasing human fatigue and disorientation requiring more effort for object recognition. It is especially important to reduce this workload making rear scenes perception intuitive in battlefield situations where a combatant can be attacked from multiple directions. This paper describes an experimental model of the system fusion architecture of the Visual Acoustic Seeing (VAS) for representation spatial geometric 3D model in form of 3D volumetric sound. Current research in the area of auralization points to the possibility of identifying sound direction. However, for complete spatial perception it is necessary to identify the direction and the distance to an object by an expression of volumetric sound, we initially assume that the distance can be encoded by the sound frequency. The chain: object features ⇒ sensor ⇒ 3D geometric model ⇒ auralization constitutes Volumetric Acoustic Seeing (VAS). Paper describes VAS experimental research for representing and perceiving spatial information by means of human hearing cues in more details.

Original languageEnglish
Title of host publicationMultisensor, Multisource Information Fusion
Subtitle of host publicationArchitectures, Algorithms, and Applications 2009
StatePublished - 2009
Externally publishedYes
EventMultisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2009 - Orlando, FL, United States
Duration: 16 Apr 200917 Apr 2009

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X


ConferenceMultisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2009
Country/TerritoryUnited States
CityOrlando, FL


  • 3D vision
  • Auralization
  • Geospatial technology


Dive into the research topics of 'innovative system architecture for spatial volumetric acoustic seeing'. Together they form a unique fingerprint.

Cite this