04-12-2013 10:16 AM - last edited on 09-07-2023 03:42 PM by FunkyTanuki
Now that there is virtual 3D ability, why not couple it with 3D sound. Check out this demo of true 3D sound using the Unreal 3 engine. You will need headphones, any will do.
http://www.youtube.com/watch?v=IyJqHDIRMhU
04-12-2013 01:14 PM
04-14-2013 03:17 PM
04-15-2013 08:26 AM
04-15-2013 08:42 AM
04-16-2013 03:12 AM
04-16-2013 05:53 AM
"ganzuul" wrote:
Hmm... Usually unspecified 'technology' means a rehash of something old. In this case, HRTF:
http://en.wikipedia.org/wiki/Head-related_transfer_function
OpenAL already has this integrated. The real difficulty in using these techniques is that sound and our relationship to it is much more complex than vision. The virtual barbershop is a fantastic introduction to start thinking about and analysing what's involved.
A great demonstration of the complexity of the relationship between space and sound is this:
It's FOSS software and it works fine in e.g. a VirtualBox VM, so you don't have to dual-boot Linux just to play with it.
http://factorial.hu/plugins/lv2/ir
Setting up a Linux DAW isn't really easy for the uninitiated, but the Ubuntu forums will tell you how to do it.
So you can play a rising sine tone 'sweep' in a room, record it with ideally a tetrahedral soundfield microphone, 'deconvolve' the recoding and put the resulting .wav file in the above software. If you play this 'transient' .wav directly it sounds like a gunshot, or a thunder clap followed by rolling thunder if the room is very big. Then when you put your audio signal through it, it will sound exactly like it is in the room that you recorded. Magic? Almost. Maybe yes.
This is some deep DSP black mojo. Essentially it means that any finite space can be largely represented as a .wav file of similar length. - A multi-channel soundfield recording of thunder could be used to reconstruct a 3D representation of the area that it is heard in.
Our brains habitually fill in the missing details, such as there being no ceiling outdoors, and making assumptions like that is extremely difficult to do in software. However if the 3D representation is a given it may become possible.
Moreover, your body reflects sound so you get that quantum effect of not being able to observe without interfering. We all have different bodies of different sizes and densities, and some frequencies travel mostly through us, getting absorbed to some degree on the way. If you're clever about configuration, you could perhaps accomplish the effect of giving the player the approximate feeling of having a different body.
ED:
http://www.mtbs3d.com/phpBB/viewtopic.php?f=138&t=16870
Second video from the top.
04-16-2013 02:14 PM