New to the forums? Click here to read the "How To" Guide.

Developer? Click here to go to the Developer Forums.

Breath Tech experience [released for free], asks if breath sensors would be a welcome addition to VR

jumblijumbli Posts: 203 Oculus Start Member
edited September 2018 in Showcase
I’ve been encouraging the use of breath in games since the DK2 when I gave away my source code for the original Breath Tech demo. The most recent version was released for free on Oculus Home last week. 



This isn’t about seeing your breath as a novelty. The more that you represent your own physicality in VR and the more the world reacts to your physical presence the more immersed you feel. For example, blowing dustmotes away and blowing on cloth and seeing it react should feel very natural.

My intention was to increase awareness of the potential to use breath as an additional tracked input method. I want to encourage developers to consider using the microphone and I want to encourage hardware manufacturers to consider adding breath sensors as standard. The experience demonstrates various ways breath can be used for immersion and as gameplay mechanics.

Using the microphone is a flawed approach because it requires calibration and having the microphone volume turned up. If you don’t calibrate well, you don’t get the best experience. You also need to play in a quiet room to stop background noise affecting the experience. However, it’s the best way to let everyone understand the benefits.

Uses for a breath sensor besides increasing immersion:
* Coupled with eye tracking a breath sensor would provide analogue input and a very flexible control system for users with restricted movement.
* Fitness apps could vary the work rate depending on how out of breath you are.
* Meditation apps could respond to your breath.
* It would help differentiate between background noise and talking. The mic wouldn’t activate when people are shouting in the background. Games could then rely on the mic to accurately decide if you are talking during a stealth game, talking to an ingame character etc.

Please try the free experience (only takes 10 minutes) and then let me know if you think breath sensors would increase immersion and be a welcome addition, or should I just stop going on about it :)


Thanks.

Developer of Dimensional, The Relentless, Breath Tech, Jigsaw 360
View my dev blog at JumbliVR.com

Comments

  • MikeFMikeF Posts: 460
    Trinity
    This is a good idea for sure, though i think getting consumers and devs on board with such a niche accessory is going to be a hard sell. Afordability, ease of use and a good amount of dev support will be what it takes for something like this.

    Your mic based prototype is decent, i feel like with a robust software api it might be enough to compensate against the shortcomings youve outlined. I dont know how you could do that, but the fact that every rift has a standardized audio input module means that out of the box youve got a potential user without any extra cost or setup required from them.

    Keep it up!
  • LuluViBritanniaLuluViBritannia Posts: 422
    Trinity
    Hey there,
    The idea of using breath is good, but adding sensors specific to breath detection is unnecessary. A mic is perfectly able to recognize breath from the rest (that only depends on the software implementation). Although they are rare, the games that use it well don't activate when hearing background noise or when the user is speaking.
    I do love the idea of blowing dust with my breath though!
    My current config : HP Omen laptop, 8 GB RAM, Intel i5-7300HQ @2.5GHz + Nvidia GTX 1050 (2GB VRAM).

    Currently plays on :

    - Beat Saber.
    - Windlands.
    - Skyrim VR.

    I use VR for :
    - Games.
    - Art Software (Tilt Brush, Oculus Medium, Mocu Mocu Dance).
    - Cinema VR (Oculus Desktop or Virtual Desktop).

    "Everything changes. Even the happy or funny things disappear. Can I still enjoy this place anyway?"
  • LuciferousLuciferous Posts: 1,534
    Wintermute
    edited October 2018
    I would love to see this as a mod in Skyrim when you visit the mountains or winterhold.
  • Nekto2Nekto2 Posts: 197
    Art3mis
    Have you seen android app with breath converted to flute sound? And there are some other musical instruments.
    They are not perfect, but very fun :)

    And that could be cool reason to add this gear. If you could implement "flute tutorial" with "correct breath style" check.

    You could try to use separate mic connected to computer for noise cancellation. Most of people have mic in laptop or with headphone.
  • falken76falken76 Posts: 2,657 Valuable Player
    I think this would be great if it were integrated into the headset already with sensors, otherwise you have to plan on the end user actually owning the sensors as an upgrade and I would suspect devs wouldn't make much use of them because so many people wouldn't have them.  But if it were a part of the headset fromt he get go, everyone would have them and devs would probably program for them.
Sign In or Register to comment.