3D recording & playback software for VR — Oculus
New to the forums? Click here to read the "How To" Guide.

Developer? Click here to go to the Developer Forums.

3D recording & playback software for VR

multimedialmultimedial Posts: 32
Brain Burst
edited December 2015 in Showcase
Hello,

we published a 3D recording and playback solution based on the Microsoft Kinect2 and standard video codecs. The software allows you to record 3d clips using the MS Kinect and play them back in Unity. You can find more information as well as a downloadable package of the software which times out in January 2016 at

http://www.multimedialab.de

We believe that our software is different to other solutions as it uses audio/video compression codecs for storing the data (x265HEVC for depth, VP8 for video, and Opus for audio) and thus produces smaller files. Our solution also allows for higher resolution - the 3d meshes are not being rendered through Unity, but by the means of DirectX11 commands, thus bypassing the 65k vertices limit of Unity. As a direct result of this however, you'll need a DirectX11 compatible graphics card to see the recordings. On the other hand however, the recorded video clips (which are standard Matroska files ".mkv") can also be previewed in 2D using a standard media player like VLC.

pic09.jpg

Youtube Video


Preliminary Documentation is to be found at http://www.multimedial.de/VrVideo/VrVid ... tation.pdf

THE SOFTWARE IS ALPHA - THERE ARE STILL BUGS. THIS IS ALSO JUST FOR WIN7 IN 64Bit OR HIGHER, AND YOU MUST HAVE A DIRECTX11 GRAPHICS CARD FOR PLAYBACK! YOU WILL ALSO NEED A MICROSOFT KINECT2 AND WIN8 OR HIGHER FOR RECORDING.

Known issues:
- only the first recording done with the recording app has audio and video in synch
- some cards (like the 1st gen NVidia Titan) crash
- same for older and low-end AMD cards
- point cloud interpolation mode in Unity is broken right now, as the interpolator was rewritten and aligns the points differently in the target buffer as in the color buffer

Please report any issues to info@multimedial.de - Thank you.

Comments

  • Looks cool! How much data is created?
  • multimedialmultimedial Posts: 32
    Brain Burst
    you can record lossless or lossy. In lossy mode, you control the bitrate of the codec.

    In lossless mode, you generally get 2-5Mb per second (keep in mind that the raw Kinect data without any compression is about 100Mb per second).

    The videostream for the texture is currently set to a fixed value of 6000bit/s and is not exposed (yet).

    You can get satisfactory results (read "sharp imagery without compression artefacts that cannot be handled anymore with the filters provided") at 1 MB per second of recording and sometimes even less. So 10sec of recording = 10 Mb Videoclip.

    By the way, you can also cut out people from the background (depth-based greenscreening), extract people FROM the background (cutout) or show the whole recording (default).
Sign In or Register to comment.