cancel
Showing results for 
Search instead for 
Did you mean: 

Oculus DK2 - display a video at a specific time

Anonymous
Not applicable
Dear all,

My goal is to play a video on the oculus DK2, by selecting the time instant of the video to be displayed with the current position of a Falcon Novint robot.

I have tried using TouchDesigner and the CHAI3D-oculus module, but I did not manage to display any video on the Oculus DK2.

Applications playing videos from the Oculus store work perfectly fine. Therefore, I was thinking of starting one of these apps (such as "Open VR Video Player" that allows selecting a video within a specific path) to select the specific time, from the robot's position (read in the program running in C++ on visual studio 2015), at which the video should be displayed. Could that be doable?

Did anyone try to perform a similar setup? Does someone have any recommendation?

Thanks a lot in advance for your help!

Simone
5 REPLIES 5

volgaksoy
Expert Protege
Hi Simone,

You can use any open source video player code and send the decoded video image data into a quad layer using the Oculus SDK. Video players usually output using the YUV color format, so you might have to do a conversion to RGBA before copying it into the VR quad layer. Also, depending on the frame rate of the video, you might have to keep submitting the same video frame a few times to keep up the 75 Hz frame rate requried by the DK2 HMD and 90 Hz for CV1.

Martti
Honored Guest
I use ffmpeg and OpenGL to play videos and sound together with DK2. There is a tutorial on ffmpeg http://dranger.com/ffmpeg/

Anonymous
Not applicable
@volgaksoy thanks for your answer, are you aware of any example helping me getting started? I have tried checking all the examples given in the Oculus SDK but could not find any information about playing a video.

Today I have been trying to use the Oculus module of CHAI3D (development for the Falcon Novint robot), I get the following error when I try playing a video : 

{!ERROR!} [Kernel:Error] OVR Error:
Code: -1005 -- ovrError_InvalidParameter
Description: Null chain pointer provided
OVRTime: 1299.699263
Time: 2019-01-25 18:01:13 [842:361:500]

Strangely, I can hear the sound of the video but I cannot figure out where the program is failing to display it on the Oculus.

Here's the repository of the solution given by CHAI3D: https://github.com/chai3d/chai3d
The same error shown above appeared for all the examples.

Thank you very much in advance for any advise,

Simone

volgaksoy
Expert Protege
There are different samples out there beyond our SDK. For example FFMPEG (see licensing to make sure it works for you) is one such example as well as Microsoft's Media Session that's part of the Media Foundation API https://docs.microsoft.com/en-us/windows/desktop/medfound/media-session. Althought they're deprecated, you can find compilable video playback samples here: https://github.com/pauldotknopf/WindowsSDK7-Samples/tree/master/multimedia/mediafoundation

I believe SimplePlay is one such example, but you would not want to use them directly since Microsoft has updated APIs. But it should get you started. Be aware that almost none of those samples are efficient and do not use D3D11 or the GPU properly. For that, you'd want to look at this doc: https://docs.microsoft.com/en-us/windows/desktop/medfound/supporting-direct3d-11-video-decoding-in-media-foundation

What you need is that once a video frame is decoded, convert to a regular RGB color format our SDK supports, and then copy it into a SDK quad layer (or directly render your own quad into an EyeFov layer). As for how you need to render a quad layer or EyeFov layer, you can see our OculusRoomTiny (ORT) samples in the native SDK download zip. We have GL, D3D11, D3D12, Vulkan versions of the same sample packaged in there. ORT only uses a single EyeFov layer. For quad layers and more advanced use of the SDK, see the OculusWorldDemo sample also in the SDK download zip.

jamunmiks
Honored Guest

I have a DK2 and haven't been using it for a while. I recently installed the Oculus Runtime and a message is always on my HMD filling up most of the view, saying that my DK2 is not support anymore. This would be fine if it was only in the Oculus Store, but this is present in all the games and things i have that uses the HMD, and it makes it completely useless. Can i dismiss the message somehow? I also see a number of buttons on the bottom of the screen, but i cannot do anything to them. Maybe i need an earlier version of the Oculus Runtime which do not have the message?