Hey everyone! It’s been quite a while since I’ve posted here.
I’ve been working a lot on camera tracking and virtual production, and recently I made a Unity add-on that enables realtime mixed reality using a Kinect.
NextStage Pro is an app I’ve developed that handles the camera tracking. It streams the tracking data into the Unity add-on, which renders the Kinect image.
Unfortunately I only have a DK1 to test with right now. The add-on is already included with NextStage Pro, but if anyone has a DK2 (or CV1) and would like to try out the beta, please let me know!
This is really cool! Have you tried marrying it to a skinned mesh renderer too? If you could start augmenting parts of the person would be even more awesome.
Great Work! Oculus, send this poor soul an updated rift 😄
Unfortunately the Kinect skeleton tracker does not work with a moving camera. Something along the lines of dynamic fusion would be amazing, but I don't know what the impact would be while running on the same system as a rift.