Welcome to the Oculus Developer Forums!
Your participation on the forum is subject to the Oculus Code of Conduct.
In general, please be respectful and kind. If you violate the Oculus Code of Conduct, your access to the developer forums may be revoked at the discretion of Oculus staff.
Your participation on the forum is subject to the Oculus Code of Conduct.
In general, please be respectful and kind. If you violate the Oculus Code of Conduct, your access to the developer forums may be revoked at the discretion of Oculus staff.
Using Lip Sync for Avatars SDK in Unity
michidk
Posts: 1 NerveGear
Hello,
i'm using the Avatar SDK and Photon for a multiplayer VR experience. I already got the Avatar SDK to work. But now I want the avatars to move their lips while talking over VoIP.
My current script looks like this:
Sometimes I get a InvalidOperationException:
Anyone got any hints in how to get this working?
i'm using the Avatar SDK and Photon for a multiplayer VR experience. I already got the Avatar SDK to work. But now I want the avatars to move their lips while talking over VoIP.
My current script looks like this:
void OnAudioFilterRead(float[] data, int channels)The filter receives the data from the audio source, but the lips just won't move.
{
avatar.UpdateVoiceVisualization(data);
}
Sometimes I get a InvalidOperationException:
InvalidOperationException: Collection was modified; enumeration operation may not execute.
System.ThrowHelper.ThrowInvalidOperationException (System.ExceptionResource resource) (at <f2e6809acb14476a81f399aeb800f8f2>:0)
System.Collections.Generic.List`1+Enumerator[T].MoveNextRare () (at <f2e6809acb14476a81f399aeb800f8f2>:0)
System.Collections.Generic.List`1+Enumerator[T].MoveNext () (at <f2e6809acb14476a81f399aeb800f8f2>:0)
OvrAvatar.Update () (at Assets/Oculus/Avatar/Scripts/OvrAvatar.cs:608)
Anyone got any hints in how to get this working?
0
Howdy, Stranger!
It looks like you're new here. If you want to get involved, click one of these buttons!
Quick Links
Categories
- 13.1K All Categories
- 479 General Development
- 150 AMA
- 1.2K Answers
- 46 Developer Dashboard
- 345 Store Submissions
- 3.7K PC Development
- 1.6K Mobile Development
- 3.3K Unity Development
- 854 Unreal Development
- 344 Platform SDK Development
- 327 Audio SDK Development
- 221 Avatars / Social SDK Development
- 10 360 Capture SDK Development
- 14 Developer Tool Feedback
- 367 Game Design
- 484 Collaboration
Comments
some more discussion in this thread
https://forums.oculusvr.com/developer/discussion/67040/how-to-get-the-new-voice-visualization-working-is-it-sent-as-part-of-the-pose
That said, we *are* in the process of finalizing the integration we demo’d at OC5, which updates the avatars with eye movement and facial movement powered in part by our Lipsync plugin. While this is coming soon, I just wanted to ensure you weren’t trying to implement Lipsync data for the avatars of today.
Let me know if that clears things up!