Kinect Face Tracking in Unity3D
Kinect SDK FaceTracking – Unity3D – Improved mouth control from Boffswana on Vimeo.
I’ve been experimenting with the latest SDK’s from Microsoft for their Kinect for Windows device in my downtime – in particular, the new facial tracking features.
It makes for an excellent facial feature animation system – tracking things like direction and rotation, as well as tracking facial features such as eyebrows and mouth shape.
It uses Microsoft’s latest Kinect SDKs, Unity3D with a 3D head model with morph targets.
Hi,
I’m trying to do what you did with kinect facetracking and Unity3d but i’m very bad in unity3d… I have all the points of the face in unity3d but how can i “connect” the face points to a 3d model in unity3d?
Thanks.
I suggest jumping into the Kinect Documentation about Face Tracking and pay close attention to the Animation Units section.
http://msdn.microsoft.com/en-us/library/jj130970.aspx
Hint: I didn’t map points on the face to points on the model.
(Hope that helps)
How do i get the facepoints in unity3d? any idea?
Have emailed you a quick explanation.
Basically using OSC and passing data.
Hey Clint really nice work here I saw you replied to richard with how you got the facepoints into unity3d is there any chance I could also get this email
regards
Pete
Hi Peter,
Looks like your email is incorrect.
Contact me via website contact form and I’ll shoot you off some details.