I’ve been experimenting with the latest SDK’s from Microsoft for their Kinect for Windows device in my downtime – in particular, the new facial tracking features.
It makes for an excellent facial feature animation system – tracking things like direction and rotation, as well as tracking facial features such as eyebrows and mouth shape.
It uses Microsoft’s latest Kinect SDKs, Unity3D with a 3D head model with morph targets.