Tag Archives: realtime facial animation

Faceware Studio uses ML to create facial animation in realtime

Faceware Technologies, which provides markerless 3D facial motion capture solutions, has released Faceware Studio, a new platform for creating high-quality facial animation in realtime. Faceware Studio is built from the ground up to be a complete replacement for the company’s former Live product.

According to the company, Studio reimagines the realtime streaming workflow with a modern and intuitive approach to creating instant facial animation. Using single-click calibration, Studio can track and animate a face in real time by using machine learning and the latest neural network techniques. Artists can then tune and tailor the animation to an actor’s unique performance and build additive logic with Motion Effects. The data can then be streamed to Faceware-supported plugins in Unreal Engine, Unity, MotionBuilder and soon Maya for live streaming or recording in engine on an avatar.

Faceware Studio is available now. Pricing starts at just $195 per month or $2,340 annually, which includes support. Trial versions are available on their site.

New features include:
Realtime jaw positioning using deep learning: Faceware’s improved jaw positioning tech, which is currently used in Faceware Retargeter, is now available in Studio, giving users the ability to create fast and accurate lipsync animation in realtime.

Motion Effects and Animation Tuning: Studio offers users direct control over their final animation. They can visualize and adjust actor-specific profiles with Animation Tuning and build powerful logic into the realtime data stream using Motion Effects.

Realtime Animation Viewport and Media Timeline: Users can see their facial animation from any angle with Studio’s 3D animation viewport and use the timeline and media controls to pause, play and scrub through their media to find suitable frames for calibration and to focus on specific sections of their video.

Dockable, customizable interface: A customizable user interface with docking panels and saveable workspaces.