Art by Carlos F. Cuervo
4D HMC PIPELINE
4D HMC Processing
Try 30-days Trial Today
The evaluation version comes with a large set of sample data and projects
4D HMC Pipeline
4D Capture Using Two Cameras on a Helmet
The new Image Facial Wrapping tool provides a high-fidelity facial animation that was previously only achievable with seated 4D capture rigs.
Now you can process 4D sequences using just two cameras mounted on a helmet. It allows capturing the facial performance at the same time as the body mocap.
4D HMC Pipeline
4D HMC Processing Tutorials
Wrap4D and Track
Multi-Camera 4D Processing
Wrap4D and Track
4D Processing in Your Hands
We present 4 new applications specifically designed for processing 4D sequences.
4D performance capture is used by many high-end studios as it captures the movements of every millimeter of an actor’s face. For a long time this technology has mainly been available as a service provided by a few vendors.
Faceform Wrap4D, Faceform Track, Faceform Rush, and Faceform Node provide an easy, efficient, and controllable way to process 4D sequences in your company.
4D Processing Pipeline
Wrap4D
Faceform Wrap4D is an extended version of Wrap designed specifically for 4D processing. It takes a sequence of textured 3D scans as an input and produces a sequence of meshes with a consitent topology as an output.
The solution includes 12 new nodes. At the heart of the pipeline is the FacialWrapping node which combines the power of the BlendWrapping node with the results from the lip and eyelid detector. The idea behind the node is to provide a robust result that doesn’t require cleanup.
4D Processing Pipeline
Faceform Track
Faceform Track is stand-alone software for tracking markers and detecting facial features. It brings all the labor-intensive work into a 2D space so that you don’t have to cleanup models in 3D.
The appearance of skin can change drastically during a performance. By using tracking markers it makes it possible to wrap even very extreme expressions. Faceform Track provides generic and personalized detectors to track lip and eyelid contours. You can train a personalized detector by giving it a set of manualy annotated frames to achive an exeptional level of accuracy.
4D Processing Pipeline
Faceform Rush
Each frame may take several minutes of computation. When processing 4D sequences you have thousands of frames, which may take weeks.
Faceform Rush allows running the computation on dozens of machines with just a few clicks. You can stop, pause, track progress, and assign different projects to different machines from a single easy-to-use interface.
It works in combination with Faceform Node, which is a headless computational node, so that you don’t need to buy a Faceform Wrap4D license for every machine.
Parallel Processing
With Faceform Wrap4D you can compute any frame of the sequence independently, meaning the entire sequence can be computed in parallel on multiple machines
Full Control
The wrapping pipeline is split into clear controlable steps. You can easily check and correct the result of each step before moving onto the next one.
2D Workflow
Thanks to Faceform Track all the labor-intensive work, such as tracking markers and detecting contours, is done in 2D so you don’t have to cleanup the models in 3D.
Flexibility
Different projects have different requirements and different scanning capabilities. You are free to use the topology that suits your needs, adapt the pipeline to work with missing data and noisy scans, add annotation frames to provide more accurate lip and eyelid tracking, and extend the set of training blendshapes to improve wrapping quality.
Handling Large Rotations
Because Faceform Wrap4D works directly with 3D scans it can handle large head rotations giving actors more freedom of action. Using a pre-stabilization step the rest of the pipeline works as if the actor’s head position is static.
Scalability
With Faceform Rush and Faceform Node you can easily scale computations to dozens of machines meet your deadlines.
Faceform Wrap4D in Production
Our solution was first used in the shortfilm “The Heretic” by Unity®. 5 shots with Jake’s performance were captured by Infinite Realities and their AEONX Motion Scanning System and processed with Faceform Wrap4D.
It took our team a single day to process the animation for the final shots of the movie. Eyes, skin detail, shading, and grooming were later added by the Unity® team. Things like gaze direction and the neck shape were also art directed.
Getting Started
It’s very easy to start with our 4D processing pipeline. We prepared 7 video tutorials explaining each step in detail.
Sample Projects And Demo 4D Sequence
In Faceform Wrap4D gallery you can find several sample projects and a demo 4D sequence. The sequence was kindly provided by Infinite Realities and captured with their AEONX Motion Scanning System.
LEARN WRAP4D
