Personal project / 2021
The current progress on the marker-less tracking setup I've been working on for almost a year.
Process
The setup uses no markers, no mocap cameras, no suit, and no keyframing - just three generic DSLR cameras. Though it is pretty far from being real-time. It still has some glitches in poses from time to time, which can be easily fixed with some manual keyframed clean up, but I kept it as it is for demo purposes. Under the hood, it uses #OpenPose ML-network for 2D tracking of joints on each camera, and then custom Houdini setup for triangulating the results into 3d, stabilizing it, and driving the rig (volumes, CHOPs, KineFX, FEM.
Credits:
R&D:
Model:
DP:
Danil Krivoruchko
Jasmine LaRae
Tatiana Stolpovskaya