RAT4D: Rig and Animate any object without Templates in 4D
TL;DR: Create 4D rigs and models of any deformable object without templates from a single video.
Interactive Results
Explore our scenes in 4D, converted to Gaussian Splats.














How it works
From a single monocular video, our RAT4D method utilizes a sophisticated nonlinear optimization process to refine detected 2D landmarks into accurate 3D poses, free from the constraints of predefined templates. These refined poses are then processed through a template-free Gaussian splatting renderer to create re-animatable and high-fidelity 3D models. The entire process, from image input to 3D model generation, is designed to be efficient, typically completing within a few minutes.
Detailed analysis of our method
















Method overview

AخA
@article{dabhi2024rat4d,
title={RAT4D: Rig and Animate any object without Templates in 4D},
author={Mosam Dabhi and Simon Lucey and László A. Jeni},
journal={arXiv},
year={2024}
}