Template‐Based Reconstruction of Surface Mesh Animation from Point Cloud Animation

In this paper, we present a method for reconstructing a surface mesh animation sequence from point cloud animation data. We mainly focus on the articulated body of a subject — the motion of which can be roughly described by its internal skeletal structure. The point cloud data is assumed to be captured independently without any inter‐frame correspondence information. Using a template model that resembles the given subject, our basic idea for reconstructing the mesh animation is to deform the template model to fit to the point cloud (on a frame‐by‐frame basis) while maintaining inter‐frame coherence. We first estimate the skeletal motion from the point cloud data. After applying the skeletal motion to the template surface, we refine it to fit to the point cloud data. We demonstrate the viability of the method by applying it to reconstruct a fast dancing motion