The method of projecting a fixed single pattern onto a target object using a video projector and restoring it in 3D from an image captured by a single camera is called active one-shot scanning method, and has been studied for shape measurement of moving objects such as a human body in motion or a rotating feather. In this study, we proposed a method to remove ambiguity and to perform stable 3D restoration by using a two-color grid pattern.
The proposed method first performs projective restoration using coplanarity, and then upgrades it to Euclidean space using pattern features (color combinations of successive grids).
This method enables to scan 3D shape of fast-moving objects captured by a high-speed camera. In the movie below, you can see that the deforming 3D shapes can be measured as surface waves propagating over the belly of a human body hit by a ball, and the dynamic deformation of subcutaneous fat on the cheeks even when the face is just shaken. Also rotating fan was successfully captured.
The moment the ball hits the stomach
Facial appearance when the face was swung left and right
