October 25, 2012

3D Puppetry: A Kinect-based Interface for 3D Animation

Super cool:

Our system allows puppeteers to directly perform animations using physical toys in front of a Kinect depth sensor. Our system tracks the puppets in real time and re-renders them in a virtual scene using stored 3D models. We combine the ease-of-use of a physical puppet show with the 3D camera and lighting controls afforded by animation software.