A cell phone based platform for facial performance capture

Svetlana Akim, Andrew Jones, Xueming Yu, Jay Busch, Graham Fyffe, Paul Graham, Paul E. Debevec · 2012

We propose a new head-mounted camera system based on stereo cell phone cameras. These cameras have the advantage of being extremely small, light-weight, and programmable. We provide step-by-step details on how to recreate this apparatus and also how to apply this data to multiple applications in facial tracking and reconstruction. Our system is based on the LG Thrill, a 3D enabled cell phone that provides two synchronized stereo cameras in a tiny 4.2 gram module. We use two phones for a total of four cameras. However we do not want to mount the entire phone at the end of the helmet arm. Instead we designed a custom umbilical cord that allows the camera module to function at a large distance from the phone itself.

Read the paper · More papers on PaperTik