Spatio-temporal sampling for video
Mohan Shankar, Nikos P. Pitsianis, David J. Brady · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2008
With this work we propose spatio-temporal sampling strategies for video using a lenslet array computational imaging system and explore the opportunities and challenges in the design of compressive video sensors and corresponding processing algorithms. The redundancies in video streams are exploited by (a) sampling the sub-apertures of a multichannel (TOMBO) camera, and (b) by the computational reconstruction to achieve low power and low complexity video sensors. A spatial and a spatio-temporal sampling strategy are considered, taking into account the feasibility for implementation in the focal-plane readout hardware. The algorithms used to reconstruct the video frames from measurements are also presented.