Applications of Multi-Bucket Sensors to Computational Photography
Gordon C. Wan, Marc Levoy · 2012
Figure 1: HDR photography using 4 buckets per pixel. (a) Each of the three colored bars depicts a single exposure. For each of the time slices within the exposure, color denotes which bucket the electrons are stored in at the conclusion of that slice. In non-interleaved HDR (top bar), four images are captured sequentially. In the original time-interleaved HDR (middle bar), four images are captured in a time-interleaved manner. For these two protocols, the four images are read out directly from the buckets at the conclusion of the exposure. In contrast, in photon-efficient HDR (bottom bar), four non-destructive readouts are performed at the conclusion of the exposure, of bucket 4 alone, bucket 4 + bucket 3, and so on, thereby producing images with exposures times, T, 2T, 4T, and 8T. These additions are performed at all pixels in parallel in the analog domain. These images can be combined digitally off-chip to produce exposure times in each pixel that range from T to 8T. The use of non-destructive readout and analog addition allows us to achieve a total capture time of only 8T, by contrast with the first two protocols based on a sequence of exposures of length T, 2T, 4T, and 8T. In the latter case, total capture time is 15T, so motion blur is worse. This is one advantage of our approach. (b) Still life with moving metronome (at center). The images labeled T, 2T, 4T, and 8T are the four images, with crops shown at bottom. At center is the synthesized HDR photograph. The four windows separated by black lines in the images correspond to pixels with slightly different designs. Since capture of the four images are finely interleaved in time, there are no motion differences between them, and no alignment is necessary before HDR synthesis. This is a second advantage of our approach, which can be extended to the capture of HDR video. [Please watch the video].