PiCam: an ultra-thin high performance monolithic camera array
Kartik Venkataraman, Dan Lelescu, Jacques Duparré, Andrew McMahon, Gabriel Molina, Priyam Chatterjee, Robert Mullis, Shree Nayar
In ACM Transactions on Graphics, 32(6), November 2013.
Abstract: We present PiCam (Pelican Imaging Camera-Array), an ultra-thin high performance monolithic camera array, that captures light fields and synthesizes high resolution images along with a range image (scene depth) through integrated parallax detection and superresolution. The camera is passive, supporting both stills and video, low light capable, and small enough to be included in the next generation of mobile devices including smartphones. Prior works [Rander et al. 1997; Yang et al. 2002; Zhang and Chen 2004; Tanida et al. 2001; Tanida et al. 2003; Duparré et al. 2004] in camera arrays have explored multiple facets of light field capture - from viewpoint synthesis, synthetic refocus, computing range images, high speed video, and micro-optical aspects of system miniaturization. However, none of these have addressed the modifications needed to achieve the strict form factor and image quality required to make array cameras practical for mobile devices. In our approach, we customize many aspects of the camera array including lenses, pixels, sensors, and software algorithms to achieve imaging performance and form factor comparable to existing mobile phone cameras. Our contributions to the post-processing of images from camera arrays include a cost function for parallax detection that integrates across multiple color channels, and a regularized image restoration (superresolution) process that takes into account all the system degradations and adapts to a range of practical imaging conditions. The registration uncertainty from the parallax detection process is integrated into a Maximum-a-Posteriori formulation that synthesizes an estimate of the high resolution image and scene depth. We conclude with some examples of our array capabilities such as postcapture (still) refocus, video refocus, view synthesis to demonstrate motion parallax, 3D range images, and briefly address future work.
Article URL: http://dx.doi.org/10.1145/2508363.2508390
BibTeX format:
@article{Venkataraman:2013:PAU,
  author = {Kartik Venkataraman and Dan Lelescu and Jacques Duparré and Andrew McMahon and Gabriel Molina and Priyam Chatterjee and Robert Mullis and Shree Nayar},
  title = {PiCam: an ultra-thin high performance monolithic camera array},
  journal = {ACM Transactions on Graphics},
  volume = {32},
  number = {6},
  pages = {166:1--166:13},
  month = nov,
  year = {2013},
}
Search for more articles by Kartik Venkataraman.
Search for more articles by Dan Lelescu.
Search for more articles by Jacques Duparré.
Search for more articles by Andrew McMahon.
Search for more articles by Gabriel Molina.
Search for more articles by Priyam Chatterjee.
Search for more articles by Robert Mullis.
Search for more articles by Shree Nayar.

Return to the search page.


graphbib: Powered by "bibsql" and "SQLite3."