Rethinking color cameras

Digital color cameras make sub-sampled measurements of color at alternating pixel locations, and then “demosaick” these measurements to create full color images by up-sampling. This allows traditional cameras with restricted processing hardware to produce color images from a single shot, but it requ...

Full description

Bibliographic Details
Main Authors: Chakrabarti, Ayan, Freeman, William T., Zickler, Todd
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers (IEEE) 2015
Online Access:http://hdl.handle.net/1721.1/100404
https://orcid.org/0000-0002-2231-7995
_version_ 1826212266675011584
author Chakrabarti, Ayan
Freeman, William T.
Zickler, Todd
author2 Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
author_facet Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Chakrabarti, Ayan
Freeman, William T.
Zickler, Todd
author_sort Chakrabarti, Ayan
collection MIT
description Digital color cameras make sub-sampled measurements of color at alternating pixel locations, and then “demosaick” these measurements to create full color images by up-sampling. This allows traditional cameras with restricted processing hardware to produce color images from a single shot, but it requires blocking a majority of the incident light and is prone to aliasing artifacts. In this paper, we introduce a computational approach to color photography, where the sampling pattern and reconstruction process are co-designed to enhance sharpness and photographic speed. The pattern is made predominantly panchromatic, thus avoiding excessive loss of light and aliasing of high spatial-frequency intensity variations. Color is sampled at a very sparse set of locations and then propagated throughout the image with guidance from the un-aliased luminance channel. Experimental results show that this approach often leads to significant reductions in noise and aliasing artifacts, especially in low-light conditions.
first_indexed 2024-09-23T15:18:40Z
format Article
id mit-1721.1/100404
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T15:18:40Z
publishDate 2015
publisher Institute of Electrical and Electronics Engineers (IEEE)
record_format dspace
spelling mit-1721.1/1004042022-10-02T02:06:29Z Rethinking color cameras Chakrabarti, Ayan Freeman, William T. Zickler, Todd Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Freeman, William T. Digital color cameras make sub-sampled measurements of color at alternating pixel locations, and then “demosaick” these measurements to create full color images by up-sampling. This allows traditional cameras with restricted processing hardware to produce color images from a single shot, but it requires blocking a majority of the incident light and is prone to aliasing artifacts. In this paper, we introduce a computational approach to color photography, where the sampling pattern and reconstruction process are co-designed to enhance sharpness and photographic speed. The pattern is made predominantly panchromatic, thus avoiding excessive loss of light and aliasing of high spatial-frequency intensity variations. Color is sampled at a very sparse set of locations and then propagated throughout the image with guidance from the un-aliased luminance channel. Experimental results show that this approach often leads to significant reductions in noise and aliasing artifacts, especially in low-light conditions. National Science Foundation (U.S.) (Grant IIS-0926148) National Science Foundation (U.S.) (Grant IIS-1212849) National Science Foundation (U.S.) (Grant IIS-1212928) 2015-12-17T01:20:14Z 2015-12-17T01:20:14Z 2014-05 Article http://purl.org/eprint/type/ConferencePaper 978-1-4799-5188-8 http://hdl.handle.net/1721.1/100404 Chakrabarti, Ayan, William T. Freeman, and Todd Zickler. “Rethinking Color Cameras.” 2014 IEEE International Conference on Computational Photography (ICCP) (May 2014). https://orcid.org/0000-0002-2231-7995 en_US http://dx.doi.org/10.1109/ICCPHOT.2014.6831801 Proceedings of the 2014 IEEE International Conference on Computational Photography (ICCP) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) MIT web domain
spellingShingle Chakrabarti, Ayan
Freeman, William T.
Zickler, Todd
Rethinking color cameras
title Rethinking color cameras
title_full Rethinking color cameras
title_fullStr Rethinking color cameras
title_full_unstemmed Rethinking color cameras
title_short Rethinking color cameras
title_sort rethinking color cameras
url http://hdl.handle.net/1721.1/100404
https://orcid.org/0000-0002-2231-7995
work_keys_str_mv AT chakrabartiayan rethinkingcolorcameras
AT freemanwilliamt rethinkingcolorcameras
AT zicklertodd rethinkingcolorcameras