Burst Photography for Learning to Enhance Extremely Dark Images

Creative Commons License

Karadeniz A. S., Erdem E., Erdem A.

IEEE TRANSACTIONS ON IMAGE PROCESSING, vol.30, pp.9372-9385, 2021 (SCI-Expanded) identifier identifier identifier identifier

  • Publication Type: Article / Article
  • Volume: 30
  • Publication Date: 2021
  • Doi Number: 10.1109/tip.2021.3125394
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, PASCAL, Aerospace Database, Applied Science & Technology Source, Business Source Elite, Business Source Premier, Communication Abstracts, Compendex, Computer & Applied Sciences, EMBASE, INSPEC, MEDLINE, Metadex, zbMATH, Civil Engineering Abstracts
  • Page Numbers: pp.9372-9385
  • Keywords: Photography, Image color analysis, Pipelines, Computer architecture, Network architecture, Noise measurement, Colored noise, Computational photography, low-light imaging, image denoising, burst images, RETINEX, SPARSE
  • Hacettepe University Affiliated: Yes


Capturing images under extremely low-light conditions poses significant challenges for the standard camera pipeline. Images become too dark and too noisy, which makes traditional enhancement techniques almost impossible to apply. Recently, learning-based approaches have shown very promising results for this task since they have substantially more expressive capabilities to allow for improved quality. Motivated by these studies, in this paper, we aim to leverage burst photography to boost the performance and obtain much sharper and more accurate RGB images from extremely dark raw images. The backbone of our proposed framework is a novel coarse-to-fine network architecture that generates high-quality outputs progressively. The coarse network predicts a low-resolution, denoised raw image, which is then fed to the fine network to recover fine-scale details and realistic textures. To further reduce the noise level and improve the color accuracy, we extend this network to a permutation invariant structure so that it takes a burst of low-light images as input and merges information from multiple images at the feature-level. Our experiments demonstrate that our approach leads to perceptually more pleasing results than the state-of-the-art methods by producing more detailed and considerably higher quality images.