A Biological Retina Inspired Tone Mapping Processor for High-Speed and Energy-Efficient Image Enhancement

In this work, a biological retina inspired tone mapping processor for high-speed and energy-efficient image enhancement has been proposed. To achieve high throughput and high energy efficiency, several hardware design techniques have been proposed, including data partition based parallel processing...

Full description

Bibliographic Details
Main Authors: Xiaoqiang Xiang, Lili Liu, Luying Que, Conghan Jia, Bo Yan, Yongjie Li, Jinhong Guo, Jun Zhou
Format: Article
Language:English
Published: MDPI AG 2020-09-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/19/5600
_version_ 1797552252139864064
author Xiaoqiang Xiang
Lili Liu
Luying Que
Conghan Jia
Bo Yan
Yongjie Li
Jinhong Guo
Jun Zhou
author_facet Xiaoqiang Xiang
Lili Liu
Luying Que
Conghan Jia
Bo Yan
Yongjie Li
Jinhong Guo
Jun Zhou
author_sort Xiaoqiang Xiang
collection DOAJ
description In this work, a biological retina inspired tone mapping processor for high-speed and energy-efficient image enhancement has been proposed. To achieve high throughput and high energy efficiency, several hardware design techniques have been proposed, including data partition based parallel processing with S-shape sliding, adjacent frame feature sharing, multi-layer convolution pipelining, and convolution filter compression with zero skipping convolution. Implemented on a Xilinx’s Virtex7 FPGA, the proposed design achieves a high throughput of 189 frames per second for 1024 × 768 RGB images while consuming 819 mW. Compared with several state-of-the-art tone mapping processors, the proposed design shows higher throughput and energy efficiency. It is suitable for high-speed and energy-constrained image enhancement applications.
first_indexed 2024-03-10T15:57:21Z
format Article
id doaj.art-edb462152dcf4805971c624374f7ec3c
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T15:57:21Z
publishDate 2020-09-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-edb462152dcf4805971c624374f7ec3c2023-11-20T15:36:22ZengMDPI AGSensors1424-82202020-09-012019560010.3390/s20195600A Biological Retina Inspired Tone Mapping Processor for High-Speed and Energy-Efficient Image EnhancementXiaoqiang Xiang0Lili Liu1Luying Que2Conghan Jia3Bo Yan4Yongjie Li5Jinhong Guo6Jun Zhou7School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, ChinaSchool of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, ChinaSchool of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, ChinaSchool of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, ChinaSchool of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, ChinaSchool of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, ChinaSchool of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, ChinaSchool of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, ChinaIn this work, a biological retina inspired tone mapping processor for high-speed and energy-efficient image enhancement has been proposed. To achieve high throughput and high energy efficiency, several hardware design techniques have been proposed, including data partition based parallel processing with S-shape sliding, adjacent frame feature sharing, multi-layer convolution pipelining, and convolution filter compression with zero skipping convolution. Implemented on a Xilinx’s Virtex7 FPGA, the proposed design achieves a high throughput of 189 frames per second for 1024 × 768 RGB images while consuming 819 mW. Compared with several state-of-the-art tone mapping processors, the proposed design shows higher throughput and energy efficiency. It is suitable for high-speed and energy-constrained image enhancement applications.https://www.mdpi.com/1424-8220/20/19/5600retinatone mapping processorhigh throughputenergy-efficient
spellingShingle Xiaoqiang Xiang
Lili Liu
Luying Que
Conghan Jia
Bo Yan
Yongjie Li
Jinhong Guo
Jun Zhou
A Biological Retina Inspired Tone Mapping Processor for High-Speed and Energy-Efficient Image Enhancement
Sensors
retina
tone mapping processor
high throughput
energy-efficient
title A Biological Retina Inspired Tone Mapping Processor for High-Speed and Energy-Efficient Image Enhancement
title_full A Biological Retina Inspired Tone Mapping Processor for High-Speed and Energy-Efficient Image Enhancement
title_fullStr A Biological Retina Inspired Tone Mapping Processor for High-Speed and Energy-Efficient Image Enhancement
title_full_unstemmed A Biological Retina Inspired Tone Mapping Processor for High-Speed and Energy-Efficient Image Enhancement
title_short A Biological Retina Inspired Tone Mapping Processor for High-Speed and Energy-Efficient Image Enhancement
title_sort biological retina inspired tone mapping processor for high speed and energy efficient image enhancement
topic retina
tone mapping processor
high throughput
energy-efficient
url https://www.mdpi.com/1424-8220/20/19/5600
work_keys_str_mv AT xiaoqiangxiang abiologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT lililiu abiologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT luyingque abiologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT conghanjia abiologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT boyan abiologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT yongjieli abiologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT jinhongguo abiologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT junzhou abiologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT xiaoqiangxiang biologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT lililiu biologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT luyingque biologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT conghanjia biologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT boyan biologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT yongjieli biologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT jinhongguo biologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement
AT junzhou biologicalretinainspiredtonemappingprocessorforhighspeedandenergyefficientimageenhancement