Vertically integrated spiking cone photoreceptor arrays for color perception
Abstract The cone photoreceptors in our eyes selectively transduce the natural light into spiking representations, which endows the brain with high energy-efficiency color vision. However, the cone-like device with color-selectivity and spike-encoding capability remains challenging. Here, we propose...
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2023-06-01
|
| Series: | Nature Communications |
| Online Access: | https://doi.org/10.1038/s41467-023-39143-8 |
| _version_ | 1797806632218918912 |
|---|---|
| author | Xiangjing Wang Chunsheng Chen Li Zhu Kailu Shi Baocheng Peng Yixin Zhu Huiwu Mao Haotian Long Shuo Ke Chuanyu Fu Ying Zhu Changjin Wan Qing Wan |
| author_facet | Xiangjing Wang Chunsheng Chen Li Zhu Kailu Shi Baocheng Peng Yixin Zhu Huiwu Mao Haotian Long Shuo Ke Chuanyu Fu Ying Zhu Changjin Wan Qing Wan |
| author_sort | Xiangjing Wang |
| collection | DOAJ |
| description | Abstract The cone photoreceptors in our eyes selectively transduce the natural light into spiking representations, which endows the brain with high energy-efficiency color vision. However, the cone-like device with color-selectivity and spike-encoding capability remains challenging. Here, we propose a metal oxide-based vertically integrated spiking cone photoreceptor array, which can directly transduce persistent lights into spike trains at a certain rate according to the input wavelengths. Such spiking cone photoreceptors have an ultralow power consumption of less than 400 picowatts per spike in visible light, which is very close to biological cones. In this work, lights with three wavelengths were exploited as pseudo-three-primary colors to form ‘colorful’ images for recognition tasks, and the device with the ability to discriminate mixed colors shows better accuracy. Our results would enable hardware spiking neural networks with biologically plausible visual perception and provide great potential for the development of dynamic vision sensors. |
| first_indexed | 2024-03-13T06:10:13Z |
| format | Article |
| id | doaj.art-2dd16a8b6d7a452e997df8eea5786771 |
| institution | Directory Open Access Journal |
| issn | 2041-1723 |
| language | English |
| last_indexed | 2024-03-13T06:10:13Z |
| publishDate | 2023-06-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Nature Communications |
| spelling | doaj.art-2dd16a8b6d7a452e997df8eea57867712023-06-11T11:19:32ZengNature PortfolioNature Communications2041-17232023-06-011411910.1038/s41467-023-39143-8Vertically integrated spiking cone photoreceptor arrays for color perceptionXiangjing Wang0Chunsheng Chen1Li Zhu2Kailu Shi3Baocheng Peng4Yixin Zhu5Huiwu Mao6Haotian Long7Shuo Ke8Chuanyu Fu9Ying Zhu10Changjin Wan11Qing Wan12School of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversityCollege of Integrated Circuit Science and Engineering, Nanjing University of Posts and TelecommunicationsSchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversitySchool of Electronic Science and Engineering, Collaborative Innovation Center of Advanced Microstructures, Nanjing UniversityAbstract The cone photoreceptors in our eyes selectively transduce the natural light into spiking representations, which endows the brain with high energy-efficiency color vision. However, the cone-like device with color-selectivity and spike-encoding capability remains challenging. Here, we propose a metal oxide-based vertically integrated spiking cone photoreceptor array, which can directly transduce persistent lights into spike trains at a certain rate according to the input wavelengths. Such spiking cone photoreceptors have an ultralow power consumption of less than 400 picowatts per spike in visible light, which is very close to biological cones. In this work, lights with three wavelengths were exploited as pseudo-three-primary colors to form ‘colorful’ images for recognition tasks, and the device with the ability to discriminate mixed colors shows better accuracy. Our results would enable hardware spiking neural networks with biologically plausible visual perception and provide great potential for the development of dynamic vision sensors.https://doi.org/10.1038/s41467-023-39143-8 |
| spellingShingle | Xiangjing Wang Chunsheng Chen Li Zhu Kailu Shi Baocheng Peng Yixin Zhu Huiwu Mao Haotian Long Shuo Ke Chuanyu Fu Ying Zhu Changjin Wan Qing Wan Vertically integrated spiking cone photoreceptor arrays for color perception Nature Communications |
| title | Vertically integrated spiking cone photoreceptor arrays for color perception |
| title_full | Vertically integrated spiking cone photoreceptor arrays for color perception |
| title_fullStr | Vertically integrated spiking cone photoreceptor arrays for color perception |
| title_full_unstemmed | Vertically integrated spiking cone photoreceptor arrays for color perception |
| title_short | Vertically integrated spiking cone photoreceptor arrays for color perception |
| title_sort | vertically integrated spiking cone photoreceptor arrays for color perception |
| url | https://doi.org/10.1038/s41467-023-39143-8 |
| work_keys_str_mv | AT xiangjingwang verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT chunshengchen verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT lizhu verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT kailushi verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT baochengpeng verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT yixinzhu verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT huiwumao verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT haotianlong verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT shuoke verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT chuanyufu verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT yingzhu verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT changjinwan verticallyintegratedspikingconephotoreceptorarraysforcolorperception AT qingwan verticallyintegratedspikingconephotoreceptorarraysforcolorperception |