Adaptive Resolution Enhancement for Visual Attention Regions Based on Spatial Interpolation
Resolution enhancement is crucial for human vision. However, it can be resource-consuming in the display pipeline. Therefore, there is a need to develop a lightweight resolution improvement algorithm specifically targeting visual attention regions. This paper presents a spatial-interpolation-based a...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-07-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/14/6354 |
| _version_ | 1797587492193435648 |
|---|---|
| author | Zhixuan Zhu Xin He Chunlai Li Shijie Liu Kun Jiang Kang Li Jianyu Wang |
| author_facet | Zhixuan Zhu Xin He Chunlai Li Shijie Liu Kun Jiang Kang Li Jianyu Wang |
| author_sort | Zhixuan Zhu |
| collection | DOAJ |
| description | Resolution enhancement is crucial for human vision. However, it can be resource-consuming in the display pipeline. Therefore, there is a need to develop a lightweight resolution improvement algorithm specifically targeting visual attention regions. This paper presents a spatial-interpolation-based algorithm to improve the resolution of the visual attention area. The eye-tracking system consists of a near-infrared camera and an event camera is proposed to obtain the 3D gaze vector and eye moving trajectory. Secondly, the observation coordinates are obtained by gaze vectors, and the visual attention region is defined by the sensitive field-of-view angle. Then, interpolation-based adaptive spatial resolution enhancement and contrast enhancement adjustment are performed in the visual attention area. Finally, the feasibility of the proposed method is tested on both qualitative and quantitative dimensions. The experimental results demonstrate that the proposed method can significantly improve the visual effects. |
| first_indexed | 2024-03-11T00:39:42Z |
| format | Article |
| id | doaj.art-1358d02b24df4b42a6f585146269a5a4 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-11T00:39:42Z |
| publishDate | 2023-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-1358d02b24df4b42a6f585146269a5a42023-11-18T21:16:33ZengMDPI AGSensors1424-82202023-07-012314635410.3390/s23146354Adaptive Resolution Enhancement for Visual Attention Regions Based on Spatial InterpolationZhixuan Zhu0Xin He1Chunlai Li2Shijie Liu3Kun Jiang4Kang Li5Jianyu Wang6Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaResolution enhancement is crucial for human vision. However, it can be resource-consuming in the display pipeline. Therefore, there is a need to develop a lightweight resolution improvement algorithm specifically targeting visual attention regions. This paper presents a spatial-interpolation-based algorithm to improve the resolution of the visual attention area. The eye-tracking system consists of a near-infrared camera and an event camera is proposed to obtain the 3D gaze vector and eye moving trajectory. Secondly, the observation coordinates are obtained by gaze vectors, and the visual attention region is defined by the sensitive field-of-view angle. Then, interpolation-based adaptive spatial resolution enhancement and contrast enhancement adjustment are performed in the visual attention area. Finally, the feasibility of the proposed method is tested on both qualitative and quantitative dimensions. The experimental results demonstrate that the proposed method can significantly improve the visual effects.https://www.mdpi.com/1424-8220/23/14/6354super resolutioneye trackingvisual attention regionvirtual reality |
| spellingShingle | Zhixuan Zhu Xin He Chunlai Li Shijie Liu Kun Jiang Kang Li Jianyu Wang Adaptive Resolution Enhancement for Visual Attention Regions Based on Spatial Interpolation Sensors super resolution eye tracking visual attention region virtual reality |
| title | Adaptive Resolution Enhancement for Visual Attention Regions Based on Spatial Interpolation |
| title_full | Adaptive Resolution Enhancement for Visual Attention Regions Based on Spatial Interpolation |
| title_fullStr | Adaptive Resolution Enhancement for Visual Attention Regions Based on Spatial Interpolation |
| title_full_unstemmed | Adaptive Resolution Enhancement for Visual Attention Regions Based on Spatial Interpolation |
| title_short | Adaptive Resolution Enhancement for Visual Attention Regions Based on Spatial Interpolation |
| title_sort | adaptive resolution enhancement for visual attention regions based on spatial interpolation |
| topic | super resolution eye tracking visual attention region virtual reality |
| url | https://www.mdpi.com/1424-8220/23/14/6354 |
| work_keys_str_mv | AT zhixuanzhu adaptiveresolutionenhancementforvisualattentionregionsbasedonspatialinterpolation AT xinhe adaptiveresolutionenhancementforvisualattentionregionsbasedonspatialinterpolation AT chunlaili adaptiveresolutionenhancementforvisualattentionregionsbasedonspatialinterpolation AT shijieliu adaptiveresolutionenhancementforvisualattentionregionsbasedonspatialinterpolation AT kunjiang adaptiveresolutionenhancementforvisualattentionregionsbasedonspatialinterpolation AT kangli adaptiveresolutionenhancementforvisualattentionregionsbasedonspatialinterpolation AT jianyuwang adaptiveresolutionenhancementforvisualattentionregionsbasedonspatialinterpolation |