Rendering Natural Bokeh Effects Based on Depth Estimation to Improve the Aesthetic Ability of Machine Vision
Machine vision is the key to realizing computer-vision tasks such as human–computer interaction and autonomous driving. However, human perception of an image’s beauty is innate. If a machine can increase aesthetic awareness, it will greatly improve the comfort of human perception in human–computer i...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-04-01
|
| Series: | Machines |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2075-1702/10/5/286 |
| _version_ | 1797498432590446592 |
|---|---|
| author | Fan Wang Yingjie Zhang Yibo Ai Weidong Zhang |
| author_facet | Fan Wang Yingjie Zhang Yibo Ai Weidong Zhang |
| author_sort | Fan Wang |
| collection | DOAJ |
| description | Machine vision is the key to realizing computer-vision tasks such as human–computer interaction and autonomous driving. However, human perception of an image’s beauty is innate. If a machine can increase aesthetic awareness, it will greatly improve the comfort of human perception in human–computer interaction. The bokeh effect is one of the most important ways to improve the artistic beauty of photographic images and the image aesthetic quality. Bokeh rendering of an image can highlight the main object of the image and blur unnecessary or unattractive background details. The existing methods usually have unrealistic rendering effects with obvious artifacts around the foreground boundary. Therefore, we propose a natural bokeh-rendering method based on depth estimation that satisfies the following characteristics: objects in the focal plane are clear and out-of-focus objects are blurred; and the further away from the focal plane, the more blurred the objects are. Our method consists of three modules: depth estimation, background subdivision, and bokeh rendering. The background-subdivision module can select different focal planes to obtain different blur radii, making the bokeh-rendering effect more diverse, so that it does not oversegment objects. The bokeh-rendering module adjusts the degree of bokeh by adjusting the blur-radius factor. In the experimental section, we analyze the model results and present the visualization results. |
| first_indexed | 2024-03-10T03:33:18Z |
| format | Article |
| id | doaj.art-eb547d95e1814ee9a739d329e1d44f01 |
| institution | Directory Open Access Journal |
| issn | 2075-1702 |
| language | English |
| last_indexed | 2024-03-10T03:33:18Z |
| publishDate | 2022-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Machines |
| spelling | doaj.art-eb547d95e1814ee9a739d329e1d44f012023-11-23T11:51:43ZengMDPI AGMachines2075-17022022-04-0110528610.3390/machines10050286Rendering Natural Bokeh Effects Based on Depth Estimation to Improve the Aesthetic Ability of Machine VisionFan Wang0Yingjie Zhang1Yibo Ai2Weidong Zhang3National Center for Materials Service Safety, University of Science and Technology Beijing, Beijing 100083, ChinaNational Center for Materials Service Safety, University of Science and Technology Beijing, Beijing 100083, ChinaNational Center for Materials Service Safety, University of Science and Technology Beijing, Beijing 100083, ChinaNational Center for Materials Service Safety, University of Science and Technology Beijing, Beijing 100083, ChinaMachine vision is the key to realizing computer-vision tasks such as human–computer interaction and autonomous driving. However, human perception of an image’s beauty is innate. If a machine can increase aesthetic awareness, it will greatly improve the comfort of human perception in human–computer interaction. The bokeh effect is one of the most important ways to improve the artistic beauty of photographic images and the image aesthetic quality. Bokeh rendering of an image can highlight the main object of the image and blur unnecessary or unattractive background details. The existing methods usually have unrealistic rendering effects with obvious artifacts around the foreground boundary. Therefore, we propose a natural bokeh-rendering method based on depth estimation that satisfies the following characteristics: objects in the focal plane are clear and out-of-focus objects are blurred; and the further away from the focal plane, the more blurred the objects are. Our method consists of three modules: depth estimation, background subdivision, and bokeh rendering. The background-subdivision module can select different focal planes to obtain different blur radii, making the bokeh-rendering effect more diverse, so that it does not oversegment objects. The bokeh-rendering module adjusts the degree of bokeh by adjusting the blur-radius factor. In the experimental section, we analyze the model results and present the visualization results.https://www.mdpi.com/2075-1702/10/5/286depth estimationbokeh effectTransformerrefocused imagemachine vision |
| spellingShingle | Fan Wang Yingjie Zhang Yibo Ai Weidong Zhang Rendering Natural Bokeh Effects Based on Depth Estimation to Improve the Aesthetic Ability of Machine Vision Machines depth estimation bokeh effect Transformer refocused image machine vision |
| title | Rendering Natural Bokeh Effects Based on Depth Estimation to Improve the Aesthetic Ability of Machine Vision |
| title_full | Rendering Natural Bokeh Effects Based on Depth Estimation to Improve the Aesthetic Ability of Machine Vision |
| title_fullStr | Rendering Natural Bokeh Effects Based on Depth Estimation to Improve the Aesthetic Ability of Machine Vision |
| title_full_unstemmed | Rendering Natural Bokeh Effects Based on Depth Estimation to Improve the Aesthetic Ability of Machine Vision |
| title_short | Rendering Natural Bokeh Effects Based on Depth Estimation to Improve the Aesthetic Ability of Machine Vision |
| title_sort | rendering natural bokeh effects based on depth estimation to improve the aesthetic ability of machine vision |
| topic | depth estimation bokeh effect Transformer refocused image machine vision |
| url | https://www.mdpi.com/2075-1702/10/5/286 |
| work_keys_str_mv | AT fanwang renderingnaturalbokeheffectsbasedondepthestimationtoimprovetheaestheticabilityofmachinevision AT yingjiezhang renderingnaturalbokeheffectsbasedondepthestimationtoimprovetheaestheticabilityofmachinevision AT yiboai renderingnaturalbokeheffectsbasedondepthestimationtoimprovetheaestheticabilityofmachinevision AT weidongzhang renderingnaturalbokeheffectsbasedondepthestimationtoimprovetheaestheticabilityofmachinevision |