ReDDLE-Net: Reflectance Decomposition for Directional Light Estimation

The surfaces of real objects can visually appear to be glossy, matte, or anywhere in between, but essentially, they display varying degrees of diffuse and specular reflectance. Diffuse and specular reflectance provides different clues for light estimation. However, few methods simultaneously conside...

Full description

Bibliographic Details
Main Authors: Jiangxin Yang, Binjie Ding, Zewei He, Gang Pan, Yanpeng Cao, Yanlong Cao, Qian Zheng
Format: Article
Language:English
Published: MDPI AG 2022-09-01
Series:Photonics
Subjects:
Online Access:https://www.mdpi.com/2304-6732/9/9/656
_version_ 1797483478455943168
author Jiangxin Yang
Binjie Ding
Zewei He
Gang Pan
Yanpeng Cao
Yanlong Cao
Qian Zheng
author_facet Jiangxin Yang
Binjie Ding
Zewei He
Gang Pan
Yanpeng Cao
Yanlong Cao
Qian Zheng
author_sort Jiangxin Yang
collection DOAJ
description The surfaces of real objects can visually appear to be glossy, matte, or anywhere in between, but essentially, they display varying degrees of diffuse and specular reflectance. Diffuse and specular reflectance provides different clues for light estimation. However, few methods simultaneously consider the contributions of diffuse and specular reflectance for light estimation. To this end, we propose ReDDLE-Net, which performs <b>Re</b>flectance <b>D</b>ecomposition for <b>D</b>irectional <b>L</b>ight <b>E</b>stimation. The primary idea is to take advantage of diffuse and specular clues and adaptively balance the contributions of estimated diffuse and specular components for light estimation. Our method achieves a superior performance advantage over state-of-the-art directional light estimation methods on the DiLiGenT benchmark. Meanwhile, the proposed ReDDLE-Net can be combined with existing calibrated photometric stereo methods to handle uncalibrated photometric stereo tasks and achieve state-of-the-art performance.
first_indexed 2024-03-09T22:48:32Z
format Article
id doaj.art-872e9706ebcc423f9b7b89285ab327c4
institution Directory Open Access Journal
issn 2304-6732
language English
last_indexed 2024-03-09T22:48:32Z
publishDate 2022-09-01
publisher MDPI AG
record_format Article
series Photonics
spelling doaj.art-872e9706ebcc423f9b7b89285ab327c42023-11-23T18:25:05ZengMDPI AGPhotonics2304-67322022-09-019965610.3390/photonics9090656ReDDLE-Net: Reflectance Decomposition for Directional Light EstimationJiangxin Yang0Binjie Ding1Zewei He2Gang Pan3Yanpeng Cao4Yanlong Cao5Qian Zheng6State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, ChinaState Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, ChinaState Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, ChinaCollege of Computer Science and Technology, Zhejiang University, Hangzhou 310027, ChinaState Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, ChinaState Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, ChinaCollege of Computer Science and Technology, Zhejiang University, Hangzhou 310027, ChinaThe surfaces of real objects can visually appear to be glossy, matte, or anywhere in between, but essentially, they display varying degrees of diffuse and specular reflectance. Diffuse and specular reflectance provides different clues for light estimation. However, few methods simultaneously consider the contributions of diffuse and specular reflectance for light estimation. To this end, we propose ReDDLE-Net, which performs <b>Re</b>flectance <b>D</b>ecomposition for <b>D</b>irectional <b>L</b>ight <b>E</b>stimation. The primary idea is to take advantage of diffuse and specular clues and adaptively balance the contributions of estimated diffuse and specular components for light estimation. Our method achieves a superior performance advantage over state-of-the-art directional light estimation methods on the DiLiGenT benchmark. Meanwhile, the proposed ReDDLE-Net can be combined with existing calibrated photometric stereo methods to handle uncalibrated photometric stereo tasks and achieve state-of-the-art performance.https://www.mdpi.com/2304-6732/9/9/656uncalibrated photometric stereodiffuse reflectancespecular reflectanceconvolutional neural network
spellingShingle Jiangxin Yang
Binjie Ding
Zewei He
Gang Pan
Yanpeng Cao
Yanlong Cao
Qian Zheng
ReDDLE-Net: Reflectance Decomposition for Directional Light Estimation
Photonics
uncalibrated photometric stereo
diffuse reflectance
specular reflectance
convolutional neural network
title ReDDLE-Net: Reflectance Decomposition for Directional Light Estimation
title_full ReDDLE-Net: Reflectance Decomposition for Directional Light Estimation
title_fullStr ReDDLE-Net: Reflectance Decomposition for Directional Light Estimation
title_full_unstemmed ReDDLE-Net: Reflectance Decomposition for Directional Light Estimation
title_short ReDDLE-Net: Reflectance Decomposition for Directional Light Estimation
title_sort reddle net reflectance decomposition for directional light estimation
topic uncalibrated photometric stereo
diffuse reflectance
specular reflectance
convolutional neural network
url https://www.mdpi.com/2304-6732/9/9/656
work_keys_str_mv AT jiangxinyang reddlenetreflectancedecompositionfordirectionallightestimation
AT binjieding reddlenetreflectancedecompositionfordirectionallightestimation
AT zeweihe reddlenetreflectancedecompositionfordirectionallightestimation
AT gangpan reddlenetreflectancedecompositionfordirectionallightestimation
AT yanpengcao reddlenetreflectancedecompositionfordirectionallightestimation
AT yanlongcao reddlenetreflectancedecompositionfordirectionallightestimation
AT qianzheng reddlenetreflectancedecompositionfordirectionallightestimation