3D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel Imaging

Transparent object detection and reconstruction are significant, due to their practical applications. The appearance and characteristics of light in these objects make reconstruction methods tailored for Lambertian surfaces fail disgracefully. In this paper, we introduce a fixed multi-viewpoint appr...

Full description

Bibliographic Details
Main Authors: Anumol Mathai, Ningqun Guo, Dong Liu, Xin Wang
Format: Article
Language:English
Published: MDPI AG 2020-07-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/15/4211
_version_ 1797560997609734144
author Anumol Mathai
Ningqun Guo
Dong Liu
Xin Wang
author_facet Anumol Mathai
Ningqun Guo
Dong Liu
Xin Wang
author_sort Anumol Mathai
collection DOAJ
description Transparent object detection and reconstruction are significant, due to their practical applications. The appearance and characteristics of light in these objects make reconstruction methods tailored for Lambertian surfaces fail disgracefully. In this paper, we introduce a fixed multi-viewpoint approach to ascertain the shape of transparent objects, thereby avoiding the rotation or movement of the object during imaging. In addition, a simple and cost-effective experimental setup is presented, which employs two single-pixel detectors and a digital micromirror device, for imaging transparent objects by projecting binary patterns. In the system setup, a dark framework is implemented around the object, to create shades at the boundaries of the object. By triangulating the light path from the object, the surface shape is recovered, neither considering the reflections nor the number of refractions. It can, therefore, handle transparent objects with a relatively complex shape with the unknown refractive index. The implementation of compressive sensing in this technique further simplifies the acquisition process, by reducing the number of measurements. The experimental results show that 2D images obtained from the single-pixel detectors are better in quality with a resolution of <inline-formula><math display="inline"><semantics><mrow><mn>32</mn><mo>×</mo><mn>32</mn></mrow></semantics></math></inline-formula>. Additionally, the obtained disparity and error map indicate the feasibility and accuracy of the proposed method. This work provides a new insight into 3D transparent object detection and reconstruction, based on single-pixel imaging at an affordable cost, with the implementation of a few numbers of detectors.
first_indexed 2024-03-10T18:08:10Z
format Article
id doaj.art-752ad21b7c1943e18b2a396cd1027bb5
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T18:08:10Z
publishDate 2020-07-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-752ad21b7c1943e18b2a396cd1027bb52023-11-20T08:20:09ZengMDPI AGSensors1424-82202020-07-012015421110.3390/s201542113D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel ImagingAnumol Mathai0Ningqun Guo1Dong Liu2Xin Wang3School of Engineering, Monash University Malaysia, Jalan Lagoon Selatan, Bandar Sunway, Selangor 47500, MalaysiaSchool of Engineering, Monash University Malaysia, Jalan Lagoon Selatan, Bandar Sunway, Selangor 47500, MalaysiaState Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, Zhejiang University, 38 Zheda Road, Hangzhou 310027, ChinaSchool of Engineering, Monash University Malaysia, Jalan Lagoon Selatan, Bandar Sunway, Selangor 47500, MalaysiaTransparent object detection and reconstruction are significant, due to their practical applications. The appearance and characteristics of light in these objects make reconstruction methods tailored for Lambertian surfaces fail disgracefully. In this paper, we introduce a fixed multi-viewpoint approach to ascertain the shape of transparent objects, thereby avoiding the rotation or movement of the object during imaging. In addition, a simple and cost-effective experimental setup is presented, which employs two single-pixel detectors and a digital micromirror device, for imaging transparent objects by projecting binary patterns. In the system setup, a dark framework is implemented around the object, to create shades at the boundaries of the object. By triangulating the light path from the object, the surface shape is recovered, neither considering the reflections nor the number of refractions. It can, therefore, handle transparent objects with a relatively complex shape with the unknown refractive index. The implementation of compressive sensing in this technique further simplifies the acquisition process, by reducing the number of measurements. The experimental results show that 2D images obtained from the single-pixel detectors are better in quality with a resolution of <inline-formula><math display="inline"><semantics><mrow><mn>32</mn><mo>×</mo><mn>32</mn></mrow></semantics></math></inline-formula>. Additionally, the obtained disparity and error map indicate the feasibility and accuracy of the proposed method. This work provides a new insight into 3D transparent object detection and reconstruction, based on single-pixel imaging at an affordable cost, with the implementation of a few numbers of detectors.https://www.mdpi.com/1424-8220/20/15/4211transparent object detectionsingle-pixel imagingcompressive sensingdisparity map acquisition
spellingShingle Anumol Mathai
Ningqun Guo
Dong Liu
Xin Wang
3D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel Imaging
Sensors
transparent object detection
single-pixel imaging
compressive sensing
disparity map acquisition
title 3D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel Imaging
title_full 3D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel Imaging
title_fullStr 3D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel Imaging
title_full_unstemmed 3D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel Imaging
title_short 3D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel Imaging
title_sort 3d transparent object detection and reconstruction based on passive mode single pixel imaging
topic transparent object detection
single-pixel imaging
compressive sensing
disparity map acquisition
url https://www.mdpi.com/1424-8220/20/15/4211
work_keys_str_mv AT anumolmathai 3dtransparentobjectdetectionandreconstructionbasedonpassivemodesinglepixelimaging
AT ningqunguo 3dtransparentobjectdetectionandreconstructionbasedonpassivemodesinglepixelimaging
AT dongliu 3dtransparentobjectdetectionandreconstructionbasedonpassivemodesinglepixelimaging
AT xinwang 3dtransparentobjectdetectionandreconstructionbasedonpassivemodesinglepixelimaging