Disparity map calculation through epipolar lines estimation for 3D facial reconstruction

In this paper, we tackle the problem of 3D reconstruction of human faces from a given stereo pair 2D instances, namely left and right images. The generated 3D model is developed to be the main input for Medical imaging tasks, although the model can be exploited in other fields as well. The algorithm...

Full description

Bibliographic Details
Main Authors: Cheddad, Abbas, Setan, Halim, Majid, Zulkepli
Format: Conference or Workshop Item
Language:English
Published: 2005
Subjects:
Online Access:http://eprints.utm.my/1216/1/Paper044abbas.pdf
_version_ 1825909034470866944
author Cheddad, Abbas
Setan, Halim
Majid, Zulkepli
author_facet Cheddad, Abbas
Setan, Halim
Majid, Zulkepli
author_sort Cheddad, Abbas
collection ePrints
description In this paper, we tackle the problem of 3D reconstruction of human faces from a given stereo pair 2D instances, namely left and right images. The generated 3D model is developed to be the main input for Medical imaging tasks, although the model can be exploited in other fields as well. The algorithm is decomposed into two phases. The first phase deals with the location and extraction of human face from its cluttered background, this process is to focus on the region of interest (ROI) and to lessen down the computational burden. Since the input 2D pair of images are in color form, a wise decision is made to exploit their RGB color map information such that the RGB matrix is transformed into a new mapping encapsulating the intensity values (Y), the Chromatic blue (Cb) and Chromatic red (Cr)(e.g.: RGB ÃŽYCbCr). The second phase is the core of this paper. In stereo vision knowledge of epipolar lines (ELs) is extremely important as they describe the geometric relationship between the world points and their projections on the imaging sensors. In other words, these ELs with the predetermined two epipoles will solve what is known as the correspondence problem in an efficient way and reduces the search from the original 2D plan into merely 1D vector. In fact, the ELs are prone to errors; therefore, they must be constructed with care. To eliminate this problem and to increase the precision we chose to start with an initial eight matched points to generate the Fundamental Matrix (FM), this is called the 8- Points Algorithm. The FM has a compact description of the camera parameters and it is a 3x3 matrix. The 8- Points are selected from applying Harris corner detector. Thus, the epipolar line function will be given by: EL=F*f(x,y), where f(x,y) holds the point coordinates in the form [x,y,1]T , the superscript ( T ) denotes matrix transpose. This indicates that the epipolar constraint can be established with no prior knowledge of the stereo parameters. A dense disparity map is generated to be the input for the depth calculation which, in its turn leads to 3D model formation.
first_indexed 2024-03-05T17:56:07Z
format Conference or Workshop Item
id utm.eprints-1216
institution Universiti Teknologi Malaysia - ePrints
language English
last_indexed 2024-03-05T17:56:07Z
publishDate 2005
record_format dspace
spelling utm.eprints-12162017-08-28T03:25:51Z http://eprints.utm.my/1216/ Disparity map calculation through epipolar lines estimation for 3D facial reconstruction Cheddad, Abbas Setan, Halim Majid, Zulkepli TA Engineering (General). Civil engineering (General) In this paper, we tackle the problem of 3D reconstruction of human faces from a given stereo pair 2D instances, namely left and right images. The generated 3D model is developed to be the main input for Medical imaging tasks, although the model can be exploited in other fields as well. The algorithm is decomposed into two phases. The first phase deals with the location and extraction of human face from its cluttered background, this process is to focus on the region of interest (ROI) and to lessen down the computational burden. Since the input 2D pair of images are in color form, a wise decision is made to exploit their RGB color map information such that the RGB matrix is transformed into a new mapping encapsulating the intensity values (Y), the Chromatic blue (Cb) and Chromatic red (Cr)(e.g.: RGB ÃŽYCbCr). The second phase is the core of this paper. In stereo vision knowledge of epipolar lines (ELs) is extremely important as they describe the geometric relationship between the world points and their projections on the imaging sensors. In other words, these ELs with the predetermined two epipoles will solve what is known as the correspondence problem in an efficient way and reduces the search from the original 2D plan into merely 1D vector. In fact, the ELs are prone to errors; therefore, they must be constructed with care. To eliminate this problem and to increase the precision we chose to start with an initial eight matched points to generate the Fundamental Matrix (FM), this is called the 8- Points Algorithm. The FM has a compact description of the camera parameters and it is a 3x3 matrix. The 8- Points are selected from applying Harris corner detector. Thus, the epipolar line function will be given by: EL=F*f(x,y), where f(x,y) holds the point coordinates in the form [x,y,1]T , the superscript ( T ) denotes matrix transpose. This indicates that the epipolar constraint can be established with no prior knowledge of the stereo parameters. A dense disparity map is generated to be the input for the depth calculation which, in its turn leads to 3D model formation. 2005-09 Conference or Workshop Item PeerReviewed application/pdf en http://eprints.utm.my/1216/1/Paper044abbas.pdf Cheddad, Abbas and Setan, Halim and Majid, Zulkepli (2005) Disparity map calculation through epipolar lines estimation for 3D facial reconstruction. In: International Symposium & Exhibition on Geoinformation 2005, 27-29 Sept 2005, Penang, Malaysia. http://www.civil.eng.usm.my/isg2005/home.shtml
spellingShingle TA Engineering (General). Civil engineering (General)
Cheddad, Abbas
Setan, Halim
Majid, Zulkepli
Disparity map calculation through epipolar lines estimation for 3D facial reconstruction
title Disparity map calculation through epipolar lines estimation for 3D facial reconstruction
title_full Disparity map calculation through epipolar lines estimation for 3D facial reconstruction
title_fullStr Disparity map calculation through epipolar lines estimation for 3D facial reconstruction
title_full_unstemmed Disparity map calculation through epipolar lines estimation for 3D facial reconstruction
title_short Disparity map calculation through epipolar lines estimation for 3D facial reconstruction
title_sort disparity map calculation through epipolar lines estimation for 3d facial reconstruction
topic TA Engineering (General). Civil engineering (General)
url http://eprints.utm.my/1216/1/Paper044abbas.pdf
work_keys_str_mv AT cheddadabbas disparitymapcalculationthroughepipolarlinesestimationfor3dfacialreconstruction
AT setanhalim disparitymapcalculationthroughepipolarlinesestimationfor3dfacialreconstruction
AT majidzulkepli disparitymapcalculationthroughepipolarlinesestimationfor3dfacialreconstruction