Disparity map calculation through epipolar lines estimation for 3D facial reconstruction
In this paper, we tackle the problem of 3D reconstruction of human faces from a given stereo pair 2D instances, namely left and right images. The generated 3D model is developed to be the main input for Medical imaging tasks, although the model can be exploited in other fields as well. The algorithm...
Main Authors: | , , |
---|---|
Format: | Conference or Workshop Item |
Language: | English |
Published: |
2005
|
Subjects: | |
Online Access: | http://eprints.utm.my/1216/1/Paper044abbas.pdf |
_version_ | 1825909034470866944 |
---|---|
author | Cheddad, Abbas Setan, Halim Majid, Zulkepli |
author_facet | Cheddad, Abbas Setan, Halim Majid, Zulkepli |
author_sort | Cheddad, Abbas |
collection | ePrints |
description | In this paper, we tackle the problem of 3D reconstruction of human faces from a given stereo pair 2D instances, namely left and right images. The generated 3D model is developed to be the main input for Medical imaging tasks, although the model can be exploited in other fields as well. The algorithm is decomposed into two phases. The first phase deals with the location and extraction of human face from its cluttered background, this process is to focus on the region of interest (ROI) and to lessen
down the computational burden. Since the input 2D pair of images are in color form, a wise decision is made to exploit their RGB color map information such that the RGB matrix is transformed into a new mapping encapsulating the intensity values (Y), the Chromatic blue (Cb) and Chromatic red (Cr)(e.g.: RGB ÃŽYCbCr). The second phase is the core of this paper. In stereo vision knowledge of
epipolar lines (ELs) is extremely important as they describe the geometric relationship between the world points and their projections on the imaging sensors. In other words, these ELs with the predetermined two epipoles will solve what is known as the correspondence problem in an efficient way and reduces the search from the original 2D plan into merely 1D vector. In fact, the ELs are
prone to errors; therefore, they must be constructed with care. To eliminate this problem and to increase the precision we chose to start with an initial eight matched points to generate the Fundamental Matrix (FM), this is called the 8- Points Algorithm. The FM has a compact description of the camera parameters and it is a 3x3 matrix. The 8- Points are selected from applying Harris
corner detector. Thus, the epipolar line function will be given by: EL=F*f(x,y), where f(x,y) holds the
point coordinates in the form [x,y,1]T , the superscript ( T ) denotes matrix transpose. This indicates that the epipolar constraint can be established with no prior knowledge of the stereo parameters. A dense disparity map is generated to be the input for the depth calculation which, in its turn leads to 3D model formation. |
first_indexed | 2024-03-05T17:56:07Z |
format | Conference or Workshop Item |
id | utm.eprints-1216 |
institution | Universiti Teknologi Malaysia - ePrints |
language | English |
last_indexed | 2024-03-05T17:56:07Z |
publishDate | 2005 |
record_format | dspace |
spelling | utm.eprints-12162017-08-28T03:25:51Z http://eprints.utm.my/1216/ Disparity map calculation through epipolar lines estimation for 3D facial reconstruction Cheddad, Abbas Setan, Halim Majid, Zulkepli TA Engineering (General). Civil engineering (General) In this paper, we tackle the problem of 3D reconstruction of human faces from a given stereo pair 2D instances, namely left and right images. The generated 3D model is developed to be the main input for Medical imaging tasks, although the model can be exploited in other fields as well. The algorithm is decomposed into two phases. The first phase deals with the location and extraction of human face from its cluttered background, this process is to focus on the region of interest (ROI) and to lessen down the computational burden. Since the input 2D pair of images are in color form, a wise decision is made to exploit their RGB color map information such that the RGB matrix is transformed into a new mapping encapsulating the intensity values (Y), the Chromatic blue (Cb) and Chromatic red (Cr)(e.g.: RGB ÃŽYCbCr). The second phase is the core of this paper. In stereo vision knowledge of epipolar lines (ELs) is extremely important as they describe the geometric relationship between the world points and their projections on the imaging sensors. In other words, these ELs with the predetermined two epipoles will solve what is known as the correspondence problem in an efficient way and reduces the search from the original 2D plan into merely 1D vector. In fact, the ELs are prone to errors; therefore, they must be constructed with care. To eliminate this problem and to increase the precision we chose to start with an initial eight matched points to generate the Fundamental Matrix (FM), this is called the 8- Points Algorithm. The FM has a compact description of the camera parameters and it is a 3x3 matrix. The 8- Points are selected from applying Harris corner detector. Thus, the epipolar line function will be given by: EL=F*f(x,y), where f(x,y) holds the point coordinates in the form [x,y,1]T , the superscript ( T ) denotes matrix transpose. This indicates that the epipolar constraint can be established with no prior knowledge of the stereo parameters. A dense disparity map is generated to be the input for the depth calculation which, in its turn leads to 3D model formation. 2005-09 Conference or Workshop Item PeerReviewed application/pdf en http://eprints.utm.my/1216/1/Paper044abbas.pdf Cheddad, Abbas and Setan, Halim and Majid, Zulkepli (2005) Disparity map calculation through epipolar lines estimation for 3D facial reconstruction. In: International Symposium & Exhibition on Geoinformation 2005, 27-29 Sept 2005, Penang, Malaysia. http://www.civil.eng.usm.my/isg2005/home.shtml |
spellingShingle | TA Engineering (General). Civil engineering (General) Cheddad, Abbas Setan, Halim Majid, Zulkepli Disparity map calculation through epipolar lines estimation for 3D facial reconstruction |
title | Disparity map calculation through epipolar lines estimation
for 3D facial reconstruction
|
title_full | Disparity map calculation through epipolar lines estimation
for 3D facial reconstruction
|
title_fullStr | Disparity map calculation through epipolar lines estimation
for 3D facial reconstruction
|
title_full_unstemmed | Disparity map calculation through epipolar lines estimation
for 3D facial reconstruction
|
title_short | Disparity map calculation through epipolar lines estimation
for 3D facial reconstruction
|
title_sort | disparity map calculation through epipolar lines estimation for 3d facial reconstruction |
topic | TA Engineering (General). Civil engineering (General) |
url | http://eprints.utm.my/1216/1/Paper044abbas.pdf |
work_keys_str_mv | AT cheddadabbas disparitymapcalculationthroughepipolarlinesestimationfor3dfacialreconstruction AT setanhalim disparitymapcalculationthroughepipolarlinesestimationfor3dfacialreconstruction AT majidzulkepli disparitymapcalculationthroughepipolarlinesestimationfor3dfacialreconstruction |