Camper’s Plane Localization and Head Pose Estimation Based on Multi-View RGBD Sensors
Head pose estimation (HPE) is a key step in computation and quantification of 3D facial features and has a significant impact on the precision and accuracy of measurements. High-precision HPE is the basis for standardized facial data collection and analysis. The Camper’s plane is the stan...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9975311/ |
| _version_ | 1797978277994823680 |
|---|---|
| author | Huaqiang Wang Lu Huang Kang Yu Tingting Song Fengen Yuan Hao Yang Haiying Zhang |
| author_facet | Huaqiang Wang Lu Huang Kang Yu Tingting Song Fengen Yuan Hao Yang Haiying Zhang |
| author_sort | Huaqiang Wang |
| collection | DOAJ |
| description | Head pose estimation (HPE) is a key step in computation and quantification of 3D facial features and has a significant impact on the precision and accuracy of measurements. High-precision HPE is the basis for standardized facial data collection and analysis. The Camper’s plane is the standard (baseline) plane commonly used by anthropologists for head and face research, but there is no research on automatic positioning of the Camper’s plane using color and depth cameras. This paper presents a high-accuracy method for Camper’s plane localization and HPE based on multi-view RGBD depth sensors. The 3D facial point clouds acquired by the multi-view RGBD depth sensors are aligned to obtain a complete 3D face. Keypoint RCNN is used for facial keypoint detection to obtain facial landmarks. A method is proposed to build a general face datum model based on a self-built dataset. The head pose is estimated by applying rigid body transformation to an individual 3D face and the general 3D face model. In order to verify the accuracy of Camper’s plane localization and HPE, 102 cases of 3D facial data and experiments were collected and conducted. The tragus and nasal alar points are localized to within 7 pixels (about 0.83 cm) and the average accuracy of the three dimensions of Camper’s plane identified is 0.87°, 0.64° and 0.47° respectively. The average accuracies of the three dimensions of HPE were 1.17°, 0.90° and 0.97. The experiment results demonstrate the effectiveness of the method for Camper’s plane localization and HPE. |
| first_indexed | 2024-04-11T05:21:32Z |
| format | Article |
| id | doaj.art-44132f12c35541ccba9d943bc95090b6 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-11T05:21:32Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-44132f12c35541ccba9d943bc95090b62022-12-24T00:00:52ZengIEEEIEEE Access2169-35362022-01-011013172213173410.1109/ACCESS.2022.32275729975311Camper’s Plane Localization and Head Pose Estimation Based on Multi-View RGBD SensorsHuaqiang Wang0https://orcid.org/0000-0003-1527-1439Lu Huang1Kang Yu2Tingting Song3Fengen Yuan4Hao Yang5Haiying Zhang6https://orcid.org/0000-0003-1911-7957Institute of Microelectronics of Chinese Academy of Sciences, Beijing, ChinaInstitute of Microelectronics of Chinese Academy of Sciences, Beijing, ChinaInstitute of Microelectronics of Chinese Academy of Sciences, Beijing, ChinaInstitute of Microelectronics of Chinese Academy of Sciences, Beijing, ChinaInstitute of Microelectronics of Chinese Academy of Sciences, Beijing, ChinaInstitute of Microelectronics of Chinese Academy of Sciences, Beijing, ChinaInstitute of Microelectronics of Chinese Academy of Sciences, Beijing, ChinaHead pose estimation (HPE) is a key step in computation and quantification of 3D facial features and has a significant impact on the precision and accuracy of measurements. High-precision HPE is the basis for standardized facial data collection and analysis. The Camper’s plane is the standard (baseline) plane commonly used by anthropologists for head and face research, but there is no research on automatic positioning of the Camper’s plane using color and depth cameras. This paper presents a high-accuracy method for Camper’s plane localization and HPE based on multi-view RGBD depth sensors. The 3D facial point clouds acquired by the multi-view RGBD depth sensors are aligned to obtain a complete 3D face. Keypoint RCNN is used for facial keypoint detection to obtain facial landmarks. A method is proposed to build a general face datum model based on a self-built dataset. The head pose is estimated by applying rigid body transformation to an individual 3D face and the general 3D face model. In order to verify the accuracy of Camper’s plane localization and HPE, 102 cases of 3D facial data and experiments were collected and conducted. The tragus and nasal alar points are localized to within 7 pixels (about 0.83 cm) and the average accuracy of the three dimensions of Camper’s plane identified is 0.87°, 0.64° and 0.47° respectively. The average accuracies of the three dimensions of HPE were 1.17°, 0.90° and 0.97. The experiment results demonstrate the effectiveness of the method for Camper’s plane localization and HPE.https://ieeexplore.ieee.org/document/9975311/Head pose estimationmulti-viewcamper’s planedepth sensor3-D point cloud |
| spellingShingle | Huaqiang Wang Lu Huang Kang Yu Tingting Song Fengen Yuan Hao Yang Haiying Zhang Camper’s Plane Localization and Head Pose Estimation Based on Multi-View RGBD Sensors IEEE Access Head pose estimation multi-view camper’s plane depth sensor 3-D point cloud |
| title | Camper’s Plane Localization and Head Pose Estimation Based on Multi-View RGBD Sensors |
| title_full | Camper’s Plane Localization and Head Pose Estimation Based on Multi-View RGBD Sensors |
| title_fullStr | Camper’s Plane Localization and Head Pose Estimation Based on Multi-View RGBD Sensors |
| title_full_unstemmed | Camper’s Plane Localization and Head Pose Estimation Based on Multi-View RGBD Sensors |
| title_short | Camper’s Plane Localization and Head Pose Estimation Based on Multi-View RGBD Sensors |
| title_sort | camper x2019 s plane localization and head pose estimation based on multi view rgbd sensors |
| topic | Head pose estimation multi-view camper’s plane depth sensor 3-D point cloud |
| url | https://ieeexplore.ieee.org/document/9975311/ |
| work_keys_str_mv | AT huaqiangwang camperx2019splanelocalizationandheadposeestimationbasedonmultiviewrgbdsensors AT luhuang camperx2019splanelocalizationandheadposeestimationbasedonmultiviewrgbdsensors AT kangyu camperx2019splanelocalizationandheadposeestimationbasedonmultiviewrgbdsensors AT tingtingsong camperx2019splanelocalizationandheadposeestimationbasedonmultiviewrgbdsensors AT fengenyuan camperx2019splanelocalizationandheadposeestimationbasedonmultiviewrgbdsensors AT haoyang camperx2019splanelocalizationandheadposeestimationbasedonmultiviewrgbdsensors AT haiyingzhang camperx2019splanelocalizationandheadposeestimationbasedonmultiviewrgbdsensors |