A 6DoF Pose Estimation Dataset and Network for Multiple Parametric Shapes in Stacked Scenarios
Most industrial parts are instantiated from different parametric templates. The 6DoF (6D) pose estimation tasks are challenging, since some part objects from a known template may be unseen before. This paper releases a new and well-annotated 6D pose estimation dataset for multiple parametric templat...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-11-01
|
| Series: | Machines |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2075-1702/9/12/321 |
| _version_ | 1797502862014545920 |
|---|---|
| author | Xinyu Zhang Weijie Lv Long Zeng |
| author_facet | Xinyu Zhang Weijie Lv Long Zeng |
| author_sort | Xinyu Zhang |
| collection | DOAJ |
| description | Most industrial parts are instantiated from different parametric templates. The 6DoF (6D) pose estimation tasks are challenging, since some part objects from a known template may be unseen before. This paper releases a new and well-annotated 6D pose estimation dataset for multiple parametric templates in stacked scenarios donated as Multi-Parametric Dataset, where a training set (50K scenes) and a test set (2K scenes) are obtained by automatical labeling techniques. In particular, the test set is further divided into a TEST-L dataset for learning evaluation and a TEST-G dataset for generalization evaluation. Since the part objects from the same template are regarded as a class in the Multi-Parametric Dataset and the number of part objects is infinite, we propose a new 6D pose estimation network as our baseline method, Multi-templates Parametric Pose Network (MPP-Net), aiming to have sufficient generalization ability for parametric part objects in stacked scenarios. To our best knowledge, our dataset and method are the first to jointly achieve 6D pose estimation and parameter values prediction for multiple parametric templates. Many experiments are conducted on the Multi-Parametric Dataset. The mIoU and Overall Accuracy of foreground segmentation and template segmentation on the two test datasets exceed 99.0%. Besides, MPP-Net achieves 92.9% and 90.8% on mAP under the threshold of 0.5cm for translation prediction, achieves 41.9% and 36.8% under the threshold of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mn>5</mn><mo>∘</mo></msup></semantics></math></inline-formula> for rotation prediction, and achieves 51.0% and 6.0% under the threshold of 5% for parameter values prediction, on the two test set, respectively. The results have shown that our dataset has exploratory value for 6D pose estimation and parameter values prediction tasks. |
| first_indexed | 2024-03-10T03:42:12Z |
| format | Article |
| id | doaj.art-a06ab7929a1e4d9d8632370a58401c22 |
| institution | Directory Open Access Journal |
| issn | 2075-1702 |
| language | English |
| last_indexed | 2024-03-10T03:42:12Z |
| publishDate | 2021-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Machines |
| spelling | doaj.art-a06ab7929a1e4d9d8632370a58401c222023-11-23T09:16:33ZengMDPI AGMachines2075-17022021-11-0191232110.3390/machines9120321A 6DoF Pose Estimation Dataset and Network for Multiple Parametric Shapes in Stacked ScenariosXinyu Zhang0Weijie Lv1Long Zeng2Department of Advanced Manufacturing, Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, ChinaDepartment of Mechanical Engineering, Tsinghua University, Beijing 100084, ChinaDepartment of Advanced Manufacturing, Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, ChinaMost industrial parts are instantiated from different parametric templates. The 6DoF (6D) pose estimation tasks are challenging, since some part objects from a known template may be unseen before. This paper releases a new and well-annotated 6D pose estimation dataset for multiple parametric templates in stacked scenarios donated as Multi-Parametric Dataset, where a training set (50K scenes) and a test set (2K scenes) are obtained by automatical labeling techniques. In particular, the test set is further divided into a TEST-L dataset for learning evaluation and a TEST-G dataset for generalization evaluation. Since the part objects from the same template are regarded as a class in the Multi-Parametric Dataset and the number of part objects is infinite, we propose a new 6D pose estimation network as our baseline method, Multi-templates Parametric Pose Network (MPP-Net), aiming to have sufficient generalization ability for parametric part objects in stacked scenarios. To our best knowledge, our dataset and method are the first to jointly achieve 6D pose estimation and parameter values prediction for multiple parametric templates. Many experiments are conducted on the Multi-Parametric Dataset. The mIoU and Overall Accuracy of foreground segmentation and template segmentation on the two test datasets exceed 99.0%. Besides, MPP-Net achieves 92.9% and 90.8% on mAP under the threshold of 0.5cm for translation prediction, achieves 41.9% and 36.8% under the threshold of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mn>5</mn><mo>∘</mo></msup></semantics></math></inline-formula> for rotation prediction, and achieves 51.0% and 6.0% under the threshold of 5% for parameter values prediction, on the two test set, respectively. The results have shown that our dataset has exploratory value for 6D pose estimation and parameter values prediction tasks.https://www.mdpi.com/2075-1702/9/12/321automationdeep learningpose estimationrobotic grasping |
| spellingShingle | Xinyu Zhang Weijie Lv Long Zeng A 6DoF Pose Estimation Dataset and Network for Multiple Parametric Shapes in Stacked Scenarios Machines automation deep learning pose estimation robotic grasping |
| title | A 6DoF Pose Estimation Dataset and Network for Multiple Parametric Shapes in Stacked Scenarios |
| title_full | A 6DoF Pose Estimation Dataset and Network for Multiple Parametric Shapes in Stacked Scenarios |
| title_fullStr | A 6DoF Pose Estimation Dataset and Network for Multiple Parametric Shapes in Stacked Scenarios |
| title_full_unstemmed | A 6DoF Pose Estimation Dataset and Network for Multiple Parametric Shapes in Stacked Scenarios |
| title_short | A 6DoF Pose Estimation Dataset and Network for Multiple Parametric Shapes in Stacked Scenarios |
| title_sort | 6dof pose estimation dataset and network for multiple parametric shapes in stacked scenarios |
| topic | automation deep learning pose estimation robotic grasping |
| url | https://www.mdpi.com/2075-1702/9/12/321 |
| work_keys_str_mv | AT xinyuzhang a6dofposeestimationdatasetandnetworkformultipleparametricshapesinstackedscenarios AT weijielv a6dofposeestimationdatasetandnetworkformultipleparametricshapesinstackedscenarios AT longzeng a6dofposeestimationdatasetandnetworkformultipleparametricshapesinstackedscenarios AT xinyuzhang 6dofposeestimationdatasetandnetworkformultipleparametricshapesinstackedscenarios AT weijielv 6dofposeestimationdatasetandnetworkformultipleparametricshapesinstackedscenarios AT longzeng 6dofposeestimationdatasetandnetworkformultipleparametricshapesinstackedscenarios |