A coarse-to-fine point completion network with details compensation and structure enhancement
Abstract Point cloud completion, the issue of estimating the complete geometry of objects from partially-scanned point cloud data, becomes a fundamental task in many 3d vision and robotics applications. To address the limitations on inadequate prediction of shape details for traditional methods, a n...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2024-01-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-024-52343-6 |
| _version_ | 1797276602837499904 |
|---|---|
| author | Yongwei Miao Chengyu Jing Weihao Gao Xudong Zhang |
| author_facet | Yongwei Miao Chengyu Jing Weihao Gao Xudong Zhang |
| author_sort | Yongwei Miao |
| collection | DOAJ |
| description | Abstract Point cloud completion, the issue of estimating the complete geometry of objects from partially-scanned point cloud data, becomes a fundamental task in many 3d vision and robotics applications. To address the limitations on inadequate prediction of shape details for traditional methods, a novel coarse-to-fine point completion network (DCSE-PCN) is introduced in this work using the modules of local details compensation and shape structure enhancement for effective geometric learning. The coarse completion stage of our network consists of two branches—a shape structure recovery branch and a local details compensation branch, which can recover the overall shape of the underlying model and the shape details of incomplete point cloud through feature learning and hierarchical feature fusion. The fine completion stage of our network employs the structure enhancement module to reinforce the correlated shape structures of the coarse repaired shape (such as regular arrangement or symmetry), thus obtaining the completed geometric shape with finer-grained details. Extensive experimental results on ShapeNet dataset and ModelNet dataset validate the effectiveness of our completion network, which can recover the shape details of the underlying point cloud whilst maintaining its overall shape. Compared to the existing methods, our coarse-to-fine completion network has shown its competitive performance on both chamfer distance (CD) and earth mover distance (EMD) errors. Such as, the repairing results on the ShapeNet dataset of our completion network are reduced by an average of $$35.62\%$$ 35.62 % , $$33.31\%$$ 33.31 % , $$29.62\%$$ 29.62 % , and $$23.62\%$$ 23.62 % in terms of CD error, comparing with PCN, FoldingNet, Atlas, and CRN methods, respectively; and also reduced by an average of $$15.63\%$$ 15.63 % , $$1.29\%$$ 1.29 % , $$64.52\%$$ 64.52 % , and $$62.87\%$$ 62.87 % in terms of EMD error, respectively. Meanwhile, the completion results on the ModelNet dataset of our network have an average reduction of $$28.41\%$$ 28.41 % , $$26.57\%$$ 26.57 % , $$20.65\%$$ 20.65 % , and $$18.55\%$$ 18.55 % in terms of CD error, comparing to PCN, FoldingNet, Atlas, and CRN methods, respectively; and also an average reduction of $$21.91\%$$ 21.91 % , $$19.59\%$$ 19.59 % , $$43.51\%$$ 43.51 % , and $$21.49\%$$ 21.49 % in terms of EMD error, respectively. Our proposed point completion network is also robust to different degrees of data incompleteness and model noise. |
| first_indexed | 2024-03-07T15:30:33Z |
| format | Article |
| id | doaj.art-4cfa435cbf0a47f68aad33515bf78425 |
| institution | Directory Open Access Journal |
| issn | 2045-2322 |
| language | English |
| last_indexed | 2024-03-07T15:30:33Z |
| publishDate | 2024-01-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj.art-4cfa435cbf0a47f68aad33515bf784252024-03-05T16:25:59ZengNature PortfolioScientific Reports2045-23222024-01-0114111210.1038/s41598-024-52343-6A coarse-to-fine point completion network with details compensation and structure enhancementYongwei Miao0Chengyu Jing1Weihao Gao2Xudong Zhang3School of Information Science and Technology, Hangzhou Normal UniversitySchool of Computer Science and Technology, Zhejiang Sci-Tech UniversitySchool of Information Science and Technology, Hangzhou Normal UniversitySchool of Information Science and Technology, Zhejiang Shuren UniversityAbstract Point cloud completion, the issue of estimating the complete geometry of objects from partially-scanned point cloud data, becomes a fundamental task in many 3d vision and robotics applications. To address the limitations on inadequate prediction of shape details for traditional methods, a novel coarse-to-fine point completion network (DCSE-PCN) is introduced in this work using the modules of local details compensation and shape structure enhancement for effective geometric learning. The coarse completion stage of our network consists of two branches—a shape structure recovery branch and a local details compensation branch, which can recover the overall shape of the underlying model and the shape details of incomplete point cloud through feature learning and hierarchical feature fusion. The fine completion stage of our network employs the structure enhancement module to reinforce the correlated shape structures of the coarse repaired shape (such as regular arrangement or symmetry), thus obtaining the completed geometric shape with finer-grained details. Extensive experimental results on ShapeNet dataset and ModelNet dataset validate the effectiveness of our completion network, which can recover the shape details of the underlying point cloud whilst maintaining its overall shape. Compared to the existing methods, our coarse-to-fine completion network has shown its competitive performance on both chamfer distance (CD) and earth mover distance (EMD) errors. Such as, the repairing results on the ShapeNet dataset of our completion network are reduced by an average of $$35.62\%$$ 35.62 % , $$33.31\%$$ 33.31 % , $$29.62\%$$ 29.62 % , and $$23.62\%$$ 23.62 % in terms of CD error, comparing with PCN, FoldingNet, Atlas, and CRN methods, respectively; and also reduced by an average of $$15.63\%$$ 15.63 % , $$1.29\%$$ 1.29 % , $$64.52\%$$ 64.52 % , and $$62.87\%$$ 62.87 % in terms of EMD error, respectively. Meanwhile, the completion results on the ModelNet dataset of our network have an average reduction of $$28.41\%$$ 28.41 % , $$26.57\%$$ 26.57 % , $$20.65\%$$ 20.65 % , and $$18.55\%$$ 18.55 % in terms of CD error, comparing to PCN, FoldingNet, Atlas, and CRN methods, respectively; and also an average reduction of $$21.91\%$$ 21.91 % , $$19.59\%$$ 19.59 % , $$43.51\%$$ 43.51 % , and $$21.49\%$$ 21.49 % in terms of EMD error, respectively. Our proposed point completion network is also robust to different degrees of data incompleteness and model noise.https://doi.org/10.1038/s41598-024-52343-6 |
| spellingShingle | Yongwei Miao Chengyu Jing Weihao Gao Xudong Zhang A coarse-to-fine point completion network with details compensation and structure enhancement Scientific Reports |
| title | A coarse-to-fine point completion network with details compensation and structure enhancement |
| title_full | A coarse-to-fine point completion network with details compensation and structure enhancement |
| title_fullStr | A coarse-to-fine point completion network with details compensation and structure enhancement |
| title_full_unstemmed | A coarse-to-fine point completion network with details compensation and structure enhancement |
| title_short | A coarse-to-fine point completion network with details compensation and structure enhancement |
| title_sort | coarse to fine point completion network with details compensation and structure enhancement |
| url | https://doi.org/10.1038/s41598-024-52343-6 |
| work_keys_str_mv | AT yongweimiao acoarsetofinepointcompletionnetworkwithdetailscompensationandstructureenhancement AT chengyujing acoarsetofinepointcompletionnetworkwithdetailscompensationandstructureenhancement AT weihaogao acoarsetofinepointcompletionnetworkwithdetailscompensationandstructureenhancement AT xudongzhang acoarsetofinepointcompletionnetworkwithdetailscompensationandstructureenhancement AT yongweimiao coarsetofinepointcompletionnetworkwithdetailscompensationandstructureenhancement AT chengyujing coarsetofinepointcompletionnetworkwithdetailscompensationandstructureenhancement AT weihaogao coarsetofinepointcompletionnetworkwithdetailscompensationandstructureenhancement AT xudongzhang coarsetofinepointcompletionnetworkwithdetailscompensationandstructureenhancement |