Skip to main content

Research Repository

Advanced Search

Developing a Semantic-Driven Hybrid Segmentation Method for Point Clouds of 3D Shapes

Yang, Xiaowen; Han, Xie; Li, Qingde; He, Ligang; Pang, Min; Jia, Caiqin


Xiaowen Yang

Xie Han

Ligang He

Min Pang

Caiqin Jia


With the rapid development of point cloud processing technologies and the availability of a wide range of 3D capturing devices, a geometric object from the real world can be directly represented digitally as a dense and fine point cloud. Decomposing a 3D shape represented in point cloud into meaningful parts has very important practical implications in the fields of computer graphics, virtual reality and mixed reality. In this paper, a semantic-driven automated hybrid segmentation method is proposed for 3D point cloud shapes. Our method consists of three stages: semantic clustering, variational merging, and region remerging. In the first stage, a new feature of point cloud, called Local Concave-Convex Histogram, is introduced to first extract saddle regions complying with the semantic boundary feature. All other types of regions are then aggregated according to this extracted feature. This stage often leads to multiple over-segmentation convex regions, which are then remerged by a variational method established based on the narrow-band theory. Finally, in order to recombine the regions with the approximate shapes, order relation is introduced to improve the weighting forms in calculating the conventional Shape Diameter Function. We have conducted extensive experiments with the Princeton Dataset. The results show that the proposed algorithm outperforms the state-of-the-art algorithms in this area. We have also applied the proposed algorithm to process the point cloud data acquired directly from the real 3D objects. It achieves excellent results too. These results demonstrate that the method proposed in this paper is effective and universal.


Yang, X., Han, X., Li, Q., He, L., Pang, M., & Jia, C. (2020). Developing a Semantic-Driven Hybrid Segmentation Method for Point Clouds of 3D Shapes. IEEE Access, 8, 40861-40880.

Journal Article Type Article
Acceptance Date Feb 21, 2020
Online Publication Date Feb 27, 2020
Publication Date 2020
Deposit Date Mar 12, 2020
Publicly Available Date Mar 12, 2020
Journal IEEE Access
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
Volume 8
Pages 40861-40880
Keywords Three-dimensional displays; Shape; Clustering algorithms; Image segmentation; Feature extraction; Semantics; Surface reconstruction;Semantic-driven; local concave-convex histogram; variational method; shape diameter function
Public URL
Publisher URL


You might also like

Downloadable Citations