Point-Denoise: Unsupervised outlier detection for 3D point clouds enhancement | Multimedia Tools and Applications Skip to main content
Springer Nature Link
Log in

Point-Denoise: Unsupervised outlier detection for 3D point clouds enhancement

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

3D point cloud denoising is an increasingly demanding field as such type of data structure is getting more attention in perceiving the 3D environment for diverse applications. Despite their novelty, recently proposed solutions are still modest in terms of effectiveness and robustness, especially for scenes corrupted with a massive amount of noise. The encountered challenges are mainly due to the data acquisition process and the little-to-no knowledge of the statistical data distribution. In this paper, two promising unsupervised machine learning techniques are investigated, which are the Isolation Forest (If) and the Elliptic Envelope (EE). Each of these techniques detects noise using different philosophies. If uses a forest of iTrees; while EE uses a learned imaginary elliptic. The proposed solution, named Point-Denoise, tunes both techniques and fuses them at the decision-level. Although the solution simplicity, Point-Denoise reports superior results to state-of-the-art techniques. For evaluation purposes, both synthetic and real data are used. The chosen synthetic data is the ModelNet40 benchmark, which is augmented with a Gaussian and emulated 3D scanner noise with three different standard deviations: 0.5%, 1.0%, and 1.5% assessing the robustness of the proposed methodology. Meanwhile, the real data is collected from the Qatar University campus. Considering that a massive amount of noise already corrupts real data at acquisition time, no additional noise is augmented. Point-Denoise outperforms state-of-the-art solutions (i.e., traditional filtering, supervised, and unsupervised learning techniques) by attaining a 0.24 distance error and achieving a 48.93% enhancement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Brownlee J (2020) One-class classification algorithms for imbalanced datasets. https://machinelearningmastery.com/one-class-classification-algorithms/

  2. Chen H, Wei M, Sun Y, Xie X, Wang J (2019) Multi-patch collaborative point cloud denoising via low-rank recovery with graph constraint. IEEE Transactions on Visualization and Computer Graphics

  3. Chen Y, Liu L, Tao J, Xia R, Zhang Q, Yang K, Xiong J, Chen X (2020) The improved image inpainting algorithm via encoder and similarity constraint. Vis Comput, pp 1–15

  4. Chen Y, Tao J, Liu L, Xiong J, Xia R, Xie J, Zhang Q, Yang K (2020) Research of improving semantic image segmentation based on a feature fusion model. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING

  5. Chen Y, Tao J, Zhang Q, Yang K, Chen X, Xiong J, Xia R, Xie J (2020) Saliency detection via the improved hierarchical principal component analysis method. Wirel Commun Mob Comput 2020

  6. Chen Y, Wang J, Chen X, Sangaiah AK, Yang K, Cao Z (2019) Image super-resolution algorithm based on dual-channel convolutional neural networks. Appl Sci 9(11):2316

    Article  Google Scholar 

  7. Chen Y, Wang J, Chen X, Zhu M, Yang K, Wang Z, Xia R (2019) Single-image super-resolution algorithm based on structural self-similarity and deformation block features. IEEE Access 7:58791–58801

    Article  Google Scholar 

  8. Chen Y, Wang J, Liu S, Chen X, Xiong J, Xie J, Yang K (2019) Multiscale fast correlation filtering tracking algorithm based on a feature fusion model. Concurrency and Computation: Practice and Experience, pp e5533

  9. Digne J, De Franchis C (2017) The bilateral filter for point clouds

  10. Domingues R, Filippone M, Michiardi P, Zouaoui J (2018) A comparative evaluation of outlier detection algorithms: Experiments and analyses. Pattern Recogn 74:406–421

    Article  Google Scholar 

  11. Duan C, Chen S, Kovacevic J (2018) Weighted multi-projection: 3d point cloud denoising with tangent planes. In: 2018 IEEE Global conference on signal and information processing (globalSIP), IEEE, pp 725–729

  12. Fan H, Su H, Guibas LJ (2017) A point set generation network for 3d object reconstruction from a single image. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 605–613

  13. Han XF, Jin JS, Wang MJ, Jiang W (2018) Guided 3d point cloud filtering. Multimedia Tools and Applications 77(13):17397–17411

    Article  Google Scholar 

  14. Han XF, Jin JS, Wang MJ, Jiang W, Gao L, Xiao L (2017) A review of algorithms for filtering the 3d point cloud. Signal Process Image Commun 57:103–112

    Article  Google Scholar 

  15. Hermosilla P, Ritschel T, Ropinski T (2019) Total denoising: Unsupervised learning of 3d point cloud cleaning. In: Proceedings of the IEEE international conference on computer vision, pp 52–60

  16. Hoyle B, Rau MM, Paech K, Bonnett C, Seitz S, Weller J (2015) Anomaly detection for machine learning redshifts applied to sdss galaxies. Mon Not R Astron Soc 452(4):4183–4194

    Article  Google Scholar 

  17. Huang H, Wu S, Gong M, Cohen-Or D, Ascher U, Zhang HR (2013) Edge-aware point set resampling. ACM Trans Graph (TOG) 32(1):9

    Article  Google Scholar 

  18. Javaheri A, Brites C, Pereira F, Ascenso J (2017) Subjective and objective quality evaluation of 3d point cloud denoising algorithms. In: 2017 IEEE International conference on multimedia & expo workshops (ICMEW), IEEE, pp 1–6

  19. Khan SS, Madden MG (2014) One-class classification: taxonomy of study and review of techniques. Knowl Eng Rev 29(3):345–374

    Article  Google Scholar 

  20. Landrieu L, Simonovsky M (2018) Large-scale point cloud semantic segmentation with superpoint graphs. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4558–4567

  21. Levin D (1998) The approximation power of moving least-squares. Mathematics of Computation of the American Mathematical Society 67 (224):1517–1531

    Article  MathSciNet  Google Scholar 

  22. Li J, Zhang XP, Tran T (2019) Point cloud denoising based on tensor tucker decomposition. arXiv preprint arXiv:1902.07602

  23. Liu FT, Ting KM, Zhou ZH (2008) Isolation forest. In: 2008 Eighth IEEE international conference on data mining, IEEE, pp 413–422

  24. Liu FT, Ting KM, Zhou ZH (2012) Isolation-based anomaly detection. ACM Trans Knowl Discov Data (TKDD) 6(1):3

    Google Scholar 

  25. Liu K, Wang W, Tharmarasa R, Wang J, Zuo Y (2019) Ground surface filtering of 3d point clouds based on hybrid regression technique. IEEE Access 7:23270–23284

    Article  Google Scholar 

  26. Qi CR, Su H, Mo K, Guibas LJ (2017) Pointnet: Deep learning on point sets for 3d classification and segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 652–660

  27. Rakotosaona MJ, La Barbera V, Guerrero P, Mitra NJ, Ovsjanikov M (2020) Pointcleannet: Learning to denoise and remove outliers from dense point clouds. In: Computer graphics forum, Wiley online library, vol 39, pp 185–203

  28. Regaya Y, Fadli F, Amira A (2019) 3d point cloud enhancement using unsupervised anomaly detection. In: 2019 International symposium on systems engineering (ISSE), IEEE, pp 1–6

  29. Rousseeuw PJ, Driessen KV (1999) A fast algorithm for the minimum covariance determinant estimator. Technometrics 41(3):212–223

    Article  Google Scholar 

  30. Rusu RB, Cousins S (2011) 3d is here: Point cloud library (pcl). In: 2011 IEEE International conference on robotics and automation, IEEE, pp 1–4

  31. Sun Y, Schaefer S, Wang W (2015) Denoising point sets via l0 minimization. Computer Aided Geometric Design 35:2–15

    Article  MathSciNet  Google Scholar 

  32. tech27.com resources: Stay connected with the latest in industrial ai, smart engineering & iot. https://tech27.com/resources/point-clouds/

  33. Wand M, Berner A, Bokeloh M, Jenke P, Fleck A, Hoffmann M, Maier B, Staneker D, Schilling A, Seidel HP (2008) Processing and interactive editing of huge point clouds from 3d scanners. Computers & Graphics 32 (2):204–220

    Article  Google Scholar 

  34. Wang Q, Kim MK (2019) Applications of 3d point cloud data in the construction industry: a fifteen-year review from 2004 to 2018. Adv Eng Inform 39:306–319

    Article  Google Scholar 

  35. Zeng J, Cheung G, Ng M, Pang J, Yang C (2018) 3d point cloud denoising using graph laplacian regularization of a low dimensional manifold model. arXiv preprint arXiv:1803.07252

  36. Zhou L, Zhang T, Tian Y, Huang H (2020) Fraction-order total variation image blind restoration based on self-similarity features. IEEE Access 8:30436–30444

    Article  Google Scholar 

  37. Zhou Y, Tuzel O (2018) Voxelnet: End-to-end learning for point cloud based 3d object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4490–4499

Download references

Author information

Authors and Affiliations

  1. Computer Science and Engineering Department, Qatar University, Doha, Qatar

    Yousra Regaya

  2. Department of Architecture and Urban Planning, College of Engineering, Qatar University, Doha, Qatar

    Fodil Fadli

  3. Institute of Artificial Intelligence, De Montfort University, Leicester, UK

    Abbes Amira

Authors
  1. Yousra Regaya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fodil Fadli
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abbes Amira
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yousra Regaya.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Regaya, Y., Fadli, F. & Amira, A. Point-Denoise: Unsupervised outlier detection for 3D point clouds enhancement. Multimed Tools Appl 80, 28161–28177 (2021). https://doi.org/10.1007/s11042-021-10924-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10924-x

Keywords

Search

Navigation