Your browser does not fully support modern features. Please upgrade for a smoother experience.
Submitted Successfully!
Thank you for your contribution! You can also upload a video entry or images related to this topic. For video creation, please contact our Academic Video Service.
Version Summary Created by Modification Content Size Created at Operation
1 handwiki Camila Xu -- 7237 2022-10-19 01:32:31

Video Upload Options

We provide professional Academic Video Service to translate complex research into visually appealing presentations. Would you like to try it?
Cite
If you have any further questions, please contact Encyclopedia Editorial Office.
HandWiki. Point Set Registration. Encyclopedia. Available online: https://encyclopedia.pub/entry/30145 (accessed on 22 September 2026).
HandWiki. Point Set Registration. Encyclopedia. Available at: https://encyclopedia.pub/entry/30145. Accessed September 22, 2026.
HandWiki. "Point Set Registration" Encyclopedia, https://encyclopedia.pub/entry/30145 (accessed September 22, 2026).
HandWiki. (2022, October 19). Point Set Registration. In Encyclopedia. https://encyclopedia.pub/entry/30145
HandWiki. "Point Set Registration." Encyclopedia. Web. 19 October, 2022.
Point Set Registration
Edit

In computer vision, pattern recognition, and robotics, point set registration, also known as point cloud registration or scan matching, is the process of finding a spatial transformation (e.g., scaling, rotation and translation) that aligns two point clouds. The purpose of finding such a transformation includes merging multiple data sets into a globally consistent model (or coordinate frame), and mapping a new measurement to a known data set to identify features or to estimate its pose. Raw 3D point cloud data are typically obtained from Lidars and RGB-D cameras. 3D point clouds can also be generated from computer vision algorithms such as triangulation, bundle adjustment, and more recently, monocular image depth estimation using deep learning. For 2D point set registration used in image processing and feature-based image registration, a point set may be 2D pixel coordinates obtained by feature extraction from an image, for example corner detection. Point cloud registration has extensive applications in autonomous driving, motion estimation and 3D reconstruction, object detection and pose estimation, robotic manipulation, simultaneous localization and mapping (SLAM), panorama stitching, virtual and augmented reality, and medical imaging. As a special case, registration of two point sets that only differ by a 3D rotation (i.e., there is no scaling and translation), is called the Wahba Problem and also related to the orthogonal procrustes problem.

point cloud registration point set registration monocular image

References

  1. Jian, Bing; Vemuri, Baba C. (2011). "Robust Point Set Registration Using Gaussian Mixture Models". IEEE Transactions on Pattern Analysis and Machine Intelligence 33 (8): 1633–1645. doi:10.1109/tpami.2010.223. PMID 21173443.  https://dx.doi.org/10.1109%2Ftpami.2010.223
  2. Fitzgibbon, Andrew W. (2003). "Robust registration of 2D and 3D point sets". Image and Vision Computing 21 (13): 1145–1153. doi:10.1016/j.imavis.2003.09.004.  https://dx.doi.org/10.1016%2Fj.imavis.2003.09.004
  3. Myronenko, Andriy; Song, Xubo (2010). "Point set registration: Coherent Point drift". IEEE Transactions on Pattern Analysis and Machine Intelligence 32 (2): 2262–2275. doi:10.1109/tpami.2010.46. PMID 20975122.  https://dx.doi.org/10.1109%2Ftpami.2010.46
  4. Chui, Haili; Rangarajan, Anand (2003). "A new point matching algorithm for non-rigid registration". Computer Vision and Image Understanding 89 (2): 114–141. doi:10.1016/S1077-3142(03)00009-2.  https://dx.doi.org/10.1016%2FS1077-3142%2803%2900009-2
  5. Holz, Dirk; Ichim, Alexandru E.; Tombari, Federico; Rusu, Radu B.; Behnke, Sven (2015). "Registration with the Point Cloud Library: A Modular Framework for Aligning in 3-D". IEEE Robotics Automation Magazine 22 (4): 110–124. doi:10.1109/MRA.2015.2432331. https://www.researchgate.net/publication/283198426. 
  6. Horn, Berthold K. P. (1987-04-01). "Closed-form solution of absolute orientation using unit quaternions" (in EN). JOSA A 4 (4): 629–642. doi:10.1364/JOSAA.4.000629. ISSN 1520-8532. Bibcode: 1987JOSAA...4..629H.  https://dx.doi.org/10.1364%2FJOSAA.4.000629
  7. Arun, K. S.; Huang, T. S.; Blostein, S. D. (September 1987). "Least-Squares Fitting of Two 3-D Point Sets". IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-9 (5): 698–700. doi:10.1109/TPAMI.1987.4767965. ISSN 1939-3539. PMID 21869429.  https://dx.doi.org/10.1109%2FTPAMI.1987.4767965
  8. Briales, Jesus; Gonzalez-Jimenez, Javier (July 2017). "Convex Global 3D Registration with Lagrangian Duality". 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR): 5612–5621. doi:10.1109/CVPR.2017.595. ISBN 978-1-5386-0457-1.  https://dx.doi.org/10.1109%2FCVPR.2017.595
  9. Yang, Heng; Shi, Jingnan; Carlone, Luca (2020-01-21). "TEASER: Fast and Certifiable Point Cloud Registration". arXiv:2001.07715 [cs.RO]. //arxiv.org/archive/cs.RO
  10. Parra Bustos, Álvaro; Chin, Tat-Jun (December 2018). "Guaranteed Outlier Removal for Point Cloud Registration with Correspondences". IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (12): 2868–2882. doi:10.1109/TPAMI.2017.2773482. ISSN 1939-3539. PMID 29990122.  https://dx.doi.org/10.1109%2FTPAMI.2017.2773482
  11. Chin, Tat-Jun; Suter, David (2017-02-27). "The Maximum Consensus Problem: Recent Algorithmic Advances" (in en-US). Synthesis Lectures on Computer Vision 7 (2): 1–194. doi:10.2200/s00757ed1v01y201702cov011. ISSN 2153-1056.  https://dx.doi.org/10.2200%2Fs00757ed1v01y201702cov011
  12. Wen, Fei; Ying, Rendong; Gong, Zheng; Liu, Peilin (February 2020). "Efficient Algorithms for Maximum Consensus Robust Fitting". IEEE Transactions on Robotics 36 (1): 92–106. doi:10.1109/TRO.2019.2943061. ISSN 1941-0468.  https://dx.doi.org/10.1109%2FTRO.2019.2943061
  13. Cai, Zhipeng; Chin, Tat-Jun; Koltun, Vladlen (2019). "Consensus Maximization Tree Search Revisited". Proceedings of IEEE International Conference on Computer Vision (ICCV): 1637–1645. Bibcode: 2019arXiv190802021C. http://openaccess.thecvf.com/content_ICCV_2019/html/Cai_Consensus_Maximization_Tree_Search_Revisited_ICCV_2019_paper.html. 
  14. Bazin, Jean-Charles; Seo, Yongduek; Pollefeys, Marc (2013). Lee, Kyoung Mu; Matsushita, Yasuyuki; Rehg, James M. et al.. eds. "Globally Optimal Consensus Set Maximization through Rotation Search" (in en). Computer Vision – ACCV 2012. Lecture Notes in Computer Science (Berlin, Heidelberg: Springer) 7725: 539–551. doi:10.1007/978-3-642-37444-9_42. ISBN 978-3-642-37444-9.  https://dx.doi.org/10.1007%2F978-3-642-37444-9_42
  15. Hartley, Richard I.; Kahl, Fredrik (2009-04-01). "Global Optimization through Rotation Space Search" (in en). International Journal of Computer Vision 82 (1): 64–79. doi:10.1007/s11263-008-0186-9. ISSN 1573-1405.  https://dx.doi.org/10.1007%2Fs11263-008-0186-9
  16. Fischler, Martin; Bolles, Robert (1981). "Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography" (in EN). Communications of the ACM 24 (6): 381–395. doi:10.1145/358669.358692.  https://dx.doi.org/10.1145%2F358669.358692
  17. Le, Huu Minh; Chin, Tat-Jun; Eriksson, Anders; Do, Thanh-Toan; Suter, David (2019). "Deterministic Approximate Methods for Maximum Consensus Robust Fitting". IEEE Transactions on Pattern Analysis and Machine Intelligence 43 (3): 842–857. doi:10.1109/TPAMI.2019.2939307. ISSN 1939-3539. PMID 31494545.  https://dx.doi.org/10.1109%2FTPAMI.2019.2939307
  18. Yang, Heng; Carlone, Luca (2019). "A polynomial-time solution for robust registration with extreme outlier rates". Robotics: Science and Systems. doi:10.15607/RSS.2019.XV.003. ISBN 978-0-9923747-5-4.  https://dx.doi.org/10.15607%2FRSS.2019.XV.003
  19. Bustos, Alvaro Parra; Chin, Tat-Jun; Neumann, Frank; Friedrich, Tobias; Katzmann, Maximilian (2019-02-04). "A Practical Maximum Clique Algorithm for Matching with Pairwise Constraints". arXiv:1902.01534 [cs.CV]. //arxiv.org/archive/cs.CV
  20. Huber, Peter J.; Ronchetti, Elvezio M. (2009-01-29) (in en). Robust Statistics. Wiley Series in Probability and Statistics. Hoboken, NJ, USA: John Wiley & Sons, Inc.. doi:10.1002/9780470434697. ISBN 978-0-470-43469-7.  https://dx.doi.org/10.1002%2F9780470434697
  21. Zhou, Qian-Yi; Park, Jaesik; Koltun, Vladlen (2016). Leibe, Bastian; Matas, Jiri; Sebe, Nicu et al.. eds. "Fast Global Registration" (in en). Computer Vision – ECCV 2016. Lecture Notes in Computer Science (Cham: Springer International Publishing) 9906: 766–782. doi:10.1007/978-3-319-46475-6_47. ISBN 978-3-319-46475-6.  https://dx.doi.org/10.1007%2F978-3-319-46475-6_47
  22. Yang, Heng; Carlone, Luca (2019). "A Quaternion-based Certifiably Optimal Solution to the Wahba Problem with Outliers". Proceedings of the IEEE International Conference on Computer Vision (ICCV): 1665–1674. Bibcode: 2019arXiv190512536Y. http://openaccess.thecvf.com/content_ICCV_2019/papers/Yang_A_Quaternion-Based_Certifiably_Optimal_Solution_to_the_Wahba_Problem_With_ICCV_2019_paper.pdf. 
  23. MacTavish, Kirk; Barfoot, Timothy D. (2015). "At all Costs: A Comparison of Robust Cost Functions for Camera Correspondence Outliers". 2015 12th Conference on Computer and Robot Vision: 62–69. doi:10.1109/CRV.2015.52. ISBN 978-1-4799-1986-4.  https://dx.doi.org/10.1109%2FCRV.2015.52
  24. Bosse, Michael; Agamennoni, Gabriel; Gilitschenski, Igor (2016). "Robust Estimation and Applications in Robotics". Foundations and Trends in Robotics (now) 4 (4): 225–269. doi:10.1561/2300000047. https://ieeexplore.ieee.org/document/8187472. 
  25. Black, Michael J.; Rangarajan, Anand (1996-07-01). "On the unification of line processes, outlier rejection, and robust statistics with applications in early vision" (in en). International Journal of Computer Vision 19 (1): 57–91. doi:10.1007/BF00131148. ISSN 1573-1405.  https://dx.doi.org/10.1007%2FBF00131148
  26. Blake, Andrew; Zisserman, Andrew (1987). Visual reconstruction. The MIT Press. ISBN 9780262524063. https://mitpress.mit.edu/books/visual-reconstruction. 
  27. Yang, Heng; Antonante, Pasquale; Tzoumas, Vasileios; Carlone, Luca (2020). "Graduated Non-Convexity for Robust Spatial Perception: From Non-Minimal Solvers to Global Outlier Rejection". IEEE Robotics and Automation Letters 5 (2): 1127–1134. doi:10.1109/LRA.2020.2965893. ISSN 2377-3774.  https://dx.doi.org/10.1109%2FLRA.2020.2965893
  28. Besl, Paul; McKay, Neil (1992). "A Method for Registration of 3-D Shapes". IEEE Transactions on Pattern Analysis and Machine Intelligence 14 (2): 239–256. doi:10.1109/34.121791. Bibcode: 1992SPIE.1611..586B. https://www.researchgate.net/publication/3191994. 
  29. Tsin, Yanghai; Kanade, Takeo (2004). A Correlation-Based Approach to Robust Point Set Registration. Lecture Notes in Computer Science. 3023. Springer Berlin Heidelberg. 558–569. doi:10.1007/978-3-540-24672-5_44. ISBN 978-3-540-21982-8.  https://dx.doi.org/10.1007%2F978-3-540-24672-5_44
  30. Rusinkiewicz, Szymon; Levoy, Marc (2001). "Efficient variants of the ICP algorithm". Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, 2001.. IEEE. pp. 145–152. doi:10.1109/IM.2001.924423.  https://dx.doi.org/10.1109%2FIM.2001.924423
  31. Gold, Steven; Rangarajan, Anand; Lu, Chien-Ping; Suguna, Pappu; Mjolsness, Eric (1998). "New algorithms for 2d and 3d point matching:: pose estimation and correspondence". Pattern Recognition 38 (8): 1019–1031. doi:10.1016/S0031-3203(98)80010-1.  https://dx.doi.org/10.1016%2FS0031-3203%2898%2980010-1
  32. Jian, Bing; Vemuri, Baba C. (2005). "A robust algorithm for point set registration using mixture of Gaussians". Tenth IEEE International Conference on Computer Vision 2005. 2. pp. 1246–1251. 
  33. Myronenko, Andriy; Song, Xubo; Carriera-Perpinán, Miguel A. (2006). "Non-rigid point set registration: Coherent point drift". Advances in Neural Information Processing Systems 19: 1009–1016. http://papers.nips.cc/paper/2962-non-rigid-point-set-registration-coherent-point-drift. Retrieved 31 May 2014. 
  34. Hirose, Osamu (2020). "A Bayesian formulation of coherent point drift". IEEE Transactions on Pattern Analysis and Machine Intelligence Early access: 1–18. doi:10.1109/TPAMI.2020.2971687. PMID 32031931.  https://dx.doi.org/10.1109%2FTPAMI.2020.2971687
  35. Assalih, Hassan. (2013). "Chapter 6: Sorting the Correspondence Space" (PDF). 3D reconstruction and motion estimation using forward looking sonar (Ph.D.). Heriot-Watt University. http://www.ros.hw.ac.uk/bitstream/handle/10399/2647/AssalihH_1013_eps.pdf
More
Upload a video for this entry
Information
Subjects: Robotics
Contributor MDPI registered users' name will be linked to their SciProfiles pages. To register with us, please refer to https://encyclopedia.pub/register :
View Times: 1.9K
Entry Collection: HandWiki
Revision: 1 time (View History)
Update Date: 19 Oct 2022
Notice
You are not a member of the advisory board for this topic. If you want to update advisory board member profile, please contact office@encyclopedia.pub.
OK
Confirm
Only members of the Encyclopedia advisory board for this topic are allowed to note entries. Would you like to become an advisory board member of the Encyclopedia?
Yes
No
${ textCharacter }/${ maxCharacter }
Submit
Cancel
There is no comment~
${ textCharacter }/${ maxCharacter }
Submit
Cancel
${ selectedItem.replyTextCharacter }/${ selectedItem.replyMaxCharacter }
Submit
Cancel
Confirm
Are you sure to Delete?
Yes No
Academic Video Service