AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (10.1 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

A hand-eye calibration algorithm of binocular stereo vision based on multi-pixel 3D geometric centroid relocalization

Jiahao FUa,bHongdi LIUa,bMinqi HEa,bDahu ZHUa,b( )
Hubei Key Laboratory of Advanced Automotive Components Technology, Wuhan University of Technology, Wuhan 430070, China
Hubei Collaborative Innovation Center for Automotive Components Technology, Wuhan University of Technology, Wuhan 430070, China
Show Author Information

Abstract

The vision-guided robotic machining accuracy highly depends on the hand-eye calibration accuracy between robot and vision equipment. In order to address the problem of less parameter constraints in existing hand-eye calibration methods, in this paper a hand-eye calibration algorithm of binocular stereo vision is proposed based on multi-pixel 3D geometric centroid relocalization. The algorithm mainly includes three steps: 1) the checkerboard relocalization images of multiple sets of fixed-point pose transformations are captured by the binocular stereo vision; 2) the robot tool center point (TCP) coordinates in the binocular coordinate system are obtained by an iterative reweighted least squares algorithm based on sub-pixel corner extraction, and 3) the hand-eye transformation matrix between the binocular system and the robot is obtained by the singular value decomposition (SVD). The experimental results show that both the average error and the mean square error of the proposed hand-eye calibration algorithm can reach 0.45mm and 0.21mm, respectively, which are much smaller than the existing algorithms and can meet the accuracy requirements of robotic positioning and machining.

References

1

Zhu DH, Feng XZ, Xu XH, et al. Robotic grinding of complex components: A step towards efficient and intelligent machining-challenges, solutions, and applications. Robotics and Computer Integrated Manufacturing 2020; 65: 101908.

2

Hao DX, Wang W, Wang QL, et al. Applications and development trend of robotics in composite material process. Journal of Mechanical Engineering 2019; 55(3): 1-17.

3

Yu Y, Wang RQ, Wang YP, et al. Contact force controlled robotic polishing for complex PMMA parts with an active end-effector. Journal of Advanced Manufacturing Science and Technology 2021; 1(4): 2021012.

4

Zhu DH, Xu XH, Li WL. Research progress in robotic grinding technology for complex blades. Acta Aeronautica et Astronautica Sinica 2021; 42(10): 8-30[Chinese].

5

Zhang P, Kai Z, Li ZW, et al. High dynamic range 3D measurement based on structured light: A review. Journal of Advanced Manufacturing Science and Technology 2021; 1(2): 2021004.

6

Kim J, Lee J, Chung M, et al. Multiple weld seam extraction from RGB-depth images for automatic robotic welding via point cloud registration. Multimedia Tools and Application 2021; 80(13): 9703- 9719.

7

Shi XJ, Liu T, Han X. Improved iterative closest point (ICP) 3D point cloud registration algorithm based on point cloud filtering and adaptive fireworks for coarse registration. International Journal of Remote Sensing 2020; 41(8): 3197-3220.

8

Vlaeyen M, Haitjema H, Dewulf W. Error compensation for laser line scanners. Measurement 2021; 175:109085.

9

Yin XQ, Tao W, Feng Y, et al. A robust and accurate breakpoint detection method for line-structured laser scanner. Optics & Laser Technology 2019; 118: 52-61.

10

Zhong L, Qin J, Yang X, et al. An accurate linear method for 3D line reconstruction for binocular or multiple view stereo vision. Sensors 2021; 21(2):658.

11

Gao ZW, Tan XD, Liu K. Object recognition and capture based on binocular vision. Science Technology and Engineering 2020; 20(20): 8285-8291.

12

Lv R, Liu HD, Wang ZJ, et al. WPMAVM: weighted plus-and-minus allowance variance minimization algorithm for solving matching distortion. Robotics and Computer-Integrated Manufacturing 2022; 76: 102320.

13

Luo Z, Zhang K, Wang Z, et al. 3D pose estimation of large and complicated workpieces based on binocular stereo vision. Applied Optics 2017; 56(24): 6822-6836.

14

Dong JT. Line-scanning laser scattering system for fast defect inspection of a large aperture surface. Applied Optics 2017; 56: 7089-7098.

15

Shiu YC, Ahmad S. Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB. IEEE Transactions on Robotics and Automation 1989, 5(1): 16-29.

16

Tsai RY, Lenz RK. A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Transactions on Robotics and Automation 1989; 5(3): 345-358.

17

Liang R, Mao J. Hand-eye calibration with a new linear decomposition algorithm. Journal of Zhejiang University – SCIENCE A 2008; 9(10): 1363-1368.

18
Zeng J, Cao G, Li W, et al. An algorithm of hand-eye calibration for arc welding robot. 16th International Conference on Ubiquitous Robots, 2019.
19

Wang LF, Wang TM, Tang PF, et al. A new hand-eye calibration approach for fracture reduction robot. Computer Assisted Surgery 2019; 22(1): 113-119.

20

Cao CT, Do VP, Lee BR. A novel indirect calibration approach for robot positioning error compensation based on neural network and handeye vision. Applied Sciences 2019; 9:1940.

21

Wang LQ, Qian L. Study on hand-eye calibration of robot and 3D camera based on 3D calibration block. Laser & Optoelectronics Progress 2021; 58(24):2433001.

22

Ren JX, Zhang X, Liu SL, et al. A high-precision robot hand-eye calibration method. Modern Manufacturing Engineering 2020; 4:44-51.

Journal of Advanced Manufacturing Science and Technology
Cite this article:
FU J, LIU H, HE M, et al. A hand-eye calibration algorithm of binocular stereo vision based on multi-pixel 3D geometric centroid relocalization. Journal of Advanced Manufacturing Science and Technology, 2022, 2(1): 2022005. https://doi.org/10.51393/j.jamst.2022005

116

Views

1

Downloads

1

Crossref

8

Scopus

Altmetrics

Received: 12 January 2022
Revised: 18 February 2022
Accepted: 04 March 2022
Published: 15 January 2022
© 2022 JAMST All rights reserved.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0),which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Return