A preview of this full-text is provided by Springer Nature.
Content available from The International Journal of Advanced Manufacturing Technology
This content is subject to copyright. Terms and conditions apply.
ORIGINAL ARTICLE
Narrow gap deviation detection in Keyhole TIG welding using image
processing method based on Mask-RCNN model
Yunke Chen
1,2
&Yonghua Shi
1,2
&Yanxin Cui
1,2
&Xiyin Chen
1,2
Received: 1 July 2020 / Accepted: 7 December 2020
#The Author(s), under exclusive licence to Springer-Verlag London Ltd. part of Springer Nature 2021
Abstract
In the process of K-TIG deep penetration welding, the workpiece does not need to be bevelled; therefore, the welding method is
butt welding, and the gap to be welded is very narrow (0.2~1 mm). Because of the large welding current, the welding arc light
intensity is very strong. These factors cause difficulties in the K-TIG weld seam tracking process. To realize weld seam tracking
in the K-TIG welding process, it is necessary to extract the keyhole entrance centre and weld centreline accurately. To reduce the
interference of strong arc light in the process of K-TIG welding, the information of keyhole entrance and weld seam in the process
of K-TIG welding is obtained by using a high-dynamic-range camera. An image processing algorithm based on Mask-RCNN is
proposed to extract the centre of the keyhole entrance accurately. An image processing algorithm based on Hough line fitting is
used to accurately identify the weld centreline in the welding image and extract the welding deviation. In welding experiments, it
is verified that the welding deviation extracted by the method proposed in this paper fluctuates within ± 0.133 mm, which meets
the requirements of actual K-TIG welding seam tracking.
Keywords K-TIG narrow gap welding .Image processing .Mask-RCNN .Seam tracking
1 Introduction
The seam tracking ability of a welding system is significant
for the welding process and for obtaining good welds [1]. In
the field of weld seam tracking, many researchers have studied
the process of weld seam tracking based on visual sensors.
The machine vision system is still the main method to realize
robot welding automation [2]. There are two methods of seam
tracking based on vision sensors: active vision and passive
vision. In the scheme of active vision, laser or other light
sources are used to irradiate the workpiece to obtain the char-
acteristic information of the weld seam. Gong et al. [3]useda
structured-light vision sensing system to yield the profile of
the deep grooves of the joint and proposed an effective
algorithm to recognize the laser stripe. Fan et al. [4]presented
a seam tracking initial point alignment method based on a
laser vision system. Xu et al. [5] used a circular laser three-
dimensional scanner to construct a seam tracking system to
realize seam tracking. Kiddee et al. [6] presented a weld seam
tracking system using cross mark structured light. However,
in order to avoid the interference of very high–intensity arc
light, the detection area of active vision is usually in front of
the actual welding area. The thermal deformation and time lag
during the welding process and other factors have a greater
impact on the accuracy of the weld deviation detected by these
methods. In the passive vision scheme, a CCD camera is typ-
ically used to obtain the welding arc and weld seam informa-
tion directly, and process this information to obtain the rele-
vant features. Guo et al. [7] analysed the imaging characteris-
tics during the metal active gas (MAG) welding process and
proposed a method for determining the V-groove centreline.
Du et al. [8] proposed an algorithm to accurately identify the
feature of atypical weld seam in robotic gas metal arc welding
(GMAW). Shen et al. [9] presented a welding robot system to
measure the offset of the torch to the seam centre and the size
of the seam groove by passive vision. Wang et al. [10]pro-
posed a method based on template-matching to detect the
groove centre during GMAW. These methods are applicable
*Yonghua Shi
yhuashi@scut.edu.cn
1
School of Mechanical and Automotive Engineering, South China
University of Technology, Guangzhou 510640, China
2
Guangdong Provincial Engineering Research Center for Special
Welding Technology and Equipment, South China University of
Technology, Guangzhou 510640, China
https://doi.org/10.1007/s00170-020-06466-5
/ Published online: 6 January 2021
The International Journal of Advanced Manufacturing Technology (2021) 112:2015–2025
Content courtesy of Springer Nature, terms of use apply. Rights reserved.