马斌,彭光宇. 基于单目视觉的钻杆位姿识别技术研究[J]. 煤田地质与勘探,2022,50(10):171−178. DOI: 10.12363/issn.1001-1986.22.01.0036
引用本文: 马斌,彭光宇. 基于单目视觉的钻杆位姿识别技术研究[J]. 煤田地质与勘探,2022,50(10):171−178. DOI: 10.12363/issn.1001-1986.22.01.0036
MA Bin,PENG Guangyu. Research on drill pipe pose recognition technology based on monocular vision[J]. Coal Geology & Exploration,2022,50(10):171−178. DOI: 10.12363/issn.1001-1986.22.01.0036
Citation: MA Bin,PENG Guangyu. Research on drill pipe pose recognition technology based on monocular vision[J]. Coal Geology & Exploration,2022,50(10):171−178. DOI: 10.12363/issn.1001-1986.22.01.0036

基于单目视觉的钻杆位姿识别技术研究

Research on drill pipe pose recognition technology based on monocular vision

  • 摘要: 钻杆自动装卸技术作为智能钻探装备领域的关键技术,制约着煤矿井下钻探装备的自动化和智能化发展,现有钻杆自动装卸系统主要依靠机械结构和接近开关进行定位,存在定位精度差自动化程度低的问题。针对此问题,提出一种基于单目视觉技术的钻杆位姿识别算法,利用摄像机拍摄含有合作目标的图像,解算摄像机与合作目标之间的相对距离和姿态,通过固定坐标变换,推导钻杆相对于机械手的位姿,引导机械手进行钻杆自动装卸。首先,确定系统总体方案,利用小孔成像原理和张正友标定法建立摄像机成像数学模型,求解摄像机内外参数;然后,使用棋盘格标定板作为被测钻杆的合作目标,根据小孔成像模型和空间成像关系,建立空间任意平面的单目测距模型,计算得到相机光心与合作目标点的距离;最后,通过摄像机成像模型得出合作目标的姿态矩阵,结合摄像机内外参数,经坐标转换求解得到合作目标在世界坐标系中的姿态矩阵,再通过固定坐标变换完成钻杆位姿识别。为验证算法准确性,在室内进行了钻杆位姿识别试验,试验中对每张现场图片进行重复测距与姿态估计,结果显示钻杆距离识别偏差在0.12%之内,钻杆姿态识别偏差在1.08%之内,满足钻杆自动装卸精度要求。试验结果表明,基于单目视觉技术的钻杆位姿识别算法真实有效,利用该算法可实现钻杆定位智能识别,提高钻杆自动装卸精度和钻探装备的智能化水平。

     

    Abstract: As a key technology in the field of intelligent drilling equipment, automatic drill pipe loading and unloading technology restricts the automation and intelligent development of underground drilling equipment in coal mines. The existing drill pipe automatic loading and unloading system mainly relies on the mechanical structure and proximity switches for positioning, which has the problem of poor positioning accuracy and low automation. To solve this problem, a drill pipe pose recognition algorithm based on monocular vision technology was proposed. The camera was used to capture the image containing the cooperative target, and the relative distance and posture between the camera and the cooperative target were calculated; the position and posture of the drill pipe relative to the manipulator was deduced through fixed coordinate transformation, and the manipulator was guided to automatically load and unload the drill pipe. First, we determine the overall scheme of the system and then establish a mathematical model of camera imaging using the principle of pinhole imaging and Zhang Zhengyou’s calibration method, so as to solve the internal and external parameters of the camera. Secondly, using the checkerboard calibration plate as the cooperation target of the drill pipe to be tested, a monocular ranging model of any plane in space was established according to the small hole imaging model and the spatial imaging relationship, and the distance between the optical center of the camera and the cooperative target point was calculated. Finally, the attitude matrix of the cooperative target was obtained through the camera imaging model. Combined with the internal and external parameters of the camera, the coordinate transformation was used to obtain the attitude matrix of the cooperative target in the world coordinate system, and then the position and attitude recognition of the drill pipe was completed through fixed coordinate transformation. To verify the accuracy of the algorithm, the drill pipe pose recognition test was carried out indoors. In the test, the repetitive distance measurement and attitude estimation were carried out for each on-site picture. The results show that the drill pipe distance recognition deviation is within 0.12%, and the drill pipe attitude recognition deviation is within 1.08%, which meets the precision requirements of automatic loading and unloading of drill pipes. The results also show that the drill pipe pose recognition algorithm based on monocular vision technology is real and effective. The algorithm can realize the intelligent recognition of drill pipe positioning, improve the automatic loading and unloading accuracy of drill pipe and the intelligent level of drilling equipment.

     

/

返回文章
返回