煤矿采掘工作面的激光雷达与相机跨模态联合标定方法

Cross-Modal Joint Calibration for LiDAR and Camera Systems in Coal Mine Working Faces

  • 摘要:
    目的 煤矿井下采掘工作面光照不足、粉尘干扰和点云稀疏条件下特征难以稳定提取,严重制约了井下非结构化场景特征的相机与激光雷达联合标定的精度与鲁棒性。
    方法 针对综采工作面和掘进巷道等复杂工况,提出一种激光雷达与相机跨深度特征耦合的联合标定方法。在特征提取阶段,设计改进了随机抽样一致(random sample consensus,RANSAC)的多平面拟合算法,结合法向量预分簇与自适应迭代机制,实现对液压支架顶梁、掘进机外壳等几何结构高效提取;同时提出跨深度边缘融合策略,协同利用曲率不连续与平面交线特征,增强边缘结构的完整性与鲁棒性。在标定框架上,采用两阶段配准策略:粗配准通过轴向循环扰动策略快速估计初始外参,精配准则在李群空间构建点、线联合约束与非线性优化迭代,确保在煤尘干扰和复杂工况下仍能实现高精度对齐。
    结果与结论 在Gazebo仿真平台与实际井下实验场景上对所提方法进行了验证,结果表明,该方法在无噪声时旋转误差小于0.2°、平移误差低于0.02 m,平均重投影误差不超过3.5 px,且在高噪声环境下仍保持优异稳定性,与传统方法相比,所提方法在掘进工作面与综采工作面下的平均重投影误差分别为2.89 px和3.03 px,显著优于对比方法。该方法无需依赖人工标定物,具备良好的环境适应性与稳定性,可满足煤矿井下复杂环境中多模态感知单元的高精度标定需求。

     

    Abstract:
    Objective Insufficient illumination, significant dust interference, and sparse point clouds in underground coal mine working faces impede the stable extraction of features, thereby severely limiting the accuracy and robustness of camera-LiDAR joint calibration based on unstructured scene characteristics.
    Methods This paper addresses complex operational scenarios, including fully mechanized mining faces and excavation roadways, by proposing a joint calibration method that leverages cross-depth feature coupling between LiDAR and camera. For feature extraction, an enhanced RANSAC multi-plane fitting algorithm is introduced, integrating normal vector pre-clustering and an adaptive iteration mechanism to efficiently extract geometric structures, such as hydraulic support roof beams and roadheader casings. A cross-depth edge fusion strategy is also proposed, which synergistically utilizes curvature discontinuities and planar intersection features to improve the completeness and robustness of edge structures. The calibration framework employs a two-stage registration strategy: coarse registration rapidly estimates initial extrinsic parameters via an axial cyclic perturbation approach, while fine registration establishes joint point-line constraints within Lie group space and iteratively refines them through nonlinear optimization. This ensures high-precision alignment is achieved even under challenging conditions involving coal dust and complex operational environments.
    Results and Conclusions  The proposed method was validated both on the Gazebo simulation platform and in real underground mining scenarios. Experimental results show that under noise-free conditions, the rotational error is less than 0.2°, the translational error is below 0.02 m, and the mean reprojection error does not exceed 3.5 px. Even in high-noise environments, the method still maintains excellent stability. Compared with traditional approaches, the proposed method achieves mean reprojection errors of 2.89 px and 3.03 px on the roadheader face and longwall face, respectively, demonstrating a significant improvement. Moreover, the method does not rely on manually placed calibration targets and exhibits strong environmental adaptability and robustness, meeting the high-precision calibration requirements of multi-modal perception systems in complex underground coal-mine environments.

     

/

返回文章
返回