- Chinese Core Periodicals
- Chinese Core Journals of Science and Technology
- RCCSE Chinese Authoritative Academic Journals
| Citation: |
HUANG Chenxuan, WANG Lei. Thinning point cloud thickening method of mine roadway based on up-sampling algorithm[J]. Safety in Coal Mines, 2025, 56（3）: 215−223. DOI: 10.13347/j.cnki.mkaq.20240537
|
Limited by the requirements of underground explosion protection, the laser radar that can be applied in coal mine is mostly low-power lidar with a few line harnesses, which forms sparse point clouds and lacks detailed description of the environment, resulting in poor mapping performance of robots. A composite residual self-attention network (CRSA-Net) based sampling technique for roadway point cloud is proposed, aiming to achieve the point cloud feature thickening through an end-to-end approach, and to make up for the low accuracy of sensors to a certain extent. Firstly, the dust and water fog noise in the point cloud are removed by outliers, and the point cloud regions with different degradation degrees are segmented by normal vector clustering according to the site characteristics. Secondly, in order to improve the local detail quality of training data, point cloud slices are extracted based on KD tree structure. To solve the problem of weak correlation of data in sparse point cloud, a method of feature calculation and feature dimension extension is proposed to strengthen the constraints on network training results. A cascaded and progressive compound residual self-attention method is adopted to ensure the network to learn the global and local features of the structurally degraded point cloud. Finally, using dense point features, multiple independent MLPs are used for feature extension to output dense point clouds through a fully connected layer based on point features. A dense point cloud dataset was constructed for training and testing by using the data of a lane in Cuncaota Coal Mine of National Energy Group and WHU-LTS open source data. In the up-sampling test, the CD index, EMD index and HD index reached 11.35×10−3, 5.52×10−3 and 112.31×10−3 respectively.
| [1] |
王国法. 煤矿智能化最新技术进展与问题探讨[J]. 煤炭科学技术,2022,50(1):1−27. doi: 10.3969/j.issn.0253-2336.2022.1.mtkxjs202201001
WANG Guofa. New technological progress of coal mine intelligence and its problems[J]. Coal Science and Technology, 2022, 50(1): 1−27. doi: 10.3969/j.issn.0253-2336.2022.1.mtkxjs202201001
|
| [2] |
刘峰,王宏伟,刘宇. 基于多传感融合的巷道三维空间映射研究[J]. 煤炭学报,2024,49(9):4019−4026.
LIU Feng, WANG Hongwei, LIU Yu. 3D spatial mapping of roadways based on multi-sensor fusion[J]. Journal of China Coal Society, 2024, 49(9): 4019−4026.
|
| [3] |
王虹,王步康,张小峰,等. 煤矿智能快掘关键技术与工程实践[J]. 煤炭学报,2021,46(7):2068−2083.
WANG Hong, WANG Bukang, ZHANG Xiaofeng, et al. Key technology and engineering practice of intelligent rapid heading in coal mine[J]. Journal of China Coal Society, 2021, 46(7): 2068−2083.
|
| [4] |
杨志方. 基于雷达与视觉融合的双模态煤矿井下环境感知技术[J]. 工矿自动化,2023,49(11):67−75.
YANG Zhifang. Bimodal environment perception technology for underground coal mine based on radar and visual fusion[J]. Journal of Mine Automation, 2023, 49(11): 67−75.
|
| [5] |
陈晓晶. 井工煤矿运输系统智能化技术现状及发展趋势[J]. 工矿自动化,2022,48(6):6−14.
CHEN Xiaojing. Current status and development trend of intelligent technology of underground coal mine transportation system[J]. Industry and Mine Automation, 2022, 48(6): 6−14.
|
| [6] |
杨林,马宏伟,王岩,等. 煤矿巡检机器人同步定位与地图构建方法研究[J]. 工矿自动化,2019,45(9):18−24.
YANG Lin, MA Hongwei, WANG Yan, et al. Research on method of simultaneous localization and mapping of coal mine inspection robot[J]. Industry and Mine Automation, 2019, 45(9): 18−24.
|
| [7] |
LI Ruihui, LI Xianzhi, HENG Phengann, et al. Point cloud upsampling via disentangled refinement[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 2021: 344−353.
|
| [8] |
WANG Z, CHEN J, HOI S C H. Deep learning for image super-resolution: A survey[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43(10): 3365−3387. doi: 10.1109/TPAMI.2020.2982166
|
| [9] |
CHEN H, HE X, QING L, et al. Real-world single image super-resolution: A brief review[J]. Information Fusion, 2022, 79: 124−145. doi: 10.1016/j.inffus.2021.09.005
|
| [10] |
ZHANG Y, TIAN Y, KONG Y, et al. Residual dense network for image super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2018: 2472−2481.
|
| [11] |
DAI A, CHANG A X, SAVVA M, et al. Scannet: Richly-annotated 3d reconstructions of indoor scenes[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2017: 5828−5839.
|
| [12] |
HUANG H, LI D, ZHANG H, et al. Consolidation of unorganized point clouds for surface reconstruction[J]. ACM Transactions on Graphics (TOG), 2009, 28(5): 1−7.
|
| [13] |
吕建新,马礼,傅颖勋,等. 基于GPU的点云模型快速重建方法[J]. 计算机工程与设计,2023,44(11):3440−3446.
LYU Jianxin, MA Li, FU Yingxun, et al. Fast reconstruction method of point cloud model based on GPU[J]. Computer Engineering and Design, 2023, 44(11): 3440−3446.
|
| [14] |
韩亚振,尹梦晓,马伟钊,等. DGOA:基于动态图和偏移注意力的点云上采样[J]. 图学学报,2024,45(1):219−229.
HAN Yazhen, YIN Mengxiao, MA Weizhao, et al. DGOA: point cloud upsampling based on dynamic graph and offset attention[J]. Journal of Graphics, 2024, 45(1): 219−229.
|
| [15] |
肖霄,柏正尧,李泽锴,等. 嵌入注意力机制的并行多尺度点云上采样方法[J]. 计算机科学,2024,51(8):183−191. doi: 10.11896/jsjkx.230500094
XIAO Xiao, BAI Zhengyao, LI Zekai, et al. Parallel multi-scale with attention mechanism for point cloud upsampling[J]. Computer Science, 2024, 51(8): 183−191. doi: 10.11896/jsjkx.230500094
|
| [16] |
YU L, LI X, FU C W, et al. Pu-net: Point cloud upsampling network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2018: 2790−2799.
|
| [17] |
QIAN G, ABUALSHOUR A, LI G, et al. Pu-gcn: Point cloud upsampling using graph convolutional networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021: 11683−11692.
|
| [18] |
LI R, LI X, FU C W, et al. Pu-gan: a point cloud upsampling adversarial network[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. IEEE, 2019: 7203−7212.
|
| [19] |
陈建文,赵丽丽,任蓝草,等. 深度学习点云质量增强方法综述[J]. 中国图象图形学报,2023,28(11):3295−3319. doi: 10.11834/jig.221076
CHEN Jianwen, ZHAO Lili, REN Lancao, et al. Deep learning-based quality enhancement for 3D point clouds: a survey[J]. Journal of Image and Graphics, 2023, 28(11): 3295−3319. doi: 10.11834/jig.221076
|
| [20] |
HU J, SHEN L, SUN G. Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2018: 7132−7141.
|
| [21] |
CUTURI M. Sinkhorn distances: Lightspeed computation of optimal transport[C]// Advances in Neural Information Processing Systems 26, vol. 3: 27th Annual Conference on Neural Information Processing Advances in Neural Information Processing Systems. 2013: 2294−2302.
|
| [22] |
GAVRILA D M, PHILOMIN V. Real-time object detection for“smart”vehicles[C]//Proceedings of the Seventh IEEE International Conference on Computer Vision. IEEE, 1999, 1: 87−93.
|
| [23] |
RUBNER Y, TOMASI C, GUIBAS L J. The earth mover's distance as a metric for image retrieval[J]. International Journal of Computer Vision, 2000, 40: 99−121. doi: 10.1023/A:1026543900054
|
| [24] |
HUTTENLOCHER D P, KLANDERMAN G A, RUCKLIDGE W J. Comparing images using the Hausdorff distance[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1993, 15(9): 850−863. doi: 10.1109/34.232073
|
Supported by: Beijing Renhe Information Technology Co., Ltd. 
DownLoad: