| Citation: |
WANG Yunhong. Transient electromagnetic numerical simulation based on the transformer neural network[J]. Coal Geology & Exploration，2024，52(11)：151−159. DOI: 10.12363/issn.1001-1986.24.07.0499
|
The deep learning-based transient electromagnetic (TEM) forward and inverse modeling methods are data-driven, requiring considerable numerical simulation results as supervisory data to train and assess neural networks. The conventional finite-difference time-domain (FDTD) method for TEM numerical simulation necessitates an iterative solution of time-domain Maxwell's equations. Therefore, this method is time-consuming and computationally intensive, failing to meet the data demand of deep learning-based TEM inversion.
This study introduced deep learning for TEM numerical simulation. Based on the transformer neural network architecture, a neural network for deep learning-based TEM numerical simulation was designed using an encoder-decoder structure. This neural network comprised a 3D gridding module, a patch embedding module, a transformer encoder module, and a linear decoder module. With geoelectric parameters as inputs, this neural network output corresponding TEM responses at the center of the loop source. It was trained for over 200 epochs using the optimization strategy of stochastic gradient descent with momentum combined with adaptive moment estimation (Adam)—an adaptive learning rate algorithm—on a server equipped with four NVIDIA V100 GPUs.
The trained network for deep learning-based TEM numerical simulation was employed to predict the TEM responses of the loop sources of four geoelectric models in real time: a homogeneous halfspace model, a layered model, a plate model, and a 3D volume model. The test results of the validation set reveal that the numerical simulation results after the turn-off time derived using the neural network exhibited low mean relative errors (MREs) of less than 2% compared to analytical solutions, linear digital filtering solutions, and FDTD numerical simulation results. Meanwhile, the TEM numerical simulation results were obtained within 1 s. Therefore, the proposed neural network exhibited fast and accurate calculations. This study will provide a theoretical foundation and data support for research on deep learning-based TEM inversion.
| [1] |
刘树才,刘志新,姜志海. 瞬变电磁法在煤矿采区水文勘探中的应用[J]. 中国矿业大学学报,2005,34(4):414−417. DOI: 10.3321/j.issn:1000-1964.2005.04.002
LIU Shucai,LIU Zhixin,JIANG Zhihai. Application of TEM in hydrogeological prospecting of mining district[J]. Journal of China University of Mining & Technology,2005,34(4):414−417. DOI: 10.3321/j.issn:1000-1964.2005.04.002
|
| [2] |
于景邨,刘志新,刘树才,等. 深部采场突水构造矿井瞬变电磁法探查理论及应用[J]. 煤炭学报,2007,32(8):818−821. DOI: 10.3321/j.issn:0253-9993.2007.08.008
YU Jingcun,LIU Zhixin,LIU Shucai,et al. Theoretical analysis of mine transient electromagnetic method and its application in detecting water burst structures in deep coal stope[J]. Journal of China Coal Society,2007,32(8):818−821. DOI: 10.3321/j.issn:0253-9993.2007.08.008
|
| [3] |
于景邨,刘志新,岳建华,等. 煤矿深部开采中的地球物理技术现状及展望[J]. 地球物理学进展,2007,22(2):586−592. DOI: 10.3969/j.issn.1004-2903.2007.02.036
YU Jingcun,LIU Zhixin,YUE Jianhua,et al. Development and pospect of geophysical technology in deep mining[J]. Progress in Geophysics,2007,22(2):586−592. DOI: 10.3969/j.issn.1004-2903.2007.02.036
|
| [4] |
白登海,Maxwell A Meju,卢健,等. 时间域瞬变电磁法中心方式全程视电阻率的数值计算[J]. 地球物理学报,2003,46(5):697−704. DOI: 10.3321/j.issn:0001-5733.2003.05.018
BAI Denghai,MEJU M A,LU Jian,et al. Numerical calculation of all-time apparent resistivity for the central loop transient electromagnetic method[J]. Chinese Journal of Geophysics,2003,46(5):697−704. DOI: 10.3321/j.issn:0001-5733.2003.05.018
|
| [5] |
戚志鹏,李貅,郭文波,等. 瞬变电磁水平分量视电阻率定义[J]. 煤炭学报,2011,36(增刊1):88−93.
QI Zhipeng,LI Xiu,GUO Wenbo,et al. Definition of apparent resistivity of transient electromagnetic horizontal component[J]. Journal of China Coal Society,2011,36(Sup.1):88−93.
|
| [6] |
杨海燕,邓居智,张华,等. 矿井瞬变电磁法全空间视电阻率解释方法研究[J]. 地球物理学报,2010,53(3):651−656.
YANG Haiyan,DENG Juzhi,ZHANG Hua,et al. Research on full-space apparent resistivity interpretation technique in mine transient electromagnetic method[J]. Chinese Journal of Geophysics,2010,53(3):651−656.
|
| [7] |
薛国强,李貅,底青云. 瞬变电磁法理论与应用研究进展[J]. 地球物理学进展,2007,22(4):1195−1200. DOI: 10.3969/j.issn.1004-2903.2007.04.026
XUE Guoqiang,LI Xiu,DI Qingyun. The progress of TEM in theory and application[J]. Progress in Geophysics,2007,22(4):1195−1200. DOI: 10.3969/j.issn.1004-2903.2007.04.026
|
| [8] |
薛国强,李貅,郭文波,等. 大回线源瞬变电磁场响应特性[J]. 石油地球物理勘探,2007,42(5):586−590. DOI: 10.3321/j.issn:1000-7210.2007.05.018
XUE Guoqiang,LI Xiu,GUO Wenbo,et al. Characters of response of large-loop transient electro-magnetic field[J]. Oil Geophysical Prospecting,2007,42(5):586−590. DOI: 10.3321/j.issn:1000-7210.2007.05.018
|
| [9] |
范亮,钱荣毅. 瞬变电磁法在煤矿采空区的应用研究[J]. 工程地球物理学报,2011,8(1):29−33. DOI: 10.3969/j.issn.1672-7940.2011.01.006
FAN Liang,QIAN Rongyi. Application of transient electromagnetic method to coal mine gobs[J]. Chinese Journal of Engineering Geophysics,2011,8(1):29−33. DOI: 10.3969/j.issn.1672-7940.2011.01.006
|
| [10] |
孙怀凤,程铭,吴启龙,等. 瞬变电磁三维FDTD正演多分辨网格方法[J]. 地球物理学报,2018,61(12):5096−5104. DOI: 10.6038/cjg2018L0659
SUN Huaifeng,CHENG Ming,WU Qilong,et al. A multi-scale grid scheme in three-dimensional transient electromagnetic modeling using FDTD[J]. Chinese Journal of Geophysics,2018,61(12):5096−5104. DOI: 10.6038/cjg2018L0659
|
| [11] |
PUZYREV V. Deep learning electromagnetic inversion with convolutional neural networks[J]. Geophysical Journal International,2019,218(2):817−832. DOI: 10.1093/gji/ggz204
|
| [12] |
LIU Bin,GUO Qian,LI Shucai,et al. Deep learning inversion of electrical resistivity data[J]. IEEE Transactions on Geoscience and Remote Sensing,2020,58(8):5715−5728. DOI: 10.1109/TGRS.2020.2969040
|
| [13] |
SHAHRIARI M,PARDO D,RIVERA J A,et al. Error control and loss functions for the deep learning inversion of borehole resistivity measurements[EB/OL]. 2020:2005.08868. https://arxiv.org/abs/2005.08868v3.
|
| [14] |
OH S,NOH K,SEOL S J,et al. Cooperative deep learning inversion of controlled-source electromagnetic data for salt delineation[J]. Geophysics,2020,85(4):E121−E137. DOI: 10.1190/geo2019-0532.1
|
| [15] |
范涛,薛国强,李萍,等. 瞬变电磁长短时记忆网络深度学习实时反演方法[J]. 地球物理学报,2022,65(9):3650−3663. DOI: 10.6038/cjg2022P0572
FAN Tao,XUE Guoqiang,LI Ping,et al. TEM real-time inversion based on long-short term memory network[J]. Chinese Journal of Geophysics,2022,65(9):3650−3663. DOI: 10.6038/cjg2022P0572
|
| [16] |
李瑞友,白细民,张勇,等. 基于小波包分解与GA优化BP神经网络的瞬变电磁反演[J]. 吉林大学学报(地球科学版),2024,54(3):1003−1015.
LI Ruiyou,BAI Ximin,ZHANG Yong,et al. Using wavelet packet denoising and BP neural network based on GA optimization for transient electromagnetic inversion[J]. Journal of Jilin University (Earth Science Edition),2024,54(3):1003−1015.
|
| [17] |
燕帅,殷长春,苏扬,等. 基于卷积神经网络的瞬变电磁数据快速成像算法研究[J]. 地球物理学报,2023,66(10):4290−4300. DOI: 10.6038/cjg2023Q0827
YAN Shuai,YIN Changchun,SU Yang,et al. Fast imaging of transient electromagnetic data based on convolutional neural network[J]. Chinese Journal of Geophysics,2023,66(10):4290−4300. DOI: 10.6038/cjg2023Q0827
|
| [18] |
古瑶,解海军,周子鹏,等. 基于Attention机制的CNN-BiLSTM瞬变电磁实时反演方法[J]. 煤田地质与勘探,2023,51(10):134−143. DOI: 10.12363/issn.1001-1986.22.12.1000
GU Yao,XIE Haijun,ZHOU Zipeng,et al. An Attention mechanism-based CNN-BiLSTM real-time transient electromagnetic method[J]. Coal Geology & Exploration,2023,51(10):134−143. DOI: 10.12363/issn.1001-1986.22.12.1000
|
| [19] |
程久龙,王慧杰,徐忠忠,等. 基于全卷积神经网络的钻孔瞬变电磁法岩层富水性预测研究[J]. 煤田地质与勘探,2023,51(1):289−297. DOI: 10.12363/issn.1001-1986.22.12.0937
CHENG Jiulong,WANG Huijie,XU Zhongzhong,et al. Research on aquifer water abundance evaluation by borehole transient electromagnetic method based on FCNN[J]. Coal Geology & Exploration,2023,51(1):289−297. DOI: 10.12363/issn.1001-1986.22.12.0937
|
| [20] |
游希然,张继锋,石宇. 基于人工神经网络的瞬变电磁成像方法[J]. 物探与化探,2023,47(5):1206−1214.
YOU Xiran,ZHANG Jifeng,SHI Yu. Artificial neural network-based transient electromagnetic imaging[J]. Geophysical and Geochemical Exploration,2023,47(5):1206−1214.
|
| [21] |
冼锦炽,蔡红柱,熊咏春,等. 基于深度学习的地面拖曳式瞬变电磁快速成像方法[J]. 工程地球物理学报,2022,19(4):536−545. DOI: 10.3969/j.issn.1672-7940.2022.04.015
XIAN Jinchi,CAI Hongzhu,XIONG Yongchun,et al. Ground-based towed transient electromagnetic imaging method based on deep learning[J]. Chinese Journal of Engineering Geophysics,2022,19(4):536−545. DOI: 10.3969/j.issn.1672-7940.2022.04.015
|
| [1] | YANG Junzhe, WANG Zhenrong, LYU Qingxu, YANG Sen, LI Guo, ZHENG Kaige. Application of advanced regional treatment technology of hard roof in Buertai Coal Mine of Shendong Coal Group[J]. COAL GEOLOGY & EXPLORATION, 2022, 50(2): 17-23. DOI: 10.12363/issn.1001-1986.21.03.0119 |
| [2] | CHEN Xinnian, WANG Jingchun, XIONG Xianyu, FAN Jiawei, SHEN Pan. Influence of composite roof structure on the stability of coal roadway[J]. COAL GEOLOGY & EXPLORATION, 2019, 47(2): 157-161,167. DOI: 10.3969/j.issn.1001-1986.2019.02.024 |
| [3] | LI Rong-wei, HOU En-ke. Orthogonality analysis of sensibility on factors of slope stability in opencast coal mine[J]. COAL GEOLOGY & EXPLORATION, 2009, 37(1): 52-56. |
| [4] | MENG Zhao-ping, CHENG Lang-hong, LEI Zhi-yong. Characters of in-situ stress field in Huainan mine area and its influence on stability of coal roof and floor[J]. COAL GEOLOGY & EXPLORATION, 2007, 35(1): 21-25. |
| [5] | LIU Hai-yan, LI Zeng-xue, LI Shu-jin, WU Fa-quan. The characteristics of mini-type structures and their influence on roof's stability in Yanzhou Coalfield[J]. COAL GEOLOGY & EXPLORATION, 2005, 33(6): 24-27. |
| [6] | ZHANG Zhi-pei, WANG Hong. Analysis of the stability about the gob of the coal mine under the freeway[J]. COAL GEOLOGY & EXPLORATION, 2005, 33(1): 46-48. |
| [7] | LIU Heng-qiu, LIU Qin-fu, MENG Zhao-ping. Application of fuzzy synthesis evaluation to coal seam-roof stability[J]. COAL GEOLOGY & EXPLORATION, 2002, 30(4): 18-20. |
| [8] | PENG Su-ping, MENG Zhao-ping, LI Yu-lin. Influence of faults on coal roof stability by physical modeling study[J]. COAL GEOLOGY & EXPLORATION, 2001, 29(3): 1-4. |
| [9] | Zhang Peihe, Hu Shaoxiang. STUDY ON THE ROCK MASS STABILITY IN COAL MINING[J]. COAL GEOLOGY & EXPLORATION, 1998, 26(S1): 10-13. |
| [10] | Wang Zhirong. INVESTIGATION TO THE TECTONITE ROOF OF THE COAL SEAM FOR THE STABILITY[J]. COAL GEOLOGY & EXPLORATION, 1992, 20(2): 44-46. |
Copyright of website design © Editorial Office of Coal Geology & Exploration 陕ICP备05001372号-6
陕公网安备 61019002002193号
Address: Editorial Office of Coal Geology & Exploration, No.82 Jinye 1st Rd, High-Tech Zone, Xi'an City, Shaanxi, China
Tel: 029-81778075 E-mail: ccrimtdzykt@vip.163.com
Supported by: Beijing Renhe Information Technology Co., Ltd. 
DownLoad: