Abstract
The time-frequency electromagnetic prospecting system has both the characteristics of frequency sounding and transient electromagnetic sounding system, can obtain apparent resistivity both in frequency domain and time domain, therefore, thus, more accurate and credible geoelectric information can be obtained. After analyzing, there are mainly three typical types of noise in time-frequency electromagnetic observed data, they are 50Hz power frequency and its harmonics interference noise, high-frequency random impulse noise and low frequency interference noise. In view of characteristics of these three types of noise and the time-frequency electromagnetic prospecting signal, we adopted frequency domain band stop filtering method remove the 50 Hz power frequency and its harmonics interference noise, proposed a segmentation and extension median filtering method and a fitting fixed extreme EMD method to remove the high frequency random impulse noise and the low frequency interference noise separately, and proposed a median filtering window size test selection method based on variance and skewness coefficient of sample signal. Moreover, we designed a denoising processing fl ow as handle 50Hz power frequency and its harmonics interference noise at fist step, handle high frequency random impulse noise at second step, handle low frequency interference noise at last step, it can give full advantages of the denoising handling methods. By theoretical analysis and verification by practical observation data experiments, the methods what we adopted and proposed and the processing flow we designed can effectively remove the three types of interference noises effectively and avoid method error, can preserve phase and amplitude information of effective signal accurately, finally, high quality and satisfactory time domain signal waveform can obtained as a result, and lays a good foundation for extracting accurate transient electromagnetic attenuation curve in time domain for the Time-Frequency electromagnetic prospecting data.
Similar content being viewed by others
References
An, H. B., and Shen, Y. Y., 2005, A method to suppress narrow-band interference based on frequeney domain filter: Optoelectronic Technology & Information, 18(5), 64–68.
Andrew, K. H., 1995, Application of frequency-domain polyphase filtering to quadrature sampling: Proc Spie, 2563, 450–457.
Bai, F. F., Miao, C. Y., Zhang, C., and Gan, J. M., 2010, Studying on denoising algorithm of heart sound signal based on the generalized mathematical morphology:IEEE International Conference on Signal Processing, 1797–1800.
Bhusana, P., Jumlong, V., and Christofer, T., 2013, Noise reduction for nonlinear nonstationary time series data using averaging intrinsic mode function: Algorithms, 6, 407–429.
Brian, H. T., and Eric, L. M., 2012, Nonlocal means denoising of ECG signals: IEEE Transactions on Biomedical Engineering, 59(9), 2383–2386.
Chang, K. M., 2010, Arrhythmia ECG noise reduction by ensemble empirical mode decomposition: sensors, 10, 6063–6080.
Cui, Z. H., Cheng, M. H., Wu, Q. L., and Wang, B. Z., 2005, A technique of fast median filtering and its application to data quality control of doppler radar: Plateau Meteorology, 24(5), 727–733.
Daniel, N., David, C. F., Vladimir, E., et al., 2000, Denoising electrocardiogram signal using adaptive wavelets: International Eurasip Conference Biosignal, 1–4.
Ding, K. L., Sheng, Y. Z., Ou, J. K., 2010, Methods of line-fitting based on total least-squares: Journal of Liaoning Technical University(Natural Science), 29(1), 44–47.
Dong, W. B., Zhao, X. M., Liu, F., and Zhao G., 2008, The time-frequency electromagnetic method and its application in western China: Applied Geophysics, 5(2), 127–135.
George, T., and Thomas, D. X., 2011, Signal denoising using empirical mode decomposition and higher order statistics: International Journal of Signal Processing, Image Processing and Pattern Recognition, 4(2), 91–106.
Gruber, P., Theis, F., Tomé, A., et al, 2004, Automatic denoising using local independent component analysis: Proceedings Ofs.
Gyanaprava, M., Kumar, B., and Asit K. M., 2013, Denoising of heart sound signal using wavelet transform: International Journal of Research in Engineering and Technology, 2(4):719–723.
He, Z. X., Wang, X. B., Kong, F. S., et.al., 2002, The Time-Frequency electromagnatic sounding method: The annual China geophysical society, Chinese Geophysical Society 18th Annual Conference Proceedings.
He, Z. X., 2006, TFEM method(Patent No.ZL03150098.6.2003).
He, Z. X., 2005, Mapping reservoir boundary by TFEM technique:one case study:75th Ann. Internat. Mtg. Soc. Expl. Geophys., Expanded Abstracts, Houston, 631–634.
Huang, N. E., Shen, Z., Long, S. R., et al, 1998, The empirical mode decomposition and the Hilbert spectrum for non-stationary time series analysis: Proceeding: Mathematical, Physical and Engineering Sciences. London: The Royal Society Press, 454(1971):903–995.
Jiang, Q. Y., 2010, Study on the key technology of wide field electromagnetic sounding instrument: PhD Thesis, Central South University, Changsha.
Kai, S., and Monika D., 2012, Audio denoising by generalized time-frequency thresholding: AES 45TH International Conference, Helsinki, Finland, 1–10.
Kalavathy, S., and Suresh, R.M., 2011, A switching weighted adaptive median filter for impulse noise removal: International Journal of Computer Applications, 28(9), 8–13.
Li, C. W., Zhan, L. W., and Shen, L. Q., 2015, Friction signal denoising using complete ensemble EMD with adaptive noise and mutual information: Entropy, 17, 5965–5979.
Li, G., Xiao, X., Tang, J. T., et al, 2017, Near-source noise suppression of AMT by compressive sensing and mathematical morphology filtering: Applied Geophysics, 14(4), 581–590.
Li, H. Q., Wang, X. F., and Chen, L., et al., 2014, Denoising and R-peak detection of electrocardiogram signal based on EMD and improved approximate envelope: Circuits Syst Signal Process, 33, 1261–1276.
Li, H., Sun, Y. L., and Xu, B. C., 2007, Noise elimination of PD signals by independent component analysis: Advanced Engineering Sciences, 39(6), 143–148.
Liu, L. M., Sun, Y. R., and Li, L., 2004, Research of median f ilter technology: Journal of Yunnan NormalU niversity, 24(1), 23–27.
Liu, W., Cao, S. Y., Chen, Y. K., Zu, S. H., 2016, An effective approach to attenuate random noise based on compressive sensing and curvelet transform: Journal of Geophysics and Engineering, 13(2016), 135–145.
Macnae, J., Lamontagne, Y., and West, G., 1984, Noise processing techniques for time-domain EM systems:G eophysics, 49(7), 934–948.
Mathieu, R., Olivier, J., Christophe, M., and Frederic, B., 2006, Mitigating pulsed interference using frequency domain adaptive filtering: Ion Gnss International Technical Meeting of the Satellite Division of the Institute of Navigation, 2251–2260.
Minty, B., and Hovgaard, J., 2002, Reducing noise in gamma-ray spectrometry using spectral component analysis: Exploration Geophysics, 33(4):172–176.
Mo, D., Jiang, Q. Y., Li, D. Q., et al, 2017, Controlled- source electromagnetic data processing based on gray system theory and robust estimation: Applied Geophysics, 14(4), 570–580.
Nelson, D. J., Cristobal, G., Kober, V., et al, 1999, Denoising using time-frequency and image processing methods: Proceedings of SPIE - The International Society for optics and photonics, 3807, 564–581.
Pei, Y., Wu, Y. G., and Jia, D. C., 2012, Research on PD signals denoising based on EMD method: Przeglad Elektrotechniczny(Electrical Review), 88(1), 137–140.
Reninger, P. A., Martelet, G., Deparis, J., et al., 2011, Singular value decomposition as a denoising tool for airborne time domain electromagnetic data: Journal of Applied Geophysics, 75(2), 264–276.
Reza, S., Mohammad, B., Shamsollahi, et al., 2007, A nonlinear Bayesian filtering framework for ECG denoising: IEEE Transactions on Biomedical Engineering, 54(12), 2172–2185.
Rishi, R. S., and Ram, B. P, 2018, Baseline wander and power line interference removal from ECG signals using eigenvalue decomposition: Biomedical Signal Processing and Control, 45, 33–49.
Rubana, H. C., Mamun, B. I. R., Mohd, A. B. M. A., et al, 2013, Surface electromyography signal processing and classification techniques: Sensors, 13, 12431–12466.
She, L. H., Xu, Z. Q., Zhang, S., et al, 2010, De-noisng Of ECG based on EMD improved-thresholding and mathematical morphology operation: International Conference on Biomedical Engineering & Informatics(3rd BMEI), 2(1), 838–842.
Sheng, Z., Xie, Q. S., and Pan, C. Y., 2008, Probability theory and mathematical statistics(Fourth Edition): Higher Education Press, China.
Simon P. and Patrick H., 2007, Median Filtering in Constant Time: IEEE Press, 16(9), 2389.
Suo, J. Q., 2010, A new improved filtering algorithm based on median filteralgorithm: Msc. Thesis, Beijing University of Posts and Telecommunications, Beijing.
Tamer, R., 2004, Adaptive hybrid mean and median filtering of high-ISO long-exposure sensor noise for digital photography: Journal of Electronic Imaging, 13(2), 264–277.
Tanusree, G., Debnath, B., Samir, K. B., et al, 2014, A review on different techniques to de-noise a signal: International Journal of Control and Automation, 7(3), 349–358.
To, A. C., Moore, J. R., and Glaser, S. D, 2009, Wavelet denoising techniques with applications to experimental geophysical data: Signal Processing, 89(2009), 144–160.
Turkey, J. W., 1970, Exploratory data analysis: Reading MA: Addison-Wesley, 212.
Wang, H., and Wang, X. H., 2011, An improved adaptive median filter based on noised detection: Journal of China University of Metrology, 22(4), 382–385.
Yu, C. X., Wei, W. B., Jing, J. E., et al., 2010, Application of Hilbert-Huang transformation to marine magnetotelluric sounding data processing: Progress in Geophysics, 25(3): 1046–1056.
Zhang, B.M., Jiang, Q. Y., Mo, D., et al, 2015, A novel method for handling gross errors in electromagnetic prospecting data: Chinese J.Geophys, 58(6), 2087–2102.
Zhang, Q., Xu, L., Jia, J. Y., 2014, 100+ times faster weighted median filter (WMF): IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2830–2837.
Zheng, J. L., Ying, Q. H., and Yang, W. L., 2011, Signals and systems(Third Edtion): Higher Education Press, China.
Acknowledgements
Thanks to all the staff involved in the field data collection. Thanks to the editorial teachers and the anonymous peer review experts for valuable advices, it make the quality of the article greatly improved.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is supported by the National Natural Science Foundation of China (No. 41574127 and No. 41227803).
Zhang Bi-Ming, student pursuing a PhD degree at CSU(Central South University), obtained his M.Sc. from CSU in 2006, his main research interests are data processing, data analysis, data visualization and parallel computing in electromagnetic exploration.
Rights and permissions
About this article
Cite this article
Zhang, bm., Dai, sk., Jiang, qy. et al. The study of time domain denoising for the time-frequency electromagnetic method prospecting data. Appl. Geophys. (2019). https://doi.org/10.1007/s11770-019-0788-8
Received:
Revised:
Published:
DOI: https://doi.org/10.1007/s11770-019-0788-8