Abstract
Wind turbine maintenance management requires new condition monitoring systems and robust algorithms for fault detection. Acoustic inspection can detect anomalies in rotatory components through the analysis of acoustic data with advanced pattern recognition algorithms. Unmanned Aerial Vehicles can carry large sensors and technologies, being one of the most relevant techniques for non-destructive inspections. This article presents a new approach to analyze the acoustic data acquired by the condition monitoring system developed in previous research studies, formed by an acoustic sensor embedded in an unmanned aerial vehicle. This approach develops different deep learning methods for acoustic signal analysis to detect abnormal patterns. One of the most suitable tools for this purpose is the Recurrent Neural Network, concretely the Long Short-Term Memory neuronal network commonly employed in sound pattern recognition. It is presented a real case study, obtaining a sound pattern classification based on the trained networks achieving 87% accuracy. This methodology aims to develop a future integrated system capable of detecting wind farms anomalies with acoustic datasets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Acaroğlu, H., García Márquez, F.P.: Comprehensive review on electricity market price and load forecasting based on wind energy. Energies 14(22), 7473 (2021)
Albawi, S., Mohammed, T.A., Al-Zawi, S.: Understanding of a convolutional neural network. In: 2017 International Conference on Engineering and Technology (ICET), pp 1–6. IEEE (2017)
Bernalte Sánchez, P.J., Garcia Marquez, F.P.: New approaches on maintenance management for wind turbines based on acoustic inspection. In: Xu, J., Duca, G., Ahmed, S.E., García Márquez, F.P., Hajiyev, A. (eds.) ICMSEM 2020. AISC, vol. 1191, pp. 791–800. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-49889-4_61
Butt, A.H., Akbar, B., et al.: Development of a linear acoustic array for aero-acoustic quantification of camber-bladed vertical axis wind Turbine. Sensors 20(20), 5954 (2020)
Chacón, A.M.P., Ramírez, I.S., Márquez, F.P.G.: False alarms analysis of wind turbine bearing system. Sustainability 12(19), 7867 (2020)
Choe, D.E., Kim, H.C., Kim, M.H.: Sequence-based modeling of deep learning with LSTM and GRU networks for structural damage detection of floating offshore wind Turbine blades. Renew. Energy 174, 218–235 (2021)
Costa, Á.M., Orosa, J.A., et al.: New tendencies in wind energy operation and maintenance. Appl. Sci. 11(4), 1386 (2021)
Council, G.W.E.: Gwec| global wind report 2021. Global Wind Energy Council: Brussels, Belgium, p. 80 (2021)
Cunningham, S., Ridley, H., Weinel, J., Picking, R.: Supervised machine learning for audio emotion recognition. Pers. Ubiquit. Comput. 25(4), 637–650 (2020). https://doi.org/10.1007/s00779-020-01389-0
Dao, P.B., Staszewski, W.J., et al.: Condition monitoring and fault detection in wind turbines based on cointegration analysis of scada data. Renew. Energy 116, 107–122 (2018)
Delgado, I., Fahim, M.: Wind turbine data analysis and LSTM-based prediction in scada system. Energies 14(1), 125 (2021)
Diez-Olivan, A., Del Ser, J., et al.: Data fusion and machine learning for industrial prognosis: trends and perspectives towards industry 4.0. Inf. Fusion 50, 92–111 (2019)
Elasha, F., Shanbr, S., et al.: Prognosis of a wind turbine gearbox bearing using supervised machine learning. Sensors 19(14), 3092 (2019)
Esmaieli, M., Ahmadian, M.: The effect of research and development incentive on wind power investment, a system dynamics approach. Renew. Energy 126, 765–773 (2018)
Garcia Marquez, F.P., Gomez Munoz, C.Q.: A new approach for fault detection, location and diagnosis by ultrasonic testing. Energies 13(5), 1192 (2020)
García Márquez, F.P., Peinado Gonzalo, A.: A comprehensive review of artificial intelligence and wind energy. Archives of Computational Methods in Engineering, pp. 1–24 (2021)
Garcia Marquez, F.P., Pliego Marugan, A., et al.: Optimal dynamic analysis of electrical/electronic components in wind turbines. Energies 10(8), 1111 (2017)
García Márquez, F.P., Segovia Ramírez, I., et al.: Reliability dynamic analysis by fault trees and binary decision diagrams. Information 11(6), 324 (2020)
García Márquez, F.P., Bernalte Sanchez, P.J., Segovia Ramírez, I.: Acoustic inspection system with unmanned aerial vehicles for wind turbines structure health monitoring. Structural Health Monitoring, p. 14759217211004822 (2021)
Ghoshal, A., Sundaresan, M.J., et al.: Structural health monitoring techniques for wind turbine blades. J. Wind Eng. Ind. Aerodyn. 85(3), 309–324 (2000)
Glowacz, A.: Fault diagnosis of single-phase induction motor based on acoustic signals. Mech. Syst. Signal Process. 117, 65–80 (2019)
Gómez Muñoz, C.Q., García Marquez, F.P., et al.: Structural health monitoring for delamination detection and location in wind turbine blades employing guided waves. Wind Energy 22(5), 698–711 (2019)
Gonzalez, E., Nanos, E.M., et al.: Key performance indicators for wind farm operation and maintenance. Energy Procedia 137, 559–570 (2017)
Harčarik, T., Bocko, J., Masláková, K.: Frequency analysis of acoustic signal using the fast fourier transformation in matlab. Procedia Eng. 48, 199–204 (2012)
de la Hermosa González, R.R., Márquez, F.P.G., et al.: Pattern recognition by wavelet transforms using macro fibre composites transducers. Mech. Syst. Signal Process. 48(1–2), 339–350 (2014)
de la Hermosa González, R.R., Márquez, F.P.G., et al.: Maintenance management of wind turbines structures via MFCS and wavelet transforms. Renew. Sustain. Energy Rev. 48, 472–482 (2015)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9, 1735–1780 (1997)
Jiménez, A.A., Zhang, L., et al.: Maintenance management based on machine learning and nonlinear features in wind turbines. Renew. Energy 146, 316–328 (2020)
Khan, S., Yairi, T.: A review on the application of deep learning in system health management. Mech. Syst. Signal Process. 107, 241–265 (2018)
Li, J., Chen, X., et al.: A new noise-controlled second-order enhanced stochastic resonance method with its application in wind turbine drivetrain fault diagnosis. Renew. Energy 60, 7–19 (2013)
Liu, Y., Guan, L., et al.: Wind power short-term prediction based on LSTM and discrete wavelet transform. Appl. Sci. 9(6), 1108 (2019)
Márquez, F., Papaelias, J., Hermosa, R.R.: Wind Turbines maintenance management based on FTA and BDD. In: International Conference on Renewable Energies and Power Quality (ICREPQ’12), pp. 4–6 (2012)
Márquez, F.P.G., Chacón, A.M.P.: A review of non-destructive testing on wind Turbines blades. Renew. Energy 161, 998–1010 (2020)
Márquez, F.P.G., Karyotakis, A., Papaelias, M.: Renewable energies: Business outlook 2050. Springer (2018)
Marugán, A.P., Chacón, A.M.P., Márquez, F.P.G.: Reliability analysis of detecting false alarms that employ neural networks: a real case study on wind turbines. Reliab. Eng. Syst. Saf. 191(106), 574 (2019)
Mckinnon, C., Carroll, J., et al.: Machine learning in wind turbine o &m: Future wind and marine (2019)
Merizalde, Y., Hernández-Callejo, L., et al.: Maintenance models applied to wind turbines: a comprehensive overview. Energies 12(2), 225 (2019)
Merrill, W., Weiss, G., et al.: A formal hierarchy of RNN architectures. arXiv preprint arXiv:2004.08500, p. 17 (2020)
Moraleda, V.B., Marugán, A.P., Márquez, F.P.G.: Acoustic maintenance management employing unmanned aerial vehicles in renewable energies. In: Xu, J., Cooke, F.L., Gen, M., Ahmed, S.E. (eds.) ICMSEM 2018. LNMIE, pp. 969–981. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-93351-1_76
Pak, M., Kim, S.: A review of deep learning in image recognition. In: 2017 4th International Conference on Computer Applications and Information Processing Technology (CAIPT), pp. 1–3. IEEE (2017)
Papaelias, M., Marquez, F.P.G., Karyotakis, A.: Non-destructive testing and condition monitoring techniques for renewable energy industrial assets. Butterworth-Heinemann (2019)
Peco Chacón, A.M., Segovia Ramírez, I., García Márquez, F.P.: State of the art of artificial intelligence applied for false alarms in wind turbines. Archives of Computational Methods in Engineering, pp. 1–25 (2021)
Pliego Marugán, A., García Márquez, F.P.: Advanced analytics for detection and diagnosis of false alarms and faults: a real case study. Wind Energy 22(11), 1622–1635 (2019)
Pliego Marugán, A., García Márquez, F.P., Lorente, J.: Decision making process via binary decision diagram. Int. J. Manage. Sci. Eng. Manage. 10(1), 3–8 (2015)
Raišutis, R., Jasiūniene, E., et al.: The review of non-destructive testing techniques suitable for inspection of the wind Turbine blades. Ultragarsas “Ultrasound” 63(2), 26–30 (2008)
Ramírez, I.S., Marugán, A.P., Márquez, F.P.G.: Remotely piloted aircraft system and engineering management: a real case study. In: Xu, J., Cooke, F.L., Gen, M., Ahmed, S.E. (eds.) ICMSEM 2018. LNMIE, pp. 1173–1185. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-93351-1_92
Ramirez, I.S., Mohammadi-Ivatloob, B., Márqueza, F.P.G.: Alarms management by supervisory control and data acquisition system for wind Turbines. Eksploatacja i Niezawodność 23(1) (2021)
Salameh, J.P., Cauet, S., et al.: Gearbox condition monitoring in wind turbines: a review. Mech. Syst. Signal Process. 111, 251–264 (2018)
Sánchez, P.J.B., Ramirez, I.S., Márquez, F.P.G.: Wind turbines acoustic inspections performed with UAV and sound frequency domain analysis. In: 2021 7th International Conference on Control, pp. 1–5. Instrumentation and Automation (ICCIA), IEEE (2021)
Segovia Ramirez, I., Das, B., Garcia Marquez, F.P.: Fault detection and diagnosis in photovoltaic panels by radiometric sensors embedded in unmanned aerial vehicles. Progress in Photovoltaics: Research and Applications, pp. 1–17 (2021)
Shafiee, M., Sørensen, J.D.: Maintenance optimization and inspection planning of wind energy assets: models, methods and strategies. Reliability Eng. Syst. Saf. 192(105), 993 (2019)
Sherstinsky, A.: Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network. Physica D 404(132), 306 (2020)
Solimine, J., Niezrecki, C., Inalpolat, M.: An experimental investigation into passive acoustic damage detection for structural health monitoring of wind turbine blades. Struct. Health Monit. 19(6), 1711–1725 (2020)
Staudemeyer, R.C., Morris, E.R.: Understanding lstm-a tutorial into long short-term memory recurrent neural networks. arXiv preprint arXiv:1909.09586, p. 42 (2019)
Tandon, N., Choudhury, A.: A review of vibration and acoustic measurement methods for the detection of defects in rolling element bearings. Tribol. Int. 32(8), 469–480 (1999)
Vamsi, I., Sabareesh, G., Penumakala, P.: Comparison of condition monitoring techniques in assessing fault severity for a wind turbine gearbox under non-stationary loading. Mech. Syst. Signal Process. 124, 1–20 (2019)
Van Gerven, M., Bohte, S.: Artificial neural networks as models of neural information processing. Front. Comput. Neurosci. 11, 114 (2017)
Walczak, S.: Artificial neural networks. In: Encyclopedia of Information Science and Technology, pp. 120–131. Fourth Edition, IGI Global (2018)
Willis, D., Niezrecki, C., et al.: Wind energy research: state-of-the-art and future research directions. Renew. Energy 125, 133–154 (2018)
Wu, Y., Ma, X.: A hybrid LSTM-KLD approach to condition monitoring of operational wind turbines. Renew. Energy 181, 554–566 (2022)
Xiang, L., Wang, P., et al.: Fault detection of wind turbine based on scada data analysis using CNN and LSTM with attention mechanism. Measurement 175(109), 094 (2021)
Yin, A., Yan, Y., et al.: Fault diagnosis of wind turbine gearbox based on the optimized LSTM neural network with cosine loss. Sensors 20(8), 2339 (2020)
Zhu, W., Liu, H., et al.: Wind turbine blade fault detection by acoustic analysis: Preliminary results. In: In: 2021 IEEE International Conference on Signal Processing, pp. 1–5. Communications and Computing (ICSPCC), IEEE (2021)
The work reported herewith has been financially by the Direccion General de Universidades, Investigacion e Innovacion of Castilla-La Mancha, under Research Grant ProSeaWind project (Ref.: SBPLY/19/180501/000102).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sanchez, P.J.B., Ramirez, I.S., Marquez, F.P.G. (2022). Deep Learning for Acoustic Pattern Recognition in Wind Turbines Aerial Inspections. In: Xu, J., Altiparmak, F., Hassan, M.H.A., García Márquez, F.P., Hajiyev, A. (eds) Proceedings of the Sixteenth International Conference on Management Science and Engineering Management – Volume 1. ICMSEM 2022. Lecture Notes on Data Engineering and Communications Technologies, vol 144. Springer, Cham. https://doi.org/10.1007/978-3-031-10388-9_25
Download citation
DOI: https://doi.org/10.1007/978-3-031-10388-9_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-10387-2
Online ISBN: 978-3-031-10388-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)