Abstract
Unmanned aerial vehicles are being used increasingly in a variety of applications. They are more and more often operating in close proximity to people and equipment. This necessitates ensuring maximum stability and flight safety. A fundamental step to achieving this goal is timely and effective diagnosis of possible defects. Popular data-based methods require a large amount of data collected during flights in various conditions. This paper describes an open PADRE database of such measurements for the detection and classification of the most common faults - multirotor propeller failures. It presents the procedure of data acquisition, the structure of the repository and ways to use the various types of data contained therein. The repository enables research on drone fault detection to be undertaken without time-consuming preparation of measurement data. The database is available on GitHub at https://github.com/AeroLabPUT/UAV_measurement_data. The article also introduces new and universal quality indicators for evaluating classifiers with non-uniform parameters, are proposed. They allow comparison of methods tested for a variety of fault classes and with different processing times.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Availability of data and materials
The data are available at https://github.com/AeroLabPUT/UAV_measurement_data
Code availability
Not applicable
References
Utsav, A., Abhishek, A., Suraj, P., Badhai, R.K.: An IoT based UAV network for military applications. In: 2021 Sixth International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), pp. 122–125 (2021). https://doi.org/10.1109/WiSPNET51692.2021.9419470
Amarasingam, N., Ashan Salgadoe, A.S., Powell, K., Gonzalez, L.F., Natarajan, S.: A review of UAV platforms, sensors, and applications for monitoring of sugarcane crops. Remote Sens. Appl.: Soc. Environ. 26, 100712 (2022). https://doi.org/10.1016/j.rsase.2022.100712
Yang, Z., Yu, X., Dedman, S., Rosso, M., Zhu, J., Yang, J., Xia, Y., Tian, Y., Zhang, G., Wang, J.: UAV remote sensing applications in marine monitoring: Knowledge visualization and review. Sci. Total Environ. 838, 155939 (2022). https://doi.org/10.1016/j.scitotenv.2022.155939
Hoang, V.T., Phung, M.D., Dinh, T.H., Ha, Q.P.: System architecture for real-time surface inspection using multiple UAVs. IEEE Syst. J. 14(2), 2925–2936 (2020). https://doi.org/10.1109/JSYST.2019.2922290
Hu, J., Niu, H., Carrasco, J., Lennox, B., Arvin, F.: Fault-tolerant cooperative navigation of networked UAV swarms for forest fire monitoring. Aerosp. Sci. Technol. 123, 107494 (2022). https://doi.org/10.1016/j.ast.2022.107494
Khan, S.I., Qadir, Z., Munawar, H.S., Nayak, S.R., Budati, A.K., Verma, K.D., Prakash, D.: UAVs path planning architecture for effective medical emergency response in future networks. Phys. Commun. 47, 101337 (2021). https://doi.org/10.1016/j.phycom.2021.101337
Shadiev, R., Yi, S.: A systematic review of UAV applications to education. Interact Learn. Environ. 1–30 (2022). https://doi.org/10.1080/10494820.2022.2028858
Li, Y., Liu, M., Jiang, D.: Application of unmanned aerial vehicles in logistics: A literature review. Sustainability. 14(21) (2022). https://doi.org/10.3390/su142114473
Pasandideh, F., Costa, J.P.J., Kunst, R., Islam, N., Hardjawana, W., Freitas, E.: A review of flying ad hoc networks: Key characteristics, applications, and wireless technologies. Remote Sens. 14(18) (2022). https://doi.org/10.3390/rs14184459
Qiao, J., Liu, Z., Zhang, Y.: Gain scheduling based pid control approaches for path tracking and fault tolerant control of a quad-rotor UAV. (2018). https://doi.org/10.18178/ijmerr.7.4.401-408
Zheng, Qinghe, Tian, Xinyu, Zhiguo, Yu., Wang, Hongjun, Elhanashi, Abdussalam, Saponara, Sergio: DL-PR: Generalized automatic modulation classification method based on deep learning with priori regularization. Eng. Appl. Artif. Intell. 122, 106082 (2023). https://doi.org/10.1016/j.engappai.2023.106082
Puchalski, R., Giernacki, W.: UAV fault detection methods, state-of-the-art. Drones. 6(11) (2022). https://doi.org/10.3390/drones6110330
Schijndel, B.A.S., Sun, S., Visser, C.C.: Fast loss of effectiveness detection on a quadrotor using onboard sensors and a Kalman estimation approach. In: 2023 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 1–8 (2023). https://doi.org/10.1109/ICUAS57906.2023.10156464
Al-Haddad, L.A., Jaber, A.A.: An intelligent fault diagnosis approach for multirotor UAVs based on deep neural network of multi-resolution transform features. Drones. 7(2) (2023). https://doi.org/10.3390/drones7020082
Ashe, A.K., Goli, S., Kandath, H., Gangadharan, D.: Multivariate data analysis for motor failure detection and isolation in a multicopter UAV using real-flight attitude signals. In: 2023 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 9–16 (2023). https://doi.org/10.1109/ICUAS57906.2023.10155856
Wang, B., Liu, D., Peng, Y., Peng, X.: Multivariate regression-based fault detection and recovery of UAV flight data. IEEE Trans. Instrum. Meas. 69(6), 3527–3537 (2019). https://doi.org/10.1109/TIM.2019.2935576
Wang, B., Peng, X., Jiang, M., Liu, D.: Real-time fault detection for UAV based on model acceleration engine. IEEE Trans. Instrum. Meas. 69(12), 9505–9516 (2020). https://doi.org/10.1109/TIM.2020.3001659
Puchalski, R., Bondyra, A., Giernacki, W., Zhang, Y.: Actuator fault detection and isolation system for multirotor unmanned aerial vehicles. In: 2022 26th International Conference on Methods and Models in Automation and Robotics (MMAR), pp. 364–369 (2022). https://doi.org/10.1109/MMAR55195.2022.9874283
Sadhu, V., Zonouz, S., Pompili, D.: On-board deep-learning-based unmanned aerial vehicle fault cause detection and identification. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 5255–5261 (2020). https://doi.org/10.48550/arXiv.2005.00336 . IEEE
D’Amato, E., Nardi, V.A., Notaro, I., Scordamaglia, V.: A particle filtering approach for fault detection and isolation of UAV IMU sensors: Design, implementation and sensitivity analysis. Sensors. 21(9) (2021). https://doi.org/10.3390/s21093066
Saied, M., Tabikh, A.R., Francis, C., Hamadi, H., Lussier, B.: An informational approach for fault tolerant data fusion applied to a UAV’s attitude, altitude, and position estimation. IEEE Sensors J. 21(24), 27766–27778 (2021). https://doi.org/10.1109/JSEN.2021.3124731
Altinors, A., Yol, F., Yaman, O.: A sound based method for fault detection with statistical feature extraction in UAV motors. Appl. Acoust. 183, 108325 (2021). https://doi.org/10.1016/j.apacoust.2021.108325
Gomez, M.S., Koschlik, A.-K., Arts, E., Raddatz, F.: Non-destructive evaluation of the condition of a UAV’s propellers by means of acoustics. In: NDE 4.0, Predictive Maintenance, and Communication and Energy Systems in a Globally Networked World, vol. 12049, pp. 22–30 (2022). https://doi.org/10.1117/12.2612770
Kołodziejczak, M., Puchalski, R., Bondyra, A., Sladic, S., Giernacki, W.: Toward lightweight acoustic fault detection and identification of UAV rotors. In: 2023 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 990–997 (2023). https://doi.org/10.1109/ICUAS57906.2023.10156624
Fourlas, G.K., Karras, G.C.: A survey on fault diagnosis methods for UAVs. In: 2021 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 394–403 (2021). https://doi.org/10.1109/ICUAS51884.2021.9476733
Puchalski, R., Kołodziejczak, M., Bondyra, A., Rao, J., Giernacki, W.: PADRE - propeller anomaly data repository for UAVs various rotor fault configurations. In: 2023 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 982–989 (2023). https://doi.org/10.1109/ICUAS57906.2023.10156238
Johnson, P., Ricker, B., Harrison, S.: Volunteered drone imagery: Challenges and constraints to the development of an open shared image repository. In: Hawaii International Conference on System Sciences (2017). https://doi.org/10.24251/HICSS.2017.242
Antonini, A., Guerra, W., Murali, V., Sayre-McCord, T., Karaman, S.: The blackbird UAV dataset. Int. J. Robotics Res. 39(10–11), 1346–1364 (2020). https://doi.org/10.48550/arXiv.1810.01987
Mylonas, N., Malounas, I., Mouseti, S., Vali, E., Espejo-Garcia, B., Fountas, S.: Eden library: A long-term database for storing agricultural multi-sensor datasets from UAV and proximal platforms. Smart Agricultural Technology. 2(100028) (2022). https://doi.org/10.1016/j.atech.2021.100028
Gururajan, S., Mitchell, K., Ebel, W.: Flights of a multirotor UAS with structural faults: Failures on composite propeller(s). Data. 4(3) (2019). https://doi.org/10.3390/data4030128
Keipour, A., Mousaei, M., Scherer, S.: ALFA: A dataset for UAV fault and anomaly detection. Int. J. Robotics Res. 40(2–3), 515–520 (2021). https://doi.org/10.1177/0278364920966642
Baldini, A., D’Alleva, L., Felicetti, R., Ferracuti, F., Freddi, A., Monteriù, A.: UAV-FD: a dataset for actuator fault detection in multirotor drones. In: 2023 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 998–1004 (2023). https://doi.org/10.1109/ICUAS57906.2023.10156060
Tsai, C.-P., Li, W.-C.: A micromechanical frequency controlled pulse density modulator. In: 2022 IEEE 35th International Conference on Micro Electro Mechanical Systems Conference (MEMS), pp. 204–207 (2022). https://doi.org/10.1109/MEMS51670.2022.9699549
Parrot: Bebop-pro 3D modeling, All-in-one drone solution for 3D modeling. Accessed 24 Apr 2024 (2024). https://www.parrot.com
3DR: Solo Operation Manual. Accessed 24 Apr 2024 (2015). https://www.wwu.edu/faculty/wallin/esci497_uas/readings/3dr_solo/Solo_FAA_6_22_operations_manual.pdf
InvenSense: MPU-6500 Product Specification Revision 1.3. Accessed: 30 Oct 2023 (2020). http://invensense.wpenginepowered.com/wp-content/uploads/2020/06/PS-MPU-6500A-01-v1.3.pdf
InvenSense: MPU-9250 Product Specification Revision 1.1. Accessed: 28 Sept 2023 (2016). https://invensense.tdk.com/wp-content/uploads/2015/02/PS-MPU-9250A-01-v1.1.pdf
Bosch: BMP280 – Data sheet. Accessed: 28 Sept 2023 (2021). https://www.bosch-sensortec.com/media/boschsensortec/downloads/datasheets/bst-bmp280-ds001.pdf
STMicroelectronics: MP34DT01-M MEMS audio sensor omnidirectional digital microphone. Accessed 28 Sept 2023 (2014). https://www.st.com/en/audio-ics/mp34dt01-m.html
Avola, Danilo and Cinque, Luigi and Foresti, Gian Luca and Lanzino, Romeo and Marini, Marco Raoul and Mecca, Alessio and Scarcello, Francesco: A novel transformer-based IMU self-calibration approach through on-board RGB camera for UAV flight stabilization. Sensors. 23(5) (2023). https://doi.org/10.3390/s23052655
Black, H.S., Edson, J.: Pulse code modulation. Trans. Am. Inst. Electr. Eng. 66(1), 895–899 (1947). https://doi.org/10.1109/T-AIEE.1947.5059525
Oshana, R.: Overview of digital signal processing algorithms. In: Oshana, R. (ed.) DSP Software Development Techniques for Embedded and Real-Time Systems. Embedded Technology, pp. 59–121. Newnes, Burlington (2006). https://doi.org/10.1016/B978-075067759-2/50006-5
Jothilakshmi, S., Gudivada, V.N.: Large scale data enabled evolution of spoken language research and applications. In: Gudivada, V.N., Raghavan, V.V., Govindaraju, V., Rao, C.R. (eds.) Cognitive Computing: Theory and Applications. Handbook of Statistics, vol. 35, pp. 301–340. Elsevier, Oxford (2016). https://doi.org/10.1016/bs.host.2016.07.005
STMicroelectronics: UM2372 STM32Cube PDM2PCM software library for the STM32F4/F7/H7 Series. Accessed: 22 Oct 2023 (2018). https://www.st.com/content/ccc/resource/technical/document/user_manual/group1/6b/43/5e/35/2d/86/49/0d/DM00482421/files/DM00482421.pdf/jcr:content/translations/en.DM00482421.pdf
Dabrowski, A., Marciniak, T.: Audio signal processing. In: Oklobdzija, V.G. (ed.) Digital Systems and Applications. CRC Press, Boca Raton (2017). https://doi.org/10.1201/9780849386206
Puchalski, R., Giernacki, W., Ha, Q.: Real-time UAV fault detection and classification using measurement data from the PADRE database. In: The 2024 IEEE/SICE International Symposium on System Integration (SII 2024), Ha Long, Vietnam (8-11 JAN 2024). https://doi.org/10.1109/SII58957.2024.10417427
Al-Haddad, L.A., Giernacki, W., Shandookh, A.A., Jaber, A.A., Puchalski, R.: Vibration signal processing for multirotor UAVs fault diagnosis: Filtering or multiresolution analysis? Eksploatacja i Niezawodność - Maintenance and Reliability. 26(1) (2024). https://doi.org/10.17531/ein/176318
Taylor, F.J.: Digital signal processing. In: Oklobdzija, V.G. (ed.) Digital Systems and Applications. CRC Press, Boca Raton (2017). https://doi.org/10.1201/9780849386206
Wied, D., Weißbach, R.: Consistency of the kernel density estimator: a survey. Stat. Pap. 53, 1–21 (2012). https://doi.org/10.1007/s00362-010-0338-1
Sedgwick, P.: Pearson’s correlation coefficient. Bmj. 345 (2012). https://doi.org/10.1136/bmj.e4483
Goutte, C., Gaussier, E.: A probabilistic interpretation of precision, recall and F-score, with implication for evaluation. In: Losada, D.E., Fernández-Luna, J.M. (eds.) Advances in Information Retrieval, pp. 345–359. Springer, Berlin, Heidelberg (2005). https://doi.org/10.1007/978-3-540-31865-1_25
Lessmann, S., Baesens, B., Mues, C., Pietsch, S.: Benchmarking classification models for software defect prediction: A proposed framework and novel findings. IEEE Trans. Softw. Eng. 34(4), 485–496 (2008). https://doi.org/10.1109/TSE.2008.35
Vieira, S.M., Kaymak, U., Sousa, J.M.C.: Cohen’s kappa coefficient as a performance measure for feature selection. In: International Conference on Fuzzy Systems, pp. 1–8 (2010). IEEE Trans Softw Eng. https://doi.org/10.1109/FUZZY.2010.5584447
Chicco, D., Warrens, M.J., Jurman, G.: The Matthews correlation coefficient (MCC) is more informative than Cohen’s kappa and Brier score in binary classification assessment. IEEE Access. 9, 78368–78381 (2021). https://doi.org/10.1109/ACCESS.2021.3084050
Hossin, M., Sulaiman, M.N.: A review on evaluation metrics for data classification evaluations. Int. J Data Min. Knowl. Manag. Process. 5(2), 01–11 (2015). https://doi.org/10.5121/ijdkp.2015.5201
Grandini, M., Bagli, E., Visani, G.: Metrics for multi-class classification: an overview. ArXiv. abs/2008.05756 (2020). ArXiv:2008.05756
Makhtar, M., Neagu, D.C., Ridley, M.J.: Comparing multi-class classifiers: On the similarity of confusion matrices for predictive toxicology applications. In: Yin, H., Wang, W., Rayward-Smith, V. (eds.) Intelligent Data Engineering and Automated Learning - IDEAL 2011, pp. 252–261. Springer, Berlin, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23878-9_31
Funding
This work has been supported by the Polish National Agency for Academic Exchange (NAWA) under the STER programme, Towards Internationalization of Poznan University of Technology Doctoral School (2022-2024). APC was funded by Poznan University of Technology grant no. 0214/SBAD/0241.
Author information
Authors and Affiliations
Contributions
Study concept: Wojciech Giernacki. System design and implementation: Radosław Puchalski. Software preparation: Radosław Puchalski, Huynh Anh Duy Nguyen. Conducting experiments: Radosław Puchalski, Lanh Van Nguyen. Article content: Quang Ha, Wojciech Giernacki. The first draft of the manuscript: Radosław Puchalski, Wojciech Giernacki. All authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Ethics approval
Not applicable
Consent to participate
Not applicable
Consent for publication
Not applicable
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Puchalski, R., Ha, Q., Giernacki, W. et al. PADRE – A Repository for Research on Fault Detection and Isolation of Unmanned Aerial Vehicle Propellers. J Intell Robot Syst 110, 74 (2024). https://doi.org/10.1007/s10846-024-02101-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-024-02101-7