Abstract
Wildfires are a common problem in many areas of the world with often catastrophic consequences. A number of systems have been created to provide early warnings of wildfires, including those that use satellite data to detect fires. The increased availability of small satellites, such as CubeSats, allows the wildfire detection response time to be reduced by deploying constellations of multiple satellites over regions of interest. By using machine learned components on-board the satellites, constraints which limit the amount of data that can be processed and sent back to ground stations can be overcome. There are hazards associated with wildfire alert systems, such as failing to detect the presence of a wildfire, or detecting a wildfire in the incorrect location. It is therefore necessary to be able to create a safety assurance case for the wildfire alert ML component that demonstrates it is sufficiently safe for use. This paper describes in detail how a safety assurance case for an ML wildfire alert system is created. This represents the first fully developed safety case for an ML component containing explicit argument and evidence as to the safety of the machine learning.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Data Availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request
References
Morton, A., Evershed, N., Readfearn, G.,“Australia bushfires factcheck: are this year’s fires unprecedented?.” The Guardian (2019). Retrieved from https://www.theguardian.com/australia-news/2019/nov/22/australia-bushfires-factcheck-are-this-years-fires-unprecedented
“South korea wildfires: Deadly blaze declared a national emergency.” BBC News (2019) Retrieved from https://www.bbc.com/news/world-asia-47824306
Martin, D., Tomida, M., Meacham, B.: Environmental impact of fire. Fire Sci. Reviews. 1(5), 1–21 (2016)
Barmpoutis, P., Papaioannou, P., Dimitropoulos, K., Grammalidis, N.: A review on early forest fire detection systems using optical remote sensing. Sensors. 20, no. 22 6442 (2020)
NASA: “FIRMS - fire information for resource management system.”(2023) https://modaps.eosdis.nasa.gov/map/
GWIS:“GWIS - Welcome to GWIS.” (2023) https://gwis.jrc.ec.europa.eu/
Copernicus:“Copernicus emergency management service.” (2023)https://emergency.copernicus.eu/
NASA:“VIIRS I-Band 375 m Active Fire Data.” (2021) https://earthdata.nasa.gov/earth-observation-data/near-real-time/firms/viirs-i-band-active-fire-data/
NASA:“MCD14DL Earthdata.”(2021) https://earthdata.nasa.gov/earth-observation-data/near-real-time/firms/mcd14dl/
Billing, P.:“Otways Fire No 22 - 1982/83 - Aspects of Fire Behaviour.” Victoria Department of Sustainability and Environment, (1983) Available at: https://www.ffm.vic.gov.au/__data/assets/pdf_file/0007/21022/Report-20-Otways-Fire-22-1982-83_-Aspects-of-Fire-Behaviour.pdf
UK Ministry of Defence (MOD):“Safety management requirements for defence systems part 1: Requirements.” Standard Def Stan 00-56:2017, UK Ministry of Defence (MOD), (2017)
Group, A.C.W.:“Goal Structuring Notation Community Standard.” Tech. Rep. SCSC-141BA v2.0, Safety Critical Systems Club, (2018)
Hawkins, R., Habli, I., Kelly, T., McDermid, J.: Assurance cases and prescriptive software safety certification: A comparative study. Safety Sci. 59, 55–71 (2013)
ISO:“Road vehicles–functional safety.” Standard ISO 26262-1 (2018)
Xu, Z., Saleh, J.H.: Machine learning for reliability engineering and safety applications: Review of current status and future opportunities. Reliab. Eng. & Syst. Safety 211, 107530 (2021)
Xiang, W., Musau, P., Wild, A.A., Lopez, D.M., Hamilton, N., Yang, X., Rosenfeld, J., Johnson, T.T.:“Verification for machine learning, autonomy, and neural networks survey.” (2018) arXiv:1810.01989
Huang, X., Kroening, D., Kwiatkowska, M., Ruan, W., Sun, Y., Thamo, E., Wu, M., Yi, X.:“Safety and trustworthiness of deep neural networks: A survey.” p. 151, (2018). arXiv:1812.08342
Salay, R., Czarnecki, K.:“Using machine learning safely in automotive software: An assessment and adaption of software process requirements in iso 26262.” (2018). arXiv:1808.01614
Jia,Y., Lawton, T., McDermid, J., Rojas, E., Habli, I.:“A framework for assurance of medication safety using machine learning.” (2021). arXiv:2101.05620
Ashmore, R., Calinescu, R., Paterson, C.: Assuring the machine learning lifecycle: Desiderata, methods, and challenges. ACM Comput. Surv. (CSUR). 5(54), 1–39 (2021)
Burton, S., Gauerhof, L., Heinzemann, C.:“Making the case for safety of machine learning in highly automated driving. In International Conference on Computer Safety, Reliability, and Security , pp. 5–16, Springer, 2017
Salay, R., Czarnecki, K., Kuwajima, H., Yasuoka, H., Nakae, T., Abdelzad, V., Huang, C., Kahn, M., Nguyen, V.D.:“The missing link: Developing a safety case for perception components in automated driving.” (2021) arXiv:2108.13294
Hawkins, R., Paterson, C., Picardi, C., Jia, Y., Calinescu, R., Habli, I.:“Guidance on the assurance of machine learning in autonomous systems (AMLAS).” arXiv:2102.01564 (2021)
ARP4754A, S.:“Guidelines for development of civil aircraft and systems.” SAE International (2010)
Liu, X., Rivera, S.C., Moher, D., Calvert, M.J., Denniston, A.K.:“Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the consort-ai extension.” bmj 370 (2020)
ISO, I.:“PAS 21448-road vehicles-safety of the intended functionality.” Int. Organ. Stand. (2019)
U. Laboratories:“Standard for evaluation of autonomous products.” Standard UL 4600, Ed. 1, Underwriters Laboratories, (2020)
S. of Autonomous Systems Working Group:“Safety assurance objectives for autonomous systems.” Tech. Rep. SCSC-153A 2.0 ed, Safety Critical Systems Club, (2020)
Schroeder, W., Oliva, P., Giglio, L., Quayle, B., Lorenz, E., Morelli, F.: Active fire detection using landsat-8/oli data. Remote Sens. Environ. 185, 210–220 (2016)
Giglio, L., Schroeder, W., Justice, C.O.: The collection 6 modis active fire detection algorithm and fire products. Remote Sens. Environ. 178, 31–41 (2016)
d.A. Pereira, G.H., Fusioka, A. M., Nassu, B.T., Minetto, R.:“A large-scale dataset for active fire detection/segmentation (landsat-8).” (2020) https://ieee-dataport.org/open-access/large-scale-dataset-active-fire-detectionsegmentation-landsat-8
de Almeida Pereira, G.H., Fusioka, A.M., Nassu, B.T., Minetto, R.: “Active fire detection in landsat-8 imagery: A large-scale dataset and a deep-learning study’’. ISPRS J. Photogramm. Remote Sens. 178, 171–186 (2021)
Kingma, D.P., Ba, J.:“Adam: A method for stochastic optimization.” (2014) . arXiv:1412.6980
Acknowledgements
The work is funded by the Assuring Autonomy International Programme (www.york.ac.uk/assuring-autonomy)
Funding
The work is funded by the Assuring Autonomy International Programme (www.york.ac.uk/assuring-autonomy)
Author information
Authors and Affiliations
Contributions
All authors contributed to the work reported in this paper. The first draft of the manuscript was written by Richard Hawkins and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript
Corresponding author
Ethics declarations
Ethics Approval
The research reported in this paper does not involve human or animal subjects
Consent for publication
The research reported in this paper does not involve human subjects
Consent to participate
The research reported in this paper does not involve human subjects
Competing Interests
The authors have no relevant financial or non-financial interests to disclose
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Hawkins, R., Picardi, C., Donnell, L. et al. Creating a Safety Assurance Case for a Machine Learned Satellite-Based Wildfire Detection and Alert System. J Intell Robot Syst 108, 47 (2023). https://doi.org/10.1007/s10846-023-01905-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-023-01905-3