Agile Deep Learning UAVs Operating in Smart Spaces: Collective Intelligence Versus “Mission-Impossible”

  • Michael CochezEmail author
  • Jacques Periaux
  • Vagan Terziyan
  • Tero Tuovinen
Conference paper
Part of the Computational Methods in Applied Sciences book series (COMPUTMETHODS, volume 45)


The environments, in which we all live, are known to be complex and unpredictable. The complete discovery of these environments aiming to take full control over them is a “mission-impossible”, however, still in our common agenda. People intend to make their living spaces smarter utilizing innovations from the Internet of Things and Artificial Intelligence. Unmanned aerial vehicles (UAVs) as very dynamic, autonomous and intelligent things capable to discover and control large areas are becoming important “inhabitants” within existing and future smart cities. Our concern in this paper is to challenge the potential of UAVs in situations, which are evolving fast in a way unseen before, e.g., emergency situations. To address such challenges, UAVs have to be “intelligent” enough to be capable to autonomously and in near real-time evaluate the situation and its dynamics. Then, they have to discover their own missions and set-up suitable own configurations to perform it. This configuration is the result of flexible plans which are created in mutual collaboration. Finally, the UAVs execute the plans and learn from the new experiences for future reuse. However, if to take into account also the Big Data challenge, which is naturally associated with the smart cities, UAVs must be also “wise” in a sense that the process of making autonomous and responsible real-time decisions must include continuous search for a compromise between efficiency (acceptable time frame to get the decision and reasonable resources spent for that) and effectiveness (processing as much of important input information as possible and to improve the quality of the decisions). To address such a “skill” we propose to perform the required computations using Cloud Computing enhanced with Semantic Web technologies and potential tools (“agile” deep learning) for compromising, such as, e.g., focusing, filtering, forgetting, contextualizing, compressing and connecting.



The authors would like to thank the department of Mathematical Information Technology of the University of Jyväskylä for financially supporting this research. Further we would like to thank the members of the Industrial Ontologies Group (IOG) of the university of Jyväskylä for their support in the research.


  1. Abadi DJ, Marcus A, Madden SR, Hollenbach K (2007) Scalable semantic web data management using vertical partitioning. In: Proceedings of the 33rd international conference on very large data bases. VLDB’07. VLDB Endowment, pp. 411–422Google Scholar
  2. Akerkar R (ed) (2013) Big data computing. Taylor & Francis group-Chapman and Hall/CRCGoogle Scholar
  3. Atmosukarto I, Ghanem B, Ahuja N (2012) Trajectory-based Fisher kernel representation for action recognition in videos. In: 2012 21st international conference on pattern recognition (ICPR), pp 3333–3336Google Scholar
  4. Baader F, Calvanese D, McGuinness DL, Nardi D, Patel-Schneider PF (eds) (2003) The description logic handbook: theory, implementation, and applications. Cambridge University Press, CambridgezbMATHGoogle Scholar
  5. Berners-Lee T, Hendler J, Lassila O et al (2001) The semantic web. Scientific american 284(5):28–37CrossRefGoogle Scholar
  6. Broekstra J, Kampman A, Harmelen Van F (2002) Sesame: a generic architecture for storing and querying rdf and rdf schema. In: The Semantic Web—ISWC 2002, pp 54–68Google Scholar
  7. Buyya R, Yeo CS, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility. Futur Gener Comput Syst 25(6):599–616CrossRefGoogle Scholar
  8. Cochez M (2012) Semantic agent programming language: use and formalizationGoogle Scholar
  9. Cochez M, Periaux J, Terziyan V, Kamlyk K, Tuovinen T (2014) Evolutionary cloud for cooperative UAV coordination. Software and Computational Engineering, No. C, Reports of the Department of Mathematical Information Technology, Series C, p 1Google Scholar
  10. Damjanovic V, Kurz T, Westenthaler R, Behrendt W, Gruber A, Schaffert S (2011) Semantic enhancement: the key to massive and heterogeneous data pools. In: Proceeding of the 20th international IEEE ERK (electrotechnical and computer science) conferenceGoogle Scholar
  11. Darwin C (1859) On the origins of species by means of natural selection. Murray, LondonGoogle Scholar
  12. Dean D, Webb C (2011) Recovering from information overload. McKinsey QuarterlyGoogle Scholar
  13. Deelman E, Gannon D, Shields M, Taylor I (2009) Workflows and e-Science: an overview of workflow system features and capabilities. Futur Gener Comput Syst 25(5):528–540CrossRefGoogle Scholar
  14. Dias MB, Zlot R, Kalra N, Stentz A (2006) Market-based multirobot coordination: a survey and analysis. Proc IEEE 94(7):1257–1270CrossRefGoogle Scholar
  15. Doherty P, Heintz F, Kvarnström J (2013) High-level mission specification and planning for collaborative unmanned aircraft systems using delegation. Unmanned Syst 01(01):75–119CrossRefGoogle Scholar
  16. Ermolayev V, Akerkar R, Terziyan V, Cochez M (2013) Chap. Towards evolving knowledge ecosystems for big data understanding. In: Akerkar R (ed) Big data computing (2013)Google Scholar
  17. Evangelinos C, Hill C (2008) Cloud Computing for parallel Scientific HPC applications: feasibility of running coupled atmosphere-ocean climate models on Amazon’s EC2. Ratio, 2(2.40):2–34Google Scholar
  18. Fayyad UM, Piatetsky-Shapiro G, Smyth P, et al (1996) Knowledge discovery and data mining: towards a unifying framework, vol. 96. KDD, pp 82–88Google Scholar
  19. Ferber J (1999) Multi-agent systems: an introduction to distributed artificial intelligence, vol. 1. Addison-Wesley ReadingGoogle Scholar
  20. Fok K-L, Wong T-T, Wong M-L (2007) Evolutionary computing on consumer graphics hardware. IEEE Intell Syst 22(2):69–78CrossRefGoogle Scholar
  21. Gonzalez LF, Lee D-S, Walker RA, Periaux J (2009) Optimal mission path planning (MPP) for an air sampling unmanned aerial system. In: Scheding S (ed) 2009 Australasian conference on robotics & automation. Robotics & Automation Association, Sydney, Australian, pp 1–9Google Scholar
  22. Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press. Book in preparation, draft chapters. Available at
  23. Haerder T, Reuter A (1983) Principles of transaction-oriented database recovery. ACM Comput Surv 15(4):287–317MathSciNetCrossRefGoogle Scholar
  24. Ito T, Chakraborty S, Kanamori R, Otsuka T (2012) Innovating multiagent algorithms for smart city: an overview. In: 2012 5th IEEE international conference on service-oriented computing and applications (SOCA), pp 1–8Google Scholar
  25. Jackson KR, Ramakrishnan L, Muriki K, Canon S, Cholia S, Shalf J, Wasserman HJ, Wright NJ (2010) Performance analysis of high performance computing applications on the amazon web services cloud. In: 2010 IEEE second international conference on cloud computing technology and science (CloudCom). IEEE, pp 159–168Google Scholar
  26. Kang K, Prasad JVR (2013) Development and flight test evaluations of an autonomous obstacle avoidance system for a rotary-wing UAV. Unmanned Syst 01(01):3–19CrossRefGoogle Scholar
  27. Katasonov A, Kaykova O, Khriyenko O, Nikitin S, Terziyan V (2008) Smart semantic middleware for the internet of things. In: Proceedings of the 5-th international conference on informatics in control, automation and robotics, pp 11–15Google Scholar
  28. Kopeikin AN, Ponda SS, Johnson LB, How JP (2013) Dynamic mission planning for communication control in multiple unmanned aircraft teams. Unmanned Syst 01(01):41–58CrossRefGoogle Scholar
  29. Lassila O (1999) Resource description framework (RDF) model and syntax specification. W3C Recommendation. W3C.
  30. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444CrossRefGoogle Scholar
  31. Lee CA (2010) A perspective on scientific cloud computing. In: Proceedings of the 19th ACM international symposium on high performance distributed computing. ACM, pp 451–459Google Scholar
  32. Li Z, Chen C, Wang K (2011) Cloud computing for agent-based urban transportation systems. IEEE Intell Syst 26(1):73–79CrossRefGoogle Scholar
  33. Matus R (2016) Neurala becomes largest supplier of deep learning software running in real time on a drone. (Sept 28)Google Scholar
  34. Mell P, Grance T (2009) The NIST definition of cloud computing, version 15. Information Technology Laboratory. National Institute of Standards and Technology (NIST).
  35. Miller E, Manola F 2004 RDF primer. W3C Recommendation. W3C.
  36. Nardi D, Brachman RJ (2003) The description logic handbook: theory, implementation, and applications. In: Chap. An introduction to description logics, pp 1–40Google Scholar
  37. Nash J (1951) Non-cooperative games. In: Annals of mathematics, pp 286–295Google Scholar
  38. Nimmagadda Y, Kumar K, Lu Y-H, Lee CSG (2010) Real-time moving object recognition and tracking using computation offloading. In: 2010 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 2449–2455Google Scholar
  39. Ostermann S, Iosup A, Yigitbasi N, Prodan R, Fahringer T, Epema D (2010) A performance analysis of EC2 cloud computing services for scientific computing. In: Cloud computing. Springer, pp 115–131Google Scholar
  40. Pathak PH, Dutta R (2011) A survey of network design problems and joint design approaches in wireless mesh networks. IEEE Commun Surv Tutor 13(3):396–428CrossRefGoogle Scholar
  41. Peng D, Dabek F (2010) Large-scale incremental processing using distributed transactions and notifications. In: Proceedings of the 9th USENIX symposium on operating systems design and implementationGoogle Scholar
  42. Petillot Y, Sotzing C, Patron P, Lane D, Cartright J (2009) Multiple system collaborative planning and sensing for autonomous platforms with shared and distributed situational awareness. In: Proceedings of the UAVSI’s unmanned systems EuropeGoogle Scholar
  43. Sadashiv N, Kumar SMD (2011) Cluster, grid and cloud computing: a detailed comparison. In: 2011 6th international conference on computer science & Education (ICCSE). IEEE, pp 477–482Google Scholar
  44. Simmhan Y, van Ingen C, Subramanian G, Li J (2010) Bridging the gap between desktop and the cloud for eScience applications. In: 2010 IEEE 3rd international conference on cloud computing (CLOUD). IEEE, pp 474–481Google Scholar
  45. Song Z (2016) Cloud-based control system for unmanned aerial vehicles. US Patent App. 15/046,560. (Feb18)Google Scholar
  46. Sorokin A, Forsyth D (2008) Utility data annotation with amazon mechanical turk. In: IEEE computer society conference on computer vision and pattern recognition workshops, 2008. CVPRW’08, pp 1–8Google Scholar
  47. Sycara K, Norman TJ, Giampapa JA, Kollingbaum MJ, Burnett C, Masato D, McCallum M, Strub MH (2010) Agent support for policy-driven collaborative mission planning. Comput J 53(5):528–540CrossRefGoogle Scholar
  48. Taleb NN (2010) The black swan: the impact of the highly improbable fragility. Random House Digital, IncGoogle Scholar
  49. Terziyan V (2008) SmartResource-Proactive self-maintained resources in semantic web: Lessons learned. Int J Smart Home 2(2):33–57Google Scholar
  50. Trigui S, Koubaa A, Ben Jamaa M, Chaari I, Al-Shalfan K (2012) Coordination in a multi-robot surveillance application using Wireless Sensor Networks. In: 2012 16th IEEE mediterranean electrotechnical conference (MELECON), pp 989–992Google Scholar
  51. Vecchiola C, Pandey S, Buyya R (2009). High-performance cloud computing: a view of scientific applications. In: 2009 10th international symposium on pervasive systems, algorithms, and networks (ISPAN). IEEE, pp 4–16Google Scholar
  52. Walker E (2008) Benchmarking Amazon EC2 for high-performance scientific computing. Usenix Login 33(5):18–23Google Scholar
  53. Wang K, Shen Z (2011) Artificial societies and GPU-based cloud computing for intelligent transportation management. IEEE Intell Syst 26(4):22–28MathSciNetCrossRefGoogle Scholar
  54. Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Internet Serv Appl 1(1):7–18CrossRefGoogle Scholar
  55. Zikopoulos PC, Eaton C, deRoos D, Deutsch T, Lapis G (2012) Understanding big data. Mc Graw HillGoogle Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Michael Cochez
    • 1
    • 2
    • 3
    Email author
  • Jacques Periaux
    • 1
    • 4
  • Vagan Terziyan
    • 1
  • Tero Tuovinen
    • 1
  1. 1.Faculty of Information TechnologyUniversity of JyväskyläJyväskyläFinland
  2. 2.Fraunhofer Institute for Applied Information Technology FITSankt AugustinGermany
  3. 3.RWTH Aachen UniversityAachenGermany
  4. 4.International Center for Numerical Methods in Engineering (CIMNE)CastelldefelsSpain

Personalised recommendations