Skip to main content

Advertisement

SpringerLink
Log in

Enhanced path planning for automated nanites drug delivery based on reinforcement learning and polymorphic improved ant colony optimization

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Nanorobots have the potential to greatly accelerate the evolution of modern medical approaches and practices. Moreover, using artificial intelligence in a medical procedure is a rapidly growing part of today’s research. Medical surgery equipment’s are undergoing evolutionary advancement and microscopy procedures turn out to be an indispensable tool for nano-sample imaging, injection of medicine or surgery. In nanoscale, accurate path planning for nanites in order to reach their destination is still a challenge especially when most of the surgeries involving nanites are still being proceeded by a human operator through an interface. This article presents an algorithm capable of parallel processing of path planning with Q-learning and ACO order to reach a considerable improvement in nano-medicine delivery and optimization of path length and increasing accuracy of the results. We used autonomous path planning for post-nanite injection in vessels. We reached environmental perception and the ability to navigate quicker and more accurately in exchange with for more processing power and memory usage which will be considered an efficient trade-off (ANDD framework). The main objective of the experiments is to evaluate the performance of the proposed adaptive agent’s method after it efficiently planed the path autonomously and optimized the length of the nanite swarm traveling distance. Simulation outcomes reveal that the introduced method can accomplish various objectives continuously, such as recalculation of an optimal path in case of a sudden change in patient tumor location, time efficiency in decision-making through the operation and decrease in error ratio.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Notes

  1. Dynamic Q-learning.

References

  1. Diller E, Zhang J (2018) Mobile device for grasping and active release of objects. Google Patents

  2. Drexler Eric K (1986) Engines of creation: the coming era of nanotechnology. Anchor Books, Doubleday. http://e-drexler.com/p/06/00/EOC_Cover.html

  3. Yadav S, Sheoran P (2016) Smart wheelchairs-a literature review. Int J Inov Emerg Res Eng 3(2):86–90

    Google Scholar 

  4. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge

    MATH  Google Scholar 

  5. Gigras Y, Gupta K (2012) Ant colony based path planning algorithm for autonomous robotic vehicles. Int J Artif Intell Appl 3(6):31

    Google Scholar 

  6. Hachour O (2008) Path planning of autonomous mobile robot. Int J Syst Appl Eng Dev 2(4):178–190

    Google Scholar 

  7. Tuncer A, Yildirim M (2012) Dynamic path planning of mobile robots with improved genetic algorithm. Comput Electr Eng 38(6):1564–1572

    Article  Google Scholar 

  8. Florczyk S (2005) Robot vision: video-based indoor exploration with autonomous and mobile robots. Wiley, Hoboken

    Google Scholar 

  9. Eichhorn V, Carlson K, Andersen K, Fatikow S, Boggild P (2007) Nanorobotic manipulation setup for pick-and-place handling and nondestructive characterization of carbon nanotubes. In: 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems

  10. Abdulkader MM, Gajpal Y, ElMekkawy TY (2015) Hybridized ant colony algorithm for the multi compartment vehicle routing problem. Appl Soft Comput 37:196–203

    Article  Google Scholar 

  11. Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: MHS’95. Proceedings of the sixth international symposium on micro machine and human science

  12. Huang H, Savkin AV (2017) Viable path planning for data collection robots in a sensing field with obstacles. Comput Commun 111:84–96

    Article  Google Scholar 

  13. Li G, Xi N, Yu M, Fung W-K (2004) Development of augmented reality system for AFM-based nanomanipulation. IEEE ASME Trans Mechatron 9(2):358–365

    Article  Google Scholar 

  14. Xu J-M, Cao X-B, Wang X-F (2005) Polymorphic ant colony algorithm. J Univ Sci Technol China 35(1):59–65

    MathSciNet  Google Scholar 

  15. Rizvi NS, Keole RR (2014) Preliminary review of swarm intelligence: a clever algorithm and data clustering. Int J Comput Sci Info Technol 5(2):1892–1899

    Google Scholar 

  16. Holland OE, Melhuish CR (1997) Getting the most from the least: lessons for the nanoscale from minimal mobile agents. In: Langton CG, Shimohara K (eds) Artificial life v: proceedings of the fifth international workshop on the synthesis and simulation of living systems. MIT Press, pp 59–66

  17. Jiao Z, Ma K, Rong Y, Wang P, Zhang H, Wang S (2018) A path planning method using adaptive polymorphic ant colony algorithm for smart wheelchairs. J Comput Sci 25:50–57

    Article  MathSciNet  Google Scholar 

  18. Moreno L, Puente EA, Salichs MA (1992) World modelling and sensor data fusion in a non static environment. Appl Mob Robots 25(6):433–436

    Google Scholar 

  19. Xu T, Zhang J, Salehizadeh M, Onaizah O, Diller E (2019) Millimeter-scale flexible robots with programmable three-dimensional magnetization and motions. Science 4(29):eaav4494

    Google Scholar 

  20. Bartenwerfer M, Fatikow S (2012) Nanorobot-based handling and transfer of individual silicon nanowires. Int J Intell Mechatron Robot (IJIMR) 2(2):34–46

    Google Scholar 

  21. Luo H, Jian X, Lu W (2014) Optimal test node selection based on dynamic ant colony algorithm for analog circuit. Chin J Sci Instrum 35(10):2231–2237

    Google Scholar 

  22. Hachour O (2009) The proposed hybrid intelligent system for path planning of intelligent autonomous systems. Int J Math Comput Simul 3:133–145

    Google Scholar 

  23. Qu H, Huang L-W, Ke X (2015) Research of improved ant colony based robot path planning under dynamic environment. J Univ Electron Sci Technol China 44(2):260–265

    Google Scholar 

  24. Zhang Y, Yang J, Wang S, Dong Z, Phillips P (2017) Pathological brain detection in MRI scanning via Hu moment invariants and machine learning. J Exp Theor Artif Intell 29(2):299–312

    Article  Google Scholar 

  25. Zhang Y, Wang S, Phillips P, Ji G-B (2014) Binary PSO with mutation operator for feature selection using decision tree applied to spam detection. Knowl Based Syst 64:22–31

    Article  Google Scholar 

  26. Thompson SE, Chau RS, Ghani T, Mistry K, Tyagi S, Bohr MT (2005) In search of “Forever” continued transistor scaling one new material at a time. IEEE Trans Semicond Manuf 18(1):26–36

    Article  Google Scholar 

  27. Falcone E, Gockley R, Porter E, Nourbakhsh I (2003) The personal rover project: the comprehensive design of a domestic personal robot. Robot Auton Syst 42(3–4):245–258

    Article  Google Scholar 

  28. Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B (Cybern) 26(1):29–41

    Article  Google Scholar 

  29. Lim C, Dehuri S (2009) Innovations in swarm intelligence, vol 248. Springer, Berlin

    Book  Google Scholar 

  30. Zhang Y, Lu S, Zhou X, Yang M, Wu L, Liu B et al (2016) Comparison of machine learning methods for stationary wavelet entropy-based multiple sclerosis detection: decision tree, k-nearest neighbors, and support vector machine. Simulation 92(9):861–871

    Article  Google Scholar 

  31. Son C (2016) Intelligent rule-based sequence planning algorithm with fuzzy optimization for robot manipulation tasks in partially dynamic environments. Inf Sci 342:209–221

    Article  Google Scholar 

  32. Tulevski GS, Franklin AD, Frank D, Lobez JM, Cao Q, Park H et al (2014) Toward high-performance digital logic technology with carbon nanotubes. ACS Nano 8(9):8730–8745

    Article  Google Scholar 

  33. Neoh S, Morad N, Marzuki A, Lim C, Aziz Z (2009) A multi-resolution GA-PSO layered encoding cascade optimization model. In: Neoh S, Morad N, Marzuki A, Lim C, Aziz Z (eds) Innovations in swarm intelligence. Springer, Berlin, pp 121–140

    Chapter  Google Scholar 

  34. Savkin AV, Huang H (2017). Optimal aircraft planar navigation in static threat environments. IEEE Trans Aerosp Electron Syst 53(5):2413–2426

    Article  Google Scholar 

  35. Wang Y, Yang Z, Chen T, Yang L, Sun L, Fukuda T (2016) CNT handling with van der Waals force inside a SEM for FET application. In: 2016 IEEE 11th Annual International Conference on Nano/micro Engineered and Molecular Systems (NEMS)

  36. Zhang Y, Wu L, Wei G, Wang S (2011) A novel algorithm for all pairs shortest path problem based on matrix multiplication and pulse coupled neural network. Digit Signal Process 21(4):517–521

    Article  Google Scholar 

  37. Sheng G, Wen T, Guo Q, Song X (2013) Trustworthy service discovery based on a modified ant colony algorithm. J Commun 34(10):37–48

    Google Scholar 

  38. Korayem MH, Hoshiar AK, Nazarahari M (2016) A hybrid co-evolutionary genetic algorithm for multiple nanoparticle assembly task path planning. Int J Adv Manuf Technol 87(9–12):3527–3543

    Article  Google Scholar 

  39. Chang Y, Wang X, An Z, Wang H (2018) Robotic path planning using A* algorithm for automatic navigation in magnetic resonance angiography. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, pp 734–737

  40. Elsayed S, Amin S, Alarif T (2014) Assessment of applying path planning technique to nanorobots in a human blood environment. In: 2014 European modelling symposium. IEEE, pp 45–51

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Shahr-e-Qods Branch, Islamic Azad University, Tehran, Iran

    Seyyed Parham Haghighate Pazhohe Tabrizi, Akram Reza & Seyed Mahdi Jameii

Authors
  1. Seyyed Parham Haghighate Pazhohe Tabrizi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Akram Reza
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Seyed Mahdi Jameii
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Akram Reza.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tabrizi, S.P.H.P., Reza, A. & Jameii, S.M. Enhanced path planning for automated nanites drug delivery based on reinforcement learning and polymorphic improved ant colony optimization. J Supercomput 77, 6714–6733 (2021). https://doi.org/10.1007/s11227-020-03559-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-020-03559-6

Keywords

Search

Navigation