On enhancing the deadlock-preventing object migration automaton using the pursuit paradigm

  • Abdolreza Shirvani
  • B. John OommenEmail author
Theoretical advances


Probably, the most reputed solution for partitioning, which has applications in databases, attribute partitioning, processor-based assignment and many other similar scenarios, is the object migration automata (OMA). However, one of the known deficiencies of the OMA is that when the problem size is large, i.e., the number of objects and partitions are large, the probability of receiving a reward, which “strengthens” the current partitioning, from the Environment is not significant. This is because of an internal deadlock scenario which is discussed in this paper. As a result of this, it can take the OMA a considerable number of iterations to recover from an inferior configuration. This property, which characterizes learning automaton (LA) in general, is especially true for the OMA-based methods. In spite of the fact that various solutions have been proposed to remedy this issue for general families of LA, overcoming this hurdle is a completely unexplored area of research for conceptualizing how the OMA should interact with the Environment. Indeed, the best reported version of the OMA, the enhanced OMA (EOMA), has been proposed to mitigate the consequent deadlock scenario. In this paper, we demonstrate that the incorporation of the intrinsic properties of the Environment into the OMA’s design leads to a higher learning capacity and to a more consistent partitioning. To achieve this, we incorporate the state-of-the-art pursuit principle utilized in the field of LA by estimating the Environment’s reward/penalty probabilities and using them to further augment the EOMA. We also verify the performance of our proposed method, referred to as the pursuit EOMA (PEOMA), through simulation, and demonstrate a significant increase in the convergence rate, i.e., by a factor of about forty. It also yields a noticeable reduction in sensitivity to the noise in the Environment. The paper also includes some results obtained for a real-world application domain involving faulty sensors.


Object partitioning Learning automata Object migration automaton Partitioning-based learning 



  1. 1.
    Amer A, Oommen BJ (2007) A novel framework for self-organizing lists in environments with locality of reference: lists-on-lists. Comput J 50(2):186–196CrossRefzbMATHGoogle Scholar
  2. 2.
    Esnaashari M, Meybodi MR (2010) A learning automata based scheduling solution to the dynamic point coverage problem in wireless sensor networks. Comput Netw 54(14):2410–2438CrossRefzbMATHGoogle Scholar
  3. 3.
    Fayyoumi E, Oommen BJ (2009) Achieving microaggregation for secure statistical databases using fixed-structure partitioning-based learning automata. IEEE Trans Syst Man Cybern B 39(5):1192–1205CrossRefGoogle Scholar
  4. 4.
    Freuder EC (1971) The object partition problem. Vision Flash 4Google Scholar
  5. 5.
    Gale W, Das S, Yu CT (1990) Improvements to an algorithm for equipartitioning. IEEE Trans Comput 39(5):706–710CrossRefGoogle Scholar
  6. 6.
    Hammer M, Chan A (1976) Index selection in a self-adaptive data base management system. In: Proceedings of the 1976 ACM SIGMOD international conference on management of data. ACM, pp 1–8Google Scholar
  7. 7.
    Hammer M, Niamir B (1979) A heuristic approach to attribute partitioning. In: Proceedings of the 1979 ACM SIGMOD international conference on management of data. ACM, pp 93–101Google Scholar
  8. 8.
    Jobava A (2015) Intelligent traffic-aware consolidation of virtual machines in a data center, Master’s thesis, University of OsloGoogle Scholar
  9. 9.
    Ma DCY (1986) Object partitioning by using learning automata, Master’s thesis, Carleton UniversityGoogle Scholar
  10. 10.
    Mamaghani AS, Mahi M, Meybodi M (2010) A learning automaton based approach for data fragments allocation in distributed database systems. In: Proceedings of the 2010 IEEE 10th international conference on computer and information technology (CIT). IEEE, pp 8–12Google Scholar
  11. 11.
    Obaidat MS, Misra S, Papadimitriou GI (2010) Guest editorial: adaptive and learning systems. IEEE Trans Syst Man Cybern B 40(1):2–5. CrossRefGoogle Scholar
  12. 12.
    Obaidat MS, Papadimitriou GI, Pomportsis AS (2002) Guest editorial learning automata: theory, paradigms, and applications. IEEE Trans Syst Man Cybern B 32(6):706–709CrossRefGoogle Scholar
  13. 13.
    Oommen BJ, Ma DCY (1988) Deterministic learning automata solutions to the equipartitioning problem. IEEE Trans Comput 37(1):2–13MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Narendra KS, Thathachar MAL (2012) Learning automata: an introduction. Courier Corporation, North ChelmsfordGoogle Scholar
  15. 15.
    Shirvani A (2017) Novel solutions and applications of the object partitioning problem. Ph.D. dissertation, Carleton University, Ottawa, CanadaGoogle Scholar
  16. 16.
    Shirvani A, Oommen BJ (2018) On enhancing the object migration automaton using the pursuit paradigm. J Comput Sci 24:329–342MathSciNetCrossRefGoogle Scholar
  17. 17.
    Shirvani A, Oommen BJ (2017) On utilizing the pursuit paradigm to enhance the deadlock-preventing object migration automaton. In: Proceedings of ICTCS’17, the international conference on new trends in computing. IEEEGoogle Scholar
  18. 18.
    Shirvani A, Oommen BJ, Yazidi A (2019) On resolving the “Unreliable Sensor” problem using the enhanced Object Migration Automata. In PreparationGoogle Scholar
  19. 19.
    Tsetlin M et al (1973) Automaton theory and modeling of biological systems. Academic Press, CambridgezbMATHGoogle Scholar
  20. 20.
    Yazidi A, Granmo OC, Oommen BJ (2012) Service selection in stochastic environments: a learning-automaton based solution. Appl Intell 36(3):617–637CrossRefGoogle Scholar
  21. 21.
    Yu CT, Suen C, Lam K, Siu MK (1985) Adaptive record clustering. ACM Trans Database Syst (TODS) 10(2):180–204CrossRefGoogle Scholar
  22. 22.
    Yu C, Siu M, Lam K, Tai F (1981) Adaptive clustering schemes: general framework. In: Proceedings of the IEEE COMPSAC conference, pp 81–89Google Scholar
  23. 23.
    Zhang J, Wang Y, Wang C, Zhou M (2017) Fast variable structure stochastic automaton for discovering and tracking spatiotemporal event patterns. IEEE Trans Cybern 48:890–903CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of Computer ScienceCarleton UniversityOttawaCanada
  2. 2.University of AgderGrimstadNorway

Personalised recommendations