Advertisement

Implementing MapReduce with MSVL

  • Nan Zhang
  • Meng Wang
  • Zhenhua DuanEmail author
  • Cong Tian
  • Jin Cui
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10795)

Abstract

This paper presents an approach to implementing MapReduce processes with Modeling Simulation and Verification Language (MSVL). This facilitates programmers not only to deal with large data sets but also to verify properties of programs in a convenient way.

Keywords

MapReduce Multi-core Parallel Big data Cloud computing 

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
    Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)CrossRefGoogle Scholar
  5. 5.
    Borthakur, D.: The hadoop distributed file system: architecture and design. Hadoop Proj. Website 11(2007), 21 (2007)Google Scholar
  6. 6.
    Bryant, R.E.: Data intensive scalable computing. Carnegie Mellon University (2008). Accessed 10 Aug 2009Google Scholar
  7. 7.
    Coppersmith, D., Winograd, S.: Matrix multiplication via arithmetic progressions. In: Proceedings of the Nineteenth Annual ACM Symposium on Theory of Computing, pp. 1–6. ACM (1987)Google Scholar
  8. 8.
    Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51, 107–113 (2008)CrossRefGoogle Scholar
  9. 9.
    Duan, Z.: An extended interval temporal logic and a framing technique for temporal logic programming. Ph.D. thesis, University of Newcastle upon Tyne (1996)Google Scholar
  10. 10.
    Duan, Z.: Temporal Logic and Temporal Logic Programming. Science Press, Marrickville (2005)Google Scholar
  11. 11.
    Duan, Z., Tian, C.: A unified model checking approach with projection temporal logic. In: Liu, S., Maibaum, T., Araki, K. (eds.) ICFEM 2008. LNCS, vol. 5256, pp. 167–186. Springer, Heidelberg (2008).  https://doi.org/10.1007/978-3-540-88194-0_12CrossRefGoogle Scholar
  12. 12.
    Herlihy, M., Shavit, N.: The Art of Multiprocessor Programming. Elsevier, Amsterdam (2008)Google Scholar
  13. 13.
    Ihaka, R., Gentleman, R.: R: a language for data analysis and graphics. J. Comput. Graph. Stat. 5(3), 299–314 (1996)Google Scholar
  14. 14.
    John Walker, S.: Big Data: A Revolution that Will Transform how We Live, Work, and Think (2014)CrossRefGoogle Scholar
  15. 15.
    McAfee, A., Brynjolfsson, E., et al.: Big data: the management revolution. Harvard Bus. Rev. 90(10), 60–68 (2012)Google Scholar
  16. 16.
    Vavilapalli, V.K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., Seth, S., et al.: Apache hadoop yarn: yet another resource negotiator. In: Proceedings of the 4th Annual Symposium on Cloud Computing, p. 5. ACM (2013)Google Scholar
  17. 17.
    Vora, M.N.: Hadoop-HBase for large-scale data. In: 2011 International Conference on Computer Science and Network Technology (ICCSNT), vol. 1, pp. 601–605. IEEE (2011)Google Scholar
  18. 18.
    Wang, M., Tian, C., Duan, Z.: Full regular temporal property verification as dynamic program execution. In: Proceedings of the 39th International Conference on Software Engineering Companion, pp. 226–228. IEEE Press (2017)Google Scholar
  19. 19.
    Wang, X., Tian, C., Duan, Z., Zhao, L.: MSVL: a typed language for temporal logic programming. Front. Comput. Sci. 11(5), 762–785 (2017)CrossRefGoogle Scholar
  20. 20.
    Yang, K., Duan, Z., Tian, C., Zhang, N.: A compiler for MSVL and its applications. Theor. Comput. Sci. (2017).  https://doi.org/10.1016/j.tcs.2017.07.032
  21. 21.
    Yang, W., Liu, X., Zhang, L., Yang, L.T.: Big data real-time processing based on storm. In: 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) 2013, pp. 1784–1787. IEEE (2013)Google Scholar
  22. 22.
    Zaharia, M., Chowdhury, M., Franklin, M.J., Shenker, S., Stoica, I.: Spark: cluster computing with working sets. HotCloud 10(10–10), 95 (2010)Google Scholar
  23. 23.
    Zhang, N., Duan, Z., Tian, C.: A cylinder computation model for many-core parallel computing. Theoret. Comput. Sci. 497, 68–83 (2013)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Zhang, N., Duan, Z., Tian, C.: A mechanism of function calls in MSVL. Theoret. Comput. Sci. 654, 11–25 (2016)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Zhang, N., Duan, Z., Tian, C.: Model checking concurrent systems with MSVL. Sci. China Inf. Sci. 59, 118101 (2016)CrossRefGoogle Scholar
  26. 26.
    Zikopoulos, P., Eaton, C., et al.: Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data. McGraw-Hill Osborne Media (2011)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Nan Zhang
    • 1
  • Meng Wang
    • 1
  • Zhenhua Duan
    • 1
    Email author
  • Cong Tian
    • 1
  • Jin Cui
    • 1
  1. 1.Institute of Computing Theory and Technology, and ISN LaboratoryXidian UniversityXi’anChina

Personalised recommendations