Advertisement

Using Map-Reduce for Image Analysis in Cloud Environment

  • S. Supreeth
  • M. M. Raja Rajeshwari
Conference paper
Part of the Lecture Notes in Networks and Systems book series (LNNS, volume 14)

Abstract

With the quick development of online networking, the quantity of pictures being transferred to the web is blasting. Gigantic amounts of pictures are shared through multi-stage administrations, for example, Instagram, Facebook and WhatsApp. Most present picture handling applications, intended for little scale, nearby calculation, have scalability issues even though there is a necessity for high computation requirement. With the help of hadoop handling such computational issues has become a little easier then traditional methods using MapReduce [1] stage addresses the issue of giving a framework to computationally serious information preparing along with appropriated capacity. In any case, to take in the specialized complexities of creating helpful technologies integrating with hadoop demands experienced Engineer. Accordingly, pool of scientists and software engineers with the shifted abilities to create applications that can utilize extensive arrangements of pictures is restricted. So, we have built up the Image Processing Framework in hadoop, giving a Hadoop library to bolster huge size picture handling in cloud environment. This paper gives a far reaching methodical audit and examination of picture preparing and picture taking care of difficulties and prerequisites in a distributed computing environment by utilizing the MapReduce system and its open-source execution Hadoop. We characterized necessities for MapReduce frameworks to perform picture handling. We likewise proposed the MapReduce algorithm and one execution of this system on Cloud Environment. This paper outlines one of the best strategies to process extensive pictures is MapReduce, it likewise can help designers to do parallel and disseminated calculation in a cloud domain, by which we can obtain the details needed for geo-referencing, in terms of data obtained from images needed for scientific applications.

Keywords

Image analysis Hadoop Map reduce Cloud 

References

  1. 1.
    Gerogiannis D, Orphanoudakis SC (1993) Load balancing requirements in parallel implementations of image feature extraction tasks. Parallel Distrib Syst IEEE Trans 4(9):994–1013CrossRefGoogle Scholar
  2. 2.
    Rimal BP, Choi E, Lumb I (2009) A taxonomy and survey of cloud computing systems. In: Fifth international joint conference on INC, IMS and IDC, Aug 2009, pp 44–51Google Scholar
  3. 3.
    Calheiros RN, Ranjan R, Beloglazov A, De Rose CAF, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw: Pract Exp 41(1):23–50Google Scholar
  4. 4.
    Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM—50th Anniv Issue 51:107–113Google Scholar
  5. 5.
    White T (2010) Hadoop: the definitive guide. O’Reilly Media, Inc.Google Scholar
  6. 6.
    Lee K-H, Lee Y-J, Choi H, Chung YD, Moon B (2011) Parallel data processing with MapReduce: a survey. ACM SIGMOD Record 40(4):11–20CrossRefGoogle Scholar
  7. 7.
    Loebman S, Nunley D, Kwon Y-C, Howe B, Balazinska M, Gardner JP (2009) Analyzing massive astrophysical datasets: Can Pig/Hadoop or a relational DBMS help? In: IEEE international conference on cluster computing and workshops, Aug 2009, pp 1–10Google Scholar
  8. 8.
    StoneBraker M, Abadi D, DeWitt DJ, Madden S, Paulson E, Pavlo A, Rasin A (2010) MapReduce and parallel DBMSs: friends or foes? Commun ACM 53(1):64–71CrossRefGoogle Scholar
  9. 9.
    Ghemawat S, Gobioff H, Leung S-T (2003) The google file system. SIGOPS Oper. Syst. Rev. 37(5):29–43CrossRefGoogle Scholar
  10. 10.
    Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: Proceedings of the 2010 IEEE 26th symposium on mass storage systems and technologies (MSST), MSST’10, Washington, DC, USA, 2010, IEEE Computer Society, pp 1–10Google Scholar
  11. 11.
    Hadoop Powered By (2011) http://wiki.apache.org/hadoop/PoweredBy/. Online: as of 29 Aug 2015
  12. 12.
    Hadoop Documentation (2012) http://hadoop.apache.org/common/docs/stable/. Online: as of 29 Aug 2014
  13. 13.
    Hadoop Wikipedia (2012) http://en.wikipedia.org/wiki/ApacheHadoop/. Online: as of 29 Aug 2014

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.REVA UniversityBengaluruIndia

Personalised recommendations