Skip to main content
View expanded cover

Latin American High Performance Computing Conference

CARLA 2017: High Performance Computing pp 399–413Cite as

Scaling the Deployment of Virtual Machines in UnaCloud

Part of the Communications in Computer and Information Science book series (CCIS,volume 796)

Abstract

UnaCloud is an Opportunistic Cloud Platform that allows to create virtual clusters in non-dedicated hardware by harvesting idle resources in computer rooms across a campus. To launch a virtual cluster, the platform first determines which desktops can run the virtual machines and copies the corresponding images to these computers, mostly located in the same room. Regretfully, UnaCloud uses a TCP-based protocol to copy those images that results in large transmission times. Our diagnostics shows that the main cause for errors when deploying multiple machines is reaching a timeout. This paper reports our efforts to scale the deployment in UnaCloud to support clusters with a large number of nodes. We have implemented and evaluated multiple protocols for transferring virtual machine images. Our tests showed that BitTorrent, a P2P file transfer protocol, outperforms copying a single image using other protocols. Using it, we can deploy up to 100 virtual machines, one per desktop, in less than 10 min. Although this time is twice the offered by Amazon EC2, it is better than the exhibited by dedicated private clouds using software such as OpenStack and VMWare vCloud.

Keywords

  • Cloud provisioning
  • Virtual machine images
  • BitTorrent

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-73353-1_28
  • Chapter length: 15 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-73353-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   107.00
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.

Notes

  1. 1.

    https://sistemasproyectos.uniandes.edu.co/iniciativas/unacloud/es/inicio/.

  2. 2.

    https://www.samba.org.

  3. 3.

    http://www.bittorrent.org.

  4. 4.

    https://filezilla-project.org/.

  5. 5.

    http://mpetazzoni.github.io/ttorrent/.

  6. 6.

    Datasets available at https://goo.gl/NXJVZF.

  7. 7.

    https://aws.amazon.com/ec2.

  8. 8.

    https://www.openstack.org/.

  9. 9.

    https://www.vmware.com/products/vcloud-suite.html.

  10. 10.

    http://cecad.udistrital.edu.co/.

  11. 11.

    More information of the evaluated private clouds at https://goo.gl/NXJVZF.

References

  1. Babaoglu, O., Marzolla, M., Tamburini, M.: Design and implementation of a P2P cloud system. In: 27th Annual ACM Symposium on Applied Computing (SAC 2012), pp. 412–417. ACM (2012)

    Google Scholar 

  2. Bhushan, A.: A File Transfer Protocol. RFC 114. IETF Network Working Group (1971). https://tools.ietf.org/html/rfc114

  3. Cohen, B.: The BitTorrent Protocol Specification (2008). http://www.bittorrent.org/beps/bep_0003.html

  4. Costa, F., Silva, L., Fedak, G., Kelley, I.: Optimizing the data distribution layer of BOINC with BitTorrent. In: 2008 IEEE International Symposium on Parallel and Distributed Processing, pp. 1–8, April 2008

    Google Scholar 

  5. Laurikainen, R., Laitinen, J., Lehtovuori, P., Nurminen, J.K.: Improving the efficiency of deploying virtual machines in a cloud environment. In: 2012 International Conference on Cloud and Service Computing, pp. 232–239, November 2012

    Google Scholar 

  6. Lopez-Garcia, A., del Castillo, E.F.: Efficient image deployment in cloud environments. J. Netw. Comput. Appl. 63, 140–149 (2016)

    CrossRef  Google Scholar 

  7. Mantoro, T., Ali, H.S.: BitTorrent: extra-locality P2P approach for grid content distribution networks. In: 7th International Conference on Advances in Mobile Computing and Multimedia (MoMM 2009), pp. 406–411. ACM (2009)

    Google Scholar 

  8. Microsoft: Microsoft SMB Protocol and CIFS Protocol Overview (2017). https://msdn.microsoft.com/en-us/library/windows/desktop/aa365233(v=vs.85).aspx. Accessed June 2017

  9. NetBIOS Working Group: Protocol Standard for a NetBIOS Service on a TCP/UDP Transport: Concepts and Methods. RFC 1001. IETF (1987). http://ubiqx.org/cifs/rfc-draft/rfc1001.html

  10. Postel, J., Reynolds, J.: File Transfer Protocol (FTP). RFC 959. IETF (1971). https://tools.ietf.org/html/rfc114

  11. Rosales, E., Castro, H., Villamizar, M.: UnaCloud: opportunistic cloud computing infrastructure as a service. In: 2nd International Conference on Cloud Computing GRIDs and Virtualization (CLOUD COMPUTING 2011), pp. 187–194 (2011)

    Google Scholar 

  12. Sharma, P., Bhakuni, A., Kaushal, R.: Performance analysis of BitTorrent protocol. In: 2013 National Conference on Communications (NCC), pp. 1–5 (2013)

    Google Scholar 

Download references

Acknowledgments

This research was performed by the Center of Excellence and Appropriation in Big Data and Data Analytics (CAOBA), financed by the Ministerio de Tecnologías de la Información y Telecomunicaciones de la República de Colombia (MinTIC) through the Departamento Administrativo de Ciencia, Tecnología e Innovación (COLCIENCIAS), contract N\(^{\underline{\mathrm {o}}}\) FP44842-anexo46-2015.

Author information

Authors and Affiliations

  1. COMIT Research Group, Universidad de los Andes, Bogotá, Colombia

    Jaime Chavarriaga, César Forero-González, Jesse Padilla-Agudelo, Andrés Muñoz & Harold Castro

  2. Centro de Computación de Alto Desempeño (CECAD), Universidad Distrital Francisco José de Caldas, Bogotá, Colombia

    Rodolfo Cáliz-Ospino

Authors
  1. Jaime Chavarriaga
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. César Forero-González
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jesse Padilla-Agudelo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andrés Muñoz
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rodolfo Cáliz-Ospino
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Harold Castro
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jaime Chavarriaga .

Editor information

Editors and Affiliations

  1. CSC-CONICET and Universidad de Buenos Aires, Buenos Aires, Argentina

    Esteban Mocskos

  2. Universidad de la República, Montevideo, Uruguay

    Sergio Nesmachnow

Rights and permissions

Reprints and Permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Chavarriaga, J., Forero-González, C., Padilla-Agudelo, J., Muñoz, A., Cáliz-Ospino, R., Castro, H. (2018). Scaling the Deployment of Virtual Machines in UnaCloud. In: Mocskos, E., Nesmachnow, S. (eds) High Performance Computing. CARLA 2017. Communications in Computer and Information Science, vol 796. Springer, Cham. https://doi.org/10.1007/978-3-319-73353-1_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73353-1_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73352-4

  • Online ISBN: 978-3-319-73353-1

  • eBook Packages: Computer ScienceComputer Science (R0)