Skip to main content
SpringerLink
Log in

Soft error resilience of Big Data kernels through algorithmic approaches

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

As the volume of data generated each day continues to increase, more and more interest is put into Big Data algorithms and the insight they provide.? Since these analyses require a substantial amount of resources, including physical machines, power, and time, reliable execution of the algorithms becomes critical. This paper analyzes the error resilience of a select group of popular Big Data algorithms and shows how they can effectively be made more fault-tolerant. Using KULFI (http://github.com/quadpixels/kulfi, 2013) and the LLVM (Proceedings of the 2004 international symposium on code generation and optimization (CGO 2004), San Jose, CA, USA, 2004) compiler for compilation allows injection of artificial soft faults throughout these algorithms, giving a thorough analysis of how faults in different locations can affect the outcome of the program. This information is then used to help guide incorporating fault tolerance mechanisms into the program, making them as impervious as possible to soft faults.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30

Similar content being viewed by others

References

  1. Christoforides A (2011) Metropolis–Hastings implementation. https://github.com/alexischr/mh

  2. IBM’s Big Data Platform and Decision Management (2012) What is big data? http://www-01.ibm.com/software/data/bigdata/what-is-big-data.html

  3. Gordon R (2013) http://math.stackexchange.com/questions/346894/prove-of-the-parsevals-theorem-for-discrete-fourier-transform-dft

  4. Sharma V, Haran A, Chen S (2013) Kulfi fault injector. http://github.com/quadpixels/kulfi

  5. AMPLab at University of California, Berkeley (2014) AMPLab big data benchmark. https://amplab.cs.berkeley.edu/benchmark/

  6. Harris M, NVidia (2015) https://devblogs.nvidia.com/parallelforall/new-features-cuda-7-5/

  7. Armstrong TG, Ponnekanti V, Borthakur D, Callaghan M (2013) Linkbench: a database benchmark based on the Facebook social graph. In: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, ACM, New York, NY, USA, SIGMOD ’13, pp 1185–1196. doi:10.1145/2463676.2465296

  8. Austin T (1999) Diva: a reliable substrate for deep submicron microarchitecture design. In: Proceedings of the 32nd Annual International Symposium on Microarchitecture (MICRO 1999)

  9. Bender C, Sanda PN, Kudva P, Mata R, Pokala V, Haraden R, Schallhorn M (2008) Soft-error resilience of the ibm power6 processor input/output subsystem. IBM J Res Dev 52(3):285–292. doi:10.1147/rd.523.0285

    Article  Google Scholar 

  10. Cappello F, Geist A, Gropp W, Kale S, Kramer B, Snir M (2014) Toward exascale resilience: 2014 update. J Supercomput Front Innov 1(1). doi:10.14529/jsfi140101

  11. Chen S, Bronevetsky G, Li B, Guix MC, Peng L (2015) A framework for evaluating comprehensive fault resilience mechanisms in numerical programs. J Supercomput 71(8):2963–2984. doi:10.1007/s11227-015-1422-z

    Article  Google Scholar 

  12. Chen S, Bronevetsky G, Peng L, Li B, Fu X (2016) Soft error resilience in big data kernels through modular analysis. J Supercomput 72(4):1570–1596. doi:10.1007/s11227-016-1682-2

    Article  Google Scholar 

  13. Chung J, Lee I, Sullivan M, Ryoo JH, Kim DW, Yoon DH, Kaplan L, Erez M (2012) Containment domains: a scalable, efficient, and flexible resilience scheme for exascale systems. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC12)

  14. Collange S, Defour D, Graillat S, Iakymchuk R (2015) Numerical reproducibility for the parallel reduction on multi- and many-core architectures. Parallel Comput 49:83–97. doi:10.1016/j.parco.2015.09.001, http://www.sciencedirect.com/science/article/pii/S0167819115001155

  15. Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R (2010) Benchmarking cloud serving systems with ycsb. In: Proceedings of the 1st ACM Symposium on Cloud Computing, ACM, New York, NY, USA, SoCC ’10, pp 143–154, doi:10.1145/1807128.1807152

  16. Cormen TH, Leiserson CE, Rivest RL, Stein C (2009) Introduction to Algorithms, 3rd edn. The MIT Press, Cambridge, MA

    MATH  Google Scholar 

  17. Ferdman M, Adileh A, Koçberber YO, Volos S, Alisafaee M, Jevdjic D, Kaynak C, Popescu AD, Ailamaki A, Falsafi B (2012) Clearing the clouds: a study of emerging scale-out workloads on modern hardware. In: Proceedings of the 17th International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS 2012, London, UK, March 3–7, 2012, pp 37–48. doi:10.1145/2150976.2150982

  18. Free Software Foundation (2016) GSL—GNU scientific library. https://www.gnu.org/software/gsl/

  19. Gao W, Luo C, Zhan J, Ye H, He X, Wang L, Zhu Y, Tian X (2015) Identifying dwarfs workloads in big data analytics. http://arxiv.org/abs/1505.06872

  20. Ghazal A, Rabl T, Hu M, Raab F, Poess M, Crolotte A, Jacobsen HA (2013) Bigbench: towards an industry standard benchmark for big data analytics. In: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, ACM, New York, NY, USA, SIGMOD ’13, pp 1197–1208. doi:10.1145/2463676.2463712

  21. Guan Q, Debardeleben N, Blanchard S, Wu P, Monrow L, Chen Z (2016) P-FSEFI: a parallel soft error fault injection framework for parallel applications. In: Proceedings of the 12th Workshop on Silicon Error in Logic-System Effect (SELSE)

  22. Huang S, Huang J, Dai J, Xie T, Huang B (2010) The HiBench benchmark suite: characterization of the MapReduce-based data analysis. In: 2010 IEEE 26th International Conference on Data Engineering Workshops (ICDEW), pp 41–51. doi:10.1109/ICDEW.2010.5452747

  23. Iakymchuk R, Collagne S, Defour D, Graillat S (2015) Exblas: reproducible and accurate BLAS library. In the Proceedings of the Numerical Reproducibility at Exascale (NRE2015) workshop held as part of the Supercomputing Conference (SC15). Austin, TX, USA, November 15-20, 2015. HAL ID: hal-01202396

  24. ITRS (2013) International technology roadmap for semiconductors. Technical report

  25. Kumar S, Hari S, Adve SV, Naeimi H, Ramachandran P (2012) Relyzer: exploiting application-level fault equivalence to analyze application resiliency to transient faults. In: Proceedings of the 17th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2012)

  26. Lattner C, Adve V (2004) LLVM: A compilation framework for lifelong program analysis and transformation. In: Proceedings of the 2004 International Symposium on Code Generation and Optimization (CGO 2004), San Jose, CA, USA

  27. Liu W, Zhang W, Wang X, Xu J (2016) Distributed sensor network-on-chip for performance optimization of soft-error-tolerant multiprocessor system-on-chip. IEEE Trans Very Large Scale Integr (VLSI) Syst 24(4):1546–1559. doi:10.1109/TVLSI.2015.2452910

    Article  Google Scholar 

  28. NVIDIA (2013) Tesla k20 gpu accelerator. http://www.nvidia.com/content/PDF/kepler/Tesla-K20-Passive-BD-06455-001-v07.pdf

  29. Serrano F, Clemente JA, Mecha H (2015) A methodology to emulate single event upsets in flip-flops using FPGAs through partial reconfiguration and instrumentation. IEEE Trans Nucl Sci 62(4):1617–1624. doi:10.1109/TNS.2015.2447391

    Article  Google Scholar 

  30. Tiwari D, Gupta S, Gallarno G, Rogers J, Maxwell D (2015) Reliability lessons learned from GPU experience with the titan supercomputer at oak ridge leadership computing facility. In: SC15: International Conference for High Performance Computing, Networking, Storage and Analysis, pp 1–12. doi:10.1145/2807591.2807666

  31. Wang L, Bertran R, Buyuktosunoglu A, Bose P, Skadron K (2014) Characterization of transient error tolerance for a class of mobile embedded applications. In: 2014 IEEE International Symposium on Workload Characterization (IISWC), pp 74–75. doi:10.1109/IISWC.2014.6983042

  32. Yeh TY, Reinman G, Patel SJ, Faloutsos P (2009) Fool me twice: exploring and exploiting error tolerance in physics-based animation. ACM Trans Graph 29(1):5:1–5:11. doi:10.1145/1640443.1640448

Download references

Acknowledgements

We are grateful to Prof. Nian-Feng Tzeng at the Center for Advanced Computer Studies, University of Louisiana at Lafayette, for providing invaluable feedbacks to our research. We are grateful to Vishal Sharma and Arvind Haran, the authors of the original KULFI and for granting us permission to modify it for our experiment purposes. We are also appreciative of the opportunity to be involved in and contribute to KULFI. Support of this research was provided by National Science Foundation under Award Numbers: 1527318, 1422408 (Directorate for Computer and Information Science and Engineering), and 1017961 (Division of Computing and Communication Foundations).

Author information

Authors and Affiliations

  1. Division of Electrical and Computer Engineering, Louisiana State University, Baton Rouge, Louisiana, USA

    Travis LeCompte, Walker Legrand, Sui Chen & Lu Peng

Authors
  1. Travis LeCompte
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Walker Legrand
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sui Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lu Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lu Peng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

LeCompte, T., Legrand, W., Chen, S. et al. Soft error resilience of Big Data kernels through algorithmic approaches. J Supercomput 73, 4739–4772 (2017). https://doi.org/10.1007/s11227-017-2042-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-017-2042-6

Keywords

Search

Navigation