The Journal of Supercomputing

, Volume 71, Issue 1, pp 144–161 | Cite as

The \(k\)-Set consensus problem with weight consideration

Article

Abstract

In the cloud computing environment, files are duplicated into several copies for storage at different locations to increase their access efficiency and fault tolerance. However, there may exist malicious processors in the cloud computing environment. How to ensure that fault-free processors coordinate to find appropriate locations to store these duplicated files without influence from malicious processors is an important issue. In this paper, we propose a consensus algorithm to assist fault-free processors in reaching a consensus on where to store the duplicated files in the presence of malicious processors. In this paper, we will extend the classical consensus problem to a new type of consensus problem called the \(k\)-Set consensus problem with weight consideration (\(k\)-SetW problem). This problem is integrated with the concepts of weight and \(k\)-Set. In other words, each processor in this problem is allowed to have multiple initial values (i.e., the expected locations for the duplicated files) and set the weight for each initial value. The weighted value shows the processor’s preference for an initial value. Regarding the consensus, this problem does not require agreement among all fault-free processors on a single consensus value. It allows coexistence of multiple consensus values as long as the number of consensus values is not greater than \(k\) (i.e., the maximum number of duplicated files). By solving the \(k\)-SetW problem, we can help fault-free processors determine the locations for storing the duplicates of at most \(k\) copies based on their preferences in the presence of malicious processors.

Keywords

Distributed system Malicious fault Fault-tolerant K-Set consensus problem Weight 

References

  1. 1.
    White T (2009) Hadoop: the definitive guide, MapReduce for the cloud. O’Reilly Media, New YorkGoogle Scholar
  2. 2.
    Afrati FN, Ullman JD (2011) Optimizing multiway joins in a map-reduce environment. IEEE Trans Knowl Data Eng 23(9)Google Scholar
  3. 3.
    Jiang D, Tung AKH, Chen G (2011) MAP-JOIN-REDUCE: toward scalable and efficient data analysis on large clusters. IEEE Trans Knowl Data Eng 23(9)Google Scholar
  4. 4.
    Attiya H, Welch J (2004) Distributed computing—fundamentals, simulation and advanced topics, 2nd edn. Wiley, New York, pp 414Google Scholar
  5. 5.
    Borran F, Hutle M, Santos N, Schiper A (2012) Quantitative analysis of consensus algorithms. IEEE Trans Depend Secure Comput 9(2):236–249CrossRefGoogle Scholar
  6. 6.
    Silberschatz A, Galvin PB, Gagne G (2009) Operating system concepts, 8th edn. Wiley, New YorkGoogle Scholar
  7. 7.
    Barborak M, Malek M, Dahubra A (1993) The consensus problem in fault-tolerant computing. ACM Comput Surv 25(2):171–220CrossRefGoogle Scholar
  8. 8.
    Attiya H, Bar-noy A, Dolev D, Peleg D, Reischuk R (1990) Renaming in an asynchronous environment. J ACM 37(3):524–548CrossRefMathSciNetMATHGoogle Scholar
  9. 9.
    Chaudhuri S, Herlihy M, Lynch N, Tuttle M (2000) Tight bounds for \(k\)-set agreement. J ACM 47(5):912–943CrossRefMathSciNetGoogle Scholar
  10. 10.
    Parvedy PR, Raynal M, Travers C (2005) Decision optimal early-stopping \(k\)-set agreement in synchronous systems prone to send omission failures. In: Proceedings of the 11th Pacific Rim international symposium on dependable computingGoogle Scholar
  11. 11.
    Saks M, Zaharoglou F (2000) Wait-free \(k\)-set agreement is impossible: the topology of public knowledge. SIAM J Comput 29(5):1449–1483CrossRefMathSciNetMATHGoogle Scholar
  12. 12.
    Garg VK, Bridgman J (2011) The weighted Byzantine agreement problem. In: Proceedings of the IEEE parallel and distributed processing symposiumGoogle Scholar
  13. 13.
    Berman P, Garay JA (1989) Asymptotically optimal distributed consensus. Proceedings of the international colloquium on automata, languages and programming, CopenhagenGoogle Scholar
  14. 14.
    Berman P, Garay JA, Perry KJ (1989) Towards optimal distributed consensus. In: Proceedings of the annual symposium on foundations of computer science, pp 410–415Google Scholar
  15. 15.
    Fisher M, Lynch N (1982) A lower bound for the time to assure interactive consistency. Inf Process Lett 14(3):183–186CrossRefGoogle Scholar
  16. 16.
    Fischer M, Lynch N, Paterson M (1985) Impossibility of distributed consensus with one faulty process. J ACM 32(2):378–382CrossRefMathSciNetGoogle Scholar
  17. 17.
    Biely M, Hutle M (2011) Consensus when all processes may be Byzantine for some time. Theor Comput Sci 412:4260–4272CrossRefMathSciNetMATHGoogle Scholar
  18. 18.
    Cheng CF, Tsai KT (2012) From immediate agreement to eventual agreement: early stopping agreement protocol for dynamic networks with malicious faulty processors. J Supercomput 62(2):874–894CrossRefGoogle Scholar
  19. 19.
    Ma ZS, Krings AW (2011) Dynamic hybrid fault modeling and extended evolutionary game theory for reliability, survivability and fault tolerance analyses. IEEE Trans Reliab 60(1)Google Scholar
  20. 20.
    Bar-Noy A, Dolev D, Dwork C, Raymond Strong H (1992) Shifting gears: changing algorithms on the fly to expedite Byzantine agreement. Inf Comput 97(2):205–233CrossRefMATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.Department of Computer Science and Information EngineeringTamkang UniversityNew Taipei CityTaiwan

Personalised recommendations