Diagnosing Data Pipeline Failures Using Action Languages: A Progress Report

  • Alex BrikEmail author
  • Jeffrey Xu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12007)


In this paper we describe our work towards automating diagnosing failures of data processing pipelines at Google Inc. using action language Hybrid \(\mathcal {ALE}\). We describe Diagnostic Modeling Library - a component providing a novel abstraction layer on top of Hybrid \(\mathcal {ALE}\), describe the requirements and give an overview of our system, which has been deployed on a limited number of data processing pipelines.


  1. 1.
    Bomanson, J., Brik, A.: Diagnosing data pipeline failures using action languages. In: Balduccini, M., Lierler, Y., Woltran, S. (eds.) LPNMR 2019. LNCS, vol. 11481, pp. 181–194. Springer, Cham (2019). Scholar
  2. 2.
    Brik, A., Remmel, J.B.: Hybrid ASP. In: Gallagher, J.P., Gelfond, M. (eds.) ICLP (Technical Communications). LIPIcs, vol. 11, pp. 40–50. Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik (2011)Google Scholar
  3. 3.
    Gelfond, M., Kahl, Y.: Knowledge Representation, Reasoning, and the Design of Intelligent Agents: The Answer-Set Programming Approach. Cambridge University Press, Cambridge (2014)CrossRefGoogle Scholar
  4. 4.
    Gelfond, M., Lifschitz, V.: The stable model semantics for logic programming. In: ICLP/SLP, pp. 1070–1080 (1988)Google Scholar
  5. 5.
    Gelfond, M., Lifschitz, V.: Action languages. Electron. Trans. Artif. Intell. 2, 193–210 (1998)MathSciNetGoogle Scholar
  6. 6.
    Verma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E., Wilkes, J.: Large-scale cluster management at Google with Borg. In: Proceedings of the European Conference on Computer Systems (EuroSys). ACM, Bordeaux (2015)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Google Inc.Mountain ViewUSA
  2. 2.University of California Los AngelesLos AngelesUSA

Personalised recommendations