Foundations of Differential Dataflow
Differential dataflow is a recent approach to incremental computation that relies on a partially ordered set of differences. In the present paper, we aim to develop its foundations. We define a small programming language whose types are abelian groups equipped with linear inverses, and provide both a standard and a differential denotational semantics. The two semantics coincide in that the differential semantics is the differential of the standard one. Möbius inversion, a well-known idea from combinatorics, permits a systematic treatment of various operators and constructs.
KeywordsAbelian Group Partial Order Operational Semantic Nest Iteration Denotational Semantic
- 1.Bhatotia, P., Wieder, A., Rodrigues, R., Acar, U.A., Pasquin, R.: Incoop: MapReduce for incremental computations. In: Proc. 2nd ACM Symposium on Cloud Computing, 7p. (2011)Google Scholar
- 2.McSherry, F., Murray, D.G., Isaacs, R., Isard, M.: Differential dataflow. In: Proc. Sixth Biennial Conference on Innovative Data Systems Research (2013), http://www.cidrdb.org
- 3.Mihaylov, S.R., Ives, Z.G., Guha, S.: REX: recursive, delta-based data-centric computation. Proc. VLDB Endowment 5(11), 1280–1291 (2012)Google Scholar
- 4.Murray, D.G., McSherry, F., Isaacs, R., Isard, M., Barham, P., Abadi, M.: Naiad: a timely dataflow system. In: Proc. ACM SIGOPS 24th. Symposium on Operating Systems Principles, pp. 439–455 (2013)Google Scholar
- 6.Stanley, R.P.: Enumerative Combinatorics, vol. 1. CUP (2011)Google Scholar