International Provenance and Annotation Workshop

IPAW 2006: Provenance and Annotation of Data pp 46-54

Towards Low Overhead Provenance Tracking in Near Real-Time Stream Filtering

  • Nithya N. Vijayakumar
  • Beth Plale
Conference paper

DOI: 10.1007/11890850_6

Volume 4145 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Vijayakumar N.N., Plale B. (2006) Towards Low Overhead Provenance Tracking in Near Real-Time Stream Filtering. In: Moreau L., Foster I. (eds) Provenance and Annotation of Data. IPAW 2006. Lecture Notes in Computer Science, vol 4145. Springer, Berlin, Heidelberg


Data streams flowing from the physical environment are as unpredictable as the environment itself. Radars go down, long haul networks drop packets, and readings are corrupted on the wire. Yet the data driven scientific models and data mining algorithms do not necessarily account for the inaccuracies when assimilating the data. Low overhead provenance collection partially solves this problem. We propose a data model and collection model for near real time provenance collection. We define a system architecture for stream provenance tracking and motivate with a real-world application in meteorology forecasting.

Download to read the full conference paper text

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Nithya N. Vijayakumar
    • 1
  • Beth Plale
    • 1
  1. 1.Department of Computer ScienceIndiana University