Enabling Reproducibility of Scientific Data Flows through Tracking and Representation of Provenance

Reproducibility of results is a key tenet of science. Some modern scientific domains, such as Earth Science, have become computationally complicated and, particularly with the advent of higher resolution space based remote sensing platforms, tremendously data intensive. Over the last few decades, these complexities along with the the rapid advancement of the state of the art confound the goal of scientific transparency.

This thesis explores concepts of data identification, organization, equivalence and reproducibility for such data intensive scientific processing. It presents a conceptual model useful for describing and representing data provenance suitable for very precise data and processing identification. It presents algorithms for creating and maintaining precise dataset membership and provenance equivalence at various degrees of granularity and data aggregation.

Application of this model will allow more specific data citations in scientific literature based on large datasets and data provenance equivalence. Our provenance representations will enable independent reproducibility required by scientific transparency. Increasing transparency will contribute to understanding, and ultimately, credibility of scientific results.

Committee:

• Yelena Yesha (co-chair)
• Milton Halem (co-chair)
• Tim Finin
• Anupam Joshi
• Jim Smith (NASA)