trungdong.github.io/getting-started-with-provenance.html at master · trungdong/trungdong.github.io · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
<!doctype html>
<html lang="en">
<head>
    <meta charset="utf-8">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <meta name="description" content="Where to start if you are interested in learning about provenance? tracking provenance in your application? or just playing with some provenance data? This post aims to list all the tools,...">

    <meta property="og:site_name" content="Dong Huynh">
    <meta property="og:type" content="article">
    <meta property="og:title" content="Getting started with provenance">
    <meta property="og:description" content="Where to start if you are interested in learning about provenance? tracking provenance in your application? or just playing with some provenance data? This post aims to list all the tools,...">
    <meta property="og:url" content="https://trungdong.github.io/getting-started-with-provenance.html">
    <meta property="og:image" content="https://trungdong.github.io/images/dong.huynh.cover.jpg">
    <meta property="article:published_time" content="2016-12-08T09:44:53+00:00">
<meta property="article:modified_time" content="2018-06-25T23:44:34+01:00">    <meta name="twitter:card" content="summary">
    <script type="application/ld+json">
    {
        "@context": "https://schema.org",
        "@type": "BlogPosting",
        "headline": "Getting started with provenance",
        "description": "Where to start if you are interested in learning about provenance? tracking provenance in your application? or just playing with some provenance data? This post aims to list all the tools,...",
        "datePublished": "2016-12-08T09:44:53+00:00",
"dateModified": "2018-06-25T23:44:34+01:00",        "author": {"@type": "Person", "name": "Dong Huynh"},
        "url": "https://trungdong.github.io/getting-started-with-provenance.html",
        "image": "https://trungdong.github.io/images/dong.huynh.cover.jpg"
    }
    </script>

        <link rel="alternate"  href="https://trungdong.github.io/feeds/all.atom.xml" type="application/atom+xml" title="Dong Huynh Full Atom Feed"/>

        <title>Getting started with provenance // Dong Huynh</title>


    <link rel="stylesheet" href="https://trungdong.github.io/theme/css/style.css">
    <link rel="stylesheet" href="https://trungdong.github.io/theme/css/pygments.css">
</head>

<body>
<div id="layout">
    <div class="sidebar sidebar-article">
        <header class="header-article">
            <h2 class="article-info"><a href="https://trungdong.github.io/author/dong-huynh.html" title="See posts by Dong Huynh">Dong Huynh</a></h2>
            <h3 class="published-label">Published</h3>
            <p><time datetime="2016-12-08T09:44:53+00:00">Thu 08 December 2016</time></p>
            <a href="/">&larr;Home</a>
        </header>
    </div>
    <div class="main">
        <div class="content">
            <section class="post">
                <header class="post-header">
                    <h1>Getting started with provenance</h1>
                        <p class="post-meta">
                            // under                                 <a class="post-category" href="https://trungdong.github.io/tag/prov-dm.html">PROV-DM</a>
                                <a class="post-category" href="https://trungdong.github.io/tag/provpy.html">ProvPy</a>
                                <a class="post-category" href="https://trungdong.github.io/tag/provstore.html">ProvStore</a>
                                <a class="post-category" href="https://trungdong.github.io/tag/provtoolbox.html">ProvToolbox</a>
                                <a class="post-category" href="https://trungdong.github.io/tag/software.html">software</a>
                        </p>
                </header>
            </section>
            <p>Where to start if you are interested in learning about provenance? tracking
provenance in your application? or just playing with some provenance data?</p>
<p>This post aims to list all the tools, software, and materials that I know about to everyone find what they need.</p>
<p><strong>ONGOING -- STILL BEING UPDATED</strong></p>
<h2>Provenance concepts</h2>
<p>PROV is the current standard for provenance (by the World Wide Web Consortium).
I recommend looking at the document roadmap in <a href="https://www.w3.org/TR/prov-overview/">PROV-OVERVIEW</a>
first to see what it comprises and what document to read next.</p>
<p>You might also find the book <a href="https://www.provbook.org/">Provenance: An Introduction to
PROV</a> by Luc Moreau and Paul Groth, who chaired the
standardisation of PROV, useful.</p>
<h2>Libraries</h2>
<p>Working with PROV in</p>
<ul>
<li>Java: <a href="https://lucmoreau.github.io/ProvToolbox/">ProvToolbox</a> (with tutorials).</li>
<li>Python: my <a href="https://prov.readthedocs.io/">PROV Python package</a> (<a href="https://trungdong.github.io/prov-python-short-tutorial.html">tutorial</a>).</li>
<li>JavaScript: <a href="https://bitbucket.org/provenance/provjs">ProvJS</a>.</li>
<li>Matlab: <a href="http://www.artefact.tk/software/matlab/provenance/">Matlab provenance package</a></li>
</ul>
<p>Other provenance libraries:</p>
<ul>
<li>R: <a href="https://github.com/End-to-end-provenance/RDataTracker">RDataTracker</a>, <a href="https://github.com/NCEAS/recordr">recordr</a>.</li>
</ul>
<h2>Software &amp; Web Applications</h2>
<ul>
<li><a href="https://openprovenance.org/store/">ProvStore</a>: a free public repository for provenance documents (<a href="https://openprovenance.org/store/help/api/">REST API</a> available).</li>
<li><a href="https://openprovenance.org/services/view/validator">ProvValidator</a>: a validator to check if your provenance is valid (against <a href="https://www.w3.org/TR/prov-constraints/">PROV-CONSTRAINTS</a>)</li>
<li><a href="https://openprovenance.org/services/view/translator">ProvTranslator</a>: an online translator that converts your provenance into a PROV serialisations or SVG graphical format.</li>
<li><a href="https://github.com/lucmoreau/ProvToolbox/wiki/provconvert">provconvert</a>: a command-line tool provided by ProvToolbox, which provides a convenient way to convert provenance data on your machine. It supports all PROV serialisations and various graphical outputs (e.g. SVG, PDF).</li>
<li><a href="https://openprovenance.org/tools/editor/">PROV-N Editor</a>: an online editor for PROV-N with syntax highlighting if you want to write down some PROV-N statements quickly.</li>
</ul>
<h2>Provenance Data</h2>
<ul>
<li><a href="https://openprovenance.org/store/public/">Public documents on ProvStore</a></li>
<li><a href="https://lucmoreau.wordpress.com/category/provenance-in-the-wild/">Provenance in the wild</a></li>
<li><a href="http://stats.lod2.eu/vocabularies/278">Linked datasets using PROV</a></li>
<li><a href="https://lov.okfn.org/dataset/lov/vocabs/prov">Vocabularies using PROV</a></li>
</ul>
<p>You can also generate synthetic provenance data using the <code>-generator</code> option
provided by the <a href="https://github.com/lucmoreau/ProvToolbox/wiki/provconvert">provconvert</a> utility that comes with ProvToolbox (see above).</p>
<h2>What have I missed?</h2>
<p>Do let me know by dropping me a message below.</p>
<p><a href="https://twitter.com/intent/tweet?screen_name=trungdong" class="twitter-mention-button" data-show-count="false">Tweet to @trungdong</a></p>
<script async src="//platform.twitter.com/widgets.js" charset="utf-8"></script>
            <div class="hr"></div>
            <a href="#" class="go-top">Go Top</a>
<div class="comments">
    <div id="disqus_thread"></div>
    <script type="text/javascript">
        /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
        var disqus_shortname = "trungdong-github-io"; // required: replace example with your forum shortname

        /* * * DON'T EDIT BELOW THIS LINE * * */
        (function() {
            var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
            dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js';
            (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
        })();
    </script>
    <noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript>
    <a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a>
</div><footer class="footer">
    <p>&copy; Dong Huynh &ndash;
        Built for <a href="https://getpelican.com/">Pelican</a>
    </p>
</footer>        </div>
    </div>
</div>
    <script>
        // Replaces jQuery 2.0.3, which the theme loaded from a CDN to do only this.
        (function () {
            var top = document.querySelector('.go-top');
            if (top) {
                var sync = function () {
                    top.classList.toggle('is-visible', window.scrollY > 200);
                };
                sync();
                window.addEventListener('scroll', sync, { passive: true });
                top.addEventListener('click', function (event) {
                    event.preventDefault();
                    window.scrollTo({ top: 0, behavior: 'smooth' });
                });
            }

            // Anchors that exist only to be styled should not jump to the top.
            document.addEventListener('click', function (event) {
                var anchor = event.target.closest('a[href="#"]');
                if (anchor) { event.preventDefault(); }
            });
        }());
    </script>
<script data-goatcounter="https://trungdong.goatcounter.com/count" async src="//gc.zgo.at/count.js"></script></body>
</html>