-
Notifications
You must be signed in to change notification settings - Fork 7
Expand file tree
/
Copy pathbottom.html
More file actions
26 lines (24 loc) · 2.32 KB
/
Copy pathbottom.html
File metadata and controls
26 lines (24 loc) · 2.32 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
<div id="sidebar">
<h1>Punctuation</h1>
<p> When <i>Treat Punctuation as separate tokens</i> is selected, punctuation is handled in a similar way to the <a href="http://ngrams.googlelabs.com/info">Google Ngram Viewer</a>. Punctuation at the beginning and end of tokens is treated as separate tokens. Word-internal apostrophes divide a word into two components. For example, <i>Maria said "I'm tired."</i> is divided into eight tokens: <i>Maria said " I 'm tired . "</i>. </p>
<h1>Open Source</h1>
<p>The source code is available for free under a <a href="http://creativecommons.org/licenses/by-sa/3.0/">Creative Commons Attribution BY-SA</a> license. This license enables you to share, copy and distribute the code. You can also remix it.
The code can be downloaded from our <a href="https://github.com/zacharski/ngramAnalyzer">github repository</a>.
</div>
<div id="extra">
<h1>Examples</h1>
<p><a href="analyze.php?ex=lotus">unigrams in The Lotus Sutra</a></p>
<p><a href="analyze.php?ex=lotus2">bigrams in The Lotus Sutra</a></p>
<p><a href="analyze.php?ex=lotus3">bigrams in The Lotus Sutra using Log Likelihood</a></p>
<p><a href="analyze.php?ex=walden">bigrams in Henry David Thoreau's Walden</a></p>
<p><a href="analyze.php?ex=moby2">bigrams in Moby Dick by Frequency</a></p>
<p><a href="analyze.php?ex=moby">bigrams in Moby Dick using Log Likelihood</a></p>
<p><a href="analyze.php?ex=moby3">trigrams in Moby Dick</a></p>
<p><a href="analyze.php?ex=super">bigrams in Les Misérables using Log Likelihood</a></p>
<p><a href="analyze.php?ex=super2">trigrams in Les Misérables.</a></p>
</div>
<div id="footer">
<span id="design-by"> Developed by <a href="http://zacharski.org">p00d13 1337<!-- Thank you for keeping this on --></a></span>
<a rel="license" href="http://creativecommons.org/licenses/by-sa/3.0/"><img alt="Creative Commons License" style="border-width:0" src="http://i.creativecommons.org/l/by-sa/3.0/80x15.png" /></a><br />This work is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-sa/3.0/">Creative Commons Attribution-ShareAlike 3.0 Unported License</a>.
Web Design by <a href="http://smallpark.org">Smallpark <!-- Thank you for keeping this on --></a>
</div>