feat: word diffs - #33

Merged

Byron merged 23 commits into

pascalkuthe:masterfrom

KnorpelSenf:word-diff

Dec 30, 2025

Commits on Sep 27, 2025

feat: define bytes token source
KnorpelSenf
committed
969dde8
feat: implement byte-based word diff
KnorpelSenf
committed
a625abc
test: cover word diffs
KnorpelSenf
committed
1bf3ccf
docs: fix typo
KnorpelSenf
committed
3dba63f

Commits on Nov 7, 2025

feat: tokenize words not bytes
KnorpelSenf
committed
2682999
test: cover word diffs
KnorpelSenf
committed
a175626
Merge branch 'master' into word-diff
KnorpelSenf
committed
fbff98b
docs: fix oversight
KnorpelSenf
committed
ae627f5
fix: lint about needless `&`
KnorpelSenf
committed
acdad54
perf: no need to copy word vec
KnorpelSenf
committed
337bbdb
refactor: only branch on word length
KnorpelSenf
committed
236ae42

Commits on Nov 8, 2025

perf: merge contiguous blocks of space chars
KnorpelSenf
committed
4c14911
docs: improve `words` docs w.r.t. space handling
KnorpelSenf
committed
83fe6bd
test: cover words tokenizer
KnorpelSenf
committed
b24e52c

Commits on Nov 21, 2025

fix: consider `_` as part of a word

KnorpelSenf
and
pascalkuthe
authored
9290066

Commits on Nov 22, 2025

fix: add missing deref
KnorpelSenf
authored
30d2f41
test: cover _ tokenization
KnorpelSenf
committed
936bbcf
test: remove lost test case
KnorpelSenf
committed
0194b50

Commits on Dec 20, 2025

Merge branch 'master' into word-diff
KnorpelSenf
committed
d042243
docs: elaborate on `word_diff` usage
KnorpelSenf
committed
cd20497

Commits on Dec 30, 2025

refactor
Byron
committed
d193772
refactor tests
Byron
committed
7724909
Add more tests for the word diff to understand postprocessing
Byron
committed
e92b3c6