diff --git a/README.md b/README.md index d7bf262..5a9d87d 100644 --- a/README.md +++ b/README.md @@ -97,6 +97,7 @@ This list of tools and software is intended to briefly describe some of the most * [DiskerNet](https://github.com/DO-SAY-GO/dn) - A non-WARC-based tool which hooks into the Chrome browser and archives everything you browse making it available for offline replay. *(In Development)* * [F(b)arc](https://github.com/justinlittman/fbarc) - A commandline tool and Python library for archiving data from [Facebook](https://www.facebook.com/) using the [Graph API](https://developers.facebook.com/docs/graph-api). *(Stable)* * [freeze-dry](https://github.com/WebMemex/freeze-dry) - JavaScript library to turn page into static, self-contained HTML document; useful for browser extensions. *(In Development)* +* [gnosis-markdown](https://github.com/SHCV-it/gnosis) - A command-line tool and Python library that fetches web pages into Markdown for LLM/RAG use, writing WARC alongside a byte-level provenance record (source URL, UTC timestamp, SHA-256, redirect chain, extraction fidelity). *(In Development)* * [grab-site](https://github.com/ArchiveTeam/grab-site) - The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns. *(Stable)* * [Heritrix](https://github.com/internetarchive/heritrix3/wiki) - An open source, extensible, web-scale, archival quality web crawler. *(Stable)* * [Heritrix Q&A](https://github.com/internetarchive/heritrix3/discussions/categories/q-a) - A discussion forum for asking questions and getting answers about using Heritrix.