From 586a59d5be36ae0399a2a1e0801d79aee03b6b6f Mon Sep 17 00:00:00 2001 From: Natanael Arndt Date: Tue, 21 Apr 2026 16:58:25 +0200 Subject: [PATCH 1/3] Add subsections for training material to make the syntax more consistant across sections --- README.md | 53 +++++++++++++++++++++++++++++++++-------------------- 1 file changed, 33 insertions(+), 20 deletions(-) diff --git a/README.md b/README.md index 7051ae5..9a9d75c 100644 --- a/README.md +++ b/README.md @@ -7,6 +7,10 @@ Web archiving is the process of collecting portions of the World Wide Web to ens ## Contents * [Training/Documentation](#trainingdocumentation) + * [Introductions to Web Archiving Concepts](#introductions-to-web-archiving-concepts) + * [Training Materials](#training-materials) + * [The WARC Standard](#the-warc-standard) + * [For Researchers using Web Archives](#for-researchers-using-web-archives) * [Resources for Web Publishers](#resources-for-web-publishers) * [Tools & Software](#tools--software) * [Acquisition](#acquisition) @@ -31,26 +35,35 @@ Web archiving is the process of collecting portions of the World Wide Web to ens ## Training/Documentation -* Introductions to web archiving concepts: - * [What is a web archive?](https://youtu.be/ubDHY-ynWi0) - A video from [the UK Web Archive YouTube Channel](https://www.youtube.com/channel/UCJukhTSw8VRj-VNTpBcqWkw) - * [Wikipedia's List of Web Archiving Initiatives](https://en.wikipedia.org/wiki/List_of_Web_archiving_initiatives) - * [Glossary of Archive-It and Web Archiving Terms](https://support.archive-it.org/hc/en-us/articles/208111686-Glossary-of-Archive-It-and-Web-Archiving-Terms) - * [The Web Archiving Lifecycle Model](https://archive-it.org/blog/post/announcing-the-web-archiving-life-cycle-model/) - The Web Archiving Lifecycle Model is an attempt to incorporate the technological and programmatic arms of the web archiving into a framework that will be relevant to any organization seeking to archive content from the web. Archive-It, the web archiving service from the Internet Archive, developed the model based on its work with memory institutions around the world. - * [Retrieving and Archiving Information from Websites by Wael Eskandar and Brad Murray](https://kit.exposingtheinvisible.org/en/web-archive.html/) -* Training materials: - * [IIPC and DPC Training materials: module for beginners (8 sessions)](https://netpreserve.org/web-archiving/training-materials/) - * [UNT Web Archiving Course](https://github.com/vphill/web-archiving-course) - * [Continuing Education to Advance Web Archiving (CEDWARC)](https://cedwarc.github.io/) - * [A Whirlwind Tour of Common Crawl's Datasets using Python](https://github.com/commoncrawl/whirlwind-python/) - * [A Whirlwind Tour of Common Crawl's Datasets as a Python notebook](https://github.com/commoncrawl/whirlwind-python-notebook) - * [A Whirlwind Tour of Common Crawl's Datasets using Java](https://github.com/commoncrawl/whirlwind-java/) -* The WARC Standard: - * The [warc-specifications](https://iipc.github.io/warc-specifications/) community HTML version of the official specification and hub for new proposals. - * The [offical ISO 28500 WARC specification homepage](http://bibnum.bnf.fr/WARC/). -* For researchers using web archives: - * [GLAM Workbench: Web Archives](https://glam-workbench.github.io/web-archives/) - See also [this related blog post on 'Asking questions with web archives'](https://netpreserveblog.wordpress.com/2020/05/28/asking-questions-with-web-archives/). - * [Archives Unleashed Toolkit documentation](https://aut.docs.archivesunleashed.org/) - * [Tutorial for Humanities researchers about how to explore Arquivo.pt](https://sobre.arquivo.pt/en/tutorial-for-humanities-researchers-about-how-to-use-arquivo-pt/) +This section provides a curated list of training materials, documentation, and educational resources for those interested in learning about web archiving practices, methodologies, and tools. + +### Introductions to Web Archiving Concepts + +* [What is a web archive?](https://youtu.be/ubDHY-ynWi0) - A video from [the UK Web Archive YouTube Channel](https://www.youtube.com/channel/UCJukhTSw8VRj-VNTpBcqWkw) +* [Wikipedia's List of Web Archiving Initiatives](https://en.wikipedia.org/wiki/List_of_Web_archiving_initiatives) +* [Glossary of Archive-It and Web Archiving Terms](https://support.archive-it.org/hc/en-us/articles/208111686-Glossary-of-Archive-It-and-Web-Archiving-Terms) +* [The Web Archiving Lifecycle Model](https://archive-it.org/blog/post/announcing-the-web-archiving-life-cycle-model/) - The Web Archiving Lifecycle Model is an attempt to incorporate the technological and programmatic arms of the web archiving into a framework that will be relevant to any organization seeking to archive content from the web. Archive-It, the web archiving service from the Internet Archive, developed the model based on its work with memory institutions around the world. +* [Retrieving and Archiving Information from Websites by Wael Eskandar and Brad Murray](https://kit.exposingtheinvisible.org/en/web-archive.html/) + +### Training Materials + +* [IIPC and DPC Training materials: module for beginners (8 sessions)](https://netpreserve.org/web-archiving/training-materials/) +* [UNT Web Archiving Course](https://github.com/vphill/web-archiving-course) +* [Continuing Education to Advance Web Archiving (CEDWARC)](https://cedwarc.github.io/) +* [A Whirlwind Tour of Common Crawl's Datasets using Python](https://github.com/commoncrawl/whirlwind-python/) +* [A Whirlwind Tour of Common Crawl's Datasets as a Python notebook](https://github.com/commoncrawl/whirlwind-python-notebook) +* [A Whirlwind Tour of Common Crawl's Datasets using Java](https://github.com/commoncrawl/whirlwind-java/) + +### The WARC Standard + +* [The warc-specifications](https://iipc.github.io/warc-specifications/) community HTML version of the official specification and hub for new proposals. +* [The offical ISO 28500 WARC specification homepage](http://bibnum.bnf.fr/WARC/). + +### For Researchers using Web Archives + +* [GLAM Workbench: Web Archives](https://glam-workbench.github.io/web-archives/) - See also [this related blog post on 'Asking questions with web archives'](https://netpreserveblog.wordpress.com/2020/05/28/asking-questions-with-web-archives/). +* [Archives Unleashed Toolkit documentation](https://aut.docs.archivesunleashed.org/) +* [Tutorial for Humanities researchers about how to explore Arquivo.pt](https://sobre.arquivo.pt/en/tutorial-for-humanities-researchers-about-how-to-use-arquivo-pt/) ## Resources for Web Publishers From 0e12ad159b71f06c95d710e17168853c21bc9eb4 Mon Sep 17 00:00:00 2001 From: Natanael Arndt Date: Wed, 22 Apr 2026 01:28:09 +0200 Subject: [PATCH 2/3] fix some linter issues --- README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index 9a9d75c..2a6ed00 100644 --- a/README.md +++ b/README.md @@ -42,7 +42,7 @@ This section provides a curated list of training materials, documentation, and e * [What is a web archive?](https://youtu.be/ubDHY-ynWi0) - A video from [the UK Web Archive YouTube Channel](https://www.youtube.com/channel/UCJukhTSw8VRj-VNTpBcqWkw) * [Wikipedia's List of Web Archiving Initiatives](https://en.wikipedia.org/wiki/List_of_Web_archiving_initiatives) * [Glossary of Archive-It and Web Archiving Terms](https://support.archive-it.org/hc/en-us/articles/208111686-Glossary-of-Archive-It-and-Web-Archiving-Terms) -* [The Web Archiving Lifecycle Model](https://archive-it.org/blog/post/announcing-the-web-archiving-life-cycle-model/) - The Web Archiving Lifecycle Model is an attempt to incorporate the technological and programmatic arms of the web archiving into a framework that will be relevant to any organization seeking to archive content from the web. Archive-It, the web archiving service from the Internet Archive, developed the model based on its work with memory institutions around the world. +* [The Web Archiving Lifecycle Model](https://archive-it.org/blog/post/announcing-the-web-archiving-life-cycle-model/) - an attempt to incorporate the technological and programmatic arms of the web archiving into a framework that will be relevant to any organization seeking to archive content from the web. Archive-It, the web archiving service from the Internet Archive, developed the model based on its work with memory institutions around the world. * [Retrieving and Archiving Information from Websites by Wael Eskandar and Brad Murray](https://kit.exposingtheinvisible.org/en/web-archive.html/) ### Training Materials @@ -56,8 +56,8 @@ This section provides a curated list of training materials, documentation, and e ### The WARC Standard -* [The warc-specifications](https://iipc.github.io/warc-specifications/) community HTML version of the official specification and hub for new proposals. -* [The offical ISO 28500 WARC specification homepage](http://bibnum.bnf.fr/WARC/). +* [The warc-specifications](https://iipc.github.io/warc-specifications/) - A community HTML version of the official specification and hub for new proposals. +* [offical ISO 28500 WARC specification homepage](http://bibnum.bnf.fr/WARC/). ### For Researchers using Web Archives From 88a8261c854e36c5b262ece8b303812fceea8195 Mon Sep 17 00:00:00 2001 From: Natanael Arndt Date: Wed, 22 Apr 2026 01:34:35 +0200 Subject: [PATCH 3/3] Some more linting --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 2a6ed00..4bd098b 100644 --- a/README.md +++ b/README.md @@ -42,7 +42,7 @@ This section provides a curated list of training materials, documentation, and e * [What is a web archive?](https://youtu.be/ubDHY-ynWi0) - A video from [the UK Web Archive YouTube Channel](https://www.youtube.com/channel/UCJukhTSw8VRj-VNTpBcqWkw) * [Wikipedia's List of Web Archiving Initiatives](https://en.wikipedia.org/wiki/List_of_Web_archiving_initiatives) * [Glossary of Archive-It and Web Archiving Terms](https://support.archive-it.org/hc/en-us/articles/208111686-Glossary-of-Archive-It-and-Web-Archiving-Terms) -* [The Web Archiving Lifecycle Model](https://archive-it.org/blog/post/announcing-the-web-archiving-life-cycle-model/) - an attempt to incorporate the technological and programmatic arms of the web archiving into a framework that will be relevant to any organization seeking to archive content from the web. Archive-It, the web archiving service from the Internet Archive, developed the model based on its work with memory institutions around the world. +* [The Web Archiving Lifecycle Model](https://archive-it.org/blog/post/announcing-the-web-archiving-life-cycle-model/) - An attempt to incorporate the technological and programmatic arms of the web archiving into a framework that will be relevant to any organization seeking to archive content from the web. Archive-It, the web archiving service from the Internet Archive, developed the model based on its work with memory institutions around the world. * [Retrieving and Archiving Information from Websites by Wael Eskandar and Brad Murray](https://kit.exposingtheinvisible.org/en/web-archive.html/) ### Training Materials @@ -57,7 +57,7 @@ This section provides a curated list of training materials, documentation, and e ### The WARC Standard * [The warc-specifications](https://iipc.github.io/warc-specifications/) - A community HTML version of the official specification and hub for new proposals. -* [offical ISO 28500 WARC specification homepage](http://bibnum.bnf.fr/WARC/). +* [Offical ISO 28500 WARC specification homepage](http://bibnum.bnf.fr/WARC/) ### For Researchers using Web Archives