Dev-crawler into dev - #242

Closed

Mammutor wants to merge 95 commits into

devfrom

Commits on Nov 12, 2025

Node init
vertrox78
committed
e0b8fbc
Basic Crawling of STAC Index API
Mammutor
committed
ff72c8d
feat: every object in the stac index, will be converted to an dynamic array
Mammutor
committed
30530da

Commits on Nov 18, 2025

added crawling to collection level, including nested catalogs
vertrox78
committed
eb0c8fd
Closes #55; added crawling to collection level, including nested catalogs
vertrox78
committed
69b9ebb
Merge branch 'dev-crawler' of https://github.com/SpatioCore/STAC-Atlas into dev-crawler
vertrox78
committed
65c6cad

Commits on Nov 19, 2025

Commits on Nov 20, 2025

feat: basic api crawling
Mammutor
committed
e15fcae

Commits on Nov 24, 2025

implements #76, stac api validation for catalog crawling
vertrox78
committed
fa5fdae
fix: updated crawler project to be ESM compliant
Mammutor
committed
b611ef4

Commits on Nov 25, 2025

Commits on Nov 26, 2025

Commits on Nov 27, 2025

feat: functions to save crawled catalogs, collections and apis in the database
LennKru
committed
4b818c7

Commits on Nov 28, 2025

Commits on Dec 3, 2025

Commits on Dec 10, 2025

Scheduling and time logic for recrawling (#190)
vertrox78
authored
5f017a9

Commits on Jan 1, 2026

fix: time utility was missing and improved main module check logic (#193)
Mammutor
authored
eb6d088

Commits on Jan 7, 2026

A quick cleanup and fix for the crawler to work for docker (#210)
Mammutor
authored
1e335db
bug fix: extent was written wrong (#212)

authored
24f6cb5

Commits on Jan 8, 2026

Commits on Jan 11, 2026

Commits on Jan 13, 2026

feat(crawler): enhance concurrency and storage configuration for crawling
Mammutor
committed
81bd246

Commits on Jan 14, 2026

Commits on Jan 15, 2026

Commits on Jan 16, 2026

Merge branch 'dev-crawler' into dev-crawler-humam
Mammutor
committed
7c28bdc
Enhance memory management in API and handlers
Mammutor
committed
c5b2e8f

Commits on Jan 18, 2026

Refactor database operations in insertOrUpdateCollection and insertSummary functions
Mammutor
committed
9a26ae0

Commits on Jan 19, 2026

Commits on Jan 20, 2026

Commits on Jan 21, 2026