Skip to content

findyourpaths/goskyr

 
 

Repository files navigation

Goskyr Documentation

Fork of: jakopako/goskyr

Web scraper for extracting structured list data from web pages.


Design Documents

Document Description
design_overview.md Fork architecture, extraction strategies, configuration format
design_scrape.md Scrape package: strategies, field extraction, pagination, detail pages
design_generate.md Generate package: pattern detection, config generation pipeline
design_sequential-scraping.md Sequential extraction strategy for flat HTML structures
design_sequential-field-extraction.md Field extraction challenges in sequential mode

Related

About

A configurable command-line web scraper written in go with auto configuration capability

Resources

License

Stars

1 star

Watchers

0 watching

Forks

Packages

 
 
 

Contributors

Languages

  • Go 99.5%
  • Makefile 0.5%