GUIDE: leverage cache: file (timesaver)
#60
dynabler
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Scenario: you went through the hassle of collecting 1000s of data point and 100K pages, but you forget to get one more data point.
Flyscrape has a nice feature whereby it caches all the pages you scrape. It's stored in a file named after your script. For example:
script.jscache is namedscript.cache. There's also a video to see it in action: Learn Flyscrape in 10 minGenerate a new JSON without actually scraping again
export const configexport default functionandreturnflyscrape run script.jsAll reactions