Notion data not prebuild with slow internet

[sashachabin]

Problem
Downloading and optimizing files crushes in the middle of the process with slow internet conntection.

How to reproduce the problem?

pnpm i

#or
pnpm preload-static

Solution
We have to upload and optimize 500 files from Notion (amazon S3) not at the same time.

• Split list of 500 urls to 20-30 chunks
• Output download and optimize status for easy problem detection