When using "deep crawl" and selecting a previously crawled URL, multiple headless chrome CLIs open recursively. I assume this is to re-crawl, however, I didn't have this in the initial crawl? Closed rusty with one open and even with the program closed they kept opening.
Steps to reproduce the behavior:
- Crawl a URL in Deep Crawl
- Select the previously crawled url in the search bar
- While "loading" the CLI will pop up multiple times.
- Further issues if RustySEO is closed with the headless browser not being closable.
Expected behavior
All progress data to be shown in the progress bar, task list, or "terminal logs".
Screenshots
System Information
- OS: Windows 11 25H2
- RustySEO Ver: 0.3.7
- Additional Features Configured: Google PSI
Additional context
I had just also configured Google PSI, is this due to PSI providing each result as an individual page? I can see how the headless browser would then scrape the results page.
When using "deep crawl" and selecting a previously crawled URL, multiple headless chrome CLIs open recursively. I assume this is to re-crawl, however, I didn't have this in the initial crawl? Closed rusty with one open and even with the program closed they kept opening.
Steps to reproduce the behavior:
Expected behavior
All progress data to be shown in the progress bar, task list, or "terminal logs".
Screenshots
System Information
Additional context
I had just also configured Google PSI, is this due to PSI providing each result as an individual page? I can see how the headless browser would then scrape the results page.