Skip to content

Fix redundant Brave search page - #38

Merged
matteopasseri407 merged 1 commit into
mainfrom
fix/firecrawl-brave-page-cap
Jul 23, 2026
Merged

Fix redundant Brave search page#38
matteopasseri407 merged 1 commit into
mainfrom
fix/firecrawl-brave-page-cap

Conversation

@matteopasseri407

Copy link
Copy Markdown
Owner

Summary

Stops the optional Brave-backed SearXNG engine after its first 20-result page.
This prevents Firecrawl's internal overfetch buffer from issuing a redundant Brave request with offset=20.

Verification

  • 704 passed, 32 skipped on Fedora.
  • Live Oracle returned 20 results across 16 domains.
  • Five selected pages were scraped successfully.
  • Post-fix logs contained no 422, CAPTCHA, rate-limit, or request exceptions.
  • Public staged leak scan and private maintainer denylist scan passed.

@matteopasseri407
matteopasseri407 merged commit 5882955 into main Jul 23, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant