Steps to Complete
- Implement a crawling feature accessible to admins from the backoffice (admin dashboard).
- Allow admin to initiate a crawl of company data in the govdoc scanner database via the following options:
- By TAXID(s): Select and crawl company records by one or more TAXID values.
- By Geolocation: Select and crawl by region or postal code for targeted data collection.
- Ensure the crawler integrates with existing data ingestion and scan workflows.
- Provide UI elements for selecting crawl mode, inputting TAXIDs, or specifying geolocation parameters.
- Add logging and status feedback for crawl operations.
- Document the crawling feature and its usage in the backoffice.
Goal: Enable admin-initiated, targeted crawling of company information from the backoffice, by TAXID or geolocation.
Steps to Complete
Goal: Enable admin-initiated, targeted crawling of company information from the backoffice, by TAXID or geolocation.