Would be great to have a field to allow this tool to exclude URLs like:
?page=
?external_url=
?sort_bef_combine=
?search_api_fulltext=
?f%5B0%5D=
So that they aren't treated as new pages. These generally aren't but are features of many dynamic CMS tools.
Would be great to have a field to allow this tool to exclude URLs like:
?page=
?external_url=
?sort_bef_combine=
?search_api_fulltext=
?f%5B0%5D=
So that they aren't treated as new pages. These generally aren't but are features of many dynamic CMS tools.