Pages of the type `.../index.php?abc=d` are often quite similar to `/` which is relevant for web crawling. Add a function to determine if a given URL is possibly the homepage of a website.
Pages of the type
.../index.php?abc=dare often quite similar to/which is relevant for web crawling.Add a function to determine if a given URL is possibly the homepage of a website.