Name		Name	Last commit message	Last commit date
LICENSE		LICENSE
README.md		README.md
method1.cs		method1.cs
method2.cs		method2.cs
method3.cs		method3.cs
monitoring.py		monitoring.py
redirects-monitoring-trigger-email.py		redirects-monitoring-trigger-email.py
robots-monitoring-trigger-email.py		robots-monitoring-trigger-email.py

Repository files navigation

robot.txt-changes

C# code to check changes in robot.txt file with 3 methods

About

💧 Test your robots.txt with this testing tool. Check if a URL is blocked, which statement is blocking it and for which user agent. You can also check if the resources for the page (CSS and JavaScript) are disallowed!. Robots.txt files help you guide how search engines crawl your site, and can be an integral part of your SEO strategy.

monitoring robots-parser robots-txt

2 stars

0 watching

Report repository

Releases

Packages

Contributors

Languages