With this testing tool you can test and validate your robots.txt. Check if your submitted URL correctly blocked on robots.txt for the specific User-Agents & bots.
Robots.txt Validator
With this testing tool you can test and validate your robots.txt. Check if your submitted URL correctly blocked on robots.txt for the specific User-Agents & bots.