Test Robots.txt Rules
Enter a URL and user-agent to check if it's allowed or blocked by the website's robots.txt file.
How It Works
This tool fetches the robots.txt file from the domain, parses the rules for your chosen user-agent, and determines whether the specific URL path is allowed or blocked.
Enter the full URL you want to test
Select the bot user-agent to test