Free Tool
Free Robots.txt Tester
Paste your robots.txt, a URL and a crawler name to see instantly whether that page is allowed or blocked, using Google’s real matching rules. No sign-up needed.
Fill in the fields above and press Test URL.
Do this and 40+ other SEO jobs in one chat
SEO Rocket runs keyword research, audits, rank tracking, AI-visibility and content, on real Ahrefs data, in plain language.
Start free – SEO RocketFree tool by SEO Rocket – runs entirely in your browser, nothing is uploaded. Longest matching rule wins; on a tie, Allow beats Disallow.