Robots.txt Tester
Test if a URL is allowed or blocked by your robots.txt
Path starting with / (e.g. /admin/page)
How to use
Paste your robots.txt content, enter the URL path you want to test (e.g. /admin/login), select a bot, and click Test. The tester follows the standard robots.txt spec — specific bot rules take priority over wildcard (*) rules.
More SEO & Marketing Tools
Readability Scorer
Score content with Flesch Reading Ease, Flesch-Kincaid Grade Level, and Gunning Fog Index.
Robots.txt Generator
Build a robots.txt file visually with crawler rules, AI bot blocking, sitemap URL, and crawl delay.
Slug Generator
Convert any text into a clean, SEO-friendly URL slug with custom separator and length options.