🤖 Robots.txt & Sitemap Tester
Check a site's robots.txt and its sitemap(s). Also test whether a specific URL is allowed or disallowed for crawlers. Uses your server proxy so external requests work reliably.
Uses seo-proxy.php
Example site input:
https://example.com — you can test a URL on the same domain in the Test URL field.