translate expand_more

robots.txt Tester

Test robots.txt allow and disallow rules against a path and user-agent to see the matching decision.

manage_search SEOhourglass_top Waiting for result

Files and text are processed in your browser and are not uploaded to the server.

Input

Status

Add text or choose files to see the result.

Add text or choose files to see the result.

How to use

Test robots.txt allow and disallow rules against a path and user-agent to see the matching decision.

Add your input, run the tool, and review the result below.
Copy or download the result for blog posts, work documents, and content production.
Review the result once more before using it in important public materials.

Are files uploaded to the server?expand_more

Files and text are processed in your browser and are not uploaded to the server.

Keep exploring

Jump into related tools from the same category and popular picks across Gogotem.

Convert titles into SEO-friendly URL slugs.

Generate SEO and Open Graph meta tags from title, description, and image.

Build trackable UTM campaign URLs from source, medium, campaign, term, and content fields.

Generate a robots.txt draft with crawler allow, disallow, and sitemap directives.

Convert question and answer pairs into FAQPage JSON-LD structured data.

Generate search-engine robots meta tags with index, follow, and preview directives.