Robots.txt is a file that tells search engine crawlers which pages they can or cannot access on your website.

Where should robots.txt be placed?

The robots.txt file must be placed in the root directory of your website (e.g., example.com/robots.txt).

Outils Marketing

Verified Tool

Robots.txt Generator

Generate robots.txt file for your website

Free Forever No Signup

Last Updated: January 15, 2026

By Viblaa Team

CMS presets

Allow/Disallow rules

Sitemap URL

Download file

Create robots.txt files to control how search engines crawl your website. Includes presets for WordPress, Next.js, and common configurations.

SEO management

Crawler control

Website security

Content protection

Site indexing