FREE ONLINE TOOL

Robots.txt Helper

Create a simple robots.txt starter. Robots.txt is not a privacy or access-control mechanism.

Important note

Do not use robots.txt to protect private data. Restrict sensitive areas using authentication and server permissions.