# Disallowed folders for search engines User-agent: * Disallow: /admin/ # Files for website administration only Disallow: /data/ # Different content files (images, PDF's etc.) Disallow: /template/ # Website template