# Crawlers Setup
User-agent: *
Crawl-delay: 60
Request-rate: 1/10m 0100-1700


User-Agent: *
Allow: /
Disallow: /wp-content/plugins/
Disallow: /wp-admin/

User-agent: 008
Disallow: /