You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

21 lines
318 B

User-agent: *
Allow: *
Crawl-delay: 5
Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self
User-agent: Mediapartners-Google*
Disallow: /
User-Agent: NPBot
Disallow: /
User-Agent: SlySearch
Disallow: /
User-Agent: AdsBot-Google
Disallow: /