You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
21 lines
318 B
21 lines
318 B
Sitemap: https://andrewzah.com/sitemap.xml |
|
|
|
User-agent: * |
|
Allow: * |
|
Crawl-delay: 5 |
|
|
|
Disallow: /harming/humans |
|
Disallow: /ignoring/human/orders |
|
Disallow: /harm/to/self |
|
|
|
User-agent: Mediapartners-Google* |
|
Disallow: / |
|
|
|
User-Agent: NPBot |
|
Disallow: / |
|
|
|
User-Agent: SlySearch |
|
Disallow: / |
|
|
|
User-Agent: AdsBot-Google |
|
Disallow: /
|
|
|