#All bots User-agent: * Disallow: /cesspit/index.html Disallow: /cesspit/ Disallow: /reference/ Disallow: /personal/Pictures/ Disallow: /personal/Pictures/gallery/ Disallow: /personal/contact.q Disallow: /elisp Disallow: /webalizer Disallow: /webalizer-recent Disallow: /news/ Disallow: /temp Disallow: /temp/ Disallow: /stjtbp Disallow: /stjtbp/ Disallow: /stjtbp/website/ Disallow: /diocese/ Disallow: /glenorchy Disallow: /glenorchy-kirk Disallow: /cos-presentation Disallow: /visitors.html Disallow: /visitors-archive.html #we particularly despise google's media-partners #these arise through opera lusers having googleads enabled, sending #every new URL they visit to google for later crawling User-agent: Mediapartners-Google/2.1 Disallow: / Disallow: /* User-agent: NPBot Disallow: /