User-agent: * Disallow: /cgi-bin/ Disallow: /v2flashslideshow/ Disallow: /form_thanks.html Disallow: /formbuilder Disallow: /v-web Disallow: /Gallery Disallow: /pdf #idiot-bot; generates tons of 404 and malformed urls User-agent: wget Disallow: / User-agent: ExtractorPro Disallow: /