# Robot Exclusion File -- robots.txt # Last Updated : 07/08/2009 User-Agent: * Disallow: / Disallow: /cs/ User-agent: Googlebot-Image Disallow: #To prevnet any images from being scanned Disallow: *.gif Disallow: *.jpg Disallow: *.png #To block main page due to size from bots Disallow: /index.php #To shut down site completely from bots use Disallow: /