# All robots will spider this domain User-agent: * Disallow: # the following directories are disallowed Disallow: /cgi-bin/ Disallow: /images/ Disallow: /admin/ Disallow: /common/ Disallow: /phorm/ Disallow: /secure/ Disallow: /regatta/