# $Id: robots.txt,v 1.0 26/10/2006 - DRA # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # Format is: # User-agent: # Disallow: | # ----------------------------------------------------------------------------- # User-agent: Fast corporate crawler # robots.txt file User-agent: * Disallow: /files Disallow: /include Disallow: /contact.html Disallow: /guestbook.html #/stop email gathering User-agent: EmailSiphon Disallow: / User-agent: GRABEMAIL Disallow: / User-agent: GRABEMAIL2 Disallow: /