# Robots.txt file # For domain: http://www.uchem.co.uk # Author: Alan Reilly, 3rd May 2006 # All robots will spider the domain User-agent: * Disallow: # Disallow directory /err User-agent: * Disallow: /err # Disallow directory /logs User-agent: * Disallow: /logs # Disallow directory /logs User-agent: * Disallow: /ordersnstuff # Disallow directory /logs User-agent: * Disallow: /webstats