# Robots.txt file created by Ted Cabeen # For domain: http://www.chem.ucsb.edu # All robots will spider the domain. User-agent: * Disallow: /cgi-bin Disallow: /cgiwrite Disallow: /htdig