# Restrict robots, crawlers and spiders User-agent: * Disallow: / Disallow: /cgi-bin Disallow: /accounts