# robots.txt fo http://www.rose.brandeis.edu/ # We do not need to index our local copies of documentation... User-agent: * Disallow: /manuals # We will allow Linbot to check all links.... #User-agent: Linbot #Allow: /