# This file keeps web crawlers from going to parts of our site that we # don't need indexed. For details, see www.robotstxt.org/wc/norobots.html. User-agent: * Disallow: /2/ Disallow: /cgi-bin/ Disallow: /demo/ Disallow: /doc/ Disallow: /htdig/ Disallow: /images/