# http://computers.douglasthrift.net/robots.txt # $Id: robots.txt 1091 2009-09-04 03:30:28Z douglas $ User-agent: * Disallow: /cgi-bin/ Disallow: /code/index Disallow: /download/? Disallow: /index Disallow: /jargon Disallow: /searchengine/index Disallow: /searchengine/search.cgi Disallow: /searchengine/download/? Disallow: /unix/index Disallow: /unix/handouts/ Disallow: /winxpfaq/index Sitemap: http://computers.douglasthrift.net/sitemap.gz