# robots.txt web.archive.org 02/14/2005 User-agent: * Disallow: /admin/ Disallow: /inlink/admin/ Disallow: /kernel/admin/ Disallow: /system/ Disallow: /tools/ Disallow: /cgi-bin/ Disallow: /core/ SITEMAP: http://www.url-indexer.com/SiteMap.xml