# Robot-Manager was used to generate this file. # Copyright (c) 2001-2002 by Sophtware.com, Inc. All Rights Reserved. # http://www.websitemanagementtools.com/ # PARTIAL access (Alta Vista) User-agent: Scooter Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (Anzwers) User-agent: AnzwersCrawl Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (Business.com) User-agent: larbin_indexer Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (Excite) User-agent: ArchitextSpider Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (FAST/AllTheWeb) User-agent: FAST-WebCrawler Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (Google) User-agent: Googlebot Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (Google Image) # NO access (Google Image) User-agent: Googlebot-Image Disallow: / Allow: /images/ # PARTIAL access (Inktomi) User-agent: Slurp Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (LinkAlarm) User-agent: LinkAlarm Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (Lycos) User-agent: Lycos_Spider_(T-Rex) Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (NetMechanic) User-agent: NetMechanic Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (Northern Light) User-agent: Gulliver Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (Speedy) User-agent: Speedy_Spider Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (Wayback Machine) User-agent: ia_archiver Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # PARTIAL access (whatUseek) User-agent: winona Disallow: /article/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /sitemgr/ # NO access (All Spiders) User-agent: * Disallow: /