# robots.txt # Robot-exclusion file for www.microcat.com # updated 8/2/97 by Alan Thornhill at@10mb.com # See: http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * # ROOT DIRECTORY EXCLUSIONS FOLLOW Disallow: /misc for at/ Disallow: /db/ Disallow: /at/ Disallow: /cfdocs/ Disallow: /cfpop/ Disallow: /cfldap/ Disallow: /cfverity/ Disallow: /data/ Disallow: /add/ Disallow: /ftp/ Disallow: /test/ Disallow: /stats/ # GLOBAL DIRECTORY EXCLUSIONS FOLLOW Disallow: *Admin/ Disallow: *Dev/ Disallow: *New/ Disallow: *Stats/ Disallow: *Tools/ Disallow: *Survey/ # SUB-DIRECTORY EXCLUSIONS FOLLOW