#robot.txt for http://www.msc.cornell.edu/ #disallows all robots into /msccf/ and beyond #written 9/16/96 mrg #information found at #http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: ccmrhtdig Disallow: User-agent: * Disallow: /ccmrcf/ Disallow: /working/ Disallow: /admin/ Disallow: /archive/ Disallow: /internal/ Disallow: /Templates/