# # This is an empty robots.txt file that can be used to indicate to # WWW robots which parts of a web site should not be indexed. # # Following page has details on how to setup a robots.txt file and # related security issues: # # http://www.chami.com/tips/internet/010198I.html # # 1. Uncomment following two lines by removing "#" at the beginning to # indicate that all robots should stay away from the /cgi-bin/ folder User-agent: * Disallow: /cgi-bin/ User-agent: * Disallow: /logs User-agent: * Disallow: /tmp # 2. Following two lines indicate that robots named "WWW_Robot_Name" # should stay away from this site. #User-agent: WWW_Robot_Name #Disallow: / User-agent: Googlebot Disallow: # 3. Following two lines indicate that robots named "WWW_Wanderer_Name" # should not index files in the /private/ folder. #User-agent: WWW_Wanderer_Name #Disallow: /private/ #User-agent: 205.252.60.7 Disallow: / #User-agent: 205.252.60.71 Disallow: / #User-agent: 194.20.32.131 Disallow: / #User-agent: 198.5.209.201 Disallow: / #User-agent: acke.dc.luth.se Disallow: / #User-agent: dallas.mt.cs.cmu.edu Disallow: / #User-agent: waldec.com Disallow: / #User-agent: www2000.ogsm.vanderbilt.edu Disallow: / #User-agent: darkwing.cadvision.com Disallow: / #User-agent: unet.ca Disallow: / #User-agent: murph.cais.net (rapid fire... sigh) Disallow: / #User-agent: spyder3.microsys.com Disallow: / #User-agent: www.freeloader.com Disallow: /