#-------------------------------------------------------------------------- # Mon Feb 2 11:59:27 PST 1998, Fred Elliott # A NOTE TO THOSE WHO'D BOTHER TO LOOK AT THIS FILE: # # Bertrand Meyer's excellent "comp.risks" posting about the potential # for misusing "robots.txt" files # (http://www.eiffel.com/private/meyer/robots.html) includes a snapshot # of the contents of this file here on www.sun.com. # # In the article, Bertrand speculates that the directories listed below # contain proprietary information. Well, they don't. # # The purpose of the "robots.txt" file is to keep these directories # from being indexed so that the average user doesn't stumble across them # while performing searches, and those that should be accessing these # directories will do so through the URL that requires them to register. # Of course, having the contents of this file advertised in "comp.risks" # diminishes its purpose. Thanks Bertrand. ;-) # #-------------------------------------------------------------------------- # User-agent: * Disallow: / Allow: /dsm Allow: /racing Allow: /rice Allow: /world Allow: /bov Allow: /ut2004