# robots.txt file for Constant Contact image and archive servers # the Robots Exclusion Standard specifies that a bot will respect # the first record containing a User-agent prefix which matches their name, or contains "*" # http://www.robotstxt.org/wc/exclusion.html # # At this point, most search spiders support the following features: # User-agent - which spider does this set of rules apply to # Disallow - where should the spider NOT crawl # Allow - where can the spider crawl (not currently supported by MSN) # * - wildcard character # $ - end of line character (can be used to exclude file types) # # syntax for this document: # User-agent: # Disallow: /privatedir/ # Allow: /publicdir/ # # last updated 20070830 by Alex Bourgeois # google User-agent: Googlebot Disallow: / Allow: /lp/images/standard/* Allow: /fs*/*/archive/* # ask User-agent: Teoma Disallow: / Allow: /lp/images/standard/* Allow: /fs*/*/archive/* # yahoo User-agent: Slurp Disallow: / Allow: /lp/images/standard/* Allow: /fs*/*/archive/* # all other search engines User-agent: * Disallow: / Allow: /lp/images/standard/* Allow: /fs*/*/archive/*