##################################################################### # Charlotte Music Lessons robots.txt file updated 2007-06-28 # ##################################################################### # # This robots.txt file is optimized for charlottemusiclessons.com Do # not simply plug this in and expect it to work. Read the robots # exclusion standard at http://www.robotstxt.org/wc/norobots.html # and understand your own file structure before you exclude robots # or you could accidentally prevent your site from being spidered # correctly or you could even prevent it from being spidered at all! # Some spiders are ill-behaved and will ignore this file! # Sitemap based upon the Google standard Sitemap 0.9 Protocol # ##################################################################### # Extended standards - these may or may not be used by some spiders # ##################################################################### # Adjust the crawl rate for some engines - Do this in Google from # the Dashboard. Yahoo, MSN and Ask use this standard. Googlebot # ignores this rule Crawl-delay: 10 # For all other robots and spiders User-Agent: * # Where is the sitemap.xml Sitemap: http://charlottemusiclessons.com/sitemap.xml # Disallow specific files under Charlotte Music Lessons Disallow: /google9d84e9eef9a8c97c.html Disallow: /resources.htm Disallow: /cml.css # Charlotte Music Lessons - use trailing slash # to exclude files below specified directory Disallow: /cgi-bin/ Disallow: /images/