# ******************************************************************************** # ROBOTS.TXT - Global robots exclusion directives # ******************************************************************************** # By: Juan Carlos Herrera # Tips: - To prevent email spammers from harvesting your email address, # never put your email address on this file. # - Comments appear after the "#" symbol at the start of a line, # or after a directive. # - Only one robot.txt allowed per site. # - Do not use this as a way to hide content # - The Sitemap directive tells the engine the location of your sitemap.xml, it is best to put it in the root of your site. # # More Info: http://www.robotstxt.org/robotstxt.html # https://en.wikipedia.org/wiki/Robots_exclusion_standard # ******************************************************************************** User-agent: * Disallow: /backup/ Disallow: /cgi-bin/ Disallow: /cb/ Disallow: /cb/ Disallow: /jQuery/ Disallow: /poc_test/ Disallow: /yui/ Sitemap: sitemap.xml