function robotstxt_update_7100 in RobotsTxt 7

Allow crawling of 'sites' folder by search engines, don't disallow it.

File

./robotstxt.install, line 96

Install, update and uninstall functions for the robotstxt module.

Code

function robotstxt_update_7100() {

  // Case #494462.
  $robotstxt = variable_get('robotstxt');
  $robotstxt = preg_replace("/Disallow:\\s\\/sites\\/(\r\n?|\n)/", '', $robotstxt);
  variable_set('robotstxt', $robotstxt);
  return t("Removed 'sites' folder from crawling exclusion list.");
}