diff options
| author | Angie Byron <webchick@24967.no-reply.drupal.org> | 2009-09-11 04:17:07 +0000 |
|---|---|---|
| committer | Angie Byron <webchick@24967.no-reply.drupal.org> | 2009-09-11 04:17:07 +0000 |
| commit | 0fa1e14880c36aaebf39cac232461ea2c0a0a7c7 (patch) | |
| tree | 75e7321779d5145786377c46f74d8dc7a4cf2b39 /robots.txt | |
| parent | d8f91382e802a2a510dfadde398e9d0766c9fb7b (diff) | |
| download | brdo-0fa1e14880c36aaebf39cac232461ea2c0a0a7c7.tar.gz brdo-0fa1e14880c36aaebf39cac232461ea2c0a0a7c7.tar.bz2 | |
#494462 by z.stolar: Don't disallow crawling of of sites/X/files by search engines in robots.txt.
Diffstat (limited to 'robots.txt')
| -rw-r--r-- | robots.txt | 1 |
1 files changed, 0 insertions, 1 deletions
diff --git a/robots.txt b/robots.txt index de875fedf..ddf673d99 100644 --- a/robots.txt +++ b/robots.txt @@ -25,7 +25,6 @@ Disallow: /misc/ Disallow: /modules/ Disallow: /profiles/ Disallow: /scripts/ -Disallow: /sites/ Disallow: /themes/ # Files Disallow: /CHANGELOG.txt |