Показать сообщение отдельно
Старый 05.05.2010, 22:41 Вверх   #11
Коварный тип
 
Аватар для Serberg
Serberg вне форума
Доп. информация
По умолчанию

Shroom, ага. И папку /install/ нужно обязательно вписать и хранить на том же месте, вдруг кто то форум захочет переустановить ) Вот про эти мелочи я и говорю, которым стоит уделять внимание.

Вот мой robots.txt:

PHP код:
User-agent: Slurp
Crawl
-delay: 10
Disallow
: /attachment.php
Disallow
: /editpost.php
Disallow
: /misc.php
Disallow
: /moderator.php
Disallow
: /newreply.php
Disallow
: /newthread.php
Disallow
: /online.php
Disallow
: /postings.php
Disallow
: /private.php
Disallow
: /report.php
Disallow
: /search.php
Disallow
: /sendtofriend.php
Disallow
: /threadrate.php
Disallow
: /usercp.php
Disallow
: /images/
Disallow: /backups/
Disallow: /downloads/
Disallow: /FILEZZZ/
Disallow: /arcade/
Disallow: /ink_f/
Disallow: /ajax.php
Disallow
: /album.php
Disallow
: /announcement.php
Disallow
: /fractalizer_ajaxreg_ajax.php
Disallow
: /fractalizer_ajaxreg_ui.php
Disallow
: /gtsearch.php
Disallow
: /register.php
Disallow
: /request_award.php
Disallow
: /award.php
Disallow
: /admincp/
Disallow: /administration/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /includes/
Disallow: /modcp/


User-agent: msnbot
Crawl
-delay: 5
Disallow
: /attachment.php
Disallow
: /editpost.php
Disallow
: /misc.php
Disallow
: /moderator.php
Disallow
: /newreply.php
Disallow
: /newthread.php
Disallow
: /online.php
Disallow
: /postings.php
Disallow
: /private.php
Disallow
: /report.php
Disallow
: /search.php
Disallow
: /sendtofriend.php
Disallow
: /threadrate.php
Disallow
: /usercp.php
Disallow
: /images/
Disallow: /backups/
Disallow: /downloads/
Disallow: /FILEZZZ/
Disallow: /arcade/
Disallow: /ink_f/
Disallow: /ajax.php
Disallow
: /album.php
Disallow
: /announcement.php
Disallow
: /fractalizer_ajaxreg_ajax.php
Disallow
: /fractalizer_ajaxreg_ui.php
Disallow
: /gtsearch.php
Disallow
: /register.php
Disallow
: /request_award.php
Disallow
: /award.php
Disallow
: /admincp/
Disallow: /administration/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /includes/
Disallow: /modcp/


User-agent: Yandex
Crawl
-delay: 3
Host
: bormotuhi.net
Disallow
: /attachment.php
Disallow
: /editpost.php
Disallow
: /misc.php
Disallow
: /moderator.php
Disallow
: /newreply.php
Disallow
: /newthread.php
Disallow
: /online.php
Disallow
: /postings.php
Disallow
: /private.php
Disallow
: /report.php
Disallow
: /search.php
Disallow
: /sendtofriend.php
Disallow
: /threadrate.php
Disallow
: /usercp.php
Disallow
: /images/
Disallow: /backups/
Disallow: /downloads/
Disallow: /FILEZZZ/
Disallow: /arcade/
Disallow: /ink_f/
Disallow: /ajax.php
Disallow
: /album.php
Disallow
: /announcement.php
Disallow
: /fractalizer_ajaxreg_ajax.php
Disallow
: /fractalizer_ajaxreg_ui.php
Disallow
: /gtsearch.php
Disallow
: /register.php
Disallow
: /request_award.php
Disallow
: /award.php
Disallow
: /admincp/
Disallow: /administration/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /includes/
Disallow: /modcp/

User-Agent: Googlebot-Image
Crawl
-delay: 10
Disallow
: /


User-agent: Mediapartners-Google*
Disallow:


User-agent: *
Crawl-delay: 10
Disallow
: /attachment.php
Disallow
: /editpost.php
Disallow
: /misc.php
Disallow
: /moderator.php
Disallow
: /newreply.php
Disallow
: /newthread.php
Disallow
: /online.php
Disallow
: /postings.php
Disallow
: /private.php
Disallow
: /report.php
Disallow
: /search.php
Disallow
: /sendtofriend.php
Disallow
: /threadrate.php
Disallow
: /usercp.php
Disallow
: /images/
Disallow: /backups/
Disallow: /downloads/
Disallow: /FILEZZZ/
Disallow: /arcade/
Disallow: /ink_f/
Disallow: /ajax.php
Disallow
: /album.php
Disallow
: /announcement.php
Disallow
: /fractalizer_ajaxreg_ajax.php
Disallow
: /fractalizer_ajaxreg_ui.php
Disallow
: /gtsearch.php
Disallow
: /register.php
Disallow
: /request_award.php
Disallow
: /award.php
Disallow
: /admincp/
Disallow: /administration/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /includes/
Disallow: /modcp/ 
  Ответить с цитированием
4 пользователя(ей) сказали cпасибо:
 
Время генерации страницы 0.10250 секунды с 9 запросами