Shroom, ага. И папку /install/ нужно обязательно вписать и хранить на том же месте, вдруг кто то форум захочет переустановить ) Вот про эти мелочи я и говорю, которым стоит уделять внимание.
Вот мой robots.txt:
PHP код:
User-agent: Slurp
Crawl-delay: 10
Disallow: /attachment.php
Disallow: /editpost.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /report.php
Disallow: /search.php
Disallow: /sendtofriend.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /images/
Disallow: /backups/
Disallow: /downloads/
Disallow: /FILEZZZ/
Disallow: /arcade/
Disallow: /ink_f/
Disallow: /ajax.php
Disallow: /album.php
Disallow: /announcement.php
Disallow: /fractalizer_ajaxreg_ajax.php
Disallow: /fractalizer_ajaxreg_ui.php
Disallow: /gtsearch.php
Disallow: /register.php
Disallow: /request_award.php
Disallow: /award.php
Disallow: /admincp/
Disallow: /administration/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /includes/
Disallow: /modcp/
User-agent: msnbot
Crawl-delay: 5
Disallow: /attachment.php
Disallow: /editpost.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /report.php
Disallow: /search.php
Disallow: /sendtofriend.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /images/
Disallow: /backups/
Disallow: /downloads/
Disallow: /FILEZZZ/
Disallow: /arcade/
Disallow: /ink_f/
Disallow: /ajax.php
Disallow: /album.php
Disallow: /announcement.php
Disallow: /fractalizer_ajaxreg_ajax.php
Disallow: /fractalizer_ajaxreg_ui.php
Disallow: /gtsearch.php
Disallow: /register.php
Disallow: /request_award.php
Disallow: /award.php
Disallow: /admincp/
Disallow: /administration/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /includes/
Disallow: /modcp/
User-agent: Yandex
Crawl-delay: 3
Host: bormotuhi.net
Disallow: /attachment.php
Disallow: /editpost.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /report.php
Disallow: /search.php
Disallow: /sendtofriend.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /images/
Disallow: /backups/
Disallow: /downloads/
Disallow: /FILEZZZ/
Disallow: /arcade/
Disallow: /ink_f/
Disallow: /ajax.php
Disallow: /album.php
Disallow: /announcement.php
Disallow: /fractalizer_ajaxreg_ajax.php
Disallow: /fractalizer_ajaxreg_ui.php
Disallow: /gtsearch.php
Disallow: /register.php
Disallow: /request_award.php
Disallow: /award.php
Disallow: /admincp/
Disallow: /administration/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /includes/
Disallow: /modcp/
User-Agent: Googlebot-Image
Crawl-delay: 10
Disallow: /
User-agent: Mediapartners-Google*
Disallow:
User-agent: *
Crawl-delay: 10
Disallow: /attachment.php
Disallow: /editpost.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /report.php
Disallow: /search.php
Disallow: /sendtofriend.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /images/
Disallow: /backups/
Disallow: /downloads/
Disallow: /FILEZZZ/
Disallow: /arcade/
Disallow: /ink_f/
Disallow: /ajax.php
Disallow: /album.php
Disallow: /announcement.php
Disallow: /fractalizer_ajaxreg_ajax.php
Disallow: /fractalizer_ajaxreg_ui.php
Disallow: /gtsearch.php
Disallow: /register.php
Disallow: /request_award.php
Disallow: /award.php
Disallow: /admincp/
Disallow: /administration/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /includes/
Disallow: /modcp/