Поисковые роботы

[Serberg]

Список поисковых роботов для их распознования форумом:

AbachoBOT (Mozilla compatible)=Бот - Crawler.de
AbachoBOT=Бот - Crawler.de
abcdatos_botlink=Бот - Abcdatos.com
About/0.1libwww-perl/5.47=Бот - About.com
abot/0.1=Бот - Abot.com
abot/0.1 (abot; www.abot.com; abot @ abot.com)=Бот - Abot.com
accoona=Бот - Accoona.com
AcoiRobot=Бот - Acoi Picture Robot
Acoon Robot v1.50.001=Бот - Acoon.de
Acoon Robot v1.52=Бот - Acoon.de
Acoon Robot=Бот - Accon.de
ActiveWorlds/3.xx=Бот - ActiveWorlds.com
admin @ crawler.de=Бот - Crawler.de
admin @ maxbot.com=Бот - maxbot.com
ADSARobot=Бот - ADSARobot
AESOP_com_SpiderMan=Бот - Aesop.com
agadine/1.x.x=Бот - Agada.de
Agent-admin/=Бот - Daum.net
ah-ha.com crawler (crawler@ah-ha.com)=Бот - Ah-ha.com
ah-ha.com crawler=Бот - Ah-ha.com
Aladin/3.324=Бот - Aladin.de
Aleksika Spider/1.0=Бот - Aleksika.de
AlkalineBOT/1.3=Бот - Vestris.com
AlkalineBOT/1.4=Бот - Vestris.com
AlkalineBOT=Бот - AlkalineBOT
Allesklar/0.1 libwww-perl/5.46=Бот - Allesklar.de
AltaVista-Intranet=Бот - Altavista.co.uk
amaya=Бот - libwww.amaya
AmfibiBOT=Бот - Amfibi.com
Amiga-AWeb/3.4.167SE=Бот - AWeb.com
amzn_assoc=Бот - Amazon.com
AnswerChase PROve x.0=Бот - AnswerChase.com
AnswerChase x.0=Бот - AnwserChase.com
AnswerChase=Бот - AnswerChase.com
Antibot=Бот - AntiSeach.net
antibot-V1.1.5/i586-linux-2.2=Бот - AntiSeach.net
AnzwersCrawl/2.0=Бот - Anzwers
A-Online Search=Бот - Jet2Web.com
Aport=Бот - Aport.ru
aport=Бот - Aport
appie 1.1=Бот - Walhello.com
appie=Бот - Walhello.com
arachnoidea @ euroseek.net=Бот - Euroseek.net
Arachnoidea=Бот - Euroseek.com
Aranha=Бот - Girafa.com
ArchitectSpider=Бот - Excite.com
archive.org_bot=Бот - Archive.org
archive_org=Бот - Archive.org
Ask Jeeves=Бот - Ask Jeeves
ask jeeves=Бот - Ask Jeeves
ask.24x.info=Бот - Ask.24x.info
ASPSeek/1.2.5=Бот - ASPSeek.org
ASPseek/1.2.9d=Бот - ASPSeek.com
ASPSeek/1.2.x=Бот - ASPSeek.org
ASPSeek/1.2.xa=Бот - ASPSeek.org
ASPseek/1.2.xx=Бот - ASPseek.org
ASPSeek/1.2.xxpre=Бот - ASPSeek.org
ASPSeek=Бот - ASPSeek.org
asterias/2.0=Бот - SingingFish.com
Asterias=Бот - SingingFish.com
AtlocalBot=Бот - Atlocal.com
AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html)=Бот - Atlocal.com
Atomz/1.0=Бот - Atomz.com
Atomz=Бот - Atomz.com
Augurfind=Бот - Augurnet.ch
augurnfind V-1.x=Бот - Augurnet.ch
autohttp=Бот - Elsop.com
AV Fetch 1.0=Бот - Altavista.com
AVSearch=Бот - Altavista.com
AVSearch-3.0=Бот - Altavista.com
AxmoRobot=Бот - Axmo.com
Baiduspider+=Бот - Baidu.com
BaiDuSpider=Бот - Baidu.com
BanBots/1.2=Бот - Banbots.com
BarraHomeCrawler=Бот - BarraHome.com
bdcindexer_2.6.2=Бот - Business.com
BDFetch=Бот - Brandimensions.com
BDNcentral Crawler v2.3=Бот - Bdncentral.com
beautybot/1.0=Бот - Cosmoty.com
Binky=Бот - libwww.Binky
Bilbo/2.3b-UNIX=Бот - Biblo Bot
BlackWidow=Бот - BlackWidow Bot
Blaiz-Bee/1.0 (+http://www.blaiz.net)=Бот - Blaiz.net
Blaiz-Bee/1.0=Бот - Blaiz.net
BlitzBOT @ tricus.net (Mozilla compatible)=Бот - Blitzsuche.rp-online.de
BlitzBOT @ tricus.net=Бот - Blitzsuche.rp-online.de
BlogBot/1.x=Бот - Blogdex.net
BlogBot=Бот - Blogdex.net
blogWatcher_Spider/0.1=Бот - Blogwatcher.pi.titech.ac.jp
Bloglines Title Fetch/1.0 (http://www.bloglines.com)=Бот - Bloglines.com
boitho.com-dc/0.xx=Бот - Boitho.com
boitho.com-robot/1.x=Бот - Boitho.com
booch=Бот - Booch
BSDSeek/1.0=Бот - Inktomi.com
BullsEye=Бот - Intelliseek.com
bumblebee @ relevare.com=Бот - Relevare.com
Buscaplus Robi/1.0=Бот - Buscaplus.com
Buscaplus Robi=Бот - Buscaplus.com
CanSeek/=Бот - Cansee.ca
ChristCRAWLER 2.0=Бот - Christcrawler.com
ChristCRAWLER=Бот - Christcrawler.com
CipinetBot=Бот - Cipinet.com
citenikbot/=Бот - Cenik.co.uk
ClariaBot/1.0=Бот - Searchscout.com
Claymont.com=Бот - Claymont.com
CLIPS-index=Бот - Cips-index.imag.fr
Clushbot/3.3-BinaryFury (+http://www.clush.com/bot.html)=Бот - Clush.com
Clushbot/3.3-BinaryFury=Бот - Clush.com
Combine/x.0=Бот - Combine Bot
Computer_and_Automation_Research_Institute_Crawler=Бот - Research Bot
contact/jylee@kies.co.kr=Бот - Kies.co.kr
Convera Internet Spider V6.x=Бот - Convera.com
cosmos/0.8_(robot@xyleme.com)=Бот - Xyleme.com
cosmos/0.9_(robot@xyleme.com)=Бот - Xyleme.com
cosmos=Бот - Xyleme.com
C-PBWF-ip3000.com-crawler=Бот - IP3000.com
CrawlConvera0.1=Бот - Converna.net
Crawler (cometsearch@cometsystems.com)=Бот - Findwhat.com
Crawler admin @ crawler.de=Бот - Crawler.de
Crawler V 0.2.x
crawler @ alexa.com=Бот - Alexa.com
crawler @ brainbot.com=Бот - Brainbot.com
crawler @ fast.no=Бот - Alltheweb.com
Crawler=Бот - Crawler.de
CrawlerBoy Pinpoint.com=Бот - Pinpoint.com
CrawlerBoy=Бот - Pinpoint.com
CrocCrawler=Бот - CrocCrawler.com
Custom Spider www.bisnisseek.com
DaAdLe.com ROBOT/=Бот - Daadle.com
DataparkSearch/4.xx=Бот - DataparkSearch.com
DaviesBot/1.7=Бот - Wholeweb.net
DaviesBot=Бот - Wholeweb.net
dbDig=Бот - Prairielandconsulting.com
DBrowse 1.4b=Бот - DBrowse Bot
DBrowse 1.4d=Бот - DBrowse Bot
dCSbot/1.1=Бот - Openmarket.com
DeepIndex=Бот - DeepIndex.com
DeepIndexer.ca=Бот - DeepIndex.com
deepweb=Бот - Deepweb.com
Demo Bot DOT 16b=Бот - Btopenworld.com
DiaGem/=Бот - Skyrocket.gr.jp
DiaGem/1.1 (http://www.skyrocket.gr.jp/diagem.html)=Бот - Skyrocket.gr.jp
DiaGem/1.1=Бот - Skyrocket.gr.jp
Diamond/1.0=Бот - Searchscout.com
Digger/1.0 JDK/1.3.0rc3=Бот - Diggit.com
Digimarc WebReader=Бот - Digimarc.com
DigOut4U=Бот - Arisem.com
DirectHit: Grabber
DIIbot/1.2=Бот - Digital-Integrity.com
DIIbot=Бот - Digital-Integrity.com
DittoSpyder=Бот - Ditto.com
dloader(NaverRobot)/=Бот - Naver.com
dtSearchSpider=Бот - Dtsearch.com
Dumbot(version 0.1 beta - dumbfind.com)=Бот - Dumbfind.com
Dumbot(version 0.1 beta)=Бот - Dumbfind.com
EARTHCOM.info/1.4beta=Бот - Earthcom.info
EasyDL/3.02=Бот - Keywen.com
EasyDL/3.03=Бот - Keywen.com
EasyDL/3.04=Бот - Keywen.com
EasyDL/3.xx keywen.com/Encyclopedi...Keywen.com
EasyDL/3.xx=Бот - Keywen.com
EchO!/2.0=Бот - Voila.com
egothor/3.0a (+http://www.xdefine.org/robot.html)=Бот - Xdefine.com
egothor/3.0a=Бот - Xdefine.com
EgotoBot/4.8=Бот - Egoto.com
Enterprise_Search/1.0.xxx=Бот - Innerprise.net
Enterprise_Search/1.0=Бот - Innerprise.net
erik @ malfunction.org=Бот - Malfunction.org
EroCrawler=Бот - Erocrawler.com
ES.NET_Crawler/2.0=Бот - Innerprise.net
eseek-larbin_2.6.2=Бот - Exactseek.com
ESISmartSpider=Бот - Travel-Finder.com
ExactSeek Crawler/0.1=Бот - Exactseek.com
exactseek-crawler-2.63=Бот - Exactseek.com
Exalead NG/MimeLive Client=Бот - Exabot.com
Excalibur Internet Spider
Excite: ArchitextSpider
V6.5.4=Бот - Excalib.com
ExperimentalHenrytheMiragoRobot=Бот - Mirago.co.uk
EyeCatcher (Download-tipp.de)/1.0=Бот - Download-tipp.de
EyeCatcher=Бот - Download-tipp.de
EZResult=Бот - Ezresults.com

[Serberg]

Продолжение:
Fast Crawler Gold Edition=Бот - Alltheweb.com
FAST Data Search Crawler=Бот - Alltheweb.com
FAST Enterprise Crawler 6 (Experimental)=Бот - Alltheweb.com
FAST Enterprise Crawler 6 used by FAST (FAST)=Бот - Alltheweb.com
FAST Enterprise Crawler 6 used by FAST=Бот - Alltheweb.com
FAST Enterprise Crawler 6=Бот - Alltheweb.com
FAST Enterprise Crawler/6 (www.fastsearch.com)=Бот - Alltheweb.com
FAST Enterprise Crawler/6=Бот - Alltheweb.com
FAST FirstPage retriever (compatible; MSIE 5.5; Mozilla/4.0)=Бот - Alltheweb.com
FAST FirstPage retriever=Бот - Alltheweb.com
Fast PartnerSite Crawler=Бот - Alltheweb.com
FastCrawler 3.0.1 (crawler@1klik.dk)=Бот - Alltheweb.com
FastCrawler 3.0.1=Бот - Alltheweb.com
FAST-WebCrawler/2.2.10=Бот - Altheweb.com
FAST-WebCrawler/2.2.6=Бот - Altheweb.com
FAST-WebCrawler/2.2.7=Бот - Altheweb.com
FAST-WebCrawler/2.2.8=Бот - Altheweb.com
FAST-WebCrawler/3.2 test=Бот - Altheweb.com
FAST-WebCrawler/3.2=Бот - Altheweb.com
FAST-WebCrawler/3.3=Бот - Altheweb.com
FAST-WebCrawler/3.4/Nirvana=Бот - Altheweb.com
FAST-WebCrawler/3.4/PartnerSite=Бот - Altheweb.com
FAST-WebCrawler/3.5=Бот - Altheweb.com
FAST-WebCrawler/3.6/FirstPage=Бот - Altheweb.com
FAST-WebCrawler/3.6=Бот - Altheweb.com
FAST- FAST-WebCrawler/3.7=Бот - Altheweb.com
FAST-WebCrawler/3.8/Fresh=Бот - Altheweb.com
FAST-WebCrawler/3.8=Бот - Altheweb.com
FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no)=Бот - Altheweb.com
FAST-WebCrawler/3.x Multimedia=Бот - Altheweb.com
FAST-WebCrawler=Бот - Alltheweb.com
Faxobot/1.0=Бот - FaXo.com
Felix - Mixcat Crawler=Бот - Mixcat.com
Felix=Бот - Mixcat.com
FFC Trap Door Spider=Бот - Frequentfinders.com
fido/1.0 Harvest/1.4.pl2=Бот - Planet Search
FinaleRobot=Бот - expressus.com
FindAnISP.com_ISP_Finder_v99a=Бот - FindAnI
FineBot=Бот - Finesearch.com
Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5)=Бот - Fireball.de
Firefly/1.0=Бот - Fireball.de
FlickBot 2.0 RPT-HTTPClient/0.3-3=Бот - DivX.com
Fluffy the spider=Бот - SearchHippo.com
Flunky=Бот - Metacarta.com
Francis/1.0 (francis@neomo.de www.neomo.de/)=Бот - Neomo.de
Francis/1.0=Бот - Neomo.de
FreeFind.com-SiteSearchEngine/1.0=Бот - Freefind.com
FyberSearch=Бот - Fybersearch.com
FyberSpider=Бот - Fybersearch.com
Gagglebot=Бот - Gagglebot
GAIS Robot/1.0B2=Бот - Seed.net.tw
Gaisbot/3.0+=Бот - Seed.net.tw
Gaisbot/3.0=Бот - Seed.net.tw
GalaxyBot/1.0 (http://www.galaxy.com/galaxybot.html)=Бот - Galaxy.com
GalaxyBot/1.0=Бот - Galaxy.com
GalaxyBot=Бот - Galaxy.com
GammaSpider/1.0=Бот - Gammasite.com
gazz/1.0=Бот - Infobee.ne.jp
gazz @ nttrd.com=Бот - Infobee.ne.jp
Geckobot=Бот - Geckobot.com
geckobot=Бот - Geckobot.com
GenCrawler=Бот - Gendoor.com
generic_crawler/01.0217/=Бот - Cmu.edu
GentleSpider=Бот - Research.att.com
GeonaBot=Бот - Geona.com
GetSmart=Бот - GetSmart
GigaBaz=Бот - Brainbot.com
GigaBazVStheWeb=Бот - Brainbot.com
GigaBlast=Бот - Gigablast
Gigabot/1.0=Бот - Gigablast.com
Gigabot=Бот - Gigablast.com
GigabotSiteSearch/2.0 (sitesearch.gigablast.com)=Бот - Gigablast.com
GigabotSiteSearch/2.0=Бот - Gigablast.com
Giskard=Бот - oralco.com
GNODSPIDER=Бот - Gnod.net
Goblin/0.9 (http://www.goguides.org/)=Бот - Goguides.org
Goblin/0.9.x (http://www.goguides.org/goblin-info.html)=Бот - Goguides.org
Goblin/0.9.x=Бот - Goguides.org
Goblin/0.9=Бот - Goguides.org
GoForIt.com=Бот - Goforit.com
Goofer/0.2=Бот - Wanadoo.fr
Googlebot/1.0=Бот - Google.com
Googlebot/2.1=Бот - Google.com
Googlebot/Test=Бот - Google.com
googlebot=Бот - Google
GoogleBot=Бот - Google
googlebot @ googlebot.com=Бот - Google.com
Googlebot-Image/1.0=Бот - Google.com Image Bot
GrigorBot 0.8=Бот - Grigor.biz
grub crawler(http://www.grub.org)=Бот - Grub.com
grub-client=Бот - Grub.org
gsa-crawler (Enterprise; GID-01422; jplastiras @ google.com)=Бот - Google.com
gsa-crawler (Enterprise; GID-01742;gsatesting@rediffmail.com)=Бот - Google.com
gsa-crawler=Бот - Google.com
Gulliver/1.2=Бот - Northernlight.com
Gulliver/1.3=Бот - Northernlight.com
Gulliver=Бот - Northernlight.com
Gulper Web Bot 0.2.4=Бот - Gulper Bot
Gulper Web Bot=Бот - Gulper Bot
Hatena Antenna/0.4 (http://a.hatena.ne.jp/help#robot)=Бот - a.hatena.ne.jp
Hatena Antenna/0.4=Бот - a.hatena.ne.jp
HeinrichderMiragoRobot=Бот - Mirago.de
HenrytheMiragoRobot=Бот - Mirago.co.uk
HenryTheMiragoRobot=Бот - Mirago.co.uk
Hippias/0.9 Beta=Бот - Hippias Bot
holmes/x.x=Бот - Morfeo.centrum.cz
HomePageSearch(hpsearch.uni-trier.de)=Бот - Hpsearch.uni-trier.de
Homerbot: www.homerweb.com=Бот - Homerweb.com
Homerbot=Бот - Homerweb.com
htdig/3.1.6 (http://computerorgs.com)=Бот - Computerorgs.com
htdig/3.1.x (root@localhost)=Бот - Htdig.org
htdig/3.1.x=Бот - Htdig.org
www.abcdatos.com/botli...cdatos.com
Hubater=Бот - Hubat.com
ia_archiver/1.6=Бот - Archive.org
ia_archiver=Бот - Archive.org
IAArchiver-1.0=Бот - Archive.org
icsbot-0.1=Бот - Icseoul.org
ideare - SignSite/1.x=Бот - Ideare.com
Ideare - SignSite=Бот - Ideare.com
IlTrovatore-Setaccio (+http://www.iltrovatore.it)=Бот - Iltrovatore.it
Iltrovatore-Setaccio/0.3-dev=Бот - Iltrovatore.it
IlTrovatore-Setaccio/1.2=Бот - Iltrovatore.it
iltrovatore-setaccio/1.2-dev=Бот - Iltrovatore.it
IlTrovatore-Setaccio=Бот - Iltrovatore.it
IncyWincy=Бот - Incywincy.com
IndexTheWeb.com Crawler7=Бот - IndexTheWeb.com
Inet library=Бот - Inetlibrary.com
info @ searchhippo.com=Бот - Searchhippo.com
InfoFly/1.0 (http://www.versions-project.org/)=Бот - Versions-project.org
InfoFly/1.0=Бот - Versions-project.org
Infoseek: Infoseek
InfoSeek Sidewinder/0.9=Бот - Infoseek.com
InfoSeek Sidewinder/1.0A=Бот - Infoseek.com
InfoSeek Sidewinder/1.1A=Бот - Infoseek.com
Infoseek SideWinder/1.45 (Compatible; MSIE 10.0; UNIX)=Бот - Infoseek.com
Infoseek SideWinder/1.45=Бот - Infoseek.com
Infoseek SideWinder/2.0B (Linux 2.4 i686)=Бот - Infoseek.com
Infoseek SideWinder/2.0B=Бот - Infoseek.com
InfoSeek Sidewinder=Бот - infoseek.com
Inktomi Search=Бот - Yahoo.com
Inktomi=Бот - Yahoo.com
InnerpriseBot/1.0 (http://www.innerprise.com/)=Бот - Innerprise.net
InnerpriseBot/1.0=Бот - Innerprise.net
InsumaScout=Бот - InsumaScout
Internet Ninja 6.0=Бот - Dti.ne.jp
InternetSeer.com=Бот - InternetSeer.com
InternetSeer=Бот - InternetSeer
InternetSeer=Бот - InternetSeer.com
Ivan Susanin=Бот - IvanSusanin
ip3000.com=Бот - ip3000.com
ip3000.com-crawler=Бот - ip3000.com
IPiumBot laurion(dot)com=Бот - Laurion.com
ipiumBot=Бот - Laurion.com
Iron33=Бот - Verno.ueda.info.waseda.ac.jp
Jabot/6.x (http://odin.ingrid.org/)=Бот - Ingrid.org
Jabot/6.x=Бот - Ingrid.org
Jabot/7.x.x (http://odin.ingrid.org/)=Бот - Ingrid.org
Jabot/7.x.x=Бот - Ingrid.org
Jack=Бот - Domanova.co.uk
jan.gelin @ av.com=Бот - Altavista.co.uk
jeeves=Бот - Ask Jeeves
Jetbot=Бот - Jet Bot
Jetbot/1.0=Бот - Jeteye.com
JoocerBot=Бот - Joocer.com
Jyxobot/x=Бот - Jyxo.cz
Katriona=Бот - Katriona
KE_1.0/2.0 libwww/5.2.8=Бот - Voila.fr
Kenjin Spider=Бот - Kenjin.ne.jp
KIT_Fireball/2.0=Бот - Fireball.de
KIT-Fireball/2.0 (compatible; Mozilla 4.0; MSIE 5.5)=Бот - Fireball.de
KIT-Fireball/2.0=Бот - Fireball.de
KIT-Fireball=Бот - Fireball.de
Knowledge.com/0.x=Бот - Knowledge.com
Kototoi/0.1=Бот - s.u-tokyo.ac.jp
kuloko-bot/0.2=Бот - Kuloko.com
kuloko-bot/0.x=Бот - Kuloko.com
Kulokobot=Бот - Kuloko.com
kulturarw3/0.1=Бот - National Library of Sweden
LEIA/3.01pr (LEIAcrawler; [SNIP])=Бот - Gseek.com
LEIA=Бот - Gseek.com
LexiBot=Бот - Lexibot.com
libwww=Бот - Punto
LNSpiderguy=Бот - Lexis-nexis.com
Look.com=Бот - Look.com
Looksmart Web Pages: Slurp
lwp-trivial/1.27=Бот - Search4free.com
lwp-trivial/1.34=Бот - Search4free.com
Lycos_Spider_(T-Rex)/3.0=Бот - Lycos.com
Lycos_Spider_(T-Rex)=Бот - Lycos.com
lycos=Бот - Lycos.com
Lycos=Бот - Lycos
Lycos.com=Бот - Lucos

[Serberg]

Продолжение:
Mackster( www.ukwizz.com )=Бот - Ukwizz.com
Mackster=Бот - Ukwizz.com
Mag-Net=Бот - Wind.it
mailto:webcraft@bea.com=Бот - Beasys.com
mammoth/1.0 (+http://www.sli-systems.com/)=Бот - Sli-Systems.com
mammoth/1.0=Бот - Sli-Systems.com
MantraAgent=Бот - Looksmart.com
mapper @ teradex.com=Бот - Mapper.teradex.com
Mariner/5.1b [de] (Win95; I;Kolibri gncwebbot)=Бот - Kolibri.de
Mariner/5.1b=Бот - Kolibri.de
Martini=Бот - Looksmart.com
MarcoPolo=Бот - MarcoPolo
Marvin v0.3=Бот - Marvin Bot
marvin/infoseek=Бот - Webseek.de
marvin-team @ webseek.de=Бот - Webseek.de
Mata Hari/2.00=Бот - Lexibot.com
MediaCrawler-1.0 (Experimental)=Бот - Mediacrawler.de
MediaCrawler-1.0=Бот - Mediacrawler.de
Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)=Бот - Google.com Adsense
Mediapartners-Google/2.1=Бот - Google.com Adsense
MediaSearch/0.1=Бот - Www.fi
MegaSheep v1.0 (www.searchuk.com internet sheep)=Бот - SearchUK.com
MegaSheep v1.0=Бот - SearchUK.com
Mercator=Бот - Altavista.com
Mercator=Бот - Altavista.com
Mercator-1.x=Бот - Altavista.com
Mercator-2.0=Бот - Altavista.com
Mercator-Scrub-1.1=Бот - Altavista.com
metabot=Бот - Metabot
Metaspinner/0.01=Бот - Meta-Spinner.de
MFC_Tear_Sample=Бот - Microsoft.com
MicrosoftPrototypeCrawler=Бот - Microsoft.com
Minibot=Бот - Minibot
MiracleAlphaTest=Бот - Nec.co.jp
MnogoSearch/3.2.xx=Бот - mNoGoSearch.org
moget/2.0=Бот - Goo.ne.jp
moget/2.1 (moget@goo.ne.jp)=Бот - Goo.ne.jp
moget/2.1=Бот - Goo.ne.jp
moget @ goo.ne.jp=Бот - Goo.ne.jp
Mole2/1.0=Бот - Intags.de
Morris - Mixcat Crawler (+http://mixcat.com)=Бот - Mixcat.com
Morris - Mixcat Crawler=Бот - Mixcat.com
Morris=Бот - Mixcat.com
Mouse-House/7.4=Бот - Spidermonkey.ca
mozDex/=Бот - Mozdex.com
mozDex/0.04-dev=Бот - Mozdex.com
Mozilla (Mozilla@somewhere.com)=Бот - Somewhere.com
Mozilla/2.0 (compatible; Ask Jeeves)=Бот - Ask Jeeves
Mozilla/2.0 (compatible; EZResult -- Internet Search Engine)=Бот - DirectHit.com
Mozilla/3.0 (compatible; MuscatFerret/1.5.4; claude @ euroferret.com)=Бот - Euroferret.com
Mozilla/3.0 (compatible; MuscatFerret/1.5; olly @ muscat.co.uk)=Бот - Euroferret.com
Mozilla/3.0 (compatible; MuscatFerret/1.6.x; claude @ euroferret.com)=Бот - Euroferret.com
Mozilla/3.01 (Compatible; Links2Go Similarity Engine)=Бот - Links2go.com
Mozilla/4.0 (compatible; FastCrawler3, support-fastcrawler3 @ fast.no)=Бот - AllTheWeb.com
Mozilla/4.0 (compatible; grub-client-2.x)=Бот - Grub.org
Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) TrueRobot; 1.5=Бот - Echo.com
Mozilla/4.0 (compatible; SpeedySpider; www.entireweb.com)=Бот - EntireWeb.com
Mozilla/4.0 (compatible; www.galaxy.com)=Бот - Galaxy.com
Mozilla/4.0 [en] (Ask Jeeves Corporate Spider)=Бот - Ask Jeeves
Mozilla/4.0(compatible; Zealbot 1.0)=Бот - LookSmart.com
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot)=Бот - MSN.com
Mozilla/5.0 wgao @ genieknows.com=Бот - GenieKnows.com
MnoGoSearch=Бот - mnoGoSearch
MP3Bot=Бот - mp3bot.de
MSNBOT/0.1=Бот - MSN.com
msnbot=Бот - MSN.com
MSN=Бот - MSN.com
MultiText/0.1=Бот - MultiText
MultiText=Бот - MultiText
MuscatFerret=Бот - Webtop.com
NationalDirectoryAddURL/1.0=Бот - NationalDirectory.com
NationalDirectory-SuperSpider=Бот - Nationaldirectory.com
NaverBot=Бот - Naver
NationalDirectory-WebSpider/1.3=Бот - NationalDirectory.com
Nazilla=Бот - Websmostlinked.com
NEC Research Agent=Бот - NEC Research Agent
NetCruiser=Бот - NetCruiser
Netprospector=Бот - Netprospector
NetResearchServer(http://www.look.com)=Бот - Look.com
NetResearchServer=Бот - Look.com
NetZippy=Бот - Netzippy.com
NextopiaBOT=Бот - Nextopia.com
NG/1.0=Бот - Exabot.com
Noago Spider=Бот - Noago.com
NPBot=Бот - NameProtect.com
NPBot-1/2.0=Бот - NameProtect.com
NP/0.1=Бот - NameProtect.com
NP/0.1 (NP; www.nameprotect.com; npbot @ nameprotect.com)=Бот - NameProtect.com
nttdirectory_robot=Бот - Navi.ocn.ne.jp
Nutch=Бот - Nutch.org
NutchCVS/0.0x-dev=Бот - Nutch.org
NutchOrg/0.0x-dev=Бот - Nutch.org
NutchOrg=Бот - Nutch.org
NZBot=Бот - NavigationZone.com
ObjectsSearch/0.01=Бот - ObjectsSearch.com
oBot ((compatible;Win32))=Бот - Cobion.com
oBot=Бот - Cobion.com
OliverPerry=Бот - Claymont.com
OmniWeb=Бот - OmniWeb
OntoSpider/1.0 libwww-perl/5.65=Бот - Ontospider.i-n.info
OntoSpider/1.0=Бот - Ontospider.i-n.info
OntoSpider=Бот - Ontospider.i-n.info
Openbot=Бот - Openfind
Openbot/=Бот - Openfind.com.tw
Openbot/3.0+=Бот - Openfind.com.tw
Openbot/3.0=Бот - Openfind.com.tw
Opencola=Бот - Opencola.com
Openfind piranha=Бот - Openfind.com
Openfind Robot/1.1A2=Бот - Openfind.com.tw
OpenTextSiteCrawler/2.9.2=Бот - Opentext.net
Oracle Ultra Search=Бот - Oracle.com
Oxxbot1=Бот - Oxxfordinfo.com
Pansophica=Бот - Pansophica
ParaSite/1.0b (http://www.ianett.com/parasite/)=Бот - Ianett.com
ParaSite/1.0b=Бот - Ianett.com
pd02_1.0.0 pd02_1.0.0@dzimi@post.sk=Бот - Post.sk
peerbot=Бот - Peerbot.com
Phoaks=Бот - Phoaks
phortse @ hanmail.net=Бот - Daum.net
PICgrabber=Бот - PICgrabber
PicoSearch/=Бот - PicoSearch.com
PicoSearch/1.0=Бот - PicoSearch.com
PictureOfInternet=Бот - PictureOfInternet
PintaSpider=Бот - PintaSpider
pipeLiner/0.10=Бот - Pipeline-Search.com
pipeLiner=Бот - Pipeline-Search.com
Pita=Бот - Pita Bot
Pizilla++ ver 2.45=Бот - He.net
PJspider/3.0 (pjspider@portaljuice.com; www.portaljuice.com)=Бот - P...ljuice.com
PJspider/3.0=Бот - Portaljuice.com
PJspider=Бот - Portaljuice.com
PlantyNet=Бот - PlantyNet
polybot 1.0 (http://cis.poly.edu/polybot/)=Бот - PolyBot
polybot 1.0=Бот - PolyBot
PolyBot=Бот - PolyBot
Pompos/1.x dir.com/pompos.html=Бот - Dir.com
Pompos/1.x pompos @ iliad.fr=Бот - Iliad.fr
Pompos/1.x=Бот - Free.fr
Popdexter/1.0=Бот - Popdex.com
PortalBSpider/2.0 (spider@portalb.com)=Бот - Portalb.com
PortalBSpider/2.0=Бот - Portalb.com
Project XP5 [2.03.07-111203]=Бот - XP5 Bot
Project XP5=Бот - XP5 Bot
PROve AnswerBot 4.0=Бот - Answerchase.com
psbot/0.1 (+http://www.picsearch.com/bot.html)=Бот - Picsearch.com
psbot/0.1=Бот - Picsearch.com
psbot=Бот - Picsearch.com
Qango.com Web Directory (http://www.qango.com/)=Бот - Qango.com
Qango.com Web Directory=Бот - Qango.com
QPCreep Test Rig ( We are not indexing, just testing ) =Бот - Quepasa.com
QPCreep Test Rig=Бот - Quepasa.com
QuepasaCreep ( crawler @ quepasacorp.com )=Бот - Quepasa.com
QuepasaCreep v0.9.1x=Бот - Quepasa.com
QuepasaCreep=Бот - Quepasa.com
QueryN Metasearch=Бот - Queryn.com
rabaz (rabaz at gigabaz dot com)=Бот - Brainbot.com
Rabaz=Бот - Brainbot.com
RaBot=Бот - Daum.net
rambler=Бот - Rambler
ramBot xtreme x.x=Бот - Intersearch.de
Reaper [2.03.10-031204] (http://www.sitesearch.ca/reaper/)=Бот - Sitesearch.ca
Reaper [2.03.10-031204]=Бот - Sitesearch.ca
Reaper/2.0x (+http://www.sitesearch.ca/reaper)=Бот - Sitesearch.ca
Reaper/2.0x=Бот - Sitesearch.ca
Reaper=Бот - Sitesearch.ca
roach.smo.av.com-1.0=Бот - Altavista.com
roach.smo.av.com-1.0=Бот - Altavista.com
RoboCrawl (www.canadiancontent.net)=Бот - CanadianContent.net
RoboCrawl=Бот - CanadianContent.net
robot/1.0=Бот - Neofonie.de
Robot/www.pj-search.com=Бот - PJ-Search.com
Robot @ SuperSnooper.Com=Бот - SuperSnooper.com
robot @ xyleme.com=Бот - Xyleme.com
robot-master @ expressus.com=Бот - Expressus.com
robot-response @ openfind.com.tw=Бот - Openfind.com.tw
Robozilla/1.0=Бот - Dmoz.org
Rotondo/3.1 libwww/5.3.1=Бот - Qualigo.de
ru-robot=Бот - Rutgers.edu
scooter=Бот - Altavista
Scooter/1.0 scooter @ pa.dec.com=Бот - Altavista.com
Scooter/1.0=Бот - Altavista.com
Scooter/1.1 (custom)=Бот - Altavista.com
Scooter/2.0 G.R.A.B. V1.1.0 =Бот - Altavista.com
Scooter/2.0 G.R.A.B. X2.0=Бот - Altavista.com
Scooter/3.3.QA.pczukor=Бот - Altavista.com
Scooter/3.3.vscooter=Бот - Altavista.com
Scooter/3.3_SF=Бот - Altavista.com
Scooter/3.3=Бот - Altavista.com
Scooter_bh0-3.0.3=Бот - Altavista.com
Scooter_trk3-3.0.3=Бот - Altavista.com
Scooter=Бот - Altavista.com
Scooter2_Mercator_3-1.0=Бот - Altavista.com
Scooter2_Mercator_x-x.0=Бот - Altavista.com
Scooter-3.0.EU=Бот - Altavista.com
Scooter-3.0.FS=Бот - Altavista.com
Scooter-3.0.HD=Бот - Altavista.com
Scooter-3.0.VNS=Бот - Altavista.com
Scooter-3.0QI=Бот - Altavista.com
Scooter-3.2.BT=Бот - Altavista.com
Scooter-3.2.DIL=Бот - Altavista.com
Scooter-3.2.EX=Бот - Altavista.com
Scooter-3.2.JT=Бот - Altavista.com
Scooter-3.2.NIV=Бот - Altavista.com
Scooter-3.2.SF0=Бот - Altavista.com
Scooter-3.2.snippet=Бот - Altavista.com
Scooter-3.2=Бот - Altavista.com
Scooter-3.3dev=Бот - Altavista.com
Scooter-ARS-1.1=Бот - Altavista.com
Scooter-ARS-1.1-ih=Бот - Altavista.com
scooter-venus-3.0.vns=Бот - Altavista.com
Scooter-W3.1.2=Бот - Altavista.com
Scooter-W3-1.0=Бот - Altavista.com
Scrubby/=Бот - Scrubtheweb.com
search.at V1.2=Бот - Search.at
search.ch V1.4.2=Бот - Search.ch
search.ch V1.4=Бот - Search.ch
SearchExpress Spider0.99=Бот - SearchExpress.com
Searchit-Now Robot/2.2 (+http://www.searchit-now.co.uk)=Бот - Searchit-now.co.uk
Searchit-Now Robot/2.2=Бот - Searchit-now.co.uk
SearchSpider.com/1.1=Бот - Searchspider.com
Searchspider/=Бот - Searchspider.com
Searchspider/1.2=Бот - Searchspider.com

[Serberg]

Продолжение:
sebastien.ailleret @ inria.fr=Бот - Inria.fr
Seeker.lookseek.com=Бот - Lookseek.com
SeznamBot/1.0=Бот - Seznam.cz
SeznamBot/1.0 (+http://fulltext.seznam.cz/)=Бот - Seznam.cz
Shark=Бот - Openfind.com
sherlock_spider=Бот - Sherlock.com.cn
SightQuestBot/=Бот - Sightquest.com
SiteSpider +(http://www.SiteSpider.com/)=Бот - Sitespider.com
SiteSpider=Бот - Sitespider.com
SiteXpert=Бот - Xtreeme.com
Skampy/0.9.x=Бот - Skaffe.com
Skimpy/0.x=Бот - Skaffe.com
Slarp/0.1=Бот - Only.com
Slider_Search_v1-de=Бот - Slider.com
Slurp=Бот - Yahoo
Slurp.so/1.0=Бот - Yahoo.com
Slurp/2.0j=Бот - Yahoo.com
Slurp/2.0-KiteHourly=Бот - Yahoo.com
Slurp/2.0-OwlWeekly=Бот - Yahoo.com
Slurp/3.0-AU=Бот - Yahoo.com
slurp @ inktomi.com=Бот - Yahoo.com
slurp@inktomi=Бот - Yahoo.com
Slurp=Бот - Yahoo.com
SlySearch/1.0=Бот - Turnitin.com
SlySearch/1.x=Бот - Turnitin.com
SlySearch=Бот - Turnitin.com
SpaceBison=Бот - SpaceBison
speedfind ramBot xtreme 8.1=Бот - Speedfind.de
speedfind ramBot xtreme=Бот - Speedfind.de
Speedy Spider=Бот - EntireWeb.com
Speedy Spider (Beta/x.x; speedy @ entireweb.com)=Бот - EntireWeb.com
Speedy_Spider (http://www.entireweb.com)=Бот - EntireWeb.com
Speedy_Spider=Бот - EntireWeb.com
Spida/0.1=Бот - Only.com
Spider TraficDublu=Бот - Traficdublu.ro
Spider/maxbot.com admin @ maxbot.com=Бот - Maxbot.com
Spider/maxbot.com=Бот - Maxbot.com
spider @ aeneid.com=Бот - Yahoo.com
Spider_Monkey/=Бот - Spidermonkey.ca
spider_monkey=Бот - Spidermonkey.ca
SpiderMonkey/7.x=Бот - Spidermonkey.ca
Sqworm/2.9.81-BETA (beta_release; 20011102-760; i686-pc-linux-gnu)=Бот - Aol.com
Sqworm=Бот - Aol.com
StackRambler=Бот - StackRambler
Steeler/1.x (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)=Бот - Steeler Bot
Steeler/1.x=Бот - Steeler Bot
Steeler=Бот - Steeler Bot
Suchbot=Бот - Suchbot.de
Suchknecht.at-Robot=Бот - Suchknecht.at
super-robot @ super.navi.ocn.ne.jp=Бот - Navi.ocn.ne.jp
support @ canseek.ca=Бот - Canseek.ca
Surfnomore Spider v1.1=Бот - Surfnomore.com
SwissSearch V1.2=Бот - SwissSearch
SynoBot=Бот - Synomia.fr
TaWWWantula=Бот - TaWWWantula
teoma_admin @ hawkholdings.com=Бот - Teoma.com
teoma_agent1=Бот - Teoma.com
TeraCrawl=Бот - TeraCrawl
Teradex_Mapper=Бот - Mapper.teradex.com
The Informant=Бот - The Informant
TheSuBot/0.1 (www.thesubot.de)=Бот - TheSuBot.de
TheSuBot/0.1=Бот - TheSuBot.de
Toutatis 2.5-2=Бот - Hoppa.com
Toutatis 3.3 (hoppa.com)=Бот - Hoppa.com
Toutatis 4-19.6 (hoppa.com)=Бот - Hoppa.com
TurnitinBot/x.x (http://www.turnitin.com/robot/crawlerinfo.html)=Бот - Turnitin.com
TurnitinBot/x.x=Бот - Turnitin.com
TurnitinBot=Бот - Turnitin.com
Tutorial Crawler=Бот - Tutorgig.com
TurtleScanner=Бот - TurtleScanner
Tv<nn>_Merc_resh_26_1_D-1.0=Бот - Altavista.com
Tv<nn>_Merc_resh_26_1_D-1.0=Бот - Altavista.com
TygoBot=Бот - Tygo.com
UCmore=Бот - Ucmore.com
UdmSearch=Бот - Mnogosearch.org
UK Searcher Spider=Бот - Uksearcher.co.uk
Ultraseek=Бот - Infoseek.com
unlostBot=Бот - Unlost.com
updated/0.1beta=Бот - Updated.com
URLBlaze=Бот - Urlblaze.net
UrlScope=Бот - UrlScope
Vagabondo/1.x MT (webagent@wise-guys.nl)=Бот - Wise-guys.nl
Vagabondo/2.0 MT (webagent at wise-guys dot nl)=Бот - Wise-guys.nl
Vagabondo/2.0 MT (webagent@NOSPAMwise-guys.nl)=Бот - Wise-guys.nl
Vagabondo/2.0 MT=Бот - Wise-guys.nl
Vagabondo=Бот - Wise-guys.nl
Vampire=Бот - NetVampire
vspider=Бот - Verity.com
What You Seek=Бот - WhatYouSeek
WhatUSeek=Бот - What You Seek
webbandit/4.xx.0=Бот - WebBandit
Webbandit=Бот - WebBandit
Webclipping.com=Бот - WebClipping.com
webcollage/1.xx=Бот - WebCollage.com
webcollage=Бот - WebCollage.com
WebCompass=Бот - WebCompass
WebCrawler=Бот - Fast
WebCrawler/3.0 Robot libwww/5.0a=Бот - WebCrawler
WebCrawler/3.7/FirstPage=Бот - Altheweb.com
WebCrawler-AddURL/2.0=Бот - WebCrawler
WebFindBot(http://www.web-find.com)=Бот - Web-find.com
WebFindBot=Бот - Web-find.com
Webgate=Бот - libwww.Webgate
WebGather=Бот - WebGather
WebGenie=Бот - WebGenie
webmaster @ intags.de=Бот - Intags.de
whatUseek_winona/3.0=Бот - Whatuseek.com
WebZIP=Бот - WebZIP
whatuseek=Бот - Whatuseek.com
WhizBang! Lab=Бот - Whizbanglabs.com
WIRE WebRefiner=Бот - Wire.co.uk
wisenutbot=Бот - Looksmart.com
WSCbot=Бот - WorldSearchCenter.com
W3C_Validator=Бот - libwww.W3C_Validator
www.inktomisearch.com=Бот - Yahoo.com
www.WebWombat.com.au=Бот - W...bat.com.au
YahooSeeker/CafeKelsa=Бот - Yahoo.com
Yahoo!=Бот - Yahoo
Yahoo-MMCrawler=Бот - Yahoo-MMCrawler
Yahoo Web Pages: Googlebot
Yandex=Бот - Yandex
Yellopet-Spider=Бот - YellowPet.com
YottaShopping_Bot/4.12=Бот - YottaShopping.com
Zao/0.1 (http://www.kototoi.org/zao/)=Бот - Zao Bot
Zao/0.1=Бот - Zao Bot
Zao/0.2=Бот - Zao Bot
Zao-Crawler=Бот - Zao Bot
Zippy v2.0 - Zippyfinder.com=Бот - Zippyfinder.com
ZipppBot=Бот - ZipppBot
ZunZun=Бот - ZunZun
ZyBorg=Бот - Wisenut.com
zyborg@looksmart=Бот - WiseNut
0.1_hseo(at)cs.rutgers.edu=Бот - Rutgers.edu
/1.0=Бот - Bisnisseek.com