PGTS PGTS Pty. Ltd.   ACN: 007 008 568

point Site Navigation



   Download Kubuntu Today

   Ubuntu

   The Power Of KDE + Ubuntu







Last Updated: 17-Oct-2010 14:21 UTC

List of Robots Ordered by Robot (Visits)


Click Here For:    Agent Switchboard

Change Order:   Order by robot name     Show values as percent


Browser Oct Sep Aug Jul Jun May Apr Mar Feb Jan Dec Nov
unknown crawler 557 918 890 1316 1044 816 840 626 581 996 1033 683
SemrushBot 231 650 399 520 685 686 353 835 327 303 642 521
YandexBot 226 323 445 188 269 286 338 287 323 279 292 2
Googlebot 150 161 193 212 174 125 131 178 154 146 171 163
MJ12bot 136 153 244 136 77 42 43 50 30 21 26 28
python-requests 132 120 65 63 70 71 95 55 86 67 66 87
unknown 96 717 481 927 720 179 117 118 112 152 146 122
MojeekBot 29 35 31 51 43 38 15 49 45 57 67 51
curl 29 19 33 51 48 200 232 236 118 325 37 32
AhrefsBot 25 41 100 41 27 41 6 33 509 8 1 209
DotBot 22 22 10 10 3 33 83 46 54 51 38 29
AliyunSecBot 16 31 0 43 29 5 0 0 0 0 6 0
ZoominfoBot 13 14 22 15 30 5 0 0 0 11 28 39
Orbbot 12 3 0 7 5 0 5 6 4 5 19 5
DataForSeoBot 9 8 8 9 10 11 7 10 5 12 9 8
IbouBot 9 13 1 0 0 0 0 0 0 0 0 0
Baiduspider 7 5 5 2 5 3 2 2 0 0 0 0
Python-urllib 6 2 1 2 1 2 0 0 0 0 1 0
Baiduspider 6 1 1 1 2 2 1 3 2 1 1 2
ev-crawler 6 2 6 4 6 5 4 5 4 6 5 6
Spider 6 211 80 0 0 0 0 0 0 0 0 0
CCBot 5 5 33 7 6 1 3 4 6 7 2 8
wpbot 4 4 4 4 3 3 3 3 3 3 3 3
Java 4 0 0 0 1 1 0 0 0 0 1 2
WanScannerBot 4 2 0 2 8 6 1 0 0 1 0 0
Google-Display-Ads-Bot 4 4 8 4 2 1 0 0 0 0 0 0
CriteoBot 3 2 4 8 2 0 0 0 0 0 0 0
AwarioBot 3 18 3 9 1 6 12 0 2 8 3 3
SeznamBot 3 3 0 8 4 2 6 6 3 6 7 3
DomainStatsBot 3 1 1 1 1 1 1 1 1 1 1 1
LWP Script 2 1 0 1 0 0 3 4 2 0 0 0
yacybot 2 0 0 1 0 0 2 2 2 2 6 1
CFNetwork 2 0 0 1 2 0 6 0 8 6 5 1
SurdotlyBot 1 1 2 1 1 1 0 0 0 0 0 0
Thinkbot 1 7 0 146 52 0 0 0 0 0 0 0
TurnitinBot 1 0 0 0 0 0 0 0 0 0 0 0
GoParserBot 1 1 1 1 0 0 0 0 0 0 0 0
Proximic Spider 1 2 7 3 0 0 0 0 0 0 0 0
VelenPublicWebCrawler 1 0 1 0 1 0 1 0 0 0 1 0
KhazandeBot 1 0 0 0 0 0 0 0 0 0 0 0
NiueBot 1 0 0 0 0 0 0 0 0 0 0 0
LinkupBot 1 0 0 0 0 0 0 0 0 0 0 0
SEMrushBot 1 1 1 1 0 0 1 1 1 0 1 0
Google Web Preview 1 0 0 0 1 0 0 0 1 0 0 1
BitSightBot 0 6 2 6 4 3 3 3 2 2 4 4
crawler 0 4 8 6 0 0 0 0 0 0 0 0
Wget 0 3 2 6 5 1 0 0 0 0 0 0
BLEXBot 0 2 10 11 5 3 0 0 1 3 2 4
HaloBot 0 2 0 0 0 0 0 0 0 0 0 0
t3versionsBot 0 1 0 0 0 0 0 0 0 0 1 0
serpstatbot 0 1 0 2 0 0 1 0 0 2 0 0
DomCopBot 0 1 0 4 2 0 0 0 0 0 0 0
Xenu Link Sleuth 0 1 0 0 0 0 0 1 3 0 0 0
AmazonAdBot 0 1 0 0 0 0 0 0 0 0 0 0
HawaiiBot 0 0 3 17 0 0 0 0 0 0 0 0
WadooBot 0 0 3 1 0 0 0 0 0 0 0 0
WebwikiBot 0 0 2 1 0 1 0 1 0 0 0 0
YandexRenderResourcesBot 0 0 2 0 0 1 0 0 0 0 2 0
GammaLiveCrawlBot 0 0 2 0 0 0 0 0 0 0 0 0
facebookexternalhit 0 0 1 0 2 16 7 41 29 30 32 39
NutchBot 0 0 1 0 0 0 0 1 0 0 1 2
peer39_crawler 0 0 1 0 0 0 0 0 0 0 0 0
WadooImageBot 0 0 0 2 0 0 0 0 0 0 0 0
imageSpider 0 0 0 0 4 0 0 0 0 0 0 0
archive.org_bot 0 0 0 0 2 0 0 6 0 0 0 0
Twitterbot 0 0 0 0 1 0 0 0 0 0 0 0
URLProcessor-v12-Crawler 0 0 0 0 1 0 0 0 0 0 0 0
Gaisbot 0 0 0 0 1 0 0 0 0 0 0 0
Facebot 0 0 0 0 1 1 0 0 0 0 1 0
StartmeBot 0 0 0 0 0 1 0 0 0 0 0 0
mithril-crawler 0 0 0 0 0 0 3 0 0 0 0 0
msnbot 0 0 0 0 0 0 1 0 0 0 0 0
bingbot 0 0 0 0 0 0 1 0 1 0 0 0
Timpibot 0 0 0 0 0 0 1 0 0 0 0 0
Sengine crawler 0 0 0 0 0 0 0 2 0 0 0 0
Qwantbot 0 0 0 0 0 0 0 2 0 4 0 0
BingPreview 0 0 0 0 0 0 0 1 0 0 0 0
JSACrawlerBot 0 0 0 0 0 0 0 1 0 0 0 0
Mail.RU_Bot 0 0 0 0 0 0 0 1 0 0 0 0
Brightbot 0 0 0 0 0 0 0 0 1 0 0 0
WordPress 0 0 0 0 0 0 0 0 0 2 0 0
centurybot 0 0 0 0 0 0 0 0 0 1 0 0
W3C_Validator 0 0 0 0 0 0 0 0 0 0 1 0
Yeti 0 0 0 0 0 0 0 0 0 0 1 0
LightspeedSystemsCrawler 0 0 0 0 0 0 0 0 0 0 1 0
Exabot 0 0 0 0 0 0 0 0 0 0 1 0
Bytespider 0 0 0 0 0 0 0 0 0 0 0 16
TenMillionDomainsBot 0 0 0 0 0 0 0 0 0 0 0 1
Bingbot 0 0 0 0 0 0 0 0 0 0 0 1
IABot 0 0 0 0 0 0 0 0 0 0 0 1
Total 1773 3523 3117 3852 3361 2599 2328 2620 2420 2518 2665 2078