PGTS PGTS Pty. Ltd.   ACN: 007 008 568

point Site Navigation



   Stop The Internet Filter!

   No Clean Feed

   The Internet Filter Is An Ex-parrot!







Last Updated: 17-Oct-2010 14:21 UTC

List of Robots Ordered by Robot (Visits)


Click Here For:    Agent Switchboard

Change Order:   Order by robot name     Show values as percent


Browser Jan Dec Nov Oct Sep Aug Jul Jun May Apr Mar Feb
unknown crawler 790 1015 1026 641 918 890 1316 1044 816 840 626 581
SemrushBot 610 812 655 366 650 399 520 685 686 353 835 327
Baiduspider 337 0 1 6 1 1 1 2 2 1 3 2
YandexBot 317 427 366 308 323 445 188 269 286 338 287 323
MJ12bot 185 230 275 159 153 244 136 77 42 43 50 30
Googlebot 176 246 235 230 161 193 212 174 125 131 178 154
AhrefsBot 123 105 35 31 41 100 41 27 41 6 33 509
IbouBot 120 181 105 9 13 1 0 0 0 0 0 0
python-requests 68 107 51 140 120 65 63 70 71 95 55 86
Baiduspider 68 0 0 7 5 5 2 5 3 2 2 0
AliyunSecBot 45 31 0 18 31 0 43 29 5 0 0 0
DotBot 43 45 17 27 22 10 10 3 33 83 46 54
SERankingBacklinksBot 30 20 0 0 0 0 0 0 0 0 0 0
curl 14 22 25 36 19 33 51 48 200 232 236 118
MojeekBot 13 16 15 30 35 31 51 43 38 15 49 45
crawler 12 4 1 15 4 8 6 0 0 0 0 0
CriteoBot 7 1 4 5 2 4 8 2 0 0 0 0
Wget 6 12 1 0 3 2 6 5 1 0 0 0
ZoominfoBot 5 14 13 15 14 22 15 30 5 0 0 0
SeznamBot 5 5 5 4 3 0 8 4 2 6 6 3
wpbot 5 4 4 4 4 4 4 3 3 3 3 3
ev-crawler 4 5 3 7 2 6 4 6 5 4 5 4
CCBot 4 6 17 6 5 33 7 6 1 3 4 6
Google-Display-Ads-Bot 3 5 5 5 4 8 4 2 1 0 0 0
SBIntuitionsBot 3 7 3 13 0 0 0 0 0 0 0 0
AwarioBot 3 3 22 6 18 3 9 1 6 12 0 2
SEMrushBot 3 1 2 1 1 1 1 0 0 1 1 1
unknown 3 3 4 97 717 481 927 720 179 117 118 112
Java 2 20 3 4 0 0 0 1 1 0 0 0
Thinkbot 2 1 3 2 7 0 146 52 0 0 0 0
HaloBot 2 0 0 2 2 0 0 0 0 0 0 0
DataForSeoBot 2 15 7 9 8 8 9 10 11 7 10 5
BingPreview 1 0 0 0 0 0 0 0 0 0 1 0
DomainStatsBot 1 0 0 3 1 1 1 1 1 1 1 1
Ask Jeeves 1 0 0 0 0 0 0 0 0 0 0 0
SurdotlyBot 1 11 2 1 1 2 1 1 1 0 0 0
yacybot 1 0 0 2 0 0 1 0 0 2 2 2
YandexRenderResourcesBot 0 3 2 0 0 2 0 0 1 0 0 0
Orbbot 0 3 0 12 3 0 7 5 0 5 6 4
BLEXBot 0 2 9 0 2 10 11 5 3 0 0 1
archive.org_bot 0 2 7 0 0 0 0 2 0 0 6 0
CFNetwork 0 1 2 2 0 0 1 2 0 6 0 8
facebookexternalhit 0 1 0 0 0 1 0 2 16 7 41 29
Exabot 0 1 0 0 0 0 0 0 0 0 0 0
browse-crawler 0 1 0 0 0 0 0 0 0 0 0 0
serpstatbot 0 1 0 0 1 0 2 0 0 1 0 0
WanScannerBot 0 1 0 4 2 0 2 8 6 1 0 0
YahooBot 0 1 1 0 0 0 0 0 0 0 0 0
Facebot 0 1 0 0 0 0 0 1 1 0 0 0
Buddybot 0 0 3 0 0 0 0 0 0 0 0 0
DuckAssistBot 0 0 2 0 0 0 0 0 0 0 0 0
LWP Script 0 0 1 2 1 0 1 0 0 3 4 2
Proximic Spider 0 0 1 1 2 7 3 0 0 0 0 0
VelenPublicWebCrawler 0 0 1 1 0 1 0 1 0 1 0 0
bingbot 0 0 1 0 0 0 0 0 0 1 0 1
ZenixOpsBot 0 0 1 0 0 0 0 0 0 0 0 0
Python-urllib 0 0 0 6 2 1 2 1 2 0 0 0
Spider 0 0 0 6 211 80 0 0 0 0 0 0
NiueBot 0 0 0 1 0 0 0 0 0 0 0 0
GoParserBot 0 0 0 1 1 1 1 0 0 0 0 0
Google Web Preview 0 0 0 1 0 0 0 1 0 0 0 1
BitSightBot 0 0 0 1 6 2 6 4 3 3 3 2
KhazandeBot 0 0 0 1 0 0 0 0 0 0 0 0
TurnitinBot 0 0 0 1 0 0 0 0 0 0 0 0
W3C_Validator 0 0 0 1 0 0 0 0 0 0 0 0
LinkupBot 0 0 0 1 0 0 0 0 0 0 0 0
t3versionsBot 0 0 0 0 1 0 0 0 0 0 0 0
DomCopBot 0 0 0 0 1 0 4 2 0 0 0 0
Xenu Link Sleuth 0 0 0 0 1 0 0 0 0 0 1 3
AmazonAdBot 0 0 0 0 1 0 0 0 0 0 0 0
HawaiiBot 0 0 0 0 0 3 17 0 0 0 0 0
WadooBot 0 0 0 0 0 3 1 0 0 0 0 0
WebwikiBot 0 0 0 0 0 2 1 0 1 0 1 0
GammaLiveCrawlBot 0 0 0 0 0 2 0 0 0 0 0 0
NutchBot 0 0 0 0 0 1 0 0 0 0 1 0
peer39_crawler 0 0 0 0 0 1 0 0 0 0 0 0
WadooImageBot 0 0 0 0 0 0 2 0 0 0 0 0
imageSpider 0 0 0 0 0 0 0 4 0 0 0 0
Twitterbot 0 0 0 0 0 0 0 1 0 0 0 0
URLProcessor-v12-Crawler 0 0 0 0 0 0 0 1 0 0 0 0
Gaisbot 0 0 0 0 0 0 0 1 0 0 0 0
StartmeBot 0 0 0 0 0 0 0 0 1 0 0 0
mithril-crawler 0 0 0 0 0 0 0 0 0 3 0 0
msnbot 0 0 0 0 0 0 0 0 0 1 0 0
Timpibot 0 0 0 0 0 0 0 0 0 1 0 0
Sengine crawler 0 0 0 0 0 0 0 0 0 0 2 0
Qwantbot 0 0 0 0 0 0 0 0 0 0 2 0
JSACrawlerBot 0 0 0 0 0 0 0 0 0 0 1 0
Mail.RU_Bot 0 0 0 0 0 0 0 0 0 0 1 0
Brightbot 0 0 0 0 0 0 0 0 0 0 0 1
Total 3015 3392 2936 2251 3523 3117 3852 3361 2599 2328 2620 2420