PGTS PGTS Pty. Ltd.   ACN: 007 008 568

point Site Navigation



   Stop The Internet Filter!

   No Clean Feed

   The Internet Filter Is An Ex-parrot!







Last Updated: 17-Oct-2010 14:21 UTC

List of Robots Ordered by Robot (Visits)


Click Here For:    Agent Switchboard

Change Order:   Order by robot name     Show values as percent


Browser Jun May Apr Mar Feb Jan Dec Nov Oct Sep Aug Jul
unknown crawler 432 816 840 626 581 996 1033 683 721 778 815 761
SemrushBot 416 686 353 835 327 303 642 521 562 413 1084 1139
unknown 179 179 117 118 112 152 146 122 96 72 26 3
YandexBot 162 286 338 287 323 279 292 2 17 8 415 676
Googlebot 62 125 131 178 154 146 171 163 193 213 202 205
python-requests 24 71 95 55 86 67 66 87 74 214 77 97
MojeekBot 19 38 15 49 45 57 67 51 46 29 33 35
curl 15 200 232 236 118 325 37 32 17 17 20 21
AliyunSecBot 14 5 0 0 0 0 6 0 0 0 0 0
MJ12bot 14 42 43 50 30 21 26 28 40 96 84 113
ZoominfoBot 14 5 0 0 0 11 28 39 20 21 28 23
WanScannerBot 8 6 1 0 0 1 0 0 0 0 0 0
CCBot 4 1 3 4 6 7 2 8 7 6 1 1
Orbbot 3 0 5 6 4 5 19 5 7 7 13 12
wpbot 3 3 3 3 3 3 3 3 3 3 6 4
SeznamBot 3 2 6 6 3 6 7 3 2 7 5 3
Baiduspider 3 3 2 2 0 0 0 0 2 0 1 0
BitSightBot 3 3 3 3 2 2 4 4 0 0 0 0
ev-crawler 3 5 4 5 4 6 5 6 4 5 6 6
facebookexternalhit 2 16 7 41 29 30 32 39 988 2776 2352 60
DataForSeoBot 2 11 7 10 5 12 9 8 8 4 14 6
DotBot 1 33 83 46 54 51 38 29 15 23 62 12
CFNetwork 1 0 6 0 8 6 5 1 1 3 4 4
Java 1 1 0 0 0 0 1 2 2 1 1 0
BLEXBot 1 3 0 0 1 3 2 4 3 7 9 3
SurdotlyBot 1 1 0 0 0 0 0 0 0 0 0 0
Baiduspider 1 2 1 3 2 1 1 2 2 1 1 1
URLProcessor-v12-Crawler 1 0 0 0 0 0 0 0 0 0 0 0
archive.org_bot 1 0 0 6 0 0 0 0 6 0 0 0
AhrefsBot 0 41 6 33 509 8 1 209 11 13 1089 1248
AwarioBot 0 6 12 0 2 8 3 3 8 6 4 10
Python-urllib 0 2 0 0 0 0 1 0 0 1 0 0
StartmeBot 0 1 0 0 0 0 0 0 0 0 0 0
WebwikiBot 0 1 0 1 0 0 0 0 0 1 0 0
Wget 0 1 0 0 0 0 0 0 0 16 1 0
Google-Display-Ads-Bot 0 1 0 0 0 0 0 0 0 0 0 0
Facebot 0 1 0 0 0 0 1 0 0 0 0 0
YandexRenderResourcesBot 0 1 0 0 0 0 2 0 0 0 0 0
DomainStatsBot 0 1 1 1 1 1 1 1 1 1 0 0
mithril-crawler 0 0 3 0 0 0 0 0 0 0 0 0
LWP Script 0 0 3 4 2 0 0 0 0 0 2 0
yacybot 0 0 2 2 2 2 6 1 0 3 0 0
SEMrushBot 0 0 1 1 1 0 1 0 0 1 0 0
msnbot 0 0 1 0 0 0 0 0 0 1 0 0
bingbot 0 0 1 0 1 0 0 0 2 0 1 2
serpstatbot 0 0 1 0 0 2 0 0 2 0 0 1
Timpibot 0 0 1 0 0 0 0 0 0 0 0 0
VelenPublicWebCrawler 0 0 1 0 0 0 1 0 0 0 0 0
Sengine crawler 0 0 0 2 0 0 0 0 0 0 0 0
Qwantbot 0 0 0 2 0 4 0 0 0 0 0 0
NutchBot 0 0 0 1 0 0 1 2 35 15 1 0
BingPreview 0 0 0 1 0 0 0 0 0 0 0 0
Xenu Link Sleuth 0 0 0 1 3 0 0 0 0 0 2 0
JSACrawlerBot 0 0 0 1 0 0 0 0 0 0 0 0
Mail.RU_Bot 0 0 0 1 0 0 0 0 0 0 0 0
Google Web Preview 0 0 0 0 1 0 0 1 0 0 0 0
Brightbot 0 0 0 0 1 0 0 0 0 0 0 0
WordPress 0 0 0 0 0 2 0 0 0 0 0 0
centurybot 0 0 0 0 0 1 0 0 0 0 0 0
t3versionsBot 0 0 0 0 0 0 1 0 0 0 0 0
W3C_Validator 0 0 0 0 0 0 1 0 1 1 0 1
Yeti 0 0 0 0 0 0 1 0 0 0 0 7
LightspeedSystemsCrawler 0 0 0 0 0 0 1 0 0 0 0 0
Exabot 0 0 0 0 0 0 1 0 0 0 0 0
Bytespider 0 0 0 0 0 0 0 16 51 43 3806 1990
TenMillionDomainsBot 0 0 0 0 0 0 0 1 1 0 0 0
Bingbot 0 0 0 0 0 0 0 1 0 0 1 0
IABot 0 0 0 0 0 0 0 1 0 0 0 0
HawaiiBot 0 0 0 0 0 0 0 0 3 0 0 0
StractBot 0 0 0 0 0 0 0 0 0 1 0 0
Python libcurl 0 0 0 0 0 0 0 0 0 1 1 2
YahooBot 0 0 0 0 0 0 0 0 0 1 0 0
Microsoft URL Control 0 0 0 0 0 0 0 0 0 1 0 0
ChatGLM-Spider 0 0 0 0 0 0 0 0 0 1 3 0
heritrix 0 0 0 0 0 0 0 0 0 0 1 0
Gabanzabot 0 0 0 0 0 0 0 0 0 0 1 0
TurnitinBot 0 0 0 0 0 0 0 0 0 0 0 1
Total 1393 2599 2328 2620 2420 2518 2665 2078 2951 4811 10172 6447