PGTS PGTS Pty. Ltd.   ACN: 007 008 568

point Site Navigation



   Stop The Internet Filter!

   No Clean Feed

   The Internet Filter Is An Ex-parrot!







Last Updated: 17-Oct-2010 14:21 UTC

List of Robots Ordered by Robot (Visits)


Click Here For:    Agent Switchboard

Change Order:   Order by robot name     Show values as percent


Browser Jun May Apr Mar Feb Jan Dec Nov Oct Sep Aug Jul
SemrushBot 1584 1851 1622 684 498 772 812 655 366 650 399 520
unknown crawler 670 855 906 1116 725 1038 1015 1027 641 918 890 1316
MJ12bot 272 264 300 308 182 240 230 275 159 153 244 136
Googlebot 259 354 391 284 264 235 246 235 230 161 193 212
YandexBot 232 592 353 410 643 385 427 366 308 323 445 188
curl 128 200 102 20 14 20 22 25 36 19 33 51
Baiduspider 106 104 145 166 169 470 0 1 6 1 1 1
python-requests 73 99 107 86 77 81 107 51 140 120 65 63
AhrefsBot 37 44 107 100 186 140 105 35 31 41 100 41
GenomeCrawler 32 12 5 18 7 0 0 0 0 0 0 0
SERankingBacklinksBot 29 72 62 51 14 36 20 0 0 0 0 0
Baiduspider 27 6 20 48 42 93 0 0 7 5 5 2
CriteoBot 21 33 49 30 11 8 1 4 5 2 4 8
crawler 16 14 17 6 5 16 4 1 15 4 8 6
Spider 14 0 9 2 0 0 0 0 6 211 80 0
AwarioBot 10 0 0 7 22 14 3 22 6 18 3 9
wpbot 9 12 11 9 5 5 4 4 4 4 4 4
CCBot 8 11 6 5 5 4 6 17 6 5 33 7
Orbbot 7 0 2 1 0 0 3 0 12 3 0 7
DotBot 7 50 49 76 1 43 45 17 27 22 10 10
AffsignalCrawler 7 1 0 0 0 0 0 0 0 0 0 0
SurdotlyBot 7 6 1 0 2 3 11 2 1 1 2 1
Timpibot 6 10 10 8 0 0 0 0 0 0 0 0
unknown 5 9 4 5 3 3 3 3 97 717 481 927
DataForSeoBot 5 5 8 5 14 6 15 7 9 8 8 9
WordPress 4 0 0 0 0 0 0 0 0 0 0 0
Exabot 4 17 16 0 0 0 1 0 0 0 0 0
HaloBot 3 0 0 2 3 3 0 0 2 2 0 0
MakeWebSalesBot 3 5 2 0 0 0 0 0 0 0 0 0
SeznamBot 3 9 11 5 1 5 5 5 4 3 0 8
ZoominfoBot 3 3 5 4 3 7 14 13 15 14 22 15
Google-Display-Ads-Bot 3 5 4 4 4 4 5 5 5 4 8 4
ev-crawler 3 5 6 5 5 4 5 3 7 2 6 4
PerplexityBot 2 2 0 0 0 0 0 0 0 0 0 0
gwf-carbon-txt-crawler 2 0 0 0 0 0 0 0 0 0 0 0
AliyunSecBot 2 2 0 2 4 45 31 0 18 31 0 43
FetchDonkeyBot 2 0 0 0 0 0 0 0 0 0 0 0
MojeekBot 1 2 4 5 12 17 16 15 30 35 31 51
bingbot 1 4 0 0 0 0 0 1 0 0 0 0
NVBot 1 1 0 0 0 0 0 0 0 0 0 0
Amazonbot 1 0 1 0 0 0 0 0 0 0 0 0
SaaSBrowserBot 1 0 0 1 0 0 0 0 0 0 0 0
ProductLookoutBot 1 0 0 1 0 0 0 0 0 0 0 0
Applebot 1 2 0 0 0 0 0 0 0 0 0 0
DuckDuckBot 1 1 0 0 0 0 0 0 0 0 0 0
CFNetwork 1 0 1 0 0 0 1 2 2 0 0 1
SEMrushBot 1 2 3 4 3 3 1 2 1 1 1 1
ClaudeBot 1 2 0 0 0 0 0 0 0 0 0 0
DataDingoBot 1 0 0 0 0 0 0 0 0 0 0 0
LWP Script 1 2 1 0 0 1 0 1 2 1 0 1
OAI-SearchBot 1 3 0 0 0 0 0 0 0 0 0 0
TenMillionDomainsBot 1 0 0 0 0 0 0 0 0 0 0 0
PricedroneShoppingBot 1 0 0 0 0 0 0 0 0 0 0 0
CCMetaBot 1 0 0 0 0 0 0 0 0 0 0 0
IntercomDetectBot 1 0 0 0 0 0 0 0 0 0 0 0
BrokenLinksBot 0 24 24 0 0 0 0 0 0 0 0 0
WebTrackrCrawler 0 19 1 0 0 0 0 0 0 0 0 0
ContactGraphBot 0 3 1 0 0 0 0 0 0 0 0 0
YouBot 0 3 0 0 0 0 0 0 0 0 0 0
EveryTabBot 0 3 0 0 0 0 0 0 0 0 0 0
heritrix 0 3 0 0 0 0 0 0 0 0 0 0
TobavaBot 0 2 1 0 0 0 0 0 0 0 0 0
Wget 0 2 1 0 11 6 12 1 0 3 2 6
ris-bot 0 2 0 0 0 0 0 0 0 0 0 0
xAI-SearchBot 0 2 0 0 0 0 0 0 0 0 0 0
serpstatbot 0 1 0 1 0 0 1 0 0 1 0 2
Java 0 1 3 1 1 8 20 3 4 0 0 0
OI-Crawler 0 1 1 0 0 0 0 0 0 0 0 0
cis5550-crawler 0 1 0 0 0 0 0 0 0 0 0 0
FeedFetcher-Google 0 1 0 0 0 0 0 0 0 0 0 0
DeepSeekBot 0 1 0 0 0 0 0 0 0 0 0 0
Thinkbot 0 1 0 0 1 2 1 3 2 7 0 146
yacybot 0 1 0 0 1 1 0 0 2 0 0 1
ImageMetaBot 0 1 0 0 0 0 0 0 0 0 0 0
TheduCrawler 0 1 0 0 0 0 0 0 0 0 0 0
BingPreview 0 1 0 1 0 1 0 0 0 0 0 0
CohereBot 0 1 0 0 0 0 0 0 0 0 0 0
Brightbot 0 1 0 0 0 0 0 0 0 0 0 0
facebookexternalhit 0 1 1 2 0 0 1 0 0 0 1 0
Python-urllib 0 0 5 0 0 0 0 0 6 2 1 2
ZeroBot 0 0 3 0 0 0 0 0 0 0 0 0
research-crawler 0 0 3 0 0 0 0 0 0 0 0 0
EECS498-CELSearchEngineCrawler 0 0 2 0 0 0 0 0 0 0 0 0
MineBot 0 0 2 0 0 0 0 0 0 0 0 0
FacebookBot 0 0 1 0 0 0 0 0 0 0 0 0
UMichSearchEngineCrawler 0 0 1 0 0 0 0 0 0 0 0 0
VelenPublicWebCrawler 0 0 1 0 0 0 0 1 1 0 1 0
Proximic Spider 0 0 1 1 0 0 0 1 1 2 7 3
vague-crawler 0 0 1 0 0 0 0 0 0 0 0 0
W3C_Validator 0 0 1 2 0 0 0 0 1 0 0 0
Xenu Link Sleuth 0 0 1 0 0 0 0 0 0 1 0 0
MyWebCrawler 0 0 1 0 0 0 0 0 0 0 0 0
BingIndexCrawler 0 0 0 5 2 0 0 0 0 0 0 0
YandexRenderResourcesBot 0 0 0 4 0 0 3 2 0 0 2 0
IbouBot 0 0 0 3 114 178 181 105 9 13 1 0
research crawler 0 0 0 2 0 0 0 0 0 0 0 0
SBIntuitionsBot 0 0 0 2 7 6 7 3 13 0 0 0
DuckAssistBot 0 0 0 2 0 0 0 2 0 0 0 0
HenkBot 0 0 0 2 0 0 0 0 0 0 0 0
YahooBot 0 0 0 1 0 0 1 1 0 0 0 0
IABot 0 0 0 1 0 0 0 0 0 0 0 0
TechCrawler 0 0 0 1 0 0 0 0 0 0 0 0
DirectoryBot 0 0 0 1 0 0 0 0 0 0 0 0
research-bot 0 0 0 0 2 0 0 0 0 0 0 0
ResearchBot 0 0 0 0 1 0 0 0 0 0 0 0
DomainStatsBot 0 0 0 0 1 1 0 0 3 1 1 1
msnbot 0 0 0 0 1 0 0 0 0 0 0 0
expo-research-bot 0 0 0 0 0 68 0 0 0 0 0 0
Google Web Preview 0 0 0 0 0 1 0 0 1 0 0 0
Ask Jeeves 0 0 0 0 0 1 0 0 0 0 0 0
BLEXBot 0 0 0 0 0 0 2 9 0 2 10 11
archive.org_bot 0 0 0 0 0 0 2 7 0 0 0 0
WanScannerBot 0 0 0 0 0 0 1 0 4 2 0 2
Facebot 0 0 0 0 0 0 1 0 0 0 0 0
browse-crawler 0 0 0 0 0 0 1 0 0 0 0 0
Buddybot 0 0 0 0 0 0 0 3 0 0 0 0
ZenixOpsBot 0 0 0 0 0 0 0 1 0 0 0 0
BitSightBot 0 0 0 0 0 0 0 0 1 6 2 6
GoParserBot 0 0 0 0 0 0 0 0 1 1 1 1
NiueBot 0 0 0 0 0 0 0 0 1 0 0 0
TurnitinBot 0 0 0 0 0 0 0 0 1 0 0 0
KhazandeBot 0 0 0 0 0 0 0 0 1 0 0 0
LinkupBot 0 0 0 0 0 0 0 0 1 0 0 0
DomCopBot 0 0 0 0 0 0 0 0 0 1 0 4
AmazonAdBot 0 0 0 0 0 0 0 0 0 1 0 0
t3versionsBot 0 0 0 0 0 0 0 0 0 1 0 0
HawaiiBot 0 0 0 0 0 0 0 0 0 0 3 17
WadooBot 0 0 0 0 0 0 0 0 0 0 3 1
WebwikiBot 0 0 0 0 0 0 0 0 0 0 2 1
GammaLiveCrawlBot 0 0 0 0 0 0 0 0 0 0 2 0
NutchBot 0 0 0 0 0 0 0 0 0 0 1 0
peer39_crawler 0 0 0 0 0 0 0 0 0 0 1 0
WadooImageBot 0 0 0 0 0 0 0 0 0 0 0 2
Total 3623 4748 4396 3510 3066 3974 3392 2936 2251 3523 3117 3852