PGTS PGTS Pty. Ltd.   ACN: 007 008 568

point Site Navigation



   Download Kubuntu Today

   Ubuntu

   The Power Of KDE + Ubuntu







Last Updated: 17-Oct-2010 14:21 UTC

List of Robots Ordered by Robot (Visits)


Click Here For:    Agent Switchboard

Change Order:   Order by robot name     Show values as percent


Browser Jul Jun May Apr Mar Feb Jan Dec Nov Oct Sep Aug
AhrefsBot 22359 34942 35069 24850 30892 33658 19716 30798 28281 31496 30916 30114
Baiduspider 6530 10739 8501 7354 8429 6177 1684 4688 8364 7620 7489 7952
bingbot 2141 3853 3615 3455 3382 2852 3159 3480 2381 3111 3021 2845
Googlebot 2129 2293 2207 1766 1885 1696 1792 1876 1906 2053 2103 2020
SemrushBot 1833 290 312 484 460 463 480 478 362 413 408 459
unknown crawler 884 2159 1115 1235 1128 914 1205 1299 1086 1162 1122 1503
unknown 520 542 564 740 937 867 740 923 945 1189 1126 1321
YandexBot 447 772 694 680 650 423 456 562 636 512 487 586
BingPreview 432 568 902 693 582 1198 777 718 877 653 638 815
facebookexternalhit 369 70 74 96 126 96 203 162 68 141 107 187
Mail.RU_Bot 339 648 793 1083 1076 1049 1089 1199 936 857 1149 991
MJ12bot 313 375 429 277 511 252 249 461 269 403 408 267
DotBot 130 165 212 493 538 302 452 452 330 435 440 427
Baiduspider 91 141 86 70 27 0 0 6 0 0 0 0
linkdexbot 88 96 114 98 116 111 106 127 133 133 148 155
CFNetwork 67 92 75 107 70 57 130 107 96 106 88 77
DuckDuckGo-Favicons-Bot 43 56 36 19 27 62 20 12 20 15 16 16
Cliqzbot 43 197 32 120 66 184 25 34 131 85 66 155
Google Web Preview 40 47 65 147 169 91 249 388 967 1141 1136 1349
SeznamBot 39 58 64 43 76 78 93 104 74 64 50 78
ltx71 33 41 142 183 134 109 122 43 38 115 45 87
Yeti 31 41 53 38 21 63 40 36 24 68 12 116
python-requests 25 23 26 22 43 27 31 74 30 14 17 21
Gluten Free Crawler 19 25 26 25 32 9 3 28 13 35 26 21
Python-urllib 14 41 37 25 16 27 14 19 16 11 14 26
CCBot 9 7 3 6 5 3 11 3 3 3 4 4
YahooCacheSystem 8 10 9 14 17 14 17 14 13 7 10 12
Pinterestbot 8 16 31 23 20 40 29 40 25 21 23 23
SEMrushBot 7 4 4 3 5 4 3 6 4 5 2 3
MojeekBot 7 14 12 17 15 7 15 5 35 18 25 25
curl 7 10 5 8 7 7 37 13 6 8 11 16
GarlikCrawler 7 35 0 21 4 7 16 7 23 8 8 17
ZoominfoBot 7 7 7 4 7 14 5 0 7 0 7 0
MauiBot 6 26 20 75 30 0 0 0 0 0 0 0
Proximic Spider 6 0 3 0 2 3 3 0 0 8 3 18
LWP Script 6 3 3 1 6 21 32 29 22 27 18 11
ia_archiver 6 4 6 9 10 6 1 6 6 4 4 2
btcrawler 5 0 2 3 7 4 0 0 3 2 4 1
archive.org_bot 5 13 185 20 11 2 3 7 3 2 8 0
DuckDuckBot 5 6 12 12 6 9 0 2 3 4 7 3
SurdotlyBot 5 6 6 3 3 4 2 3 5 3 2 3
YahooBot 4 7 13 11 18 159 222 234 211 303 281 289
Python libcurl 3 3 9 3 0 0 14 17 0 0 0 0
spbot 3 4 7 11 10 15 11 9 8 7 12 12
wget 3 8 8 9 7 6 10 7 9 11 12 8
Twitterbot 3 0 0 0 0 1 0 0 3 0 1 2
ExtLinksBot 2 11 5 13 12 10 3 8 37 55 79 27
Sengine crawler 2 0 4 0 2 0 0 0 0 0 0 2
WordPress 2 3 0 3 1 3 2 0 3 2 4 9
NutchBot 2 7 2 3 3 1 3 5 1 7 4 5
Wget 2 9 6 10 4 19 5 18 22 28 11 41
MegaIndex Crawler 1 3 3 3 3 0 2 3 3 4 4 3
EveryoneSocialBot 1 0 0 0 0 0 0 0 0 0 0 0
PaperLiBot 1 0 0 0 0 0 0 0 0 0 0 1
MBCrawler 1 1 8 0 0 2 2 0 1 0 0 0
oBot 1 1 2 1 1 1 0 1 1 1 1 2
LightspeedSystemsCrawler 1 2 2 0 2 1 0 2 1 0 0 0
Java 1 6 14 8 17 13 7 27 22 1 2 35
007ac9 Crawler 1 0 0 0 0 0 1 0 0 0 0 0
yacybot 1 4 7 5 0 6 0 0 8 4 5 7
GrapeshotCrawler 1 3 3 4 10 9 2 0 12 5 2 10
istellabot 1 1 2 1 0 1 1 2 1 0 1 1
AppEngine-Google 0 6 0 0 0 0 2 5 8 4 12 5
Companybook-Crawler 0 5 9 2 14 0 0 0 2 0 0 0
Bingbot 0 5 11 15 6 13 4 4 5 3 9 2
Knowknot 0 3 0 0 0 0 0 0 17 0 13 0
Findxbot 0 3 0 0 0 6 1 0 2 0 0 21
bl.uk_lddc_bot 0 2 0 0 0 0 0 0 0 0 0 0
Plukkie 0 2 0 5 0 0 0 0 0 0 0 0
TinEye-bot 0 1 1 0 0 0 2 2 2 1 2 8
TurnitinBot 0 1 1 2 1 1 4 2 1 0 6 1
OutclicksBot 0 1 2 5 0 3 0 0 0 0 0 0
SafeDNSBot 0 1 4 0 2 4 5 4 5 2 5 3
EarwigBot 0 1 0 0 0 0 0 0 0 0 0 0
vebidoobot 0 1 0 0 0 1 0 0 0 1 0 0
LinkedInBot 0 1 1 2 2 1 2 1 1 2 1 1
WordChampBot 0 1 0 0 0 0 1 0 0 0 0 0
NinjaBot 0 0 3 2 1 4 2 0 0 0 0 0
Xenu Link Sleuth 0 0 3 2 7 0 0 1 2 1 0 5
EasyBib AutoCite 0 0 2 0 1 0 1 1 3 3 3 1
VenusCrawler 0 0 1 2 1 0 0 0 0 2 3 1
Web-Crawler 0 0 1 0 0 0 0 0 0 0 0 0
DnyzBot 0 0 0 9 25 12 13 39 40 0 0 0
msnbot 0 0 0 1 0 0 0 0 0 0 0 0
LinqiaCrawlerBot 0 0 0 1 0 0 0 0 0 1 1 2
DeuSu 0 0 0 0 23 39 46 17 0 0 0 0
woobot 0 0 0 0 2 0 0 0 0 0 0 1
uipbot 0 0 0 0 1 0 0 0 0 0 0 0
SpaceBison 0 0 0 0 1 0 0 0 0 0 0 0
Microsoft-WebDAV 0 0 0 0 1 0 0 0 0 0 0 1
Wotbox 0 0 0 0 1 0 0 2 0 2 0 2
SpuhexBot 0 0 0 0 1 0 0 0 0 2 0 2
W3C_Validator 0 0 0 0 1 1 1 0 0 0 0 0
ToutiaoSpider 0 0 0 0 0 1 0 0 0 0 0 0
TerrawizBot 0 0 0 0 0 1 0 0 0 0 0 0
ichiro 0 0 0 0 0 1 2 7 1 0 0 0
datagnionbot 0 0 0 0 0 1 0 0 0 0 0 0
ICC-Crawler 0 0 0 0 0 0 2 0 0 0 0 0
YamanaLab-Robot 0 0 0 0 0 0 1 0 0 0 0 0
Scanbot 0 0 0 0 0 0 0 5 5 6 7 3
RSSingBot 0 0 0 0 0 0 0 5 0 0 0 0
WebCapture 0 0 0 0 0 0 0 1 0 0 0 0
PiplBot 0 0 0 0 0 0 0 0 258 0 0 0
MaxPointCrawler 0 0 0 0 0 0 0 0 2 1 0 2
WebTV 0 0 0 0 0 0 0 0 2 0 0 1
MS Data Access 0 0 0 0 0 0 0 0 2 0 0 0
FemtosearchBot 0 0 0 0 0 0 0 0 1 1 0 0
psbot 0 0 0 0 0 0 0 0 1 0 2 0
Mozilla/5.0+(compatible;+PiplBot;+http:/ 0 0 0 0 0 0 0 0 0 203 24 0
AliveAdvisorCrawler 0 0 0 0 0 0 0 0 0 22 0 15
pycurl 0 0 0 0 0 0 0 0 0 11 1 1
VeriCiteCrawler 0 0 0 0 0 0 0 0 0 3 6 5
007Bot 0 0 0 0 0 0 0 0 0 2 0 0
Contacts-Crawler 0 0 0 0 0 0 0 0 0 1 0 0
RavenCrawler 0 0 0 0 0 0 0 0 0 1 0 0
NetpeakCheckerBot 0 0 0 0 0 0 0 0 0 1 0 0
iisbot 0 0 0 0 0 0 0 0 0 0 2 0
TelegramBot 0 0 0 0 0 0 0 0 0 0 1 0
Jakarta Commons 0 0 0 0 0 0 0 0 0 0 1 0
RockhallFundingCrawler 0 0 0 0 0 0 0 0 0 0 1 0
SMTBot 0 0 0 0 0 0 0 0 0 0 0 2
demandbase-bot 0 0 0 0 0 0 0 0 0 0 0 1
KokorikoBot 0 0 0 0 0 0 0 0 0 0 0 1
OpenSearchServer_Bot 0 0 0 0 0 0 0 0 0 0 0 1
Teoma 0 0 0 0 0 0 0 0 0 0 0 1
Total 39100 58542 55685 44455 51729 51246 33383 48638 48844 52656 51687 52269