PGTS PGTS Pty. Ltd.   ACN: 007 008 568

point Site Navigation



   Download Kubuntu Today

   Ubuntu

   The Power Of KDE + Ubuntu







Last Updated: 17-Oct-2010 14:21 UTC

List of Robots Ordered by Robot (Visits)


Click Here For:    Agent Switchboard

Change Order:   Order by robot name     Show values as percent


Browser May Apr Mar Feb Jan Dec Nov Oct Sep Aug Jul Jun
AhrefsBot 20326 28853 37686 35521 36427 31529 36242 30902 29180 42706 30681 34942
SemrushBot 2946 3333 5740 5069 5702 6249 5652 5135 4164 3805 2788 290
bingbot 948 1240 3861 3753 3823 3945 2654 3106 2819 3635 2863 3853
Baiduspider 612 3132 2926 2622 2669 2292 2894 3113 3935 4281 9119 10739
Googlebot 518 596 1644 1629 1693 1480 1734 2189 2532 2452 2708 2293
unknown crawler 506 578 1163 922 1068 1489 1146 1369 1125 1204 1189 2159
unknown 330 390 416 378 385 345 417 717 761 824 756 542
YandexBot 120 147 350 458 538 771 738 552 666 759 607 772
MJ12bot 108 251 334 269 419 369 379 378 360 389 398 375
ZoominfoBot 85 92 159 180 42 24 6 6 16 8 7 7
ltx71 37 74 72 55 73 55 45 57 59 41 52 41
DuckDuckGo-Favicons-Bot 37 32 61 50 64 47 50 40 69 69 55 56
Baiduspider 35 16 146 142 143 187 130 194 216 181 151 141
SEMrushBot 33 39 49 50 22 35 36 34 40 26 13 4
Python libcurl 27 14 22 16 21 80 70 80 59 7 6 3
SeznamBot 26 21 36 43 61 51 39 48 37 50 51 58
Python-urllib 21 26 24 37 45 27 10 17 21 15 19 41
python-requests 18 15 32 32 29 45 29 38 20 48 39 23
curl 18 37 20 5 9 8 2 3 9 9 11 10
BingPreview 14 7 468 568 552 2012 703 2649 3167 2981 647 568
Mail.RU_Bot 12 63 756 1024 1044 966 879 485 359 437 499 648
Nimbostratus-Bot 10 19 25 19 26 40 51 54 45 17 0 0
Cliqzbot 8 6 261 7 20 44 6 4 19 2 45 197
CFNetwork 6 17 122 144 146 155 87 80 67 103 94 92
yacybot 4 1 3 2 3 0 5 2 0 2 1 4
oBot 3 2 3 1 3 2 3 3 1 4 2 1
MojeekBot 3 4 22 16 31 26 28 14 28 29 13 14
CCBot 3 6 3 5 5 5 5 8 7 4 10 7
GrapeshotCrawler 3 4 8 8 1 3 1 3 10 2 2 3
BublupBot 2 0 0 3 0 16 10 10 0 1 0 0
Yeti 2 0 21 45 45 44 68 52 46 47 51 41
Java 2 2 7 12 10 7 8 3 0 5 5 6
GarlikCrawler 2 3 4 3 6 4 6 31 5 8 12 35
SurdotlyBot 2 1 2 1 2 4 2 3 2 3 6 6
linkdexbot 1 1 4 9 47 56 66 48 75 108 102 96
istellabot 1 1 2 1 4 1 0 1 1 1 1 1
Xenu Link Sleuth 1 0 1 3 0 1 0 1 1 1 0 0
DotBot 1 2 84 176 180 51 83 148 159 117 151 165
SafeDNSBot 1 0 0 5 5 0 4 3 3 4 0 1
Sengine crawler 1 0 0 0 0 0 2 0 0 0 2 0
Wget 1 1 1 8 4 2 10 1 3 10 4 9
LWP Script 1 2 6 8 1 2 11 10 5 12 6 3
archive.org_bot 0 17 11 2 1 43 4 1 3 0 5 13
WordPress 0 8 1 9 2 10 14 21 26 30 9 3
MS Data Access 0 1 0 7 0 0 0 0 0 0 0 0
YahooBot 0 1 3 3 12 5 6 23 9 25 6 7
ia_archiver 0 1 1 1 2 3 1 2 3 11 8 4
facebookexternalhit 0 0 80 91 103 53 67 711 67 108 441 70
Pinterestbot 0 0 12 6 15 10 19 9 18 11 11 16
DomainStatsBot 0 0 9 10 16 23 7 10 13 0 0 0
Google Web Preview 0 0 6 10 14 7 26 36 50 33 45 47
MBCrawler 0 0 4 0 1 1 1 0 2 3 1 1
TurnitinBot 0 0 3 2 1 1 1 0 1 3 0 1
Bingbot 0 0 3 0 3 0 3 1 5 10 1 5
DuckDuckBot 0 0 3 0 1 1 4 4 5 7 9 6
Proximic Spider 0 0 2 2 2 0 1 3 8 5 6 0
YahooCacheSystem 0 0 2 8 5 9 8 3 6 10 12 10
LightspeedSystemsCrawler 0 0 1 1 1 0 2 1 0 2 1 2
Keybot 0 0 1 0 0 0 0 0 0 0 0 0
Slackbot 0 0 1 0 0 0 0 0 0 0 0 0
ICC-Crawler 0 0 1 7 0 0 2 2 3 0 0 0
OutclicksBot 0 0 1 1 0 0 4 1 0 0 0 1
NetpeakCheckerBot 0 0 1 0 0 0 0 0 0 0 0 0
Gluten Free Crawler 0 0 1 23 28 12 26 24 25 26 25 25
ExtLinksBot 0 0 0 4 2 3 4 2 1 7 2 11
WebTV 0 0 0 3 0 0 0 0 0 0 0 0
Knowknot 0 0 0 3 2 0 6 11 0 0 0 3
MegaIndex Crawler 0 0 0 2 2 2 1 3 2 3 2 3
SpaceBison 0 0 0 2 0 0 0 0 0 0 0 0
LinkedInBot 0 0 0 1 1 1 2 0 1 0 0 1
W3C-checklink 0 0 0 1 0 0 0 0 0 0 0 0
WordChampBot 0 0 0 1 0 0 0 0 0 1 0 1
EasyBib AutoCite 0 0 0 1 0 0 0 0 0 0 0 0
Embedly 0 0 0 0 27 6 6 0 0 0 0 0
NutchBot 0 0 0 0 5 7 0 1 4 6 5 7
RyteBot 0 0 0 0 2 4 3 1 0 0 0 0
ImplisenseBot 0 0 0 0 2 1 0 0 0 0 0 0
Twitterbot 0 0 0 0 2 0 0 0 0 1 4 0
Tweetbot 0 0 0 0 1 0 0 0 0 0 0 0
PaperLiBot 0 0 0 0 1 0 0 0 0 0 1 0
007ac9 Crawler 0 0 0 0 1 1 0 0 0 0 1 0
enolystBot 0 0 0 0 1 1 1 1 0 0 0 0
oebot 0 0 0 0 1 0 0 0 0 0 0 0
Seekport Crawler 0 0 0 0 1 2 0 0 0 0 0 0
btcrawler 0 0 0 0 0 3 8 1 0 4 6 0
nsrbot 0 0 0 0 0 2 2 5 0 36 17 0
Companybook-Crawler 0 0 0 0 0 2 9 10 6 10 3 5
Gowikibot 0 0 0 0 0 2 2 2 1 0 0 0
Webcollage crawler 0 0 0 0 0 1 0 0 0 0 0 0
MS FrontPage 0 0 0 0 0 1 0 0 0 0 0 0
Discordbot 0 0 0 0 0 1 0 0 1 0 0 0
ConBot 0 0 0 0 0 1 0 0 0 0 0 0
bl.uk_lddc_bot 0 0 0 0 0 1 0 0 0 0 0 2
woobot 0 0 0 0 0 0 7 0 0 0 0 0
V-BOT 0 0 0 0 0 0 2 6 24 5 0 0
Mozila/5.0(compatible;HMEOnlineHomeBot 0 0 0 0 0 0 1 0 0 0 0 0
OK-Search-Bot 0 0 0 0 0 0 0 4 0 0 0 0
EarwigBot 0 0 0 0 0 0 0 3 2 0 0 1
pycurl 0 0 0 0 0 0 0 1 0 0 0 0
msnbot 0 0 0 0 0 0 0 1 0 0 0 0
spbot 0 0 0 0 0 0 0 1 0 1 3 4
PDFDriveCrawler 0 0 0 0 0 0 0 1 0 0 0 0
PiplBot 0 0 0 0 0 0 0 0 52 0 0 0
Findxbot 0 0 0 0 0 0 0 0 2 0 0 3
Microsoft URL Control 0 0 0 0 0 0 0 0 1 0 0 0
AppEngine-Google 0 0 0 0 0 0 0 0 1 0 0 6
ToutiaoSpider 0 0 0 0 0 0 0 0 0 4 0 0
W3C_Validator 0 0 0 0 0 0 0 0 0 3 0 0
ht2cl-0.1-crawler 0 0 0 0 0 0 0 0 0 1 0 0
MauiBot 0 0 0 0 0 0 0 0 0 0 6 26
wget 0 0 0 0 0 0 0 0 0 0 3 8
EveryoneSocialBot 0 0 0 0 0 0 0 0 0 0 1 0
RukiCrawler 0 0 0 0 0 0 0 0 0 0 1 0
Plukkie 0 0 0 0 0 0 0 0 0 0 0 2
vebidoobot 0 0 0 0 0 0 0 0 0 0 0 1
TinEye-bot 0 0 0 0 0 0 0 0 0 0 0 1
Total 26835 39056 56691 53500 55626 52689 54561 52497 50433 64773 53801 58542