PGTS PGTS Pty. Ltd.   ACN: 007 008 568

point Site Navigation



   Download Kubuntu Today

   Ubuntu

   The Power Of KDE + Ubuntu







Last Updated: 17-Oct-2010 14:21 UTC

List of Robots Ordered by Robot (Visits)


Click Here For:    Agent Switchboard

Change Order:   Order by robot name     Show values as percent


Browser Dec Nov Oct Sep Aug Jul Jun May Apr Mar Feb Jan
AhrefsBot 23950 36242 30902 29180 42706 30681 34942 35069 24850 30892 33658 19716
SemrushBot 3728 5652 5135 4164 3805 2788 290 312 484 460 463 480
bingbot 2081 2654 3106 2819 3635 2863 3853 3615 3455 3382 2852 3159
BingPreview 1710 703 2649 3167 2981 647 568 902 693 582 1198 777
Baiduspider 1277 2894 3113 3935 4281 9119 10739 8501 7354 8429 6177 1684
unknown crawler 944 1146 1369 1125 1204 1189 2159 1115 1235 1128 914 1205
Googlebot 914 1734 2189 2532 2452 2708 2293 2207 1766 1885 1696 1792
Mail.RU_Bot 561 879 485 359 437 499 648 793 1083 1076 1049 1089
YandexBot 509 738 552 666 759 607 772 694 680 650 423 456
unknown 227 417 717 761 824 756 542 564 740 937 867 740
MJ12bot 162 379 378 360 389 398 375 429 277 511 252 249
Baiduspider 106 130 194 216 181 151 141 86 70 27 0 0
CFNetwork 76 87 80 67 103 94 92 75 107 70 57 130
Python libcurl 51 70 80 59 7 6 3 9 3 0 0 14
ltx71 49 45 57 59 41 52 41 142 183 134 109 122
facebookexternalhit 38 67 711 67 108 441 70 74 96 126 96 203
DotBot 36 83 148 159 117 151 165 212 493 538 302 452
Nimbostratus-Bot 34 51 54 45 17 0 0 0 0 0 0 0
python-requests 33 29 38 20 48 39 23 26 22 43 27 31
DuckDuckGo-Favicons-Bot 30 50 40 69 69 55 56 36 19 27 62 20
SeznamBot 29 39 48 37 50 51 58 64 43 76 78 93
linkdexbot 27 66 48 75 108 102 96 114 98 116 111 106
SEMrushBot 27 36 34 40 26 13 4 4 3 5 4 3
archive.org_bot 26 4 1 3 0 5 13 185 20 11 2 3
ZoominfoBot 21 6 6 16 8 7 7 7 4 7 14 5
Yeti 21 68 52 46 47 51 41 53 38 21 63 40
Python-urllib 20 10 17 21 15 19 41 37 25 16 27 14
MojeekBot 20 28 14 28 29 13 14 12 17 15 7 15
BublupBot 16 10 10 0 1 0 0 0 0 0 0 0
WordPress 10 14 21 26 30 9 3 0 3 1 3 2
Google Web Preview 7 26 36 50 33 45 47 65 147 169 91 249
Pinterestbot 6 19 9 18 11 11 16 31 23 20 40 29
Embedly 6 6 0 0 0 0 0 0 0 0 0 0
Gluten Free Crawler 6 26 24 25 26 25 25 26 25 32 9 3
GarlikCrawler 4 6 31 5 8 12 35 0 21 4 7 16
Java 4 8 3 0 5 5 6 14 8 17 13 7
YahooCacheSystem 4 8 3 6 10 12 10 9 14 17 14 17
curl 4 2 3 9 9 11 10 5 8 7 7 37
btcrawler 3 8 1 0 4 6 0 2 3 7 4 0
CCBot 3 5 8 7 4 10 7 3 6 5 3 11
DomainStatsBot 3 7 10 13 0 0 0 0 0 0 0 0
YahooBot 3 6 23 9 25 6 7 13 11 18 159 222
SurdotlyBot 2 2 3 2 3 6 6 6 3 3 4 2
Gowikibot 2 2 2 1 0 0 0 0 0 0 0 0
RyteBot 2 3 1 0 0 0 0 0 0 0 0 0
GrapeshotCrawler 2 1 3 10 2 2 3 3 4 10 9 2
Companybook-Crawler 2 9 10 6 10 3 5 9 2 14 0 0
nsrbot 2 2 5 0 36 17 0 0 0 0 0 0
ia_archiver 2 1 2 3 11 8 4 6 9 10 6 1
Cliqzbot 2 6 4 19 2 45 197 32 120 66 184 25
MegaIndex Crawler 1 1 3 2 3 2 3 3 3 3 0 2
ExtLinksBot 1 4 2 1 7 2 11 5 13 12 10 3
oBot 1 3 3 1 4 2 1 2 1 1 1 0
MBCrawler 1 1 0 2 3 1 1 8 0 0 2 2
Discordbot 1 0 0 1 0 0 0 0 0 0 0 0
Wget 1 10 1 3 10 4 9 6 10 4 19 5
Seekport Crawler 1 0 0 0 0 0 0 0 0 0 0 0
DuckDuckBot 1 4 4 5 7 9 6 12 12 6 9 0
007ac9 Crawler 1 0 0 0 0 1 0 0 0 0 0 1
LWP Script 1 11 10 5 12 6 3 3 1 6 21 32
istellabot 1 0 1 1 1 1 1 2 1 0 1 1
Webcollage crawler 1 0 0 0 0 0 0 0 0 0 0 0
MS FrontPage 1 0 0 0 0 0 0 0 0 0 0 0
ConBot 1 0 0 0 0 0 0 0 0 0 0 0
woobot 0 7 0 0 0 0 0 0 0 2 0 0
Knowknot 0 6 11 0 0 0 3 0 0 0 0 0
yacybot 0 5 2 0 2 1 4 7 5 0 6 0
OutclicksBot 0 4 1 0 0 0 1 2 5 0 3 0
SafeDNSBot 0 4 3 3 4 0 1 4 0 2 4 5
Bingbot 0 3 1 5 10 1 5 11 15 6 13 4
V-BOT 0 2 6 24 5 0 0 0 0 0 0 0
ICC-Crawler 0 2 2 3 0 0 0 0 0 0 0 2
LinkedInBot 0 2 0 1 0 0 1 1 2 2 1 2
Sengine crawler 0 2 0 0 0 2 0 4 0 2 0 0
LightspeedSystemsCrawler 0 2 1 0 2 1 2 2 0 2 1 0
TurnitinBot 0 1 0 1 3 0 1 1 2 1 1 4
enolystBot 0 1 1 0 0 0 0 0 0 0 0 0
Proximic Spider 0 1 3 8 5 6 0 3 0 2 3 3
Mozila/5.0(compatible;HMEOnlineHomeBot 0 1 0 0 0 0 0 0 0 0 0 0
OK-Search-Bot 0 0 4 0 0 0 0 0 0 0 0 0
EarwigBot 0 0 3 2 0 0 1 0 0 0 0 0
spbot 0 0 1 0 1 3 4 7 11 10 15 11
Xenu Link Sleuth 0 0 1 1 1 0 0 3 2 7 0 0
msnbot 0 0 1 0 0 0 0 0 1 0 0 0
NutchBot 0 0 1 4 6 5 7 2 3 3 1 3
PDFDriveCrawler 0 0 1 0 0 0 0 0 0 0 0 0
pycurl 0 0 1 0 0 0 0 0 0 0 0 0
PiplBot 0 0 0 52 0 0 0 0 0 0 0 0
Findxbot 0 0 0 2 0 0 3 0 0 0 6 1
Microsoft URL Control 0 0 0 1 0 0 0 0 0 0 0 0
AppEngine-Google 0 0 0 1 0 0 6 0 0 0 0 2
ToutiaoSpider 0 0 0 0 4 0 0 0 0 0 1 0
W3C_Validator 0 0 0 0 3 0 0 0 0 1 1 1
WordChampBot 0 0 0 0 1 0 1 0 0 0 0 1
ht2cl-0.1-crawler 0 0 0 0 1 0 0 0 0 0 0 0
Twitterbot 0 0 0 0 1 4 0 0 0 0 1 0
MauiBot 0 0 0 0 0 6 26 20 75 30 0 0
wget 0 0 0 0 0 3 8 8 9 7 6 10
PaperLiBot 0 0 0 0 0 1 0 0 0 0 0 0
EveryoneSocialBot 0 0 0 0 0 1 0 0 0 0 0 0
RukiCrawler 0 0 0 0 0 1 0 0 0 0 0 0
Plukkie 0 0 0 0 0 0 2 0 5 0 0 0
bl.uk_lddc_bot 0 0 0 0 0 0 2 0 0 0 0 0
vebidoobot 0 0 0 0 0 0 1 0 0 0 1 0
TinEye-bot 0 0 0 0 0 0 1 1 0 0 0 2
NinjaBot 0 0 0 0 0 0 0 3 2 1 4 2
EasyBib AutoCite 0 0 0 0 0 0 0 2 0 1 0 1
Web-Crawler 0 0 0 0 0 0 0 1 0 0 0 0
VenusCrawler 0 0 0 0 0 0 0 1 2 1 0 0
DnyzBot 0 0 0 0 0 0 0 0 9 25 12 13
LinqiaCrawlerBot 0 0 0 0 0 0 0 0 1 0 0 0
DeuSu 0 0 0 0 0 0 0 0 0 23 39 46
Wotbox 0 0 0 0 0 0 0 0 0 1 0 0
uipbot 0 0 0 0 0 0 0 0 0 1 0 0
SpuhexBot 0 0 0 0 0 0 0 0 0 1 0 0
SpaceBison 0 0 0 0 0 0 0 0 0 1 0 0
Microsoft-WebDAV 0 0 0 0 0 0 0 0 0 1 0 0
TerrawizBot 0 0 0 0 0 0 0 0 0 0 1 0
datagnionbot 0 0 0 0 0 0 0 0 0 0 1 0
ichiro 0 0 0 0 0 0 0 0 0 0 1 2
YamanaLab-Robot 0 0 0 0 0 0 0 0 0 0 0 1
Total 36816 54561 52497 50433 64773 53801 58542 55685 44455 51729 51246 33383