PGTS PGTS Pty. Ltd.   ACN: 007 008 568

point Site Navigation



   Stop The Internet Filter!

   No Clean Feed

   The Internet Filter Is An Ex-parrot!







Last Updated: 17-Oct-2010 14:21 UTC

List of Robots Ordered by Robot (Visits)


Click Here For:    Agent Switchboard

Change Order:   Order by robot name     Show values as percent


Browser Oct Sep Aug Jul Jun May Apr Mar Feb Jan Dec Nov
AhrefsBot 19056 29180 42706 30681 34942 35069 24850 30892 33658 19716 30798 28281
SemrushBot 2604 4164 3805 2788 290 312 484 460 463 480 478 362
bingbot 2082 2819 3635 2863 3853 3615 3455 3382 2852 3159 3480 2381
Baiduspider 2043 3935 4281 9119 10739 8501 7354 8429 6177 1684 4688 8364
BingPreview 1526 3167 2981 647 568 902 693 582 1198 777 718 877
Googlebot 1323 2532 2452 2708 2293 2207 1766 1885 1696 1792 1876 1906
unknown crawler 904 1125 1204 1189 2159 1115 1235 1128 914 1205 1299 1086
facebookexternalhit 684 67 108 441 70 74 96 126 96 203 162 68
unknown 434 761 824 756 542 564 740 937 867 740 923 945
YandexBot 351 666 759 607 772 694 680 650 423 456 562 636
Mail.RU_Bot 311 359 437 499 648 793 1083 1076 1049 1089 1199 936
MJ12bot 254 360 389 398 375 429 277 511 252 249 461 269
Baiduspider 121 216 181 151 141 86 70 27 0 0 6 0
DotBot 101 159 117 151 165 212 493 538 302 452 452 330
CFNetwork 43 67 103 94 92 75 107 70 57 130 107 96
ltx71 39 59 41 52 41 142 183 134 109 122 43 38
linkdexbot 37 75 108 102 96 114 98 116 111 106 127 133
Yeti 35 46 47 51 41 53 38 21 63 40 36 24
SeznamBot 33 37 50 51 58 64 43 76 78 93 104 74
Nimbostratus-Bot 31 45 17 0 0 0 0 0 0 0 0 0
Python libcurl 29 59 7 6 3 9 3 0 0 14 17 0
GarlikCrawler 28 5 8 12 35 0 21 4 7 16 7 23
DuckDuckGo-Favicons-Bot 26 69 69 55 56 36 19 27 62 20 12 20
SEMrushBot 25 40 26 13 4 4 3 5 4 3 6 4
python-requests 20 20 48 39 23 26 22 43 27 31 74 30
Google Web Preview 20 50 33 45 47 65 147 169 91 249 388 967
WordPress 13 26 30 9 3 0 3 1 3 2 0 3
Knowknot 11 0 0 0 3 0 0 0 0 0 0 17
Gluten Free Crawler 11 25 26 25 25 26 25 32 9 3 28 13
Python-urllib 9 21 15 19 41 37 25 16 27 14 19 16
MojeekBot 9 28 29 13 14 12 17 15 7 15 5 35
Companybook-Crawler 7 6 10 3 5 9 2 14 0 0 0 2
LWP Script 7 5 12 6 3 3 1 6 21 32 29 22
DomainStatsBot 7 13 0 0 0 0 0 0 0 0 0 0
CCBot 6 7 4 10 7 3 6 5 3 11 3 3
YahooBot 6 9 25 6 7 13 11 18 159 222 234 211
OK-Search-Bot 4 0 0 0 0 0 0 0 0 0 0 0
DuckDuckBot 4 5 7 9 6 12 12 6 9 0 2 3
V-BOT 4 24 5 0 0 0 0 0 0 0 0 0
BublupBot 4 0 1 0 0 0 0 0 0 0 0 0
Cliqzbot 3 19 2 45 197 32 120 66 184 25 34 131
SurdotlyBot 3 2 3 6 6 6 3 3 4 2 3 5
EarwigBot 3 2 0 0 1 0 0 0 0 0 0 0
MegaIndex Crawler 3 2 3 2 3 3 3 3 0 2 3 3
Java 3 0 5 5 6 14 8 17 13 7 27 22
GrapeshotCrawler 3 10 2 2 3 3 4 10 9 2 0 12
Proximic Spider 3 8 5 6 0 3 0 2 3 3 0 0
SafeDNSBot 3 3 4 0 1 4 0 2 4 5 4 5
ExtLinksBot 2 1 7 2 11 5 13 12 10 3 8 37
ICC-Crawler 2 3 0 0 0 0 0 0 0 2 0 0
YahooCacheSystem 2 6 10 12 10 9 14 17 14 17 14 13
Gowikibot 2 1 0 0 0 0 0 0 0 0 0 0
oBot 2 1 4 2 1 2 1 1 1 0 1 1
Pinterestbot 2 18 11 11 16 31 23 20 40 29 40 25
LightspeedSystemsCrawler 1 0 2 1 2 2 0 2 1 0 2 1
pycurl 1 0 0 0 0 0 0 0 0 0 0 0
Xenu Link Sleuth 1 1 1 0 0 3 2 7 0 0 1 2
curl 1 9 9 11 10 5 8 7 7 37 13 6
spbot 1 0 1 3 4 7 11 10 15 11 9 8
ia_archiver 1 3 11 8 4 6 9 10 6 1 6 6
msnbot 1 0 0 0 0 0 1 0 0 0 0 0
nsrbot 1 0 36 17 0 0 0 0 0 0 0 0
PDFDriveCrawler 1 0 0 0 0 0 0 0 0 0 0 0
btcrawler 1 0 4 6 0 2 3 7 4 0 0 3
archive.org_bot 1 3 0 5 13 185 20 11 2 3 7 3
Wget 1 3 10 4 9 6 10 4 19 5 18 22
Bingbot 1 5 10 1 5 11 15 6 13 4 4 5
PiplBot 0 52 0 0 0 0 0 0 0 0 0 258
ZoominfoBot 0 16 8 7 7 7 4 7 14 5 0 7
NutchBot 0 4 6 5 7 2 3 3 1 3 5 1
MBCrawler 0 2 3 1 1 8 0 0 2 2 0 1
Findxbot 0 2 0 0 3 0 0 0 6 1 0 2
Discordbot 0 1 0 0 0 0 0 0 0 0 0 0
AppEngine-Google 0 1 0 0 6 0 0 0 0 2 5 8
TurnitinBot 0 1 3 0 1 1 2 1 1 4 2 1
istellabot 0 1 1 1 1 2 1 0 1 1 2 1
LinkedInBot 0 1 0 0 1 1 2 2 1 2 1 1
Microsoft URL Control 0 1 0 0 0 0 0 0 0 0 0 0
ToutiaoSpider 0 0 4 0 0 0 0 0 1 0 0 0
W3C_Validator 0 0 3 0 0 0 0 1 1 1 0 0
yacybot 0 0 2 1 4 7 5 0 6 0 0 8
Twitterbot 0 0 1 4 0 0 0 0 1 0 0 3
WordChampBot 0 0 1 0 1 0 0 0 0 1 0 0
ht2cl-0.1-crawler 0 0 1 0 0 0 0 0 0 0 0 0
MauiBot 0 0 0 6 26 20 75 30 0 0 0 0
wget 0 0 0 3 8 8 9 7 6 10 7 9
Sengine crawler 0 0 0 2 0 4 0 2 0 0 0 0
RukiCrawler 0 0 0 1 0 0 0 0 0 0 0 0
PaperLiBot 0 0 0 1 0 0 0 0 0 0 0 0
007ac9 Crawler 0 0 0 1 0 0 0 0 0 1 0 0
EveryoneSocialBot 0 0 0 1 0 0 0 0 0 0 0 0
bl.uk_lddc_bot 0 0 0 0 2 0 0 0 0 0 0 0
Plukkie 0 0 0 0 2 0 5 0 0 0 0 0
OutclicksBot 0 0 0 0 1 2 5 0 3 0 0 0
vebidoobot 0 0 0 0 1 0 0 0 1 0 0 0
TinEye-bot 0 0 0 0 1 1 0 0 0 2 2 2
NinjaBot 0 0 0 0 0 3 2 1 4 2 0 0
EasyBib AutoCite 0 0 0 0 0 2 0 1 0 1 1 3
Web-Crawler 0 0 0 0 0 1 0 0 0 0 0 0
VenusCrawler 0 0 0 0 0 1 2 1 0 0 0 0
DnyzBot 0 0 0 0 0 0 9 25 12 13 39 40
LinqiaCrawlerBot 0 0 0 0 0 0 1 0 0 0 0 0
DeuSu 0 0 0 0 0 0 0 23 39 46 17 0
woobot 0 0 0 0 0 0 0 2 0 0 0 0
Microsoft-WebDAV 0 0 0 0 0 0 0 1 0 0 0 0
Wotbox 0 0 0 0 0 0 0 1 0 0 2 0
uipbot 0 0 0 0 0 0 0 1 0 0 0 0
SpuhexBot 0 0 0 0 0 0 0 1 0 0 0 0
SpaceBison 0 0 0 0 0 0 0 1 0 0 0 0
datagnionbot 0 0 0 0 0 0 0 0 1 0 0 0
TerrawizBot 0 0 0 0 0 0 0 0 1 0 0 0
ichiro 0 0 0 0 0 0 0 0 1 2 7 1
YamanaLab-Robot 0 0 0 0 0 0 0 0 0 1 0 0
Scanbot 0 0 0 0 0 0 0 0 0 0 5 5
RSSingBot 0 0 0 0 0 0 0 0 0 0 5 0
WebCapture 0 0 0 0 0 0 0 0 0 0 1 0
WebTV 0 0 0 0 0 0 0 0 0 0 0 2
MS Data Access 0 0 0 0 0 0 0 0 0 0 0 2
MaxPointCrawler 0 0 0 0 0 0 0 0 0 0 0 2
psbot 0 0 0 0 0 0 0 0 0 0 0 1
FemtosearchBot 0 0 0 0 0 0 0 0 0 0 0 1
Total 32311 50433 64773 53801 58542 55685 44455 51729 51246 33383 48638 48844