robots.txt checker
Bots
Name
Last Seen
2ADAMbot
2016-06-18 17:41:15
AaayyyBot
2016-05-07 05:41:58
AddSugarSpiderBot
2016-05-17 06:17:33
AdsBot-Google
2016-05-05 18:08:19
AhrefsBot
2016-05-08 06:35:28
aiHitBot
2016-06-09 03:31:10
Ant bot
2017-03-03 13:05:11
Applebot
2016-05-06 00:06:12
AppleNewsBot
2016-09-16 02:09:20
archive.org bot
2016-05-07 21:07:21
ArhpostBot
2016-12-25 03:05:53
ArielisBot
2017-03-23 05:24:51
aylienbot
2016-10-13 09:59:48
Baiduspider
2017-04-22 15:18:18
BecomeBot
2017-04-17 10:10:50
bhcBot
2017-03-28 18:47:06
bingbot
2016-05-08 06:35:29
bitlybot
2016-07-01 11:31:13
bl.uk lddc bot
2016-12-23 17:06:26
BLEXBot
2016-05-07 03:43:02
bnf.fr bot
2016-11-23 09:38:35
BoogleBot
2017-01-06 21:46:06
bot-pge.chlooe.com
2016-07-16 15:23:13
botrobin
2016-11-04 16:41:41
C-T bot
2016-05-03 20:25:55
calculon spider
2016-06-24 22:48:41
CarianBot
2017-05-06 02:13:19
CCBot
2016-05-07 03:23:01
Clickagy Intelligence Bot
2017-04-21 02:03:54
Cliqzbot
2016-05-14 23:24:30
Cloudflare-AMP
2017-03-17 07:55:07
coccocbot-image
2017-04-21 07:45:13
coccocbot-web
2017-04-21 11:27:06
CommonCrawler
2016-05-11 17:50:10
Comos
2016-05-07 06:37:53
Comparserbot
2017-01-26 21:56:15
datagnionbot
2016-07-30 12:57:04
deepcrawl
2017-01-31 02:19:40
DeuSu
2016-05-08 06:32:29
Diffbot
2016-05-26 18:54:08
Digincore
2016-05-14 22:23:41
Discordbot
2016-05-03 22:17:53
DomainSigmaCrawler
2016-06-28 21:25:13
DomainStatsBot
2016-07-26 07:40:05
DomainTunoCrawler
2016-07-14 20:26:51
DotBot
2016-05-08 06:30:48
DuckDuckGo-Favicons-Bot
2016-05-08 05:30:26
EarwigBot
2017-01-28 18:34:13
Echobot
2017-01-20 20:56:10
ElaneRuBot
2016-07-22 21:59:44
Elmer, the Thinglink ImageBot
2016-05-06 22:20:34
Eurobot
2016-05-07 06:24:07
EveryoneSocialBot
2017-04-04 14:43:52
Exabot
2016-05-07 22:22:47
Facebot Twitterbot
2017-04-15 15:38:28
Favicon downloader
2016-12-11 05:42:26
FeedlyBot
2016-05-10 02:07:54
Feedspotbot
2017-02-06 12:04:47
FemtosearchBot
2017-04-23 05:59:57
Findcloserbot
2016-05-05 01:37:18
Findxbot
2017-04-10 08:36:32
FlippyBearBot
2016-06-19 03:02:48
focusbot
2016-05-21 15:22:29
GetIntent Crawler
2016-07-17 05:45:01
GG PeekBot
2017-03-30 15:46:59
Gigabot
2016-05-20 18:12:50
GimmeUSAbot
2016-05-14 06:48:32
Girafabot
2016-07-18 07:51:33
GnowitNewsbot
2017-03-19 23:43:59
GOFORITBOT
2017-03-13 18:22:26
Google Adwords DisplayAds WebRender
2017-04-22 16:30:48
Google Adwords Instant
2017-04-14 18:21:21
Googlebot
2016-05-08 06:35:23
Googlebot-Image
2016-05-08 06:35:28
Googlebot-Mobile
2016-05-08 06:33:47
Googlebot-Video
2016-05-13 02:37:06
GumGum
2016-12-24 17:05:16
HybridBot
2016-06-24 17:31:54
IDBot
2017-04-22 16:17:58
IRLbot
2017-04-20 14:23:43
ISOWQ
2016-09-12 12:04:36
istellabot
2016-05-06 07:43:33
James BOT
2016-05-17 14:19:33
JobboerseBot
2017-04-29 06:10:39
Jooblebot
2017-01-03 23:20:27
K7MLWCBot
2016-05-25 03:29:33
kazbtbot
2016-05-05 01:46:06
KD Bot
2016-06-25 13:24:23
KomodiaBot
2016-05-06 03:27:13
Kraken
2017-03-07 07:05:00
Linguee
2017-04-22 21:54:17
linkapediabot
2016-05-02 07:34:53
linkdexbot
2016-05-07 20:55:54
LinkedInBot
2016-05-09 16:01:09
LinkisBot
2016-05-09 23:39:01
LinkosmosBot
2016-10-22 05:41:12
LinkpadBot
2016-05-14 09:15:40
LinqiaCrawlerBot
2017-04-23 00:46:44
Livechat OpenGraph Robot
2017-01-18 16:28:17
LivelapBot
2016-06-10 08:59:48
MagiBot
2017-03-26 19:15:16
Mail.RU Bot
2016-05-08 05:53:11
Mail.RU Bot Fast
2016-05-08 06:33:20
Mail.RU Bot Img
2017-03-31 16:45:10
MailDBBot
2017-04-07 01:40:36
Mediapartners-Google
2017-04-23 17:42:51
Mediatoolkitbot
2016-08-04 15:53:33
MegaIndexAuditBot
2017-02-06 14:46:30
memoryBot
2017-02-19 01:53:32
MetaCommentBot
2016-06-01 11:58:35
mfibot
2016-05-08 01:30:00
MixrankBot
2016-05-05 20:28:34
MJ12bot
2016-05-08 06:09:05
MojeekBot
2017-02-15 15:13:48
MoodleBot
2016-12-28 11:09:32
msnbot
2016-05-23 09:14:23
msnbot-media
2016-05-08 06:20:20
msnbot-news
2017-04-17 07:15:56
msnbot-Products
2016-05-05 05:01:45
NerdyBot
2016-05-07 17:13:24
NeumobBot
2016-06-26 00:00:23
NextGenSearchBot
2016-11-24 23:06:51
NTENTbot
2016-05-07 08:52:59
NutchCVS
2016-05-21 09:08:34
obot
2016-05-03 22:31:39
OdklBot
2016-05-07 21:40:01
openstat.ru Bot
2016-05-07 23:25:16
OptimizationCrawler
2016-08-19 15:18:34
PagesInventory
2016-06-06 14:19:56
PaperLiBot
2016-05-05 23:54:19
Pinterest
2017-04-23 05:55:34
Pinterestbot
2017-04-22 23:53:40
pipeline-service
2017-02-09 01:33:10
Plukkie
2016-05-22 03:07:34
Prezibot
2016-05-12 14:57:07
psbot
2016-07-25 20:34:26
psbot-page
2017-02-13 16:23:14
redditbot
2017-05-02 08:27:31
ReplazBot
2016-09-29 15:13:23
rogerBot
2017-04-14 21:07:24
RojnameBot
2016-12-04 10:02:19
RookeeBot
2016-05-12 12:07:21
RSSingBot
2016-05-22 07:26:37
SafeDNSBot
2016-05-04 09:29:12
SBL-BOT
2016-05-19 20:43:17
Searchie Bot
2016-09-04 04:58:06
SearchmetricsBot
2016-12-19 07:21:21
semanticbot
2016-05-21 18:04:45
SemrushBot
2016-05-08 05:44:21
seocharger-robot
2017-03-03 13:30:16
SEOChat Bot
2017-04-19 11:37:19
SEOkicks-Robot
2016-05-07 00:50:20
SeznamBot
2016-05-03 16:41:54
SkimBot
2016-05-09 02:11:34
Slack-ImgProxy
2016-05-13 20:19:28
Slackbot-LinkExpanding
2016-05-11 08:55:59
SMTBot
2016-05-08 04:30:36
SocialRankIOBot
2017-04-16 05:07:54
spbot
2016-05-07 12:13:18
special_archiver
2016-05-08 05:50:37
Spiderbot/Nutch
2016-05-05 16:18:23
Spinn3r
2016-05-07 20:35:20
SputnikBot
2016-05-08 06:15:05
SputnikImageBot
2016-05-08 01:34:57
Squidbot/
2016-09-13 00:13:44
sSearch Crawler
2016-06-05 13:06:56
startmebot
2016-05-12 14:00:16
statdom.ru Bot
2016-05-06 23:25:30
StatOnlineRuBot
2016-05-14 12:01:40
StorygizeBot
2017-04-26 20:00:26
SurdotlyBot
2016-05-05 08:47:54
SurveyBot
2016-05-06 16:49:19
Swiftbot
2017-02-22 19:02:13
Tailrank
2016-05-24 14:20:08
TarmotBot
2017-04-12 20:29:22
tcinet.ru Bot
2016-05-07 19:56:34
TeeRaidBot
2016-06-29 17:40:49
TelegramBot
2016-05-06 17:54:40
TinEye-bot
2016-05-06 15:40:53
TOBBOT
2016-07-16 05:39:03
Toweya.com bot
2017-04-23 06:19:16
Toweyabot
2016-10-14 01:43:23
trendictionbot
2016-05-04 09:57:10
tSearchBot
2017-03-27 05:36:52
TurnitinBot
2016-05-02 06:51:42
TweetmemeBot
2016-05-04 15:53:11
Twitterbot
2016-05-07 22:04:47
uipbot
2017-02-25 13:06:24
Uptimebot
2017-04-23 01:48:29
UptimeRobot
2017-04-23 06:45:21
UXCrawlerBot
2016-05-15 00:06:42
VeBot
2016-05-02 06:34:15
Veoozbot
2016-05-09 23:43:24
VoilaBot
2017-04-19 14:34:27
WBSearchBot
2016-05-12 05:04:45
WebAlta Crawler
2016-05-11 06:49:50
WebartexBot
2016-09-25 15:18:43
WebCorpLSEBot
2016-10-27 18:14:35
WebHistoryBot
2017-03-30 13:32:12
Who.is
2016-05-09 19:58:58
woobot
2016-05-20 15:07:29
WordChampBot
2016-05-06 00:33:30
Wotbox
2016-05-07 14:46:01
XoviBot
2016-07-15 18:27:07
yacybot
2016-06-19 19:52:43
YaDirectFetcher
2017-04-11 16:36:39
YandexAccessibilityBot
2016-05-06 16:51:39
YandexAntivirus
2016-05-07 22:30:24
YandexBlogs
2017-05-06 07:56:34
YandexBot
2016-05-08 06:35:29
YandexImageResizer
2016-05-08 06:03:26
YandexImages
2016-05-08 06:34:38
YandexMetrika
2016-05-07 15:02:15
YandexMobileBot
2016-05-08 06:04:21
YandexNews
2016-05-17 17:33:43
YandexVideo
2017-04-23 13:55:13
YandexWebmaster
2016-05-10 02:28:19
YesupBot
2016-05-12 18:57:59
Yeti
2016-05-23 16:34:27
yoozBot
2016-06-17 11:08:58
ZoomBot
2017-02-22 00:37:59
ZumBot
2017-03-13 14:26:06
ZyBorg
2016-06-21 16:41:56