robots.txt checker
Bots
Name
archive.org bot
URL
http://archive.org/details/archive.org_bot
http://www.archive.org/details/archive.org_bot
Last Seen
2017-04-22 15:03:44
User Agent
IP Ranges
Last Seen
Mozilla/5.0 (compatible; archive.org_bot; Wayback Machine Live Record; +http://archive.org/details/archive.org_bot)
207.241.226.230 - 207.241.226.234
US
207.241.226.215 - 207.241.226.219
US
207.241.225.229
US
207.241.225.235 - 207.241.225.236
US
207.241.225.226 - 207.241.225.227
US
207.241.231.247
US
207.241.225.246
US
207.241.226.94
US
207.241.225.244
US
2016-05-07 21:07:21
Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
207.241.231.148 - 207.241.231.152
US
207.241.231.142 - 207.241.231.147
US
207.241.229.149 - 207.241.229.151
US
207.241.229.49 - 207.241.229.51
US
207.241.229.215
US
207.241.229.198
US
207.241.229.33
US
207.241.229.48
US
207.241.229.31
US
207.241.229.214
US
207.241.229.243
US
...
2016-05-07 11:43:28
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot)
207.241.231.163
US
207.241.231.164
US
2016-05-05 22:30:26
Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20140702-2247 +http://archive.org/details/archive.org_bot)
207.241.229.64
US
207.241.226.163
US
207.241.226.165
US
207.241.226.207
US
207.241.229.81
US
207.241.226.96
US
207.241.229.82
US
207.241.226.107
US
207.241.229.67
US
207.241.226.208
US
207.241.225.53
US
...
2017-04-22 15:03:44