Simon Willison’s Weblog

The Internet Archive should actively partner with bit.ly / tinyurl.com / icanhaz.com etc. and maintain a mirror database of their redirects

— Me, on Twitter

Posted 8th March 2009 at 2:59 pm

Tagged bitly, icanhaz, internetarchive, me, tinyurl, twitter, urlshorteners

1 comment

A more pressing issue, IMHO, is that IA respects robots.txt retroactively, so that expired domain squatters are slowly eating the archive.

I've seen it on many great sites.

I understand the copyright concern which causes respect for robots.txt, but IA should require some proof of ownership continuance before removing prior archives.

In any case, I think URL xref services like is.gd, etc. should standardize on expiry strategy-- if that's IA, so be it.

Jeremy Dunck - 9th March 2009 01:31 - #

Comments are closed.