Feed Sign in with OpenID OpenID

Simon Willison’s Weblog

The X-Robots-Tag HTTP header. News to me, but both Google and Yahoo! have supported it since last year. You can add per-page robots exclusion rules in HTTP headers instead of using meta tags, and Google’s version supports unavailable_after which is handy for content with a known limited shelf-life.

Tagged , , , ,

0 comments

No comments.

Comments are closed.
A django site