Yahoo! Search Adds Support for X-Robots-Tag Directive
Posted by jonathan at 10:46am EST on 12/06/2007
Yahoo! Search posted this on their blog yesterday. A small update to their robot controls to allow more extensive use of the X-Robots-Tag directive. Here are the updates.
- X-Robots-Tag: NOINDEX — If you don’t want to show the URL in the Yahoo! Search results.
- X-Robots-Tag: NOARCHIVE — If you don’t want to display cache link in the search results page.
- X-Robots-Tag: NOSNIPPET — If you don’t want to display summary in the search results page.
- X-Robots-Tag: NOFOLLOW — If you don’t want Yahoo! to crawl links in the page.
The one I find particularly interesting is the NOSNIPPET robot tag. I haven’t seen this available anywhere — or even seen the tag at all before.
Some major search engines support the use of NOODP, such as this tag, , but not all support it; Live.com, to name a specific search engine, does support it.
Oh yeah, Yahoo! Search is at SES Chicago and PubCon if you want to stop by and say hi to them.
