Dec
06

Yahoo! Search Adds Support for X-Robots-Tag Directive

Written by Jonathan Dingman
12/06/2007 10:11 ET - Filed under Search

Yahoo! Search posted this on their blog yesterday. A small update to their robot controls to allow more extensive use of the X-Robots-Tag directive. Here are the updates.

  • X-Robots-Tag: NOINDEX — If you don’t want to show the URL in the Yahoo! Search results.
  • X-Robots-Tag: NOARCHIVE — If you don’t want to display cache link in the search results page.
  • X-Robots-Tag: NOSNIPPET — If you don’t want to display summary in the search results page.
  • X-Robots-Tag: NOFOLLOW — If you don’t want Yahoo! to crawl links in the page.

The one I find particularly interesting is the NOSNIPPET robot tag. I haven’t seen this available anywhere — or even seen the tag at all before.

Some major search engines support the use of NOODP, such as this tag, , but not all support it; Live.com, to name a specific search engine, does support it.

Oh yeah, Yahoo! Search is at SES Chicago and PubCon if you want to stop by and say hi to them.

Tags:
  • Subscribe via RSS
  • Bookmark to del.icio.us