Are NoIndex And NoFollow Meta Tags Being Ignored By Bing?
Friday, September 25th, 2009
According to a recent post on WebProNews, Microsoft has admitted a problem with Bing whereby pages marked as NoIndex or NoFollow are being ignored by the ‘MSN Bot’ when crawling a website.
NoIndex and NoFollow Meta Tags can be used to advise search engine spiders to avoid indexing specific web pages. There are a number of reasons why you might want to use these tags, such as preventing duplicate content, or private or non essential web pages from being indexed.
The industry standard NoIndex and NoFollow Meta Tags are recognised by all major search engines including Google and Yahoo. Therefore this problem only appears to be affecting Bing.
According to Brett Yount from Bing’s webmaster team, Bing have acknowledged that there is a problem.
“This is a known issue we are working quickly to resolve. If you have pages you would like permanently removed from our index, please send me a mail to bwmc@microsoft.com with your domain name and “MSNBot ignoring robots tags” in the subject line. Please also include the URLs in the body of the message. You may use an * wildcard for any directories such as, http:example.com/ wrongdirectory/*
Normally, I would request that you fill out a content removal request, however, since this is a problem on our side, I’ll do the leg work for you.”
So, if you have pages within your website that are using these NoIndex Meta Tags, I would strongly recommend checking these pages in the Bing search results and taking appropriate action to establish if they have been indexed in error.
If you would like further information on how to prevent search engine spiders from indexing your web pages I would recommend you review other methods supported by the Robots Exclusion Standard.
If you found this post helpful, why not subscribe to my Blog by RSS Feed or Email and receive free Professional SEO Tips and Market News, direct to your inbox. As ever, please feel free to comment on this post.




















Here is the third Google video from their webmaster educational series – “Speeding up in a Slowdown”.


