Posts Tagged ‘spiders’
Why is my xml sitemap getting indexed on Yahoo?
I’ve got a site that sells some products. When you search for that product on Yahoo, it shows the xml sitemap on Yahoo instead of the page.
Is there a way to stop this from happening so that the spiders/bots can still crawl all the links with in the xml sitemap but not actually show up on the search engine?