Posts Tagged ‘search engine’

I’ve got a site that sells some products. When you search for that product on Yahoo, it shows the xml sitemap on Yahoo instead of the page.

Is there a way to stop this from happening so that the spiders/bots can still crawl all the links with in the xml sitemap but not actually show up on the search engine?

i am developing a search engine project in that i need to convert a HTML file to XML file.. i planned to work out in ASP.Net.. in that i am giving HIGH significance level to meta tags, title tags etc.. MEDIUM significance to bold,italics,para etc.. LOW to body of the HTML file.. this is used for just calculating the score of the page.. so how can i convert a HTML(semi structured) to XML(well structured)..

I have a website and 5 subdomains, and only my main homapage have sitemap.xml and robots.txt. I want all of my subdomains to be indexed by search engine. do i have to make robots.txt and sitemap.xml on every subdomain?

Does anyone here know a great tutorial on how to create a search engine to search my xml pages, and then to return data (with room for advertisements)