my sitemaps.xml

abud · Joined: 23 Jun 2006 Posts: 16

hi, I want to ask...yesterday I checked my site on google..and i found my sitemaps.xml indexed by google...,is it ok?? Do I have to add sitemaps.xml to robots.txt??

http://www.google.com/search?q=site:www.ford-forums.net&hl=en&lr=&rls=GGGL,GGGL:2006-16,GGGL:en&filter=0

Thanks for time Smile

dcz · Posted: Sat Jul 01, 2006 12:07 am Post subject: Re: my sitemaps.xml

Actually I bet this is because those links where posted either here on this site or elsewhere.

Then, I am not sure you can disallow them with robots.txt and still have Google crawl them. It's not sure at all Google will bypass the robots.txt because it's a Google sitemaps.

Anyway, it's no big deal, because these are going to be ignored by Google when it will have found more pages in your site. The only issue here could be these URLs to be loaded ten times per second, but even then, we could react and check if it's really Google loading the sitemap before loading it.

Actually, I have seen in my log that other bots where spidering my sitemaps, so one could think they are able to grab the URLs in them, as they are presented in a rather simple way. So ...

Then, if you want to track you SEO results a bit, since you just installed the mod rewrite and such, you can read this post Wink

++