| |
| |
|
|
|
|
| |
|
| |
|
| :: |
| Author |
Message |
abud
Joined: 23 Jun 2006 Posts: 16
|
|
| Back to top |
|
 |
|
 |
dcz Administrateur - Site Admin

Joined: 28 Apr 2006 Posts: 15242
|
Posted: Sat Jul 01, 2006 12:07 am Post subject: Re: my sitemaps.xml |
|
|
Actually I bet this is because those links where posted either here on this site or elsewhere.
Then, I am not sure you can disallow them with robots.txt and still have Google crawl them. It's not sure at all Google will bypass the robots.txt because it's a Google sitemaps.
Anyway, it's no big deal, because these are going to be ignored by Google when it will have found more pages in your site. The only issue here could be these URLs to be loaded ten times per second, but even then, we could react and check if it's really Google loading the sitemap before loading it.
Actually, I have seen in my log that other bots where spidering my sitemaps, so one could think they are able to grab the URLs in them, as they are presented in a rather simple way. So ...
Then, if you want to track you SEO results a bit, since you just installed the mod rewrite and such, you can read this post
++ |
_________________ Useful links :
SEO Forum || SEO Directory || SEO phpBB || SEO phpBB3 || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Référencement phpBB3 || Recherche |
|
| Back to top |
|
 |
|
| Navigation |
Similar Topics |
|
|
|
|
|
|
|
| |
|
|
|
|
| |
|
|
|
|
| |