Hello,
i just had a look at my latest cpanel error log messages and I've found a lot of these entries...

Code: Select all

File does not exist: /home/public_html/forum-sitemap-81.xml
File does not exist: /home/public_html/forum-sitemap-50.xml
File does not exist: /home/public_html/forum-sitemap-79.xml
File does not exist: /home/public_html/forum-sitemap-50.xml
File does not exist: /home/public_html/forum-sitemap-66.xml
File does not exist: /home/public_html/forum-sitemap77.xml.gz
File does not exist: /home/public_html/forum-sitemap-77.xml.gz
File does not exist: /home/public_html/forum-sitemap-55.xml
File does not exist: /home/public_html/forum-sitemap-75.xml
File does not exist: /home/public_html/forum-sitemap-77.xml
File does not exist: /home/public_html/forum-sitemap-64.xml
File does not exist: /home/public_html/sitemap-forum.xml
File does not exist: /home/public_html/forum-sitemap-1.xml


I've only copied some... but there are really a lot of these entries, all similar.
Is it normal that bots search for such links and cannot find them? Where do they get these links to follow?

I've just checked my sitemaps.xml and my forum-sitemap.xml and they both seem to work fine... so I don't see why these non existing urls come from...

I use mixed mod rewrite and this is my .htaccess, if might help:

Code: Select all

Options +FollowSymlinks
RewriteEngine On
RewriteBase /

#########################################################
# PHPBB SEO REWRITE RULES            #
#########################################################
# AUTHOR : DCZ http://www.phpbb-seo.com/
# STARTED : 01/2006
#####################################################
# FORUMS PAGES
########################
# FORUM INDEX (un-comment if used)
# RewriteRule ^index\.html$ /index.php [QSA,L]
# FORUM PROTECTION RULE
RewriteRule ^board/.+/([^/]+\.html)$ /board/index.php [R=301,L]
# CATEGORIES
RewriteRule ^board/.+-vc([0-9]+)\.html$ /board/index.php?c=$1 [QSA,L]
# PAGINATED FORUM
RewriteRule ^board/.+-vf([0-9]+)-([0-9]+)\.html$ /board/viewforum.php?f=$1&start=$2 [QSA,L]
# FORUM
RewriteRule ^board/.+-vf([0-9]+)\.html$ /board/viewforum.php?f=$1 [QSA,L]
# PAGINATED TOPIC
RewriteRule ^board/topic([0-9]+)-([0-9]+)\.html$ /board/viewtopic.php?t=$1&start=$2 [QSA,L]
# TOPIC
RewriteRule ^board/topic([0-9]+)\.html$ /board/viewtopic.php?t=$1 [QSA,L]
# POST
RewriteRule ^board/post([0-9]+)\.html$ /board/viewtopic.php?p=$1 [QSA,L]
#PROFILES
RewriteRule ^board/member([0-9]+)\.html$ /board/profile.php?mode=viewprofile&u=$1 [QSA,L]
# END PHPBB PAGES
#####################################################
#########################################################
# GYM SITEMAPS AND RSS REWRITE RULES         #
#########################################################
# AUTHOR : dcz http://www.phpbb-seo.com/
# STARTED : 2006/02/22
########################
# RSS main
RewriteRule ^rss-?(l|s)?-?(m)?\.([xml|xml\.gz]+)$ /rss.php?$1&$2 [L]
# RSS forums
RewriteRule ^forums-rss-?(l|s)?-?(m)?\.([xml|xml\.gz]+)$ /rss.php?forum&c&$1&$2 [L]
# RSS all
RewriteRule ^([a-zA-Z0-9]+)-rss([0-9]*)-?(l|s)?-?(m)?\.([xml|xml\.gz]+)$ /rss.php?$1=$2&$3&$4 [L]
# RSS forum topics
RewriteRule ^.+-rf([0-9]+)-?(l|s)?-?(m)?\.([xml|xml\.gz]+)$ /rss.php?forum=$1&$2&$3 [L]
# SitemapIndex
RewriteRule ^sitemaps\.([xml|xml\.gz]+)$ /sitemap.php [L]
# Sitemap modules
RewriteRule ^([a-zA-Z0-9]+)-sitemap\.([xml|xml\.gz]+)$ /sitemap.php?$1 [L]
# Forum Sitemaps
RewriteRule ^.+-gf([0-9]+)\.([xml|xml\.gz]+)$ /sitemap.php?forum=$1 [L]
# Yahoo! urllist.txt
RewriteRule ^urllist\.([txt|txt\.gz]+)$ /urllist.php [L]
#########################################################
# END GYM SITEMAPS AND RSS REWRITE RULES      #
#########################################################
#########################################################
# MX SITEMAPS REWRITE RULES   SIMPLE         #
#########################################################
# AUTHOR : dcz http://www.phpbb-seo.com/
# STARTED : 2006/04/28
########################################################
# INDEX
RewriteRule ^board/sitemaps\.html$ /board/sitemaps.php [QSA,L]
# PORTAL INDEX
RewriteRule ^board/mx-map\.html$ /board/sitemaps.php?mx [QSA,L]
# FORUM INDEX
RewriteRule ^board/forum-map\.html$ /board/sitemaps.php?fim [QSA,L]
# PAGINATED FORUM MAP
RewriteRule ^board/.+-fmp([0-9]+)-([0-9]+)\.html$ /board/sitemaps.php?fmp=$1&start=$2 [QSA,L]
# FORUM MAP
RewriteRule ^board/.+-fmp([0-9]+)\.html$ /board/sitemaps.php?fmp=$1 [QSA,L]
# CATEGORIES
RewriteRule ^board/.+-sc([0-9]+)\.html$ /board/sitemaps.php?c=$1 [QSA,L]
#########################################################
# END SITEMAPS REWRITE RULES            #
#########################################################

By the way, regarding this mod i have put the 3 files sitemap.php, rss.php, urllist.php in the root of my domain, by editing inside them the

Code: Select all

   $phpbb_root_path = './';

to

Code: Select all

   $phpbb_root_path = './board/';

because my forum is under that subdirectory.

Just looks like these are the older URLs, the one you stop using when you updated.

So if you did not resubmit, Google will test the older ones until it will download the new sitemapIndex.

++

When I installed the new version of this mod, 3 days ago,
I resubmitted all the links as new, both in Yahoo! Site Explorer and Google sitemaps tools, I did this also yesterday...
But I don't know why they both still search for these non-existing links, it's not really a problem, because I don't see any error in both management control panels (yahoo and google tools).

Maybe after a few days this will end, hopefully