umutgultekin
Joined: 26 Apr 2008
Posts: 3
|
 Posted: Mon Apr 28, 2008 10:13 am Post subject: Google is not crawling anymore |
|
|
Hi,
Could you please help me? I have PHPBB3 forum which has all of the SEO mods applied. It is running on a subfolder called forum. Before the mods, following htaccess file was working fine and I had no problem with google crawling the site.
| Code: | RewriteCond %{HTTP_HOST} ^daihatsuaskina.com$ [OR]
RewriteCond %{HTTP_HOST} ^www.daihatsuaskina.com$
RewriteRule ^/?$ http://www.daihatsuaskina.com/forum [R=301,L] |
And then I installed the mods, so I had new lines on my htaccess:
| Code: |
# Lines That should already be in your .htacess
<Files "config.php">
Order Allow,Deny
Deny from All
</Files>
<Files "common.php">
Order Allow,Deny
Deny from All
</Files>
# You may need to un-comment the following line
# Options +FollowSymlinks
# REMEBER YOU ONLY NEED TO STARD MOD REWRITE ONCE
RewriteEngine On
# REWRITE BASE
RewriteBase /
# HERE IS A GOOD PLACE TO ADD THE WWW PREFIXE REDIRECTION
#####################################################
# PHPBB SEO REWRITE RULES - ADVANCED
#####################################################
# AUTHOR : dcz www.phpbb-seo.com
# STARTED : 01/2006
#################################
# FORUMS PAGES
###############
# FORUM INDEX
RewriteRule ^forum/forum\.html$ /forum/index.php [QSA,L,NC]
# FORUM
RewriteRule ^forum/[a-z0-9_-]*-f([0-9]+)(-([0-9]+))?\.html$ /forum/viewforum.php?f=$1&start=$3 [QSA,L,NC]
# TOPIC WITH VIRTUAL FOLDER
RewriteRule ^forum/[a-z0-9_-]*-f([0-9]+)/[a-z0-9_-]*-t([0-9]+)(-([0-9]+))?\.html$ /forum/viewtopic.php?f=$1&t=$2&start=$4 [QSA,L,NC]
# GLOBAL ANNOUNCES WITH VIRTUAL FOLDER
RewriteRule ^forum/duyuru/[a-z0-9_-]*-t([0-9]+)(-([0-9]+))?\.html$ /forum/viewtopic.php?t=$1&start=$3 [QSA,L,NC]
# TOPIC WITHOUT FORUM ID & DELIM
RewriteRule ^forum/([a-z0-9_-]*)/?[a-z0-9_-]*-t([0-9]+)(-([0-9]+))?\.html$ /forum/viewtopic.php?forum_uri=$1&t=$2&start=$4 [QSA,L,NC]
# PROFILES ADVANCED
RewriteRule ^forum/[a-z0-9_-]*-u([0-9]+)\.html$ /forum/memberlist.php?mode=viewprofile&u=$1 [QSA,L,NC]
# USER MESSAGES ADVANCED
RewriteRule ^forum/[a-z0-9_-]*-u([0-9]+)-(topics|posts)(-([0-9]+))?\.html$ /forum/search.php?author_id=$1&sr=$2&start=$4 [QSA,L,NC]
# GROUPS ADVANCED
RewriteRule ^forum/[a-z0-9_-]*-g([0-9]+)(-([0-9]+))?\.html$ /forum/memberlist.php?mode=group&g=$1&start=$3 [QSA,L,NC]
# POST
RewriteRule ^forum/gonderi([0-9]+)\.html$ /forum/viewtopic.php?p=$1 [QSA,L,NC]
# ACTIVE TOPICS
RewriteRule ^forum/aktif-konular(-([0-9]+))?\.html$ /forum/search.php?search_id=active_topics&start=$2&sr=topics [QSA,L,NC]
# UNANSWERED TOPICS
RewriteRule ^forum/yanitsiz(-([0-9]+))?\.html$ /forum/search.php?search_id=unanswered&start=$2&sr=topics [QSA,L,NC]
# NEW POSTS
RewriteRule ^forum/yeni(-([0-9]+))?\.html$ /forum/search.php?search_id=newposts&start=$2&sr=topics [QSA,L,NC]
# THE TEAM
RewriteRule ^forum/takim\.html$ /forum/memberlist.php?mode=leaders [QSA,L,NC]
# HERE IS A GOOD PLACE TO ADD OTHER PHPBB RELATED REWRITERULES
# FORUM WITHOUT ID & DELIM
# THESE FOUR LINES MUST BE LOCATED AT THE END OF YOUR HTACCESS TO WORK PROPERLY
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_FILENAME} !-l
RewriteRule ^forum/([a-z0-9_-]+)(-([0-9]+))?\.html$ /forum/viewforum.php?forum_uri=$1&start=$3 [QSA,L,NC]
# END PHPBB PAGES
#####################################################
|
Funny thing is, when the SEO MOD's lines are entered to htaccess, google is not crawling my site. When I remove the lines, it is working again.
I am testing the site with the following site:
http://www.smart-it-consulting.com/internet/google/googlebot-spoofer/index.htm
It reports OK when htaccess file only has my redirection lines. But it reports error when I enter the MOD's lines. Error code is also funny. HTTP Error 301.
I know that 301 is moved permanently. However, my redirection lines which are working, doesn't give this error and the site continues its operation as appearing googlebot and it also shows on who's online page at the forum as googlebot.
As soon as I enter the MOD's lines, It is working again but not for googlebot and for this spoofer.
Am I missing something?
Thanks in advance for your reply.
Kind regards,
Umut |
|
|
) redirected to 