Google is not crawling anymore

[umutgultekin]

Hi,

Could you please help me? I have PHPBB3 forum which has all of the SEO mods applied. It is running on a subfolder called forum. Before the mods, following htaccess file was working fine and I had no problem with google crawling the site.

Code: Select all

RewriteCond %{HTTP_HOST} ^daihatsuaskina.com$ [OR]
RewriteCond %{HTTP_HOST} ^www.daihatsuaskina.com$
RewriteRule ^/?$ http://www.daihatsuaskina.com/forum [R=301,L]

And then I installed the mods, so I had new lines on my htaccess:

Code: Select all

    # Lines That should already be in your .htacess
    <Files "config.php">
    Order Allow,Deny
    Deny from All
    </Files>
    <Files "common.php">
    Order Allow,Deny
    Deny from All
    </Files>

    # You may need to un-comment the following line
    # Options +FollowSymlinks
    # REMEBER YOU ONLY NEED TO STARD MOD REWRITE ONCE
    RewriteEngine On
    # REWRITE BASE
    RewriteBase /
    # HERE IS A GOOD PLACE TO ADD THE WWW PREFIXE REDIRECTION

    #####################################################
    # PHPBB SEO REWRITE RULES - ADVANCED
    #####################################################
    # AUTHOR : dcz www.phpbb-seo.com
    # STARTED : 01/2006
    #################################
    # FORUMS PAGES
    ###############
    # FORUM INDEX
    RewriteRule ^forum/forum\.html$ /forum/index.php [QSA,L,NC]
    # FORUM
    RewriteRule ^forum/[a-z0-9_-]*-f([0-9]+)(-([0-9]+))?\.html$ /forum/viewforum.php?f=$1&start=$3 [QSA,L,NC]
    # TOPIC WITH VIRTUAL FOLDER
    RewriteRule ^forum/[a-z0-9_-]*-f([0-9]+)/[a-z0-9_-]*-t([0-9]+)(-([0-9]+))?\.html$ /forum/viewtopic.php?f=$1&t=$2&start=$4 [QSA,L,NC]
    # GLOBAL ANNOUNCES WITH VIRTUAL FOLDER
    RewriteRule ^forum/duyuru/[a-z0-9_-]*-t([0-9]+)(-([0-9]+))?\.html$ /forum/viewtopic.php?t=$1&start=$3 [QSA,L,NC]
    # TOPIC WITHOUT FORUM ID & DELIM
    RewriteRule ^forum/([a-z0-9_-]*)/?[a-z0-9_-]*-t([0-9]+)(-([0-9]+))?\.html$ /forum/viewtopic.php?forum_uri=$1&t=$2&start=$4 [QSA,L,NC]
    # PROFILES ADVANCED
    RewriteRule ^forum/[a-z0-9_-]*-u([0-9]+)\.html$ /forum/memberlist.php?mode=viewprofile&u=$1 [QSA,L,NC]
    # USER MESSAGES ADVANCED
    RewriteRule ^forum/[a-z0-9_-]*-u([0-9]+)-(topics|posts)(-([0-9]+))?\.html$ /forum/search.php?author_id=$1&sr=$2&start=$4 [QSA,L,NC]
    # GROUPS ADVANCED
    RewriteRule ^forum/[a-z0-9_-]*-g([0-9]+)(-([0-9]+))?\.html$ /forum/memberlist.php?mode=group&g=$1&start=$3 [QSA,L,NC]
    # POST
    RewriteRule ^forum/gonderi([0-9]+)\.html$ /forum/viewtopic.php?p=$1 [QSA,L,NC]
    # ACTIVE TOPICS
    RewriteRule ^forum/aktif-konular(-([0-9]+))?\.html$ /forum/search.php?search_id=active_topics&start=$2&sr=topics [QSA,L,NC]
    # UNANSWERED TOPICS
    RewriteRule ^forum/yanitsiz(-([0-9]+))?\.html$ /forum/search.php?search_id=unanswered&start=$2&sr=topics [QSA,L,NC]
    # NEW POSTS
    RewriteRule ^forum/yeni(-([0-9]+))?\.html$ /forum/search.php?search_id=newposts&start=$2&sr=topics [QSA,L,NC]
    # THE TEAM
    RewriteRule ^forum/takim\.html$ /forum/memberlist.php?mode=leaders [QSA,L,NC]
    # HERE IS A GOOD PLACE TO ADD OTHER PHPBB RELATED REWRITERULES

    # FORUM WITHOUT ID & DELIM
    # THESE FOUR LINES MUST BE LOCATED AT THE END OF YOUR HTACCESS TO WORK PROPERLY
    RewriteCond %{REQUEST_FILENAME} !-f
    RewriteCond %{REQUEST_FILENAME} !-d
    RewriteCond %{REQUEST_FILENAME} !-l
    RewriteRule ^forum/([a-z0-9_-]+)(-([0-9]+))?\.html$ /forum/viewforum.php?forum_uri=$1&start=$3 [QSA,L,NC]
    # END PHPBB PAGES
    #####################################################


Funny thing is, when the SEO MOD's lines are entered to htaccess, google is not crawling my site. When I remove the lines, it is working again.

I am testing the site with the following site:
http://www.smart-it-consulting.com/inte ... /index.htm

It reports OK when htaccess file only has my redirection lines. But it reports error when I enter the MOD's lines. Error code is also funny. HTTP Error 301.

I know that 301 is moved permanently. However, my redirection lines which are working, doesn't give this error and the site continues its operation as appearing googlebot and it also shows on who's online page at the forum as googlebot.

As soon as I enter the MOD's lines, It is working again but not for googlebot and for this spoofer.

Am I missing something?

Thanks in advance for your reply.

Kind regards,
Umut

[dcz]

Well, everything seems to be working great, 301 is normal if you try http://www.daihatsuaskina.com/forum or http://www.daihatsuaskina.com/forum/

since they actually are HTTP 301 (aren't they duplicates ) redirected to http://www.daihatsuaskina.com/forum/forum.html

but the last one does work as expected.

So Google can access you site without problems, and by the way does : http://www.google.fr/search?q=site:www. ... com/forum/

++