Robots.txt

phpBB3 SEO Mixed mod Rewrite support forum. This mods performs URL rewriting for phpBB3, injecting forums in their URLs and keeping a static rewriting for topics.

Moderator: Moderators


Robots.txt

Postby tcf » Mon Jan 25, 2010 5:17 pm

Hi all,

When should I upload the robots.txt to prevent google indexing viewtopic etc. etc.

My board was active and indexed prior to install phpbb-seo and setting it to mixed mode.

Im worried with how google will index though? as I have a mod that shows what thread is being viewed in the view online. now when google bot is active and i follow it. the url presented is not the nice looking one that we want indexed?

cheers
tcf
 
Posts: 14
Joined: Wed Jan 20, 2010 10:47 am

Advertisement

Re: Robots.txt

Postby HB » Tue Jan 26, 2010 4:07 pm

If you have the no dupe mod activated, there's no rush to modify the robots.txt. Google will continue to follow (and update where necessary) the "old" URLs. From phpBB SEO Premod V 3.0.6:

SeO wrote:robots.txt
A sample robots.txt is provided in the package to make sure no useless content is taken into account by the Search Engines.

Warning :
  • In case you are migrating from a previous unrewritten phpBB version, wait couple month after you activate the zero duplicate mod before you implement the robots.txt. In such case we want to redirect first and then drop useless content.
Dan Kehn
HB
phpBB SEO Team
phpBB SEO Team
 
Posts: 1109
Joined: Mon Oct 16, 2006 2:25 am

Re: Robots.txt

Postby tcf » Tue Jan 26, 2010 7:59 pm

HB wrote:If you have the no dupe mod activated, there's no rush to modify the robots.txt. Google will continue to follow (and update where necessary) the "old" URLs. From phpBB SEO Premod V 3.0.6:

SeO wrote:robots.txt
A sample robots.txt is provided in the package to make sure no useless content is taken into account by the Search Engines.

Warning :
  • In case you are migrating from a previous unrewritten phpBB version, wait couple month after you activate the zero duplicate mod before you implement the robots.txt. In such case we want to redirect first and then drop useless content.


Hi,

Thanks for the response. I have not used the premod tho. I did test with it at first, but i actually took the upgrade option on the live board. will this make a difference?

I dont have the zero duplicate installed. I guess this is recomended?? and if so do i activitate immeidetly? then set the robots.txt a few months after that?

Will the zero duplicate mean that viewtopic will no longer work?? as I have an exteranal source that autoposts reviews if this is the case that will setup will need to be changed also i guess

Cheers

Andy
tcf
 
Posts: 14
Joined: Wed Jan 20, 2010 10:47 am

Re: Robots.txt

Postby HB » Wed Jan 27, 2010 4:01 pm

tcf wrote:will this make a difference? I dont have the zero duplicate installed. I guess this is recomended?? and if so do i activitate immeidetly? then set the robots.txt a few months after that? Will the zero duplicate mean that viewtopic will no longer work??

Yes. Yes. Yes. Yes. No.
Dan Kehn
HB
phpBB SEO Team
phpBB SEO Team
 
Posts: 1109
Joined: Mon Oct 16, 2006 2:25 am


Return to Mixed SEO URL

 


  • Related topics
    Replies
    Views
    Last post
  • My robots.txt
    by megh789 » Fri Feb 27, 2009 6:51 pm
    1 Replies
    167 Views
    Last post by SeO View the latest post
    Tue Mar 03, 2009 11:26 am

Who is online

Users browsing this forum: No registered users and 6 guests


 
cron