robots.txt settings

phpBB3 SEO Advanced mod Rewrite support forum.
This mods performs URL rewriting for phpBB, injecting forums and topic titles in their URLs.

Moderator: Moderators

robots.txt settings

Postby sansar » Mon Mar 17, 2008 5:19 pm

hi, when i set my robots.txt as in the mod's robots.txt google visit my site but no indexes pages. when i delete these rows
Code: Select all
Disallow: /phpbb/viewtopic.php
Disallow: /phpbb/viewforum.php
Disallow: /phpbb/index.php?
Disallow: /phpbb/posting.php
Disallow: /phpbb/search.php?
Disallow: /phpbb/ucp.php
Disallow: /phpbb/mcp.php
Disallow: /phpbb/post
Disallow: /phpbb/member
Disallow: /phpbb/memberlist.php
Disallow: /phpbb/faq.php
google index my pages as post345.html, not abc-edf-f34.html. how can i solve this problem?
User avatar
sansar
 
Posts: 16
Joined: Sun Mar 16, 2008 10:40 am

Advertisement

Postby fabiomaticus » Tue Mar 18, 2008 10:10 pm

I have this error.
fabiomaticus
PR0
PR0
 
Posts: 51
Joined: Wed Jun 06, 2007 11:46 am
Location: Taranto - Italy

Re: robots.txt settings

Postby HB » Wed Mar 19, 2008 2:31 am

sansar wrote:google index my pages as post345.html, not abc-edf-f34.html. how can i solve this problem?

My guess is the "post" icon in the left hand corner wasn't mapped to the topic URL because you selected "No" in ACP > phpBB SEO Class settings:

The No duplictate:
The No duplicate mod remplaces posts URLs with the corresponding Topic URL (with pagination).
It does not add any SQL, just a LEFT JOIN on a query already being performed, this could still mean a bit more work but should not be a problem for server load.

PS: Please please, somebody buy dcz a spell checker! :lol:
Dan Kehn
HB
phpBB SEO Team
phpBB SEO Team
 
Posts: 1211
Joined: Mon Oct 16, 2006 2:25 am

Re: robots.txt settings

Postby HB » Wed Mar 19, 2008 2:35 am

Continued... and "No" here:
Activate the Zero duplictate:
Allow to activate and desactivate the Zero duplicate redirections.

This will result in Google adding BOTH the rewritten URL and the postNNN.html URL. You can either zero dupe it (post -> topic injected URL) or use the first option to generate the topic URL directly. The drawback is another join and the remote chance that someone will refer to a post that is later split (i.e., the postNNN.html links are permanent -- even if you split a topic, the post URL stays the same; topic injected URLs can change for the split off posts if the topic is split).
Dan Kehn
HB
phpBB SEO Team
phpBB SEO Team
 
Posts: 1211
Joined: Mon Oct 16, 2006 2:25 am

Postby fabiomaticus » Wed Mar 19, 2008 9:14 am

fabiomaticus
PR0
PR0
 
Posts: 51
Joined: Wed Jun 06, 2007 11:46 am
Location: Taranto - Italy

Re: robots.txt settings

Postby dcz » Sun Mar 23, 2008 6:04 pm

HB wrote:PS: Please please, somebody buy dcz a spell checker! :lol:

:lol: Actually, I'm able to trick both FF and Google toolbar spellcheckers :lol:

fabiomaticus, you just need to be logged in to be able to download this one.

And sansar, was your forum previously indexed using the un-rewritten urls ?

If so, you should only use the zero duplicate, with the post redirection at least set to "Guest" in acp, and then one or two month after, implement the suggested robots.txt.

SE should take the new url into account pretty fast this way, Google especially.

++
Useful links :
SEO Forum || SEO Directory || SEO phpBB || Search
____________________

Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
dcz
Admin
Admin
 
Posts: 21219
Joined: Fri Apr 28, 2006 9:03 pm

Postby sansar » Wed Mar 26, 2008 8:10 pm

thanks, but i don't understand exactly what i must do. my robots.txt is like that:

Code: Select all
Disallow: /httpdocs/forum/viewtopic.php
Disallow: /httpdocs/forum/viewforum.php
Disallow: /httpdocs/forum/index.php?
Disallow: /httpdocs/forum/posting.php
Disallow: /httpdocs/forum/search.php?
Disallow: /httpdocs/forum/ucp.php
Disallow: /httpdocs/forum/mcp.php
Disallow: /httpdocs/forum/post
Disallow: /httpdocs/forum/member
Disallow: /httpdocs/forum/memberlist.php
Disallow: /httpdocs/forum/faq.php


And how do mod settings must be?

Profiles and groups injection:?
Profiles ID removing:?
Search User Page rewriting:?
SID Removing:?
Highlights Removing:?
Remove small words:?
Virtual Folder:?
Virtual Root:?
Forum URL caching:?
Forum ID Removing:?
User avatar
sansar
 
Posts: 16
Joined: Sun Mar 16, 2008 10:40 am

Postby sansar » Thu Mar 27, 2008 4:17 pm

thanks all you, i think its ok now!
User avatar
sansar
 
Posts: 16
Joined: Sun Mar 16, 2008 10:40 am

Postby dcz » Sat Mar 29, 2008 6:52 pm

You did or did not implement a robots.txt ?

You really need to wait couple month before you install it, since you are redirecting already indexed urls.


++
Useful links :
SEO Forum || SEO Directory || SEO phpBB || Search
____________________

Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
dcz
Admin
Admin
 
Posts: 21219
Joined: Fri Apr 28, 2006 9:03 pm


Return to Advanced SEO URL

 


  • Related topics
    Replies
    Views
    Last post

Who is online

Users browsing this forum: No registered users and 3 guests