| |
| |
|
|
|
|
| |
|
| |
|
| :: |
| Author |
Message |
junkman
Joined: 18 Nov 2008 Posts: 13
|
Posted: Wed Nov 19, 2008 11:01 am Post subject: problems with robots phpbb3 |
|
|
I recently installed phpbb3 (first time) and everything seems fine except that when making the site map, the same topic is crawled 5 times. After modifying the robots.txt using
User-agent: *
Disallow: /forum/phpBB3/viewtopic.php?p=
Disallow: /forum/phpBB3/viewtopic.php?=&p=
Disallow: /forum/phpBB3/viewtopic.php?t=
Disallow: /forum/phpBB3/viewtopic.php?start=
Disallow: /forum/phpBB3/*&view=previous
Disallow: /forum/phpBB3/*&view=next
Disallow: /forum/phpBB3/*&sid=
Disallow: /forum/phpBB3/*&p=
Disallow: /forum/phpBB3/*&sd=a
It has reduce to 4 times per topic. (only "viewtopic.php?p=" is disallowed) I notice that files having /*&sid=, /*&sd=a, and start=, are not blocked. Puzzling though, is that if I substitute the p for f as in "viewtopic.php?f", everything is disallowed. Can you help please? |
|
|
| Back to top |
|
 |
|
 |
MrGroove PR0


Joined: 17 Oct 2008 Posts: 59 Location: groovyPost.com
|
Posted: Fri Nov 21, 2008 1:04 am Post subject: Re: problems with robots phpbb3 |
|
|
| Are you using a vanilla phpbb3 or the phpbb3 Premod or? |
|
|
| Back to top |
|
 |
SeO Administrateur - Site Admin

Joined: 15 Mar 2006 Posts: 4551
|
Posted: Fri Nov 21, 2008 1:26 pm Post subject: Re: problems with robots phpbb3 |
|
|
Is your forum indeed installed in /forum/phpBB3/ as well ?
If you do not use any url rewriting, then you will still have duplicates.
If you where previously using phpBB2 and converted, then you should drop the viewtopic.php?t= line, because the old topic urls where of that form.
Then, if you want to obtain better results, take look at our SEO preomod, worth a local try IMO  |
_________________ phpBB SEO || SEO Forum || Forum Référencement
GYM Sitemap & RSS for phpBB3 has been released ! || GYM Sitemap & RSS for phpBB3 est disponible ! |
|
| Back to top |
|
 |
junkman
Joined: 18 Nov 2008 Posts: 13
|
Posted: Sat Nov 22, 2008 7:34 am Post subject: Re: problems with robots phpbb3 |
|
|
I am using Phpbb3 prosilver as downloaded and it is installed in
-www.domain.com\forum\phpBB3.
I will drop the viewtopic.php?t= line and see what happens.
Thanks much for your help. |
|
|
| Back to top |
|
 |
|
| Navigation |
Similar Topics |
|
|
|
|
|
|
|
| |
|
|
|
|
| |
|
|
|
|
| |