I recently installed phpbb3 (first time) and everything seems fine except that when making the site map, the same topic is crawled 5 times. After modifying the robots.txt using
User-agent: *
Disallow: /forum/phpBB3/viewtopic.php?p=
Disallow: /forum/phpBB3/viewtopic.php?=&p=
Disallow: /forum/phpBB3/viewtopic.php?t=
Disallow: /forum/phpBB3/viewtopic.php?start=
Disallow: /forum/phpBB3/*&view=previous
Disallow: /forum/phpBB3/*&view=next
Disallow: /forum/phpBB3/*&sid=
Disallow: /forum/phpBB3/*&p=
Disallow: /forum/phpBB3/*&sd=a
It has reduce to 4 times per topic. (only "viewtopic.php?p=" is disallowed) I notice that files having /*&sid=, /*&sd=a, and start=, are not blocked. Puzzling though, is that if I substitute the p for f as in "viewtopic.php?f", everything is disallowed. Can you help please?

English |
French

