hello

i want ask about one robots.txt rule
this one :

Code: Select all

Disallow: /viewtopic.php?

i have installed zero dupe and all SEO mod for www.ariantalk.com
from 2 days ago 6800 URL are submitted in google sitemap and in my sitemap account i saw that 8600 URL restricted by that robots.txt rule i mentiond above.

this forum was active for two years and has lot of internal link in standard URL shape

that robots.txt cause google don't follow that link and as you know google after indexing page will return to check that page again but now all that old topics are restricted by that rule

is it necessary to keep that rule ?

i have installed zero dupe

Not really with the zero dupe.

As you mention, if those where already crawled, you'd better let the zero dupe do it all.

++

good call. i have the same in google sitemaps, so I'd like to remove those lines to un-restrict the urls from robots.txt.

I'll give it a shot!

hi mreider

please read this one too

-http://www.phpbb-seo.com/boards/dev-and-code/discussions-vt516.html#4160