hi

me again

i check my site indexed page in yahoo.
i saw that pages are indexed with anchor tags. like this URL

forum.persia-cms.com/persia-cms-vt92.html#342

i have this problem only with yahoo.
all of sites that i have installed zero dupe on them have this problem.
in other search engline everything is normal but in yahoo ....

This is absolutely not an issue.

-forum.persia-cms.com/persia-cms-vt92.html#342 and -forum.persia-cms.com/persia-cms-vt92.html are not duplicate, any decent bots knows its just an html anchor in the same page.

Now, I had not noticed such URL listed before, maybe it is because the post links are finally useful as they are redirected and Yahoo is taking these as important since they are linked from the index.
Anyway, you can check both have the same exact PageRank, it's just the same page.

Could be interesting to see if this leads to both URL showing up in search result sometime. Imagine two time the same page without PR loss thus showing up together in SERPs

++

This has also happened to me. I was migrating with an already indexed board. For the first two months everything worked fine, including all 301 redirects. Suddenly Google was indexing dynamic post URLs (/viewtopic.php?f=12&t=345&p=678) like crazy. I could stop that via robots.txt some days later, but now all those URLs are in the index and get 301 redirected to those post-URLs with anchor tags.

How can that be a good thing? In my opinion that's just duplicate content.

Have you set the post redirection option of the zero dupe to at least GUEST ?

From what you describe, it really looks like you deactivated url rewriting at some point (and possibly rest all your url rewriting option, could be by deleting all files in phpbb_seo/cache).

dcz wrote:Have you set the post redirection option of the zero dupe to at least GUEST ?

Yes, since beginning.

dcz wrote:From what you describe, it really looks like you deactivated url rewriting at some point (and possibly rest all your url rewriting option, could be by deleting all files in phpbb_seo/cache).

I can't remember ever having deactivated URL rewriting (and it's activated now of course). The directory phpbb_seo/cache/ contains: phpbb_cache.php, phpbb_cache.php.current and phpbb_cache.php.old.

Is there anything I can do to help my board / improve the situation?

Thanks!

First thing would be to elaborate on the situation. From the topic title, you seem to be talking of url with hashes being indexed, which is not an issue what so ever, but you also mentioned post urls, which would be a problem, so it remains mostly unclear.

Edited URLs

A part from the "url rewriting that was stopped from some reasons" episode, I don't see anything wrong here. php url are properly redirected and everything should soon go back to normal (make sure you do NOT disallow them through your robots.txt to let the zero dupe do its job properly).

++

Because of my custom style the overall_header.html was missing this important code:

Code: Select all

{SEO_BASE_HREF}
<!-- IF SEO_CANONICAL_URL --><link rel="canonical" href="{SEO_CANONICAL_URL}" /><!-- ENDIF -->

Now with the added canonical-element problems should be past soon I guess / hope.

After removing the Disallow for *.php files in the robots.txt even more dynamic (post) URLs have been indexed (20k+). While migrating indexed *.php files count went down from 40k to 10k and now there exist ~85.000 in the Google index.

As long as they are 301 redirected, it OK !

Things will soon come back to normal (a lot faster and better than with the robots.txt). It's normal to see google crawling "new" php links, it's just that it is trying its old crawl list from the incident and WILL acknowledge the 301.

Thanks for your answer! All redirects for existing sites work, but deleted posts which we have a lot of get a 302-redirect to the correct 404 error pages which have such URLs:http://www.domain.tld/topic1234.html. Of course that's not correct, but some experienced webmasters say it doesn't cause problems in reality, others say it makes trouble. What's your opinion on that matter? And is there an easy way to identify the cause of this problem and resolve it?

Can i add RewriteRule ^topic.*\.html - [G] after Rewritebase / to get rid of those useless URLs? I use the SEO mod in advanced mode, so my real topic-URLs won't be affected. Is that ok? Short answer please.

Thanks!

If you are running the latest version of the USU (and its .htaccess) and the zero dupe, then, all kind of url for topic and forums will be properly handled and redirected, so you really do not need to do anything, example.com/topicxx.html should be http 301 redirected to example.com/custom-url-txx.html when you use keywords in urls.

The redirects for forums and topics work perfectly since 2,5 months, but unluckily post-URLs are being indexed since ~3 weeks and they get 302-redirected to URLs like topic123.html - I have no idea why, because I changed nothing.