I posted a question a few weeks back about an email that I received from Google-

http://www.phpbb-seo.com/boards/google- ... t3611.html




Now I have just logged into my google account and it says URLs restricted by robots.txt 38,820



Help!

Any ideas are most welcome.

Thanks

chez

mm interesting, I don't see anything wrong in your robots.txt though.

Does google tells you more about the disallowed urls ?

Could you post some disallowed urls here ?

SeO wrote:mm interesting, I don't see anything wrong in your robots.txt though.

Does google tells you more about the disallowed urls ?

Could you post some disallowed urls here ?

Thanks for the reply.

Here are a few url's

http://www.ultimatehandyman.co.uk/forum ... s-f27.html

http://www.ultimatehandyman.co.uk/forum ... t1895.html

Some of the other ones are strange (http://www.ultimatehandyman.co.uk/foru. ... topic=9469) and I can't copy the full url because when I click on the url in the webmaster tools it redirects me to this page-

-http://www.ultimatehandyman.co.uk/forum1/login.php?redirect=ignore.php

I wonder if it is something to do with the ignore mod

I have never noticed having that many pages before being restricted by robots.txt

Thanks for any replies.

For the first two it's normal, these are not accessible for guests, so bots and guest are redirected to login.php which is and should be disallowed.

The third example is unfortunately not a complete link, but if it's as well redirecting to login, it's normal.

Generally speaking, it's not a problem to see google telling you that you have disallowed urls like these as long as they really are and should, it's just giving us an idea on how much more duplicate there would be without the robots.txt

dcz wrote:For the first two it's normal, these are not accessible for guests, so bots and guest are redirected to login.php which is and should be disallowed.

The third example is unfortunately not a complete link, but if it's as well redirecting to login, it's normal.

Generally speaking, it's not a problem to see google telling you that you have disallowed urls like these as long as they really are and should, it's just giving us an idea on how much more duplicate there would be without the robots.txt

Ah, OK.

I was just a little worried when I saw so many url's were restricted!

Thanks

chez