Thanks for the replies guys. When I go to my admin area I see the google bot ip address still looking at profile etc. That's how I know it is still looking at the files, despite the robots.txt file.

Cheers

Hey guys I run a financial forum in New Zealand. My problem is that phrases I should be ranking highly on google for are not even appearing. For example a forum I have on my site is called "Pensions & retirement planning" When I type that into google a tick NZ results only I don't show...

DCZ, I implemented your change but the bot is still looking at profile etc. Whats going on?

Any Ideas?

Cheers

Thanks dcz, I'll give it a go.

Thanks guys can anyone help me write a simple robots.txt that simply stops google looking at private messages and viewing profile etc? I want it to index all my posts.

Thanks

Thanks for the reply, will the viewtopic, search or viewforum ban stop google from indexing posts though?

Hi all, hope you can help. Google is still looking at areas of my forum that I do not want it to waste it's time on, for example it still views private messages and profile Below is my robots txt file. Any advice appreciated. Thanks User-agent: * Disallow: /forum/private/ Disallow: /forum/admin/ Dis...