viewtopic and downloads...

[argenta]

Hello dcz! I try to ask you a suggestion...
I noticed that especially yahoo! (inktomi bot) is indexing a lot of my viewtopics with the "?dowload" prefix (as I have installed a mod which can make u download an entire topic in a little txt)
So in search engine I see links like this: viewtopic.php?download-.... which are redirected to download that little txt file.

How can I tell the bots not to get these downloads? should i put

[dcz]

Yahoo! is not the bot to best follow robots.txt directives.

But your robots.txt rule is ok for what you want to do.

To go further, you could hide this dl link to guests, and, as this mod will require a small adaptation for the zero dupe, as it's adding a GET var on viewtopic.php, we can as well imagine to HTTP 301 redirects guest trying to browse this page.

++

[argenta]

Hi, thanks for the explanations...

so if i keep the rule

[dcz]

yes