Hello, here's my robots.txt. Any suggestion?

Code: Select all

User-agent: *
Disallow: /adm/
Disallow: /cache/
Disallow: /download/
Disallow: /files/
Disallow: /images/
Disallow: /includes/
Disallow: /language/
Disallow: /store/
Disallow: /styles/
Disallow: /chat.php
Disallow: /common.php
Disallow: /config.php
Disallow: /contact.php
Disallow: /cron.php
Disallow: /faq.php
Disallow: /functions.php
Disallow: /mcp.php
Disallow: /memberlist.php
Disallow: /posting.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /shout.php
Disallow: /ucp.php
Disallow: /viewonline.php
Disallow: /viewtopic.php
Disallow: /viewforum.php
Disallow: /index.php?
Disallow: /member

If none of the concerned url are cached right now, you should as well add :

Code: Select all

Disallow: /post

Generally speaking, it's not very useful to disallow directories such as files/ or download/, because they are already locked by .htaccess. So all you do is actually tell bots that such a directory exists (they could not even know it if not).