Discussion about the Google Search Engine. SEO, PageRank, AdSense, AdWords, Use and other Services.
Hi im new at phpbb-seo and i was wondering what i should write in my robots.txt so i can get indexed on google and get a higher rank.
My site: http://www.bloodworthy.com/robots.txt
Im using this robots.txt right now but i dont know if its correct to get my threads and site indexed.
// Alexander Hjelm
- Posts: 1
- Joined: Thu Dec 29, 2011 12:15 am
There is no relation between robots.txt and SERPs.
It's though important to avoid duplicate content and force SE to use your best urls.
Your robots.txt will have sense only if you do use url rewriting and if you have been doing so for a while. Otherwise, drop it, because if you do not use url rewriting, then nothing will be indexed, and if you just switched to rewritten urls, you need google to find the new url before you disallow the old ones (and this takes some time).
- Posts: 21322
- Joined: Fri Apr 28, 2006 9:03 pm
Return to Google Forums
Users browsing this forum: No registered users and 53 guests