Hello all, I just created a robots.txt file.
this is my robots.txt file...
http://www.m-benzforum.com/robots.txt
Please add If I need... and Please correct if I'm wrong
Thanks for your help
- phpBB SEO
phpBB SEO- Home - en
News
Site map- Statistics
- phpBB SEO Directory
- Directory
- Downloads
- Downloads
phpBB SEO- Home - fr
- Forum - fr
- Forums
- Search
- Search for keywords
- Advanced search
- View unanswered posts
- View active topics
- Register
- Login
robots.txt for my forum
GoogleBot, MSNBot, Yahoo!Slurp ... Everything about indexing Bots, ip lists, User Agents, Crawl and robots.txt.
Moderator: Moderators
4 posts
• Page 1 of 1
robots.txt for my forum
by abud » Fri Jun 30, 2006 2:55 pm
- abud
- Posts: 16
- Joined: Fri Jun 23, 2006 9:14 am
Advertisement
by dcz » Fri Jun 30, 2006 3:01 pm
it's ok, but you should add :
First one is for your posts (by the way we had seen how to even get rid of the vp in those)
Second one to make sure no URL like index.php?bla=bli shows up in search results, this won't disallow index.php.
++
- Code: Select all
Disallow: /mercedes-benz-forum
Disallow: /index.php?
First one is for your posts (by the way we had seen how to even get rid of the vp in those)
Second one to make sure no URL like index.php?bla=bli shows up in search results, this won't disallow index.php.
++
Useful links :
SEO Forum || SEO Directory || SEO phpBB || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
SEO Forum || SEO Directory || SEO phpBB || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
- dcz
- Admin
- Posts: 21238
- Joined: Fri Apr 28, 2006 9:03 pm
by abud » Fri Jun 30, 2006 3:14 pm
how about
so in my other forums need
and
thanks
- Code: Select all
Disallow: /member
Disallow: /member*.html
so in my other forums need
- Code: Select all
Disallow: /ford-forum
Disallow: /index.php?
and
- Code: Select all
Disallow: /bmw-forum
Disallow: /index.php?
thanks
- abud
- Posts: 16
- Joined: Fri Jun 23, 2006 9:14 am
by dcz » Fri Jun 30, 2006 3:39 pm
For the members, the first one is the best one to use.
Then, sorry I missed it, but I thought you had seen the sample robots.txt file in the release thread.
++
Then, sorry I missed it, but I thought you had seen the sample robots.txt file in the release thread.
++
Useful links :
SEO Forum || SEO Directory || SEO phpBB || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
SEO Forum || SEO Directory || SEO phpBB || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
- dcz
- Admin
- Posts: 21238
- Joined: Fri Apr 28, 2006 9:03 pm
4 posts
• Page 1 of 1
-
- Related topics
- Replies
- Views
- Last post
-
- robots.txt problem, google not indexing my forum pages
by pradip200 » Thu Dec 01, 2011 2:25 pm - 1 Replies
- 1448 Views
- Last post by coyote
Sat Dec 24, 2011 8:06 pm
- robots.txt problem, google not indexing my forum pages
-
- About robots.txt
by Peter77 » Tue Jun 06, 2006 5:15 pm - 3 Replies
- 1466 Views
- Last post by dcz
Wed Jun 07, 2006 3:19 pm
- About robots.txt
-
- Hello, please help me with my robots.txt?
by tmaker » Tue Oct 17, 2006 4:10 am - 4 Replies
- 1844 Views
- Last post by tmaker
Tue Oct 17, 2006 2:30 pm
- Hello, please help me with my robots.txt?
-
- Help with robots.txt
by technofreaks » Tue Mar 27, 2007 7:19 am - 8 Replies
- 1803 Views
- Last post by technofreaks
Tue Apr 03, 2007 7:09 am
- Help with robots.txt
-
- My robots
by fabiomaticus » Tue Jun 19, 2007 8:50 pm - 9 Replies
- 1773 Views
- Last post by dcz
Wed Jul 11, 2007 7:26 pm
- My robots
Who is online
Users browsing this forum: No registered users and 1 guest
SitemapIndex
RSS Feed