If i block my /style/ directory from all the bots will that be wise like?
Disallow: /styles/
- phpBB SEO
phpBB SEO- Home - en
News
Site map- Statistics
- phpBB SEO Directory
- Directory
- Downloads - phpBB SEO
- Downloads - phpBB SEO
phpBB SEO- Home - fr
- Forum - fr
- Forums
- Search
- Search for keywords
- Advanced search
- View unanswered posts
- View active topics
- Register
- Login
Blocking style directory wise?
GoogleBot, MSNBot, Yahoo!Slurp ... Everything about indexing Bots, ip lists, User Agents, Crawl and robots.txt.
Moderator: Moderators
2 posts
• Page 1 of 1
Blocking style directory wise?
by kemraj » Wed May 20, 2009 5:55 pm
- kemraj
- Posts: 32
- Joined: Thu Mar 05, 2009 12:58 am
Advertisement
Re: Blocking style directory wise?
by dcz » Mon May 25, 2009 1:10 pm
Well, it won't change much, since at first bot won't list it, and then, the robots.txt will not be a final blocking (bot do what they want about it).
But it's safe to disallow it, unless you want your theme images (like new post image) to be listed as well.
++
But it's safe to disallow it, unless you want your theme images (like new post image) to be listed as well.
++
Useful links :
SEO Forum || SEO Directory || SEO phpBB || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
SEO Forum || SEO Directory || SEO phpBB || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
- dcz
- Admin
- Posts: 19930
- Joined: Fri Apr 28, 2006 9:03 pm
2 posts
• Page 1 of 1
-
- Related topics
- Replies
- Views
- Last post
-
- blocking bad bots from .htaccess
by lavinya » Thu Sep 14, 2006 6:41 pm - 11 Replies
- 1800 Views
- Last post by dcz
Sat Sep 27, 2008 12:18 pm
- blocking bad bots from .htaccess
-
- Blocking all other bots except google,msn,yahoo
by kemraj » Mon Jun 15, 2009 11:44 pm - 4 Replies
- 577 Views
- Last post by dcz
Mon Aug 03, 2009 12:32 pm
- Blocking all other bots except google,msn,yahoo
-
- I need Robots.txt to block spiders from root directory
by daddyo » Thu Oct 25, 2007 6:11 pm - 4 Replies
- 1482 Views
- Last post by daddyo
Sun Oct 28, 2007 2:37 pm
- I need Robots.txt to block spiders from root directory
Who is online
Users browsing this forum: No registered users and 1 guest
SitemapIndex
RSS Feed