about nofollow (request)

GoogleBot, MSNBot, Yahoo!Slurp ... Everything about indexing Bots, ip lists, User Agents, Crawl and robots.txt.

Moderator: Moderators

about nofollow (request)

Postby mhmdkhamis » Fri Feb 16, 2007 12:31 pm

i read in google if i add this code to my robots.txt

i will disallow robot to follow links in my site

Code: Select all
<META NAME="Googlebot" CONTENT="nofollow">


what everybody think about that
mhmdkhamis
PR4
PR4
 
Posts: 437
Joined: Sun Nov 26, 2006 11:15 pm
Location: egypt

Advertisement

Postby dcz » Fri Feb 16, 2007 12:56 pm

Well, it's rather a code to add in the html head, it's a meta tag.

And yes, if you put this, you'll prevent Google from crawling and indexing your pages.

The robots.txt equivalent for all site would be :

Code: Select all
User-agent: Googlebot
Disallow: /


++
Useful links :
SEO Forum || SEO Directory || SEO phpBB || Search
____________________

Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
dcz
Admin
Admin
 
Posts: 21238
Joined: Fri Apr 28, 2006 9:03 pm

Re: about nofollow (request)

Postby HB » Sat Feb 17, 2007 4:28 am

mhmdkhamis wrote:i read in google if i add this code to my robots.txt

i will disallow robot to follow links in my site

Do you mean that you want to prevent google from following outgoing links from your site, or you want to prevent google from indexing your site? The nofollow metatag (and <a href="..." rel="nofollow"> element) tells the bot that the link should not be followed, e.g., because they are untrusted (external) or lead to navigation pages of no interest (internal links, like viewforum.php?p=).

The robots.txt file defines sections of your site that you wish the bots to skip. Most honor your request, but they are not required to do so and some "bad bots" will do so with impunity. If you want to prevent access, you would need password protection using a .htaccess and .htpasswd file (if running Apache).
Dan Kehn
HB
phpBB SEO Team
phpBB SEO Team
 
Posts: 1220
Joined: Mon Oct 16, 2006 2:25 am


Return to roBots

Who is online

Users browsing this forum: No registered users and 1 guest