English English | French French
 

Naughty google bot please advise

GoogleBot, MSNBot, Yahoo!Slurp ... Everything about indexing Bots, ip lists, User Agents, Crawl and robots.txt.

Moderator: Moderators

Post a reply

Postby SeO » Sun Feb 01, 2009 8:34 am

Pigeon wrote:you could do the same thing only with an IP check set to exclude googlebot's IPs instead of an auth check.


Do not, it would be cloaking.
Besides, filtering upon registered state (bots aren't registered in phpBB3) is enough and safe.
SeO
Admin
Admin
 
Posts: 6333
Joined: Wed Mar 15, 2006 9:41 pm
Top

Advertisement

Re: Naughty google bot please advise

Postby rein08 » Mon Jul 12, 2010 5:31 am

Just dont mind them.
Anyway, it wont cause you anything.
Goodluck
rein08
 
Posts: 6
Joined: Fri Jul 09, 2010 4:33 am
Top
Previous
Post a reply

Return to roBots

 


  • Related topics
    Replies
    Views
    Last post

Who is online

Users browsing this forum: No registered users and 2 guests


 
Powered by phpBB © phpBB Group

phpBB SEO
Time : 0.070s | 15 Queries | GZIP : Off