Yahoo bot

ultimatehandyman · PR2 Joined: 15 Mar 2007 Posts: 224

Yahoo bot used to visit my site and it would not be uncommon to see 100 Yahoo bots on my site at any one time. Since moving to a new server it seems that Only one or Two Yahoo bots visit my site Confused

Is this unique to my site or else are other people experiencing the same thing on their sites as well?

SeO · Posted: Mon Jun 09, 2008 4:52 pm Post subject: Re: Yahoo bot

Yahoo heavy crawling seems periodical, it seemed to me that the last couple month it was crawling at a high rate and then in June, started to crawl a bit less.

The new ip, since it should be the only noticeable difference between your two servers could play some role, like if the ip previously was blacklisted, but I doubt it.

Do you still show up in Yahoo's SERPs the same way as before ?

How long since you first noticed this ?

ultimatehandyman · PR2 Joined: 15 Mar 2007 Posts: 224

I have noticed this over the last few weeks.

I just checked Yahoo and could not find a single post from the forum Shocked

A few days ago I sent a sitemap containing the static pages on the site, but I think the GYM sitemap tells Yahoo about new pages in the forum, but they seem to be missing from the Yahoo index Shocked

ultimatehandyman · PR2 Joined: 15 Mar 2007 Posts: 224

I have just logged into Yahoo and the urllist.php was missing Shocked

I am sure that I submitted this months ago Confused

Anyway I have resubmitted it now Wink

ultimatehandyman · PR2 Joined: 15 Mar 2007 Posts: 224

I submitted the sitemap, but still I only seem to have 1 yahoo bot online Confused

SeO · Posted: Thu Jun 12, 2008 10:41 pm Post subject: Re: Yahoo bot

ultimatehandyman · PR2 Joined: 15 Mar 2007 Posts: 224

SeO · Posted: Thu Jun 19, 2008 3:43 pm Post subject: Re: Yahoo bot

If it's indeed the site in your signature, yahoo did not drop it from it's index : Pages (115,212) | Inlinks (27,760)

And it shows up in SERP : ultimatehandyman

So what is happening, yahoo bots is just crawling less frequently ? How do you measure this ?

ultimatehandyman · PR2 Joined: 15 Mar 2007 Posts: 224

dcz · Posted: Fri Jun 20, 2008 7:32 am Post subject: Re: Yahoo bot

The new server migration was a bit tricky if I recall well, so it could explain that Yahoo is slowing down it's crawling a bit.

But it's the same here, after several month of heavy crawl, yahoo seems to have calm down a bit, pretty much the same as last year actually, Yahoo seems lazier in the summer Wink

Cama · Joined: 25 Oct 2008 Posts: 6

Sorry for a silly question. Smile

And why at me urllist.txt it is downloaded, instead of opens in a browser?

dcz · Posted: Sun Oct 26, 2008 10:14 am Post subject: Re: Yahoo bot

If you are using gunzip, it's normal Wink

Cama · Joined: 25 Oct 2008 Posts: 6