Yahoo bot

ultimatehandyman · by **ultimatehandyman** » Mon Jun 09, 2008 3:54 pm

Yahoo bot used to visit my site and it would not be uncommon to see 100 Yahoo bots on my site at any one time. Since moving to a new server it seems that Only one or Two Yahoo bots visit my site

Is this unique to my site or else are other people experiencing the same thing on their sites as well?

Yahoo heavy crawling seems periodical, it seemed to me that the last couple month it was crawling at a high rate and then in June, started to crawl a bit less.

The new ip, since it should be the only noticeable difference between your two servers could play some role, like if the ip previously was blacklisted, but I doubt it.

Do you still show up in Yahoo's SERPs the same way as before ?

How long since you first noticed this ?

ultimatehandyman · by **ultimatehandyman** » Mon Jun 09, 2008 5:04 pm

I have noticed this over the last few weeks.

I just checked Yahoo and could not find a single post from the forum :shock:

A few days ago I sent a sitemap containing the static pages on the site, but I think the GYM sitemap tells Yahoo about new pages in the forum, but they seem to be missing from the Yahoo index :shock:

ultimatehandyman · by **ultimatehandyman** » Mon Jun 09, 2008 5:41 pm

I have just logged into Yahoo and the urllist.php was missing :shock:

I am sure that I submitted this months ago

Anyway I have resubmitted it now :wink:

ultimatehandyman · by **ultimatehandyman** » Thu Jun 12, 2008 6:03 pm

I submitted the sitemap, but still I only seem to have 1 yahoo bot online

SeO · by **SeO** » Thu Jun 12, 2008 10:41 pm

ultimatehandyman wrote:they seem to be missing from the Yahoo index

URL ?

Could be temporary, but if your site really disappeared from the yahoo index, this require some investigations.

ultimatehandyman · by **ultimatehandyman** » Thu Jun 19, 2008 3:00 pm

SeO wrote:
ultimatehandyman wrote:they seem to be missing from the Yahoo index

URL ?

Could be temporary, but if your site really disappeared from the yahoo index, this require some investigations.

The Yahoo bots still have not returned

Any advice on how to investigate further would be appreciated?

Thanks in advance

chez

SeO · by **SeO** » Thu Jun 19, 2008 3:43 pm

If it's indeed the site in your signature, yahoo did not drop it from it's index : Pages (115,212) | Inlinks (27,760)

And it shows up in SERP : ultimatehandyman

So what is happening, yahoo bots is just crawling less frequently ? How do you measure this ?

ultimatehandyman · by **ultimatehandyman** » Thu Jun 19, 2008 4:51 pm

SeO wrote:If it's indeed the site in your signature, yahoo did not drop it from it's index : Pages (115,212) | Inlinks (27,760)

And it shows up in SERP : ultimatehandyman

So what is happening, yahoo bots is just crawling less frequently ? How do you measure this ?

Thanks Seo, at least there is nothing to worry about then.

I just thought it was strange that there used to be 30-100+ yahoo bots online at any one time and then after a server move there is only one yahoo bot at a time.

Thanks

chez

dcz · by **dcz** » Fri Jun 20, 2008 7:32 am

The new server migration was a bit tricky if I recall well, so it could explain that Yahoo is slowing down it's crawling a bit.

But it's the same here, after several month of heavy crawl, yahoo seems to have calm down a bit, pretty much the same as last year actually, Yahoo seems lazier in the summer

Cama · by **Cama** » Sun Oct 26, 2008 5:58 am

Sorry for a silly question.

And why at me urllist.txt it is downloaded, instead of opens in a browser?

dcz · by **dcz** » Sun Oct 26, 2008 10:14 am

If you are using gunzip, it's normal

Cama · by **Cama** » Sun Oct 26, 2008 1:37 pm

dcz wrote:If you are using gunzip, it's normal

I too have thought on guzip. Has taken an interest to be the function assured of correct work

Yahoo bot

Yahoo bot

Advertisement

Who is online

Advertisement