Getting Yahoo urllist.txt to work

stevefree · Joined: 16 Jun 2007 Posts: 23

My website has over 300,000 posts. It's a very busy board. I installed the GYM Sitemap tool and the RSS.xml feeds and SiteMaps.xml are both working greate. The UrlList.txt or .php however is not working. My box goes to 100% CPU utilization and sits there for 30 seconds then a blank page is displayed. Looking in the cache folder, the file is never created either.

I went ahead and install the mod on my smaller site which has ~ 5000 posts. That site the urllist.txt file worked without issues.

So, my question is could it be a # of posts issue?

SeO

Exactly.

urllist are pretty close to rss feeds when it comes to build them. We are querying from all forums at once, unlike the sitemaps where we can list huge amounts of urls.

But, you can limit the output both in total amount and using the age of the posts (time limit) in acp.
You do not need to list thousands of url in your urllists.txt, especially now that yahoo is as well officially playing with sitemaps.

Try to lower the yahoo limits a bit.

++

stevefree · Joined: 16 Jun 2007 Posts: 23

Gotcha,

I seem to have found that 200 Posts work well for my site.

Thanks again!

http://www.dogs4sale.net/sitemaps.xml
http://www.dogs4sale.net/urllist.txt