Number of urls in sitemap limited?

The GYM Sitemaps & RSS module for phpBB. Sitemaps and RSS feeds for Google Yahoo! and MSN Live, support, add ons etc ...

Moderator: Moderators

Number of urls in sitemap limited?

Postby nasht00 » Tue Oct 06, 2009 9:07 pm

Hi,
I've just installed GYM sitemaps, and sent it to Google.
Google said they found 9,467 URLs in my sitemap, even though my board has 123,650 topics.
Is there a limit?
I know there is a limit per sitemap file according to google, but using sitemap indexes are supposed to make it possible to have all my topics in the sitemaps.
I need all my topics to be on google.
What should I do?

PS. There are a lot of options and settings in this mod, maybe too much ...
If it helps directing me, I'm just interested in XML sitemaps for search engines

Thanks

Nathan
nasht00
 
Posts: 21
Joined: Thu Oct 01, 2009 10:29 pm

Advertisement

Re: Number of urls in sitemap limited?

Postby Professional » Wed Oct 07, 2009 4:49 pm

yes it will divide it to some cycles,u can change them at gym main panel setting :wink:
انجمن تخصصی نسل جدید موبایل ها-Apple Portal
My Handwritings: Professional Dreams
Every Thing That U Feel,Is Every Thing That I Feel.
User avatar
Professional
PR5
PR5
 
Posts: 550
Joined: Mon Apr 07, 2008 5:41 am
Location: 1/2 of the World

Re: Number of urls in sitemap limited?

Postby nasht00 » Wed Oct 07, 2009 5:40 pm

I don't see the breaking up happening.
My settings for Google Sitemaps limits are
Item Limits: 2500 (is this the overall total? of what?)
SQL Cycling: 150 (is it the number of items per sitemap? it doesn't match the results ...)

This sub-forum has more than 17 000 topics: http://messageboards.makemeheal.com/bre ... -implants/
Yet it's sitemap only has 163 items: http://messageboards.makemeheal.com/sitemap.php?forum=2
And I only see one sitemap for each forum ...

Is it related to the "pagination" setting? What is this one for? So many settings ...
nasht00
 
Posts: 21
Joined: Thu Oct 01, 2009 10:29 pm

Re: Number of urls in sitemap limited?

Postby Professional » Thu Oct 08, 2009 7:04 am

it's because u have installed it recently just wait all of your topic will include at sitemap.
انجمن تخصصی نسل جدید موبایل ها-Apple Portal
My Handwritings: Professional Dreams
Every Thing That U Feel,Is Every Thing That I Feel.
User avatar
Professional
PR5
PR5
 
Posts: 550
Joined: Mon Apr 07, 2008 5:41 am
Location: 1/2 of the World

Re: Number of urls in sitemap limited?

Postby nasht00 » Thu Oct 08, 2009 5:23 pm

Ohh you're right the number has grown today
But wait, does that mean it's only adding new topics as they come?
Or is it also gradually adding old topics to the sitemap?
Because of course I also want my old topics to be indexed ...
nasht00
 
Posts: 21
Joined: Thu Oct 01, 2009 10:29 pm

Re: Number of urls in sitemap limited?

Postby Professional » Thu Oct 08, 2009 7:14 pm

nasht00 wrote:Ohh you're right the number has grown today
But wait, does that mean it's only adding new topics as they come?
Or is it also gradually adding old topics to the sitemap?
Because of course I also want my old topics to be indexed ...

first your new postd will add to it then old ones,but u can exclude forums that u don't want at sitemap setting
انجمن تخصصی نسل جدید موبایل ها-Apple Portal
My Handwritings: Professional Dreams
Every Thing That U Feel,Is Every Thing That I Feel.
User avatar
Professional
PR5
PR5
 
Posts: 550
Joined: Mon Apr 07, 2008 5:41 am
Location: 1/2 of the World

Re: Number of urls in sitemap limited?

Postby dcz » Sun Oct 18, 2009 8:46 am

nasht00 wrote:I don't see the breaking up happening.
My settings for Google Sitemaps limits are
Item Limits: 2500 (is this the overall total? of what?)
SQL Cycling: 150 (is it the number of items per sitemap? it doesn't match the results ...)

This sub-forum has more than 17 000 topics:http://messageboards.makemeheal.com/breast-augmentation-implants/
Yet it's sitemap only has 163 items:http://messageboards.makemeheal.com/sitemap.php?forum=2
And I only see one sitemap for each forum ...

Is it related to the "pagination" setting? What is this one for? So many settings ...


Yes, item limit is the overall limit, you can go up to 50 000 there (if your server can handle it, see : Biggest sitemap challenge : Beat the Record! [ 35,001 urls ])
Then, SQL cycling is the amount of items queried for by each query, meaning that you will need (Item Limits/SQL Cycling) queries to list all the content (if of course you have enough to go up to the limit).
So for listing 17 000 urls, you would need to set the Item Limits to like 20 000 and SQL cycling to 1 000, should work, but this needs to be tested on your server, it may be actually faster with 800 or 1500.
To test, turn the cache of to see the actual result directly, what you want is the page to be generated in more or less 10sec max. Look in the xml source code of your page, you'll see generation stats at the very bottom.
Once you have a good limit/sql cycle combo, activate cache again, and you'll be fine.
Of course, do the test on your biggest forum and do not get tricked by the overriding, you may need to set limits for both main and forum google module to see the result.

Can look complex at first, but this is how we can actually generate such big sitemaps on the fly ;)

++
Useful links :
SEO Forum || SEO Directory || SEO phpBB || Search
____________________

Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
dcz
Admin
Admin
 
Posts: 21391
Joined: Fri Apr 28, 2006 9:03 pm


Return to GYM Sitemaps & RSS

 


  • Related topics
    Replies
    Views
    Last post

Who is online

Users browsing this forum: Google Adsense [Bot], Yahoo [Bot] and 8 guests