| :: |
| Author |
Message |
abhishek1711
PR0
Joined: 03 May 2007
Posts: 59
|
 Posted: Fri Nov 16, 2007 4:46 am Post subject: Pages not being indexed in google |
|
|
hii i think there is something really fishy in the seo status of my forum www.ibsrocks.com . i believe the new threads are not being indexed .... only 376 results throw up in google search and all those threads are old ones. but the recent threads(even 3 months recent) are not showing up.
i think this is due to the seo mods i installed few months back. all the indexed pages are basically of before that period.
i had done seo mod re write, dynamic meta tags etc...
can any1 just have a look n suggest me what the problem could be ! |
|
|
| Back to top |
|
 |
|
|
SeO
Administrateur - Site Admin
Joined: 15 Mar 2006
Posts: 3137
|
| Posted: Fri Nov 16, 2007 4:44 pm Post subject: Re: Pages not being indexed in google |
|
|
http://www.google.com/search?q=cache%3Ahttp%3A%2F%2Fwww.ibsrocks.com%2Fforum%2Fplacement-ibs-bangalore-class-of-2008-t705.html
| Quote: | | Posted: Thu Oct 04, 2007 8:07 pm |
Cached on the 9th of October.
So I don't think that there is a problem. I saw that some topics where not in google's cache yet, but this does not necessarily means much than Google crawling your site a bit slowly.
Looking at http://www.google.com/search?q=site:www.ibsrocks.com/forum/ shows that 393 are cached so far, and actually, it does not looks this far from a full crawl with 2008 posts.
The relatively "slow" crawling rate could come from the content update rate in your forum, Google more or less follow the rhythm, so if your forum is not very active, it won't update your site's cache every other day.
As well, it looks like you have a lot of empty forums (with no content post at all). It's not very attractive for bots (and user by the way) to see almost the same page ("There are no posts in this forum"), like in this forum : http://www.ibsrocks.com/forum/2nd-year-projects-f40.html
Another thing that could really help Google to find new content faster is the GYM sitemap module.
I could not find any Google sitemap installed in your forum, and it would definitely help. Besides, it's simple to install  |
_________________
|
|
| Back to top |
|
|
HB
phpBB SEO Team
Joined: 16 Oct 2006
Posts: 795
|
| Posted: Fri Nov 16, 2007 8:02 pm Post subject: Re: Pages not being indexed in google |
|
|
| I agree with dcz, a forum looks moribund if it has < 100 topics. If a forum has a couple hundred topics and a good portion of them are on a related subject, split them to a new forum. An all too common mistake is to create a bazillion forums under the assumption that it boosts the site's "significance." Better to have 3-4 active forums than 10-20 forums with half of them near dead. |
_________________
Dan Kehn |
|
| Back to top |
|
|
abhishek1711
PR0
Joined: 03 May 2007
Posts: 59
|
| Posted: Sat Nov 17, 2007 5:02 am Post subject: Re: Pages not being indexed in google |
|
|
| thnks a lot , i get the point.... ill re structure the forum categories |
|
|
| Back to top |
|
|
abhishek1711
PR0
Joined: 03 May 2007
Posts: 59
|
| Posted: Sat Nov 17, 2007 5:16 am Post subject: Re: Pages not being indexed in google |
|
|
| well the sitemap installation doesnt seems that easy....so many if's and if not' s...not very easy ! |
|
|
| Back to top |
|
|
abhishek1711
PR0
Joined: 03 May 2007
Posts: 59
|
| Posted: Sat Nov 17, 2007 5:21 am Post subject: Re: Pages not being indexed in google |
|
|
btw there is a sitemap http://www.ibsrocks.com/forum/sitemaps.php
is this something else
also on my google webmaster a/c it shows robots.txt status as 404 not found. |
|
|
| Back to top |
|
|
Peter77
phpBB SEO Team
Joined: 10 May 2006
Posts: 512
Location: Michigan
|
| Posted: Sun Nov 18, 2007 9:28 am Post subject: Re: Pages not being indexed in google |
|
|
You have to create a file called robots.txt in your site root directory. Inside it you add this, for example..
| Code: | User-agent: *
Disallow: /forum/viewtopic.php?
Disallow: /forum/viewforum.php?
Disallow: /forum/index.php?
Disallow: /forum/posting.php?
Disallow: /forum/groupcp.php
Disallow: /forum/profile.php?
Disallow: /forum/memberlist.php
Disallow: /forum/search.php?
Disallow: /forum/login.php
Disallow: /forum/faq.php |
And add any other page or directory you do not want bots to spider.
But to stay on topic, Please post Here for robots.txt questions or concerns and Here for the Sitemaps Module.
Good luck!  |
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 13354
|
| Posted: Sun Nov 18, 2007 10:14 pm Post subject: Re: Pages not being indexed in google |
|
|
GYM sitemaps is the one to build Google sitemaps (xml), mx sitemaps builds html sitemaps. By the way, you should activate a bit of last topic listing in the mx sitemaps ACP, it can help out to provide with more links to fresh content.
| abhishek1711 wrote: |
also on my google webmaster a/c it shows robots.txt status as 404 not found. |
Well, it's the case, you do not have any. The robots.txt is a txt file you have to create and upload in your ftp (in the domain root folder).
++ |
_________________
Useful links :
SEO Forum || SEO Directory || SEO phpBB || SEO phpBB3 || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Référencement phpBB3 || Recherche |
|
| Back to top |
|
|
abhishek1711
PR0
Joined: 03 May 2007
Posts: 59
|
| Posted: Sun Nov 18, 2007 11:32 pm Post subject: Re: Pages not being indexed in google |
|
|
thnks so much again, ill ask qury related to sitemap in relevant thread . thnks for the link.
btw how do i go about adding last topic listing in the mx sitemaps ACP... |
|
|
| Back to top |
|
|
abhishek1711
PR0
Joined: 03 May 2007
Posts: 59
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 13354
|
|
| Back to top |
|
|
abhishek1711
PR0
Joined: 03 May 2007
Posts: 59
|
| Posted: Tue Dec 18, 2007 5:50 am Post subject: Re: Pages not being indexed in google |
|
|
| dcz wrote: |
GYM sitemaps is the one to build Google sitemaps (xml), mx sitemaps builds html sitemaps. By the way, you should activate a bit of last topic listing in the mx sitemaps ACP, it can help out to provide with more links to fresh content. |
hi i still dont get how to do this |
|
|
| Back to top |
|
|
|
|
