| :: |
| Author |
Message |
asiaexpat
PR1
Joined: 04 Aug 2006
Posts: 121
|
 Posted: Mon Feb 19, 2007 11:26 am Post subject: dramatic drop in indexed pages |
|
|
I have applied many of the mods from this site yet i have gone from over 1000 indexed pages to under 200.
any explanations?
www.asia-expatsforum.com |
|
|
| Back to top |
|
 |
|
|
HB
phpBB SEO Team
Joined: 16 Oct 2006
Posts: 829
|
| Posted: Mon Feb 19, 2007 1:20 pm Post subject: Re: dramatic drop in indexed pages |
|
|
200? Google reports about 11,000. I see URL written pages starting on page start=100.
BTW, how many links does google webmaster's sitemap report are submitted? Ideally the number reported in your site map and the number reported in the index are very close. |
_________________
Dan Kehn |
|
| Back to top |
|
|
asiaexpat
PR1
Joined: 04 Aug 2006
Posts: 121
|
|
| Back to top |
|
|
HB
phpBB SEO Team
Joined: 16 Oct 2006
Posts: 829
|
| Posted: Mon Feb 19, 2007 1:33 pm Post subject: Re: dramatic drop in indexed pages |
|
|
OK, let's try again. What query led you to conclude your site only has 200 indexed pages? The query I posted showed 11,000, not 200, although the rewritten URLs didn't show up until page 10. And how many URLs did google webmaster tools say were processed? And how long have you had the mod installed?
Do you have the "zero dupe" mod installed too? It takes several weeks for the index to update completely (I'm in week three and still waiting... it looks about 80% complete on google and 90% on Yahoo). |
_________________
Dan Kehn |
|
| Back to top |
|
|
asiaexpat
PR1
Joined: 04 Aug 2006
Posts: 121
|
|
| Back to top |
|
|
HB
phpBB SEO Team
Joined: 16 Oct 2006
Posts: 829
|
| Posted: Mon Feb 19, 2007 1:50 pm Post subject: Re: dramatic drop in indexed pages |
|
|
| Sorry, I'm coming late into your story. Why you would install a rewrite mod without the zero dupe for an established board? |
_________________
Dan Kehn |
|
| Back to top |
|
|
asiaexpat
PR1
Joined: 04 Aug 2006
Posts: 121
|
| Posted: Mon Feb 19, 2007 1:56 pm Post subject: Re: dramatic drop in indexed pages |
|
|
| HB wrote: | | Sorry, I'm coming late into your story. Why you would install a rewrite mod without the zero dupe for an established board? |
because the zero dupe mod was introduced much later than the rewrite mod
i never got around to the dupe mod mod cause there were still problems with the GYM mod--that were never dealt with-- |
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
| Posted: Mon Feb 19, 2007 6:40 pm Post subject: Re: dramatic drop in indexed pages |
|
|
All right, so it is not normal to be this poorly indexed for the forum after this much time.
http://www.google.com/search?q=site:www.asia-expatsforum.com/phpBB2/ shows only 139 indexed links.
And I think it's because you disallowed all the previously index urls and the zero dupe is not operational : http://www.asia-expatsforum.com/phpBB2/big-dupe-vt2853.html
| Quote: |
HTTP Status Code: HTTP/1.1 200 OK
Date: Mon, 19 Feb 2007 18:30:42 GMT
Server: Apache
X-Powered-By: PHP/4.3.11
Connection: close
Transfer-Encoding: chunked
Content-Type: text/html |
No redirection at all. Is it really installed ?
So, the robots.txt told bots to stop indexing your links, while no redirection where installed, not very efficient.
So I think you should drop the disallow on index.php, viewforum.php and viewtopic.php and install the zero dupe. This can help to go faster as bots may start again to explore older url they used to like and then discover the new one faster thanks to the HTTP 301 redirections.
Then, about GYM sitemaps, the xslt style sheet does not work because you board config for domain is asia-expatsforum.com, without the www. The url used and the url set up in config should be the same.
From now on, thing can only be better 
Never hesitate to ask for help you'll win time.
++ |
_________________
Useful links :
SEO Forum || SEO Directory || SEO phpBB || SEO phpBB3 || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Référencement phpBB3 || Recherche |
|
| Back to top |
|
|
asiaexpat
PR1
Joined: 04 Aug 2006
Posts: 121
|
| Posted: Tue Feb 20, 2007 12:55 am Post subject: Re: dramatic drop in indexed pages |
|
|
ok i removed those 3 lines from the robots txt already.
now you say I should install the zero dupe mod? Why?
What is this "check duplicates" check box in the admin panel of gym config?
redirection? u mean via htacess? or some other way? we went through my htaccess after i installed the gym sitemap mod--i can post it later if you want to seee again.
and I should ad the www. to the asia-expatsforum.com now entered as "domain name" in admin CP general admin section configuration ?
thanks for your time |
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
|
| Back to top |
|
|
HB
phpBB SEO Team
Joined: 16 Oct 2006
Posts: 829
|
| Posted: Tue Feb 20, 2007 1:50 pm Post subject: Re: dramatic drop in indexed pages |
|
|
| dcz wrote: | | well, the zero duplicate will help out a lot. |
Help a lot? I would not install a URL remapping mod on an established board without some form of redirection, either using zero dupe or adding "moved permanent" entries to the .htaccess. Otherwise google et al will be flooded with duplicate content.
The zero dupe mod has the added advantage of redirecting viewtopic.php?p= type backlinks. Prior to installing this mod, I blocked them in robots.txt to prevent them being added to search engines and "lost" credit for the backlink. Now I unblocked them knowing they'd be redirected w/o penalty.
Finally, the zero dupe tidies the index, which saves the bot time crawling your site. That can't hurt your server's performance. IMO, the zero dupe mod is more important than the URL remapping. I haven't looked at phpBB v3 closely, but I ardently hope they've elminated the bazillion duplicate URLs, or at least allowed an option to turn on rel=nofollow for the dupes. |
_________________
Dan Kehn |
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
|
| Back to top |
|
|
asiaexpat
PR1
Joined: 04 Aug 2006
Posts: 121
|
| Posted: Tue Feb 20, 2007 2:10 pm Post subject: Re: dramatic drop in indexed pages |
|
|
I have become really confused by all of this. I don't even know if I have installed advance mod rewrite or not.
My urls are being rewritten but i dont have these folders
phpbb_seo/phpbb_seo_class.php
phpbb_seo/.htaccess
in my file structure |
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
|
| Back to top |
|
|
asiaexpat
PR1
Joined: 04 Aug 2006
Posts: 121
|
| Posted: Tue Feb 20, 2007 2:21 pm Post subject: Re: dramatic drop in indexed pages |
|
|
why does the update instructions say to edit
Installation Level: (Easy)
## Installation Time: 3 Minutes
## Files To Edit: (2)
## phpbb_seo/phpbb_seo_class.php,
when i dont even have a phpbb_seo/phpbb_seo_class.php, |
|
|
| Back to top |
|
|
|
|
