Heavy problems being indexed my google!!

Support for the phpBB2 SEO mods released in the phpBB2 SEO Toolikt forum.

Moderator: Moderators

Heavy problems being indexed my google!!

Postby Darth Pincho » Sat Jan 20, 2007 10:57 pm

Hi DCZ my website have almost all yor mods intalled.

Mixed mod rewrite
MX sitempas
google sitempas
Delete session ids
Dynamic meta tags

But i have months waiting for google to index my site. Some days idenxed pages go up, some days go down. I wait more time expecting this was a transitional problem from wiewtopic.php to postxxxx.html urls.

But now (about 60 days later) i realize that i have 22 forum pages indexed, and i had 150 qhen i begin to install your mods.

Y have more than 7000 posts, and 1500 content pages in my website (not forum)

Why google do not index them.
Any special instructions in robots.txt for google to do that?

im using the sitempas for google and submit them months ago. But apparently google is not visiting my entire website.

I will really appreciate some of your time helping me out here.

My actual robots.txt is: (at root level).

User-agent: *
Disallow: /admin/
Disallow: /images/
Disallow: /includes/
Disallow: /skins/
Disallow: /foro/admin/
Disallow: /foro/db/
Disallow: /foro/files/
Disallow: /foro/images/
Disallow: /foro/includes/
Disallow: /foro/languages/
Disallow: /foro/templates/
Disallow: /foro/posting.php
Disallow: /foro/login.php
Disallow: /foro/memberlist.php
Disallow: /foro/statistics.php
Disallow: /foro/profile.php
Disallow: /foro/viewtopic.php
Disallow: /foro/viewforum.php
Disallow: /foro/groupcp.php
Disallow: /foro/search.php
Disallow: /foro/login.php
Disallow: /foro/member
Disallow: /foro/profile.php
Disallow: /foro/faq.php
Disallow: /foro/solo-moderadores-vf34.html

User-agent: BoardTracker
Disallow: Forum=34

Also there is another /foro/robots.txt

User-agent: *
Disallow: admin/
Disallow: db/
Disallow: files/
Disallow: images/
Disallow: includes/
Disallow: languages/
Disallow: templates/
Disallow: posting.php
Disallow: login.php
Disallow: memberlist.php
Disallow: statistics.php
Disallow: profile.php
Disallow: viewtopic.php
Disallow: viewforum.php
Disallow: groupcp.php
Disallow: search.php
Disallow: login.php
Disallow: member
Disallow: profile.php
Disallow: faq.php
Disallow: solo-moderadores-vf34.html

User-agent: BoardTracker
Disallow: Forum=34

ANY IDEA??
Webmaster at:
http://www.tupincho.net
Discussion board at:
http://www.tupincho.net/foro/
Darth Pincho
PR1
PR1
 
Posts: 146
Joined: Fri Sep 22, 2006 8:37 pm

Advertisement

Postby dcz » Sun Jan 21, 2007 2:04 am

Well, it's not so bad given the fact still one page load over two won't work on your site.
I already told you this how this could become an important issue.
I mean 7000 URL to crawl takes 700 sec (12min) with 0.1 sec average, it's 120min with 1 sec page loading time, and it's 600 min with 5 sec.
I just have things like :

Tiempo de generación: 11.08816 Segundos


on your index. You get the issue, you're asking bots (and users) to be patient, and they are not. 1200 min to crawl 7000 url with a 10 sec page loading time, worst if like I just experienced, it sometime even does not output any page.

You need to upgrade your server.

Then your robots.txt still misses /post and the only one that matter is the one at the domains root level.
But Google did not index them, probably because he found the topics links in the Google sitemap.
Then, it does not seems your worked on backlinks, you had five two DC updates ago, and now it's 6

So all this put together does not helps, especially the page loading time in your case.
In the time Google would actually crawl the 100 page listed (16min with 10 sec avg) he would crawl all of you 7000 URLs with a page loading time comparable as this site. This matters a lot.

++
Useful links :
SEO Forum || SEO Directory || SEO phpBB || Search
____________________

Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
dcz
Admin
Admin
 
Posts: 21219
Joined: Fri Apr 28, 2006 9:03 pm

Postby argenta » Mon Jan 22, 2007 9:27 am

Hey Darth Pincho!
Your forum is so slow that I can't even open it!! :shock:

EDITED after 2 hours:
probably it was just a temporary problem because now it runs fine... a few seconds to open the page.
argenta
 
Posts: 16
Joined: Sat Nov 18, 2006 10:03 am

Postby Darth Pincho » Mon Jan 22, 2007 4:41 pm

Hi DCA wich hosting company do you use. Someone you can recomend to me to run a fast forum??

I plan to move my website.
Webmaster at:
http://www.tupincho.net
Discussion board at:
http://www.tupincho.net/foro/
Darth Pincho
PR1
PR1
 
Posts: 146
Joined: Fri Sep 22, 2006 8:37 pm


Return to phpBB2 SEO MODS

 


  • Related topics
    Replies
    Views
    Last post

Who is online

Users browsing this forum: No registered users and 1 guest