| |
| |
|
|
|
|
| |
|
| |
|
| :: |
| Author |
Message |
Darth Pincho
PR1
Joined: 22 Sep 2006
Posts: 141
|
 Posted: Sat Jan 20, 2007 10:57 pm Post subject: Heavy problems being indexed my google!! |
|
|
Hi DCZ my website have almost all yor mods intalled.
Mixed mod rewrite
MX sitempas
google sitempas
Delete session ids
Dynamic meta tags
But i have months waiting for google to index my site. Some days idenxed pages go up, some days go down. I wait more time expecting this was a transitional problem from wiewtopic.php to postxxxx.html urls.
But now (about 60 days later) i realize that i have 22 forum pages indexed, and i had 150 qhen i begin to install your mods.
Y have more than 7000 posts, and 1500 content pages in my website (not forum)
Why google do not index them.
Any special instructions in robots.txt for google to do that?
im using the sitempas for google and submit them months ago. But apparently google is not visiting my entire website.
I will really appreciate some of your time helping me out here.
My actual robots.txt is: (at root level).
User-agent: *
Disallow: /admin/
Disallow: /images/
Disallow: /includes/
Disallow: /skins/
Disallow: /foro/admin/
Disallow: /foro/db/
Disallow: /foro/files/
Disallow: /foro/images/
Disallow: /foro/includes/
Disallow: /foro/languages/
Disallow: /foro/templates/
Disallow: /foro/posting.php
Disallow: /foro/login.php
Disallow: /foro/memberlist.php
Disallow: /foro/statistics.php
Disallow: /foro/profile.php
Disallow: /foro/viewtopic.php
Disallow: /foro/viewforum.php
Disallow: /foro/groupcp.php
Disallow: /foro/search.php
Disallow: /foro/login.php
Disallow: /foro/member
Disallow: /foro/profile.php
Disallow: /foro/faq.php
Disallow: /foro/solo-moderadores-vf34.html
User-agent: BoardTracker
Disallow: Forum=34
Also there is another /foro/robots.txt
User-agent: *
Disallow: admin/
Disallow: db/
Disallow: files/
Disallow: images/
Disallow: includes/
Disallow: languages/
Disallow: templates/
Disallow: posting.php
Disallow: login.php
Disallow: memberlist.php
Disallow: statistics.php
Disallow: profile.php
Disallow: viewtopic.php
Disallow: viewforum.php
Disallow: groupcp.php
Disallow: search.php
Disallow: login.php
Disallow: member
Disallow: profile.php
Disallow: faq.php
Disallow: solo-moderadores-vf34.html
User-agent: BoardTracker
Disallow: Forum=34
ANY IDEA?? |
_________________
Webmaster at:
http://www.tupincho.net
Discussion board at:
http://www.tupincho.net/foro/ |
|
| Back to top |
|
 |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 14279
|
| Posted: Sun Jan 21, 2007 2:04 am Post subject: Re: Heavy problems being indexed my google!! |
|
|
Well, it's not so bad given the fact still one page load over two won't work on your site.
I already told you this how this could become an important issue.
I mean 7000 URL to crawl takes 700 sec (12min) with 0.1 sec average, it's 120min with 1 sec page loading time, and it's 600 min with 5 sec.
I just have things like :
| Quote: | | Tiempo de generación: 11.08816 Segundos |
on your index. You get the issue, you're asking bots (and users) to be patient, and they are not. 1200 min to crawl 7000 url with a 10 sec page loading time, worst if like I just experienced, it sometime even does not output any page.
You need to upgrade your server.
Then your robots.txt still misses /post and the only one that matter is the one at the domains root level.
But Google did not index them, probably because he found the topics links in the Google sitemap.
Then, it does not seems your worked on backlinks, you had five two DC updates ago, and now it's 6
So all this put together does not helps, especially the page loading time in your case.
In the time Google would actually crawl the 100 page listed (16min with 10 sec avg) he would crawl all of you 7000 URLs with a page loading time comparable as this site. This matters a lot.
++ |
_________________
Useful links :
SEO Forum || SEO Directory || SEO phpBB || SEO phpBB3 || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Référencement phpBB3 || Recherche |
|
| Back to top |
|
|
argenta
Joined: 18 Nov 2006
Posts: 16
|
| Posted: Mon Jan 22, 2007 9:27 am Post subject: Re: Heavy problems being indexed my google!! |
|
|
Hey Darth Pincho!
Your forum is so slow that I can't even open it!! 
EDITED after 2 hours:
probably it was just a temporary problem because now it runs fine... a few seconds to open the page. |
|
|
| Back to top |
|
|
Darth Pincho
PR1
Joined: 22 Sep 2006
Posts: 141
|
| Posted: Mon Jan 22, 2007 4:41 pm Post subject: Re: Heavy problems being indexed my google!! |
|
|
Hi DCA wich hosting company do you use. Someone you can recomend to me to run a fast forum??
I plan to move my website. |
_________________
Webmaster at:
http://www.tupincho.net
Discussion board at:
http://www.tupincho.net/foro/ |
|
| Back to top |
|
|
|
| Navigation |
Similar Topics |
|
|
|
|
|
|
|
| |
|
|
|
|
| |
|
|
|
|
| |
