| :: |
| Author |
Message |
TomaS
PR2
Joined: 08 Jun 2007
Posts: 226
|
 Posted: Tue Oct 23, 2007 6:23 pm Post subject: robots.txt |
|
|
hi,i have this in my robots file in root
| Code: | User-agent: *
Disallow: /forum/viewtopic.php
Disallow: /forum/viewforum.php
Disallow: /forum/index.php?
Disallow: /forum/posting.php
Disallow: /forum/search.php?
Disallow: /forum/ucp.php
Disallow: /forum/mcp.php
Disallow: /forum/post
Disallow: /forum/vedenie-fora.html |
and after time few days i see indexed only index and posts not viewforum topics and viewtopics as you can see here in first pages in the oldest you can see not staics url
in google put site:phpbb3.sk
you i ask can i delete | Code: | Disallow: /forum/viewtopic.php
Disallow: /forum/viewforum.php |
from robots file to allow bots index this part of forum because i think it is important to index it.
thx for reply |
_________________
phpBB podpora-slovak phpBB support
slovenský preklad pre phpbb3-slovak translate for phpBB3
predaj a kupa domeny, marketing a internetove podnikanie- Slovak domain center |
|
| Back to top |
|
 |
|
|
TomaS
PR2
Joined: 08 Jun 2007
Posts: 226
|
|
| Back to top |
|
|
SeO
Administrateur - Site Admin
Joined: 15 Mar 2006
Posts: 4006
|
| Posted: Tue Oct 23, 2007 6:32 pm Post subject: Re: robots.txt |
|
|
Google indexed a lot of post URLs, looks like your did not implement the robots.txt at the very first.
You do not need to to nothing about viewtopic and viewforum, unless some vanilla URLs (viewtopi.php?f=xx&t=yy) are already indexed.
But you should install the zero duplicate and set the post redirection on "guest" or "all" to get rid of the post URLs and go for the topic ones.
Only topic URLs are worth indexing, post URLs are duplicates. That's why they are disallowed with the robots.txt and HTTP 301 redirected by the zero duplicate. |
_________________
phpBB SEO || SEO Forum || Forum Référencement
GYM Sitemap & RSS for phpBB3 has been released ! || GYM Sitemap & RSS for phpBB3 est disponible ! |
|
| Back to top |
|
|
TomaS
PR2
Joined: 08 Jun 2007
Posts: 226
|
| Posted: Tue Oct 23, 2007 6:38 pm Post subject: Re: robots.txt |
|
|
ok so you say:Be patient and dont change your robots.txt or better apply zero duplicate?Think you that google later will index my changed viewforum and viewtopics to?because there are keywords for me in indexed post are only post.html and in viewtopic some-keyword/post.html
OK zero mod install but what exactly it will do,how it help?i have all properities in acp turn on and select "all" |
_________________
phpBB podpora-slovak phpBB support
slovenský preklad pre phpbb3-slovak translate for phpBB3
predaj a kupa domeny, marketing a internetove podnikanie- Slovak domain center |
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
|
| Back to top |
|
|
TomaS
PR2
Joined: 08 Jun 2007
Posts: 226
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
|
| Back to top |
|
|
TomaS
PR2
Joined: 08 Jun 2007
Posts: 226
|
| Posted: Sun Oct 28, 2007 1:11 pm Post subject: Re: robots.txt |
|
|
ok thx dcz i see now that is work and index topics too.
I will try to be more patient and write less stupid posts 
But i see and think that this problematics is not easy to understand and need little time to show some results
anyway thx for many replies here you help me a lot  |
_________________
phpBB podpora-slovak phpBB support
slovenský preklad pre phpbb3-slovak translate for phpBB3
predaj a kupa domeny, marketing a internetove podnikanie- Slovak domain center |
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
|
| Back to top |
|
|
TomaS
PR2
Joined: 08 Jun 2007
Posts: 226
|
|
| Back to top |
|
|
|
|
rewrite mod is great and looks great another mods here wich will help me is in my target but still only in research in my 