| |
| |
|
|
|
|
| |
|
| |
|
| :: |
| Author |
Message |
AmirAbbas
phpBB SEO Team
Joined: 11 May 2006
Posts: 529
Location: IRAN
|
 Posted: Thu Dec 07, 2006 12:33 pm Post subject: robots.txt for zero dupe mod |
|
|
hello
i want ask about one robots.txt rule
this one :
| Code: | | Disallow: /viewtopic.php? |
i have installed zero dupe and all SEO mod for www.ariantalk.com
from 2 days ago 6800 URL are submitted in google sitemap and in my sitemap account i saw that 8600 URL restricted by that robots.txt rule i mentiond above.
this forum was active for two years and has lot of internal link in standard URL shape
that robots.txt cause google don't follow that link and as you know google after indexing page will return to check that page again but now all that old topics are restricted by that rule
is it necessary to keep that rule ?
i have installed zero dupe  |
_________________
طراحی وب ، آموزش سئو ، آموزش CSS ، phpbb فارسی ، phpbb3 فارسی ، دروپال فارسی
طراحی وب ، قالب وبلاگ ، استاندارد وب ، آموزش CSS و HTML ، آموزش php |
|
| Back to top |
|
 |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 13354
|
|
| Back to top |
|
|
mreider
phpBB SEO Team
Joined: 07 May 2006
Posts: 219
|
| Posted: Fri Dec 29, 2006 1:54 am Post subject: Re: robots.txt for zero dupe mod |
|
|
good call. i have the same in google sitemaps, so I'd like to remove those lines to un-restrict the urls from robots.txt.
I'll give it a shot! |
|
|
| Back to top |
|
|
AmirAbbas
phpBB SEO Team
Joined: 11 May 2006
Posts: 529
Location: IRAN
|
|
| Back to top |
|
|
|
| Navigation |
Similar Topics |
|
|
|
|
|
|
|
| |
|
|
|
|
| |
|
|
|
|
| |
