| :: |
| Author |
Message |
najam
Joined: 01 Jul 2008
Posts: 22
Location: Toronto, Canada
|
 Posted: Fri Aug 08, 2008 8:45 am Post subject: Posts Redirections option and adsense bot |
|
|
Hey Guys,
I was wondering what is the best option to set for adsense bot so that it can see and access whatever the visiters of the forum see.
I have already set my robots.txt file to allow total access to adsense bot but the rest have limited access based on the robots.txt provided in the mod.
Thanks in advance!,
nd |
|
|
| Back to top |
|
 |
|
|
najam
Joined: 01 Jul 2008
Posts: 22
Location: Toronto, Canada
|
| Posted: Mon Aug 11, 2008 4:52 am Post subject: Re: Posts Redirections option and adsense bot |
|
|
| im having allot of problems with this damn adsense thing. Its only showing reliant ads for a day, and after it shows no ads at all. Even some posts with allot of content are showing no ads at all. |
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
|
| Back to top |
|
|
najam
Joined: 01 Jul 2008
Posts: 22
Location: Toronto, Canada
|
| Posted: Wed Aug 13, 2008 10:05 am Post subject: Re: Posts Redirections option and adsense bot |
|
|
Its been more then a month.. and still no relevant ads...  |
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
| Posted: Wed Aug 13, 2008 4:02 pm Post subject: Re: Posts Redirections option and adsense bot |
|
|
Everything looks fine, zero duplicate et all.
But the reason maybe very trivial :
-http://yourdomain.pk/robots.txt
| Code: | User-agent: Mediapartners-Google*
Disallow:
User-agent: *
Disallow: /viewtopic.php
Disallow: /viewforum.php
Disallow: /index.php?
Disallow: /posting.php
Disallow: /search.php?
Disallow: /ucp.php
Disallow: /mcp.php
Disallow: /post
Disallow: /member
Disallow: /memberlist.php
Disallow: /faq.php |
You disalowed the google adsense bot to crawl any of your pages so ...
as well, if your forum previously was indexed with the vanilla urls and if you implemented the robots.txt before the advised 2 month period in suc case, t could explain the slow down.
So fix your robots.txt, and things should go back to normal.
++ |
_________________
Useful links :
SEO Forum || SEO Directory || SEO phpBB || SEO phpBB3 || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Référencement phpBB3 || Recherche |
|
| Back to top |
|
|
najam
Joined: 01 Jul 2008
Posts: 22
Location: Toronto, Canada
|
| Posted: Thu Aug 14, 2008 4:54 am Post subject: Re: Posts Redirections option and adsense bot |
|
|
I just want to say thanks allot for putting your time into helping us get this mod going... 
Regarding the robots file... i updated it based on the instructions provided by google...
https://www.google.com/adsense/support/bin/answer.py?answer=10532 |
|
|
| Back to top |
|
|
dcz
Administrateur - Site Admin
Joined: 28 Apr 2006
Posts: 15242
|
| Posted: Mon Aug 18, 2008 8:24 am Post subject: Re: Posts Redirections option and adsense bot |
|
|
| Quote: | If you would like to grant our crawler access to your pages, you can do so without granting permission to any other bots. Simply add the following two lines of text to the top of your robots.txt file:
User-agent: Mediapartners-Google*
Disallow:
This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content. |
I'm really wondering why Google would ask for a disallow in the robots.txt to allow spidering 
This article makes me doubt, but to me, since :
stands for disallowing everything, I was assuming that :
worked the same. It could then mean to disallow nothing thus allow everything, but it's quite weird, since the general principle about robots.txt is to disallow, not to grant access.
In all cases, I still encourage you to drop these lines and forget about this Google advice, since they are either useless or dangerous.
And, if your forum previously was indexed with the natural urls, make sure you delete the phpBB disallows as well for at least two months.
++ |
_________________
Useful links :
SEO Forum || SEO Directory || SEO phpBB || SEO phpBB3 || Search
____________________
Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Référencement phpBB3 || Recherche |
|
| Back to top |
|
|
najam
Joined: 01 Jul 2008
Posts: 22
Location: Toronto, Canada
|
| Posted: Mon Aug 18, 2008 9:03 am Post subject: Re: Posts Redirections option and adsense bot |
|
|
thanks dcz for the your help!.. i found the problem few days ago and forgot to update here... it is the arabic/urdu font.. google bot was going to the site and where it saw enough of it.. it tried to load arabic/urdu ads, which it does not have..
Now we removed the arab/urdu content and ads slowly coming again.. |
|
|
| Back to top |
|
|
|
|
