Non-indexing of new forum posts

phpBB SEO Premod for phpBB3 support forum.
This premodded version of phpBB3 includes the three different type of URL rewriting for phpBB3 by phpBB SEO. It comes with several other Search Engine Optimization mods installed.

Moderator: Moderators

Non-indexing of new forum posts

Postby chealy » Sat Jun 08, 2013 12:07 am

I've got an issue with the latest version of phpBB SEO Premod. I upgraded to it about 3 weeks ago and since this time no new forum topics are being indexed to Google. The only reference to topics in Google are in the /forum/sitemap.php file which is (strangely) being indexed by Google. I've disallowed that since in robots.txt.

To figure out why, this is what I've checked:
- Does robots.txt restrict the indexing of the file? No, my robots.txt blocks viewtopic.php and post but doesn't contain anything else that might block ALL new topics
- Can Google fetch the full URL? (the correctly rewritten one with title injection)... YES via Google Webmaster Tools
- Is there any reference to robots in the topic page source? Yes, and it's a correct meta tag set to index, follow
- What headers are the new topic pages returning? Normal 200 status.

My configuration / setup is as follows:
- phpBB SEO Premod v3.0.11 with the following MODs: WP-UNITED, One Click Ban, Thanks for posts, Set User Notify of Replies to Yes on Registration.
- Advanced mode
- Activate SQL Rewriting: NO
- Profiles and groups injection: NO
- Virtual folder Profiles: NO
- Profiles ID removing: NO
- Common Search and User messages pages rewriting: NO
- Attachment Rewriting: NO
- SID Removing: YES
- Highlights Removing: YES
- Remove small words: NO
- Virtual Folder:YES
- Virtual Root: NO
- Forum URL caching:YES
- Forum ID Removing: YES
- Activate The No duplicate:YES
- Activate the Zero duplicate:YES
- Posts Redirections: ALL

I'm using the .htaccess generator to create the necessary code for placement in /forum/.htaccess

Any ideas as to where I'm going wrong?
Is there an easy fix to get ALL new topics to be indexed in Google again?
Thanks!
chealy
 
Posts: 20
Joined: Sat Jun 20, 2009 11:35 pm

Advertisement

Re: Non-indexing of new forum posts

Postby HB » Mon Jun 10, 2013 6:33 pm

You shouldn't block viewtopic.php or viewforum.php. Instead, let the no dupe 301 redirect Googlebot to the canonical URL. That may explain why the new content isn't being indexed.
Dan Kehn
HB
phpBB SEO Team
phpBB SEO Team
 
Posts: 1512
Joined: Mon Oct 16, 2006 2:25 am

Re: Non-indexing of new forum posts

Postby chealy » Tue Jun 11, 2013 11:25 am

Turned out to be a canonical tag error that was pointing to the forum index on every single forum page. Fixed it and Google is indexing again.
This problem was nothing to do with phpBB-SEO but instead a WP & phpBB bridge plugin.

Thanks anyway.
chealy
 
Posts: 20
Joined: Sat Jun 20, 2009 11:35 pm

Re: Non-indexing of new forum posts

Postby bidiesman » Fri Jan 24, 2014 11:39 am

Hey!
Could you give more explanation how to fix it? I have exactly the same problem.
Are you using wp-united

bonus question, did you succeed to setup Phpbb seo plugin if yes I'm also interested to know how.
You probably follow a blog procedure? if yes,do you have the link?

Cheers,
bidiesman
 
Posts: 6
Joined: Thu Jul 25, 2013 3:39 pm

Re: Non-indexing of new forum posts

Postby chealy » Fri Jan 24, 2014 11:54 am

Best solution for WP United is NOT to use it. Caused us an unimaginable world of pain and life was much better when we completely removed it.
The plugin author started doing a great job, but then went AWOL and left a half-finished plugin out there causing a lot of headaches. I would have happily PAID for a fully working version of this plugin.
chealy
 
Posts: 20
Joined: Sat Jun 20, 2009 11:35 pm

Re: Non-indexing of new forum posts

Postby bidiesman » Fri Jan 24, 2014 1:04 pm

But are you still using a bridge? if yes which one?
and what about the indexing problem? for the moment, google tell me that the robots.txt stop him to index the page.
Now, I have the basic wordpress robots.txt
Code: Select all
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

Sitemap: http://www.blablabla/sitemapindex.xml


But I'm also thinking that I have to add extra disallow in order to protect a bit the forum.

Code: Select all
User-agent: *

Disallow: /forum/memberlist.php
Disallow: /forum/search.php?
Disallow: /forum/login.php
Disallow: /forum/faq.php
..




If you can help advice me about the bridge and optimal solution for the robots.txt it will be really cool.

Cheers,
bidiesman
 
Posts: 6
Joined: Thu Jul 25, 2013 3:39 pm


Return to phpBB SEO Premod

 


  • Related topics
    Replies
    Views
    Last post

Who is online

Users browsing this forum: Baidu [Spider], HB and 64 guests