[arnalyse]

Hi you guys,

I’m in the process of importing a rather large vBulletin board. It has around 50’000 topics and more than 3 million posts.

And I’ve got this one question: does bbPress write out or somehowe save topics, which it couldn’t import? So I can get a glimpse at the problem at hand why a certain vBulletin thread has not been imported?

A little more background: I’ve done a few test imports, and so far bbPress is doing a terrific job. To keep import time manageable, I modified the vBulletin converter from bbPress to skip replies, which I import with some more complex SQL queries after the bbPress importer has created users and topics.

Nearly all of my 20’000 users and 50’000 topics get imported, but some vBulletin threads do not shop up with the meta_key named _bbp_old_topic_id. I really tried to spot a pattern there, but had no luck. So I’m hoping there’s a way to gather some more information directly from the bbPress import.

I’m running bbPress 2.5.9 and WordPress 4.5.2

[Robin W]

ok, suspect it is a It could be a theme or plugin issue

Plugins

Deactivate all but bbpress and see if this fixes. if it does, re-enable one at a time to see which is causing the error.

Themes

If plugins don’t pinpoint the problem, as a test switch to a default theme such as twentyfifteen, and see if this fixes.

[Robin W]

ok, I’m close to a solution for @amaros using private groups, and might fix @aurelienpierre as well.

Either of you got a test site where you can see if it does what is needed?

[Schoelje]

[Warning]: DO NOT DO THIS ON A PRODUCTION DATABASE!
My apologies for the caps, but this is really important 😉

[Assumptions]: Debian/Ubuntu developmachine with phpMyAdmin.

[Note]: Obviously I haven’t tested all Apache/MySql versions. This was done on SolydK (Debian Jessie). It is also not perfect. So, if somebody can improve on the code. Please, let me know.

After you’ve setup a development machine, imported the phpBB data and checked that everything is working fine, you still need to convert the phpBB internal links like “viewtopic.php?p=####” or “viewtopic.php?t=####” to the slugs that are being used by bbPress.

Let’s start!

1) First you’ll need to install and compile lib_mysqludf_preg.
Create a bash file install_preg.sh with this content:

#!/bin/bash
apt-get update
apt-get install libpcre3-dev libmysqlclient-dev build-essential libmysqld-dev libpcre3-dev
wget https://github.com/mysqludf/lib_mysqludf_preg/archive/testing.zip
unzip testing.zip
cd lib_mysqludf_preg-testing
./configure
make  install
make MYSQL="mysql -p" installdb
service mysql restart

Make it executable:
chmod +x install_preg.sh

And run it:
./install_preg.sh

2) Install the stored procedures.
In phpMyAdmin, select the database and the SQL tab.
Paste the following codes separately, creating three stored procedures on your database:

DELIMITER $$
CREATE PROCEDURE sp_cleanup_replies()
BEGIN
  -- declare cursor for reply url change
  DECLARE reply_cursor CURSOR FOR 
  SELECT DISTINCT old_post_id, REPLACE(<code>xkcom_posts</code>.<code>guid</code>, 'http://yoursite.com', '') AS new_url
  FROM (SELECT CAST(CONVERT(PREG_CAPTURE('/#p([0-9]+)/i', <code>post_content</code>, 1) USING UTF8) AS UNSIGNED) AS old_post_id FROM <code>xkcom_posts</code>) AS t1
  INNER JOIN <code>xkcom_postmeta</code> ON <code>xkcom_postmeta</code>.<code>meta_value</code> = old_post_id
  INNER JOIN <code>xkcom_posts</code> ON <code>xkcom_posts</code>.<code>ID</code> = <code>xkcom_postmeta</code>.<code>post_id</code>
  WHERE <code>xkcom_postmeta</code>.<code>meta_key</code> = '_bbp_old_reply_id'
  AND old_post_id IS NOT NULL
  ORDER BY old_post_id DESC;
  
  SELECT 'sp_cleanup_replies: START';
  
  -- Change posts
  OPEN reply_cursor;
  BEGIN
    DECLARE old_reply_id MEDIUMINT;
    DECLARE new_url VARCHAR(255);
    DECLARE search_string VARCHAR(255);
    DECLARE done INT DEFAULT FALSE;
    DECLARE CONTINUE HANDLER FOR NOT FOUND SET done = TRUE;

    read_loop: LOOP
      FETCH reply_cursor INTO old_reply_id, new_url;
      IF done THEN
	LEAVE read_loop;
      END IF;
      
      SET search_string = CONCAT('|[a-z0-9\.\-:\/&=\?\+]+#p', old_reply_id, '|i');
      SELECT CONCAT('sp_cleanup_replies: replace ', search_string, CONCAT(' with ', new_url));
      
      -- Uncomment the following line if you want to test the regexp
      -- SELECT CONVERT(PREG_REPLACE(search_string, new_url, <code>post_content</code>) USING UTF8) FROM <code>xkcom_posts</code> WHERE INSTR(<code>post_content</code>, CONCAT('#p', old_reply_id)) > 0; LEAVE read_loop;
      
      UPDATE <code>xkcom_posts</code> SET <code>post_content</code>= CONVERT(PREG_REPLACE(search_string, new_url, <code>post_content</code>) USING UTF8) WHERE INSTR(<code>post_content</code>, CONCAT('#p', old_reply_id)) > 0;
    
    END LOOP;
  END;
  CLOSE reply_cursor;
  
  SELECT 'sp_cleanup_replies: DONE';
  
END$$
DELIMITER ;

DELIMITER $$
CREATE PROCEDURE sp_cleanup_topics()
BEGIN 
  -- declare cursor for topic url change
  DECLARE topic_cursor CURSOR FOR 
  SELECT DISTINCT old_topic_id, REPLACE(<code>xkcom_posts</code>.<code>guid</code>, 'http://yoursite.com', '') AS new_url
  FROM (SELECT CAST(CONVERT(PREG_CAPTURE('/t=([0-9]+)/i', <code>post_content</code>, 1) USING UTF8) AS UNSIGNED) AS old_topic_id FROM <code>xkcom_posts</code>) AS t1
  INNER JOIN <code>xkcom_postmeta</code> ON <code>xkcom_postmeta</code>.<code>meta_value</code> = old_topic_id
  INNER JOIN <code>xkcom_posts</code> ON <code>xkcom_posts</code>.<code>ID</code> = <code>xkcom_postmeta</code>.<code>post_id</code>
  WHERE <code>xkcom_postmeta</code>.<code>meta_key</code> = '_bbp_old_topic_id'
  AND old_topic_id IS NOT NULL
  ORDER BY old_topic_id DESC;
  
  SELECT 'sp_cleanup_topics: START';
  
  -- Change topics
  OPEN topic_cursor;
  BEGIN
    DECLARE old_topic_id MEDIUMINT;
    DECLARE new_url VARCHAR(255);
    DECLARE search_string VARCHAR(255);
    DECLARE done INT DEFAULT FALSE;
    DECLARE CONTINUE HANDLER FOR NOT FOUND SET done = TRUE;

    read_loop: LOOP
      FETCH topic_cursor INTO old_topic_id, new_url;
      IF done THEN
	LEAVE read_loop;
      END IF;
      
      SET search_string = CONCAT('|[a-z0-9\.\-:\/&=\?\+]+t=', old_topic_id, '|i');
      SELECT CONCAT('sp_cleanup_topics: replace ', search_string, CONCAT(' with ', new_url));
      
      -- Uncomment the following line if you want to test the regexp
      -- SELECT CONVERT(PREG_REPLACE(search_string, new_url, <code>post_content</code>) USING UTF8) FROM <code>xkcom_posts</code> WHERE INSTR(<code>post_content</code>, CONCAT('t=', old_topic_id)) > 0; LEAVE read_loop;
      
      UPDATE <code>xkcom_posts</code> SET <code>post_content</code>= CONVERT(PREG_REPLACE(search_string, new_url, <code>post_content</code>) USING UTF8) WHERE INSTR(<code>post_content</code>, CONCAT('t=', old_topic_id)) > 0;

    END LOOP;
  END;
  CLOSE topic_cursor;
  
  SELECT 'sp_cleanup_topics: DONE';
  
END$$
DELIMITER ;

DELIMITER $$
CREATE PROCEDURE sp_cleanup_missing()
BEGIN
  -- declare cursor for reply url change
  DECLARE missing_cursor CURSOR FOR 
  SELECT DISTINCT old_post_id
  FROM (SELECT CAST(CONVERT(PREG_CAPTURE('|/&[a-z0-9=\+]+#p([0-9]+)|i', <code>post_content</code>, 1) USING UTF8) AS UNSIGNED) AS old_post_id FROM <code>xkcom_posts</code>) AS t1
  WHERE old_post_id IS NOT NULL
  ORDER BY old_post_id DESC;
  
  SELECT 'sp_cleanup_missing: START';
  
  -- Change posts
  OPEN missing_cursor;
  BEGIN
    DECLARE missing_reply_id MEDIUMINT;
    DECLARE search_string VARCHAR(255);
    DECLARE done INT DEFAULT FALSE;
    DECLARE CONTINUE HANDLER FOR NOT FOUND SET done = TRUE;

    read_loop: LOOP
      FETCH missing_cursor INTO missing_reply_id;
      IF done THEN
	LEAVE read_loop;
      END IF;
      
      SET search_string = CONCAT('|[a-z0-9&=\+]+#p', missing_reply_id, '|i');
      SELECT CONCAT('sp_cleanup_missing: remove ', search_string);
      
      -- Uncomment the following line if you want to test the regexp
      -- SELECT CONVERT(PREG_REPLACE(search_string, '#', <code>post_content</code>) USING UTF8) FROM <code>xkcom_posts</code> WHERE INSTR(<code>post_content</code>, CONCAT('#p', missing_reply_id)) > 0; LEAVE read_loop;
      
      UPDATE <code>xkcom_posts</code> SET <code>post_content</code>= CONVERT(PREG_REPLACE(search_string, '#', <code>post_content</code>) USING UTF8) WHERE INSTR(<code>post_content</code>, CONCAT('#p', missing_reply_id)) > 0;
    
    END LOOP;
  END;
  CLOSE missing_cursor;
  
  SELECT 'sp_cleanup_missing: DONE';
  
END$$
DELIMITER ;

3) Run the stored procedures from terminal.
It is important that you check some example posts with links that need to change. First the post links like “viewtopic.php?some_parameters#p#####”, then topic links like “viewtopic.php?some_parameters&t=#####” and lastly the links to missing posts are removed.

mysql -u root -p -e 'CALL sp_cleanup_replies()' my_database

mysql -u root -p -e 'CALL sp_cleanup_topics()' my_database

mysql -u root -p -e 'CALL sp_cleanup_missing()' my_database

Now, check your posts and when you’re happy you can drop the stored procedures:

DROP PROCEDURE IF EXISTS sp_cleanup_replies;
DROP PROCEDURE IF EXISTS sp_cleanup_topics;
DROP PROCEDURE IF EXISTS sp_cleanup_missing;

Mod note: edited and changed dev site from contributer to yoursite.com

[randrcomputers]

@siparker I think I took care of most of that? disabled all facebook stuff. fixed the style.css deal that was missing. not sure on jquwry.min but will look into that. will test tonight thank you for the tips! can you look again and see if I took care of at least a few of the issues?

[sasenzon]

Hi. I would have to ask my server tech to run the error test again.
But it is the same blank screen for all buddypress pages.

I hope my theme developer can fix this.
Thanks for your suggestions.

If you have any other thoughts or people I could consult to look at it I would appreciate it.
Thanks again.
Simon

[Vitor Madeira]

Thanks! This is the kind of information that I’m looking for: Real user testimonies when dealing conversions from vBulletin to bbPress with success or not!

[Robkk]

@mica123

I already replied to your topic here about the bbpress.php file in your theme. As for the bbP Default theme package template files in bbPress, there were no changes from 2.5.8 to 2.5.9, 2.5.9 was mainly an update to a security issue involving at-mention functionality.

In the future when the release of 2.6 happens, you would have to edit some files. It would be quite easy to

1. compare the new 2.6 templates and compare them to your modified files
2. make those changes to a copy of the 2.6 templates
3. test them to see if everything is in working order in a testing environment
4. update to bbPress 2.6 on your main production site (after taking a backup of course)
5. and then push the template files to your child theme using FTP

As for the text editor issue above from the other user, I think they just modified their footer.php file in their theme and accidentally removed <?php wp_footer(); ?>, and then that screwed up all the scripts and styles hooked into the footer.

[hivoltage316]

Thanks, but this did not work.

I disabled all plugins except bbPress, as well as switching to the twentyfifteen theme.

There is nothing else that will cause conflict.

If I type anything in the search criteria, I’m always returned the same blog post even if the search does not match. The URL I am shown is http://xxxxxxx/forums/search/test/
But the result is a single blog page and not any forum posts.

Any help would be appreciated.

[Robin W]

bbPress is tested with wordpress default themes. It maybe a conflict – you need to check plugins and themes

It could be a theme or plugin issue

Plugins

Deactivate all but bbpress and see if this fixes. if it does, re-enable one at a time to see which is causing the error.

Themes

If plugins don’t pinpoint the problem, as a test switch to a default theme such as twentyfifteen, and see if this fixes.

Then come back

[Robin W]

ok, so you don’t have private groups and the error is not the same error as the issue above apart from the first 9 words which are generic 🙂

sorry this is a totally different issue.

bbPress is tested with wordpress default themes. It maybe a conflict – you need to check plugins and themes

It could be a theme or plugin issue

Plugins

Deactivate all but bbpress and see if this fixes. if it does, re-enable one at a time to see which is causing the error.

Themes

If plugins don’t pinpoint the problem, as a test switch to a default theme such as twentyfifteen, and see if this fixes.

[amaros]

Hello all,

I got some trouble with my latest project.
Here what I need to do:
I am managing a forum with a few hundred members, it is not public. Right now I am using “Members” to manage WP roles and “private groups” for 6 different private subforums. Now I want to give all members the ability to read 5 of the private subforums, while only the members of the groups should be able to create topics and replies. I thought about something like override the bbp roles with the wp roles and hiding the bbp-form for different roles or switching the bbp roles (participant – spectator) depending on the forum id.

Any suggestions or ideas?

[Robin W]

ok, I’ve had a quick look.

The page number is set by this line

$reply_page = ceil( (int) bbp_get_reply_position( $reply_id, $topic_id ) / (int) bbp_get_replies_per_page() );

I suspect that bbp_get_replies_per_page is not the issue, but that bbp_get_reply_position is.

so this function is as follows :

function bbp_get_reply_position( $reply_id = 0, $topic_id = 0 ) {

		// Get required data
		$reply_id       = bbp_get_reply_id( $reply_id );
		$reply_position = get_post_field( 'menu_order', $reply_id );

		// Reply doesn't have a position so get the raw value
		if ( empty( $reply_position ) ) {
			$topic_id = !empty( $topic_id ) ? bbp_get_topic_id( $topic_id ) : bbp_get_reply_topic_id( $reply_id );

			// Post is not the topic
			if ( $reply_id !== $topic_id ) {
				$reply_position = bbp_get_reply_position_raw( $reply_id, $topic_id );

				// Update the reply position in the posts table so we'll never have
				// to hit the DB again.
				if ( !empty( $reply_position ) ) {
					bbp_update_reply_position( $reply_id, $reply_position );
				}

			// Topic's position is always 0
			} else {
				$reply_position = 0;
			}
		}

		// Bump the position by one if the lead topic is in the replies loop
		if ( ! bbp_show_lead_topic() )
			$reply_position++;

		return (int) apply_filters( 'bbp_get_reply_position', $reply_position, $reply_id, $topic_id );
	}

so given that you seem fine with accessing the database, and hoping you are fine with editing files and uploading these, let’s see what value are being set in this function. I presume you can edit files, and you say you have a ‘safe’ area in which to play.

so lets start with

$reply_position = get_post_field( 'menu_order', $reply_id );

which is set on line 1742 of includes/replies/template.php

Now we can filter and play with this function, but it is probably easier just to edit the file whilst we test – just take a copy of it before so you can restore at the end.

So I’d add a line after 1742 saying

update_option( 'encide', $reply_position ) ;

save and upload, and then display a page which works and one that doesn’t and each time you can access wp_options in the database and look for the encide option name.

That should tell you what it is set to.

I’d suspect that it is not correct for the faulty ones, and is returning 1 or 0 – hence no pagination.

Come back and let me know what it says, and we can progress from there.

[randrcomputers]

fuskeren i do have a dev site up test.vpinball.com Ive spent so much time trying to get normal speed im at a loss at this point.

[randrcomputers]

I have tried for months to speed up site but nothing is working. Submitting a post can take 20 sec. everything is slow. Cant find anything to help ive tried 3 host’s VPS, CDN Everything and still slow. Seems switching now wont be easy but im loosing members due to speed. Anyone have link to anyone who can help? or is switching to another forum software only answer? I tested regular forum software and is instant response but i see no easy way to convert the bbpress forums 🙁

vpinball.com is the site

[timsilva_]

Hmm, I also just noticed that some topics from the migrated database with only a few pages (4 pages in the one I just tested) don’t seem to have this issue.

I designed some the forum topics to be long, ongoing threads. For example, we have a “Music” thread that currently has 7,674 replies (15 per page, so 512 pages total). Could the issue simply be that the thread is so large, that bbPress somehow doesn’t do the calculation?

I have read in some support threads about issues with pagination on bbPress when dealing with large numbers, perhaps it is related to that?

Some additional details that may be related: I have nested replies turned off (and they were never turned on). Also, all of my categories are set to hidden.

[littlemisslanna]

When I use my test account, there’s no option for normal users to edit their posts, and there definitely used to be! I’ve disabled all my plugins one at a time, and it doesn’t seem to help. Any ideas, or thoughts on what I can add in where to make the edit button come back?

[timsilva_]

@robin-w I do have access to phpmyadmin. I have been looking around, and the only thing that looks fishy is that the “guid” varchar(255) row has my old local environment in the URL instead of my live domain. So it is http://localhost/forum/topic/title/ when it should be http://example.com/forum/topic/title/ – But after I tried to correct that for the post and the postmeta of the thread’s latest reply (in a safe environment) it didn’t seem to fix the problem. I did notice that my old local URL was hardcoded over 220,000 times in my database though, I wonder if this is something that needs to be corrected for each topic/reply.

I tried to get creative by changing the “Replies Per Page” in wp-admin > Settings > Forums to a different number. That successfully recalculated the correct number of pages required for the non-affected threads (I set it from 15 replies per page to 30 replies per page, so a thread with 10 pages was updated with 5 pages, and the latest reply link updated to point to page 5), but the affected threads still have no “/page/##/” segment in the URL.

[Robin W]

ok, thanks – sorry it’s sometimes hard to understand the obvious until you see it !

so I’m presuming that there should be some content to that post?!

bbPress is tested with wordpress default themes. It maybe a conflict – you need to check plugins and themes

It could be a theme or plugin issue

Plugins

Deactivate all but bbpress and see if this fixes. if it does, re-enable one at a time to see which is causing the error.

Themes

If plugins don’t pinpoint the problem, as a test switch to a default theme such as twentyfifteen, and see if this fixes.

[christopheran]

Thank you both very much – I am testing this out right now!

[Robin W]

Also I am not sure there is a visitor WordPress role.

oops… no there isn’t – old code left on my test site !

and who gets what were just examples 🙂

[Robin W]

not tested, but the following in your functions file should do it

you’ll need to edit the code for which role does what

add_action('wp_login', 'rew_assign_role_on_login', 10, 2);

//this function assigns user to bbp roles on login
function rew_assign_role_on_login($user_login, $user) {
	$user_id = $user->ID ; 
	$role = get_role($use_id) ; 
	if (empty ($role)) return ; //has no role in the database
	if ($role == 'administrator' )  $new_role = 'bbp_keymaster' ;
	if ($role == 'editor' )  $new_role = 'bbp_moderator' ;
	if ($role == 'author' )  $new_role = 'bbp_moderator' ;
	if ($role == 'contributor' )  $new_role = 'bbp_participant' ;
	if ($role == 'visitor' )  $new_role = 'bbp_blocked' ;
	if ($role == 'subscriber' )  $new_role = 'bbp_spectator' ;
	bbp_set_user_role( $user_id, $new_role) 
	}

[Robin W]

bbPress is tested with wordpress default themes. It maybe a conflict – you need to check plugins and themes

It could be a theme or plugin issue

Plugins

Deactivate all but bbpress and see if this fixes. if it does, re-enable one at a time to see which is causing the error.

Themes

If plugins don’t pinpoint the problem, as a test switch to a default theme such as twentyfifteen, and see if this fixes.

[Fuskeduske]

Hi all,

On my forum, the latest Topic / freshest Topic sometimes shows the wrong topic as you can see here:
http://imgur.com/E1Y9Bu9 newest post is about 1 day, 18 hours old.

It always reverts back to the same thread, which was comverted from a phpbb forum.

I have tried recounting using the integrated tools, but that does not seem to work, however when i post a new topic it will work as intended showing the right post for about a day or two, and then go back.

[sharmavishal]

maybe this can help

https://gist.github.com/sc0ttkclark/e5de9d9f2f13964bcecc

and

https://wordpress.org/plugins/multisite-bbpress-slave/

i tested both and was not able to get it working on my setup