Forum Replies Created
Yeah, a pure MySQL will always be better, for bbPress 1.x imports both the topics and replies steps of the imports have a table join that is currently required for topics to determine the 1st post and ignore replies, then for replies to ignore the topic.
I’ve got some ideas on how we can eliminate this join which would speed things up significantly but that will have to wait a bit as it involves refactoring the entire process, that then means refactoring the other ~24 importers to also work. At the moment this process is all manual, try this, try that, and that makes it incredibly time consuming. Hopefully not to far down the road I can automate much of this with bbPress’ new testing setup much of the manual work can be eliminated and iterating the importers can happen alot faster.
Make sure you are using Twenty Fifteen, or Twenty Sixteen and no other plugins activated, 3 a second sounds a little slow, like my reply here, sorry about not getting to it sooner, as said 84 hours have now passed did the import finish?
I’ve really got nothing else except what has already been discussed here in this topic.
Thanks for dropping by @redsand, great appreciated 🙂
Regarding option 1, is it even possible and does such a script exist?
Yes, there one, maybe two scripts, but they are quite out of date.
Regarding option 2, what are the required wp_postmeta keys I would need to generate?
Have you looked at the internals of any of the ~25 importers included with bbPress?
phpBB and SMF are the two most “feature complete” in that they import nearly 100% of the required
A basic example version of an importer is included,
Example.phpin the `/includes/admin/converters/ folder, its fairly basic, when comparing it with either the phpBB or SMF importers it might make more sense. There is also some initial documentation on modifying this yourself https://codex.bbpress.org/getting-started/importing-data/import-forums/custom-import/
If you upload to https://gist.github.com/ or somewhere, take a screenshot of it from phpMyAdmin I’ll happily help you get it up and running.
Also, I suggest using bbPress 2.6-alpha, loads of importer improvements over bbPress 2.5.9, you can grab it from here https://bbpress.org/download/
Unfortunately the original Sucuri article incorrectly stated what versions of bbPress were affected, the article has seen been updated to document what versions of bbPress were affected. bbPress 2.5.9 patched the security issue documented by Sucuri.
@jkuzma, I’ve moved this to its own topic.
I did not think your issue was to do do with 2.5.9, as you’d replied to I have the same exact problem to the original authors post from before bbPress 2.5.9 was released.
Can you add here a list of your plugins and the theme you’re using so I can try and replicate your setup and reproduce the issue please.
p.s. I won’t be able to now, but will look in the mornings its half past midnight here local time, and yawn, I’m tired 😉
Yes, just delete the 2.5.x version, and upload or copy the 2.6 .zip file to your WP install 🙂
Having created a 2nd keymaster user this sounds like a plugin conflict, follwo the steps here to see if you can narrow down which plugin is causing the conflict
Most likely all the above replies which are *not* the same thing, they are all different errors are caused by the same thing though, a plugin or theme conflict.
It probably needs an update, I’m pretty sure its the same one I worked on but just cannot find right this second 😉
Grab me a link to it and post it here, also make sure your database you want to import from is on the same database server you are using for WordPress, doesn’t have to be the same database, just the same MySQL server.
This seems to be after 24-36 hours of run time, so I am not sure if I am running across some sort of session expiration or what.
Yes, that is exactly what you are coming up against, on the technical side, its WordPress dropping the MySQL session, the work around is to every few,4,6,8,12 hours even is to open a new browser tab and refresh a WordPress admin page and that should stop those
Is it possible to re-run an import, picking off where it left off?
It’s supposed to, there’s some improvements here coming in bbPress 2.6, I also strongly suggest using 2.6-alpha available from https://bbpress.org/download, there will be no more import changes before 2.6 ships and there are vast improvements to importing in 2.6.
Give it a try and let me know it goes 🙂
You should try bbPress 2.6-alpha, there are lots of bug fixes for SMF in this upcoming release
Grab it from https://bbpress.org/download
It contains pretty big improvements around the importing and matching of users and their data. It should now correctly map any Anonymous users to bbPress’ Anonymous user though now it will include their vBulletin Anonymous user name. It also works in a similar fashion for deleted users, if the user was deleted and their posts kept, bbPress now maps these posts and usernames to its own internal Anonymous user.
Also make sure to run the repair tools after importing, it fixes up any freshness, last poster type issues if we couldn’t import that data it recalculates it for you.
Grab 2.6-alpha from https://bbpress.org/download
You should try bbPress 2.6-alpha, there are heaps of phpBB improvements in bbPress 2.6 🙂
That should fix your author mapping, it also adds support for mapping anonymous/deleted users to their topics which is pretty cool.
The mapping of the users old phpBB user ID is also updated to work quite differently to how it did in the 2.5.x release so again this should fix that for you also.
p.s. bbPress.org here runs 2.6-alpha, and we’re hoping to ship 2.6 in the next couple of weeks.
Edit: Get 2.6-alpha via our downloads page https://bbpress.org/download
WPML have a bbPress plugin you need to use, they don’t publish it publicly, you need to ask them for a copy of it, that should fix any WPML and bbPress compatibility issues you’re having.
Thats a little weird ¯\_(ツ)_/¯
I’ve really got nothing if you were shown that 0 topics were imported etc, the same system is shared across ~25 different forum packages and I’ve never seen that reported before 🙁
Awesome, glad you’ve got your site running faster 🙂
Hopefully as bbPress 2.6 main focus has been on performance this will get even better once 2.6 is released.
I need to take a closer look, and I’m exhausted today, so hopefully over the weekend I’ll get a chance to take a look and make said nerdy pull request 😉
Based on said closer look I can start to think how we might integrate it into core and go from there
will the changes affect this rewrite set? i see bbpress replies as comments?
No, for bbPress 2.7 yes, but not for bbPress 2.6
@siparker This is awesome, thank you 🙂
Could you set this up in a GitHub repo please, I’ve got a few change suggestions 🙂
@celziobiaz I very nearly marked this post of yours as spam, jumping into an old topic near on 2 years of age to promote your plugin is not cool.
Also, if the old xenForo site is still live and people are posting to it, can I re-run the import tool to have it grab the latest posts or would I want to start over? I know that I’ll probably want to start over since you’ve added new import functionality, but in the future, would it work to just run the import tool from time to time until I’m ready to shut down the old site?
I’d like to add this functionality down the road, we’ve got it partially, partially in that currently if it finished importing forums and only half way through topics then it would resume from the topics it didn’t finish then continue on to to replies.
It literally resumes from where it left off, it never goes back to check if there are new forums, or new topics but in the future that would be a great addition.