Forum Replies Created
-
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 import
Hmm, looks like a broken import. Dammit. That means I’ll have to run it again! Some topics don’t have replies in them.
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 importOK, got that task to run by fiddling around with the structure of the foreach.
Counts are still all screwy though. The tasks run fine when updating post counts, last activity etc but nothing changes.
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 importHey again,
OK, we’re getting somewhere but now the task that fails is: “Remap existing users to default forum roles” and the various counts don’t appear to have updated. I still see last activity as being 4 years ago and forum post counts at zero
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 importIt’s the “Recalculate the position of each reply” tool at the moment that’s messing us around. I presume it’s the 500k or so replies giving issues.
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 importBelieve it or not, still whacking away at this one 🙂
I’ve managed to get the bloody thing to convert but now the issue is running the scripts to repair the forums. Is there some way I can do this programmatically or through wp-cli or something? I’m hitting memory limits even if I set PHP’s memory limit to 2048M and above.
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 importThanks! 🙂 I figured it’d been a while since I last posted so who knows? Maybe something would have popped up in your head 😀
I actually started it off in a totally clean wordpress this time around so I know that’s not the bottleneck. It really does just seem to take this long – I setup a new logging mechanism to watch the rate of insert statements and the highest I got it to with tweaking was ~6.7 p/s with 3500 posts and 0 seconds wait between.
It’s really quite odd because as far as I can see, it basically changes the posts to WP posts and populates the post metadata. It checks to see if this is a sticky etc and that’s about it. I’m wondering if a purely SQL based approach would work or if that’s too complex.
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 importSo I’m at this again for a different forum. Just as huge though 🙂
Any hints as to tweaking MySQL or anything to make this run faster? Currently sitting at about 3 post imports per second which means it’ll be about 84 hours before it’s done. Crazy.
@netweb – any insights? 😀Machine has same spec as before and should be a monster.
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 importWith all plugins disabled it’s much faster – still taking a long time though. Been running for approx. 24 hours and has processed 200k replies.
Machine is:
4gb RAM (2GB dedicated to MySQL, 1GB dedicated to apache)
60GB SSDCPU graphs show it sitting at around 50% at all times so it’s not maxing out there and the disk isn’t stressing either. Very interesting to keep an eye on.
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 importMakes sense – I’ll have to check it. It’s currently shunting along at 5k “rows” and 0.2 delay
In reply to: Huge bbPress 1.2 – bbPress 2.5.8 importThanks – I’ll take a look at those, perhaps run it in parallel on another machine to see which is going faster. I won’t fiddle with the current box just in case. Current projections show it’ll take around 5.5 days to complete which is a bit rough but the client is happy with it so I’ll let her ride 🙂
It’s quite a process from what I can see – basically converting each bbpress post to a wp post and then adding post metadata and working out all the relationships. I may write a script to run it for the hell of it while I’m waiting.