woklet (@woklet)

Forum Replies Created

Viewing 10 replies - 1 through 10 (of 10 total)

  • woklet
    Participant

    @woklet

    Hmm, looks like a broken import. Dammit. That means I’ll have to run it again! Some topics don’t have replies in them.


    woklet
    Participant

    @woklet

    OK, got that task to run by fiddling around with the structure of the foreach.

    Counts are still all screwy though. The tasks run fine when updating post counts, last activity etc but nothing changes.


    woklet
    Participant

    @woklet

    Hey again,

    OK, we’re getting somewhere but now the task that fails is: “Remap existing users to default forum roles” and the various counts don’t appear to have updated. I still see last activity as being 4 years ago and forum post counts at zero


    woklet
    Participant

    @woklet

    It’s the “Recalculate the position of each reply” tool at the moment that’s messing us around. I presume it’s the 500k or so replies giving issues.


    woklet
    Participant

    @woklet

    Believe it or not, still whacking away at this one 🙂

    I’ve managed to get the bloody thing to convert but now the issue is running the scripts to repair the forums. Is there some way I can do this programmatically or through wp-cli or something? I’m hitting memory limits even if I set PHP’s memory limit to 2048M and above.


    woklet
    Participant

    @woklet

    Thanks! 🙂 I figured it’d been a while since I last posted so who knows? Maybe something would have popped up in your head 😀

    I actually started it off in a totally clean wordpress this time around so I know that’s not the bottleneck. It really does just seem to take this long – I setup a new logging mechanism to watch the rate of insert statements and the highest I got it to with tweaking was ~6.7 p/s with 3500 posts and 0 seconds wait between.

    It’s really quite odd because as far as I can see, it basically changes the posts to WP posts and populates the post metadata. It checks to see if this is a sticky etc and that’s about it. I’m wondering if a purely SQL based approach would work or if that’s too complex.


    woklet
    Participant

    @woklet

    So I’m at this again for a different forum. Just as huge though 🙂

    Any hints as to tweaking MySQL or anything to make this run faster? Currently sitting at about 3 post imports per second which means it’ll be about 84 hours before it’s done. Crazy.


    @netweb
    – any insights? 😀

    Machine has same spec as before and should be a monster.


    woklet
    Participant

    @woklet

    With all plugins disabled it’s much faster – still taking a long time though. Been running for approx. 24 hours and has processed 200k replies.

    Machine is:

    4gb RAM (2GB dedicated to MySQL, 1GB dedicated to apache)
    60GB SSD

    CPU graphs show it sitting at around 50% at all times so it’s not maxing out there and the disk isn’t stressing either. Very interesting to keep an eye on.


    woklet
    Participant

    @woklet

    Makes sense – I’ll have to check it. It’s currently shunting along at 5k “rows” and 0.2 delay


    woklet
    Participant

    @woklet

    Thanks – I’ll take a look at those, perhaps run it in parallel on another machine to see which is going faster. I won’t fiddle with the current box just in case. Current projections show it’ll take around 5.5 days to complete which is a bit rough but the client is happy with it so I’ll let her ride 🙂

    It’s quite a process from what I can see – basically converting each bbpress post to a wp post and then adding post metadata and working out all the relationships. I may write a script to run it for the hell of it while I’m waiting.

Viewing 10 replies - 1 through 10 (of 10 total)