[@gcoz Participant 11 years, 3 months ago]

I’m already running it on an SSD. Would RAM Drive still improve the performance significantly?

[@gcoz Participant 11 years, 3 months ago]

thanks for checking the queries. I believe it’s not your importer, actually…
I think there’s just an issue with my databases. I did the optimization for all tables, made another local copy (a brand new installation of Ubuntu with default settings for apache, php and the largest settings for mysql allowing it to use more resources).
However, after some more digging, I’m starting to think that my tables are the reason for this slow-down. Specifically them being a mix of MyISAM and InnoDB after many years of conversions, WP updates and one forum conversion from phpbb to vanilla.

I tried to get some out-of-memory errors but all it does is slow it down and it keeps going really slowly. Even setting it to 2000 rows at 1 second doesn’t seem to push it to run out of memory. The “top” command just shows me that it’s working away at 60% CPU and 11% memory for mysql and 50% CPU and 2% memory for apache.

MySQL workbench shows that I only have 6 connections active, which is probably another related issue. I don’t know how to change that but my current running test conversion is with all WP tables converted to InnoDB. It fluctuates at 50-200 writes per second according to MySQL workbench

This is total guesswork on my end (I’m no expert) and I thought it might be a helpful starting point for others with similar issues…

[@gcoz Participant 11 years, 3 months ago]

Thanks for the link, I had a read through the topic and I did see those dashes mentioned over there pop up twice in my import so far. All I needed to do, was to reload the Tools/Forum page with the importer, add all the db details and hit start.
It picked it up where it left off (no way for me to verify at this stage if anything got messed up but that was the only error I could see)…

The one odd thing I noticed was that the topic import is blazingly fast but the replies are very slow. Not sure if there’s a reason for that?

I lowered the delay to 1 second but looking at the rate at which posts are added to the “reply” post-type, it’s not really speeding up the process. Maybe my MySQL config might be to blame there if it’s not catching up?

Might have to try it on a different machine locally if 6 hours is possible for this kind of import. At this rate it’ll take another 4-5 days which is enough time to set up another machine for testing and letting it run for a while.