@stephen edgar – it was weird. I ran the job in a staging environment. Very bizarre but it happened.
@rolling stone I then ran the job in my production environment and it failed. My hosting company is WPEngine and they had to turn off the script timeout from the backend and it worked like a champ.
Even running 10 rows at a time with a 5 second delay was failing. It would go to 80 rows and then fail because of the timeout.
When they turned off the timeout, I was able to do 600 rows at a time just fine.
It seems like it’s really important to work with your hosting company to help with this. I only had a small forum with about 2500 topics. I can’t imagine what a huge forum must be doing to some folks.
Once again, hope that helps.
