Forum Replies Created
Thats a little weird ¯\_(ツ)_/¯
I’ve really got nothing if you were shown that 0 topics were imported etc, the same system is shared across ~25 different forum packages and I’ve never seen that reported before 🙁
Awesome, glad you’ve got your site running faster 🙂
Hopefully as bbPress 2.6 main focus has been on performance this will get even better once 2.6 is released.
I need to take a closer look, and I’m exhausted today, so hopefully over the weekend I’ll get a chance to take a look and make said nerdy pull request 😉
Based on said closer look I can start to think how we might integrate it into core and go from there
will the changes affect this rewrite set? i see bbpress replies as comments?
No, for bbPress 2.7 yes, but not for bbPress 2.6
@siparker This is awesome, thank you 🙂
Could you set this up in a GitHub repo please, I’ve got a few change suggestions 🙂
@celziobiaz I very nearly marked this post of yours as spam, jumping into an old topic near on 2 years of age to promote your plugin is not cool.
Also, if the old xenForo site is still live and people are posting to it, can I re-run the import tool to have it grab the latest posts or would I want to start over? I know that I’ll probably want to start over since you’ve added new import functionality, but in the future, would it work to just run the import tool from time to time until I’m ready to shut down the old site?
I’d like to add this functionality down the road, we’ve got it partially, partially in that currently if it finished importing forums and only half way through topics then it would resume from the topics it didn’t finish then continue on to to replies.
It literally resumes from where it left off, it never goes back to check if there are new forums, or new topics but in the future that would be a great addition.
Yeah, I’m actually thinking it might be best to require the user (me) to manually move the images directory from the old site to the new site. Then, maybe just use the xenForo URL to the image to display it in the post. It “should” be safe since xenForo reduced the images based on admin settings when they were originally uploaded. Just some random thoughts from a guy not looking at import code. 😉
I can add a “generic” that would change
, you could then manually change thehttps:/example.com/attachment/
part of that to anything you want for examplehttp://surveyorconnect.com/attachments/` and have that folder on your server serve up the attachments from there?
I’m wondering if https://bbpress.dev4press.com would actually cure some of the bbcode issues automatically.
We actually use a pretty comprehensive BBCode library already during import it converts a huge amount of common BBCode code to native HTML for us, I think you’d find there are only a handful of custom BBCode’s not covered by this library and is why I add them manually.
p.s. I haven’t packaged up a new release with the changes just yet, but you can always get the latest version (with the above updates) from:
At the bottom of that page is a link to download the file in “original format” and that will get you the file, the link is dynamic and changes each revision so that’s why no direct link.
Probably the most noticeable issue after the import are the attachments. They are basically a number with opening and closing ATTACH bbcodes.
I’m not quite sure what to do with attachments as bbPress import system does not yet support attachments ¯\_(ツ)_/¯
I could add some code to “hide” the BBCode whilst still keeping it as a refernce?
Also I’ve added support for YouTube, Daily Motion and Vimeo BBCode conversion
Then there are the quotes to other posts. These simply just come in as text and the post IDs don’t match those in bbpress. In xenForo, the quoted posts link back to the post that was quoted.
I’ve added some styling to the quotes now, so it wraps that quotes in “blockquote” and cites the authors name, e.g “wendellh wrote:”
For now we can’t link to the quoted post, this is on my radar to do but requires some pretty big changes, maybe bbPress 2.8.
I’ve also noticed that soft deleted posts (only viewable by mods and admins) in xenForo are coming in as public posts.
Ah, I didn’t know about these types of posts, I’ve now done this, for topics/threads replies/posts that were “soft deleted” these are now imported with bbPress/WordPress “pending” status.
I appreciate bbPress may add an extra 2 seconds to your site, though I’m not sure why.
That said, if your site was taking 10 seconds before bbPress I would stop visiting your site, honestly, even the best content in the world would not be enough for me to endure a 10 second page load.
As Pascal’s detailed reply points out above, I would take a look at the cause of your sites poor performance and get that fixed before adding anything new to your site.
p.s. I wanted you to run that query to see if it failed, if it did fail that would have meant you and I have different database schemas for our Xenforo databases.
o are the reply authors all correct now or still having issues with them?
If you look at the phpBB and SMF importers they have near the end of the file a bunch of regular expressions for converting custom BBCode into native HTML for WordPress.
Get me a list of what you want copied from the SMF/phpBB importers to Xenforo and I’ll add them.
If you need more, or tweaks to them happy to help out here also.
The queries in this post should do what you need:
Following up with research complete….New Relic is really awesome for this type of stuff.
It is, I’m not using New Relic but am using similar services on various sites
There are some example views here if that helps https://gist.github.com/ntwb/8167699
We have a plan to switch forums from custom post types to a taxonomy in most like 2.7 which will open up all kinds of views…
I wrote a reply here yesterday, it’s vanished 🙁
I have an idea what it might be but today has run out of hours, I’ll test this tomorrow and let you know 🙂
I’m a bit nervous about changing anything in the live xenForo database…
There is nothing changed in the XenForo database, the query only “reads” data it does not write anything to the database 🙂
p.s. It still pays to have a backup 😉
I’ve just pushed a new 2.6-alpha that includes a fix for deleting imported users, it wasn’t behaving as it should.
I’ve just bumped 2.6-alpha with the above changes and also a fix for deleting imported users that wasn’t playing nice 😉
I’ve just added support to the XenForo importer to support deleted users.
If you update your 2.6-alpha via this zip file you’ll have that included for your import.
What this does is if a user has been deleted from XenForo their topics and replies are not actually deleted (they are kept to maintain context) but during import because that user no longer exists they cannot be imported and the topic/reply would then be attributed to the
anonymoususer. Now the topic/reply is still attributed to the
anonymoususer but includes the original author name, basically the same way XenForo handled this.
Edit: You can see the difference from when the
Member Twouser still existed and was imported per https://cloudup.com/c_epfx4Q4z8/f, I then deleted
Member Twoand the result looks like this https://cloudup.com/cNnYv-3eSyl https://cloudup.com/c5iQ-iIOoW4
I’ve just got my copy of Xenforo up and running locally, I don’t have an issue with reply authors here, see this screenshot https://cloudup.com/c_epfx4Q4z8
Can you open up phpMyAdmin and run this SQL query on your Xenfor database:
SELECT convert(post.post_id USING "utf8mb4") AS post_id, convert(thread.thread_id USING "utf8mb4") AS thread_id, convert(post.thread_id USING "utf8mb4") AS thread_id, convert(post.user_id USING "utf8mb4") AS user_id, convert(post.message USING "utf8mb4") AS message, convert(post.post_date USING "utf8mb4") AS post_date FROM xf_post AS post LEFT JOIN xf_thread AS thread USING (thread_id) WHERE thread.first_post_id != post.post_id
You might have to change the following two lines if your database does not use
xf_as the forum prefix:
FROM xf_post AS post LEFT JOIN xf_thread AS thread
FROM myprefix_post AS post LEFT JOIN myprefix_thread AS thread
@wendellh Thanks for the info on that error, not sure why that error occured, nothing really changed between 2.5.8 and 2.6 in regard to this table creation. I’ll try to duplicate the issue later today.
I changed the default value to “special” in this part below.
I don’t think this would cause that error, the fact that I’ve no idea what is causing that error “could” be in fact the cause of the error.
The “Reset Forums” tool includes the ability to delete all bbPress forum content and imported users, run this and that should get rid of your ~30k imported users.
After that, try changing that “special” back to “Snitz” (I think thats what it was) and se what happens.