Stephen Edgar (@netweb)

Forum Replies Created

Viewing 25 replies - 1 through 25 (of 3,020 total)
  • Thats a little weird ¯\_(ツ)_/¯

    I’ve really got nothing if you were shown that 0 topics were imported etc, the same system is shared across ~25 different forum packages and I’ve never seen that reported before 🙁

    Awesome, glad you’ve got your site running faster 🙂

    Hopefully as bbPress 2.6 main focus has been on performance this will get even better once 2.6 is released.

    I need to take a closer look, and I’m exhausted today, so hopefully over the weekend I’ll get a chance to take a look and make said nerdy pull request 😉

    Based on said closer look I can start to think how we might integrate it into core and go from there

    will the changes affect this rewrite set? i see bbpress replies as comments?

    No, for bbPress 2.7 yes, but not for bbPress 2.6

    @siparker This is awesome, thank you 🙂

    Could you set this up in a GitHub repo please, I’ve got a few change suggestions 🙂

    @celziobiaz I very nearly marked this post of yours as spam, jumping into an old topic near on 2 years of age to promote your plugin is not cool.

    Also, if the old xenForo site is still live and people are posting to it, can I re-run the import tool to have it grab the latest posts or would I want to start over? I know that I’ll probably want to start over since you’ve added new import functionality, but in the future, would it work to just run the import tool from time to time until I’m ready to shut down the old site?

    No

    I’d like to add this functionality down the road, we’ve got it partially, partially in that currently if it finished importing forums and only half way through topics then it would resume from the topics it didn’t finish then continue on to to replies.

    It literally resumes from where it left off, it never goes back to check if there are new forums, or new topics but in the future that would be a great addition.

    Yeah, I’m actually thinking it might be best to require the user (me) to manually move the images directory from the old site to the new site. Then, maybe just use the xenForo URL to the image to display it in the post. It “should” be safe since xenForo reduced the images based on admin settings when they were originally uploaded. Just some random thoughts from a guy not looking at import code. 😉

    I can add a “generic” that would change [ATTACH=full]872[/ATTACH] to generic URLhttps:/example.com/attachment/872, you could then manually change thehttps:/example.com/attachment/part of that to anything you want for examplehttp://surveyorconnect.com/attachments/` and have that folder on your server serve up the attachments from there?

    I’m wondering if https://bbpress.dev4press.com would actually cure some of the bbcode issues automatically.

    We actually use a pretty comprehensive BBCode library already during import it converts a huge amount of common BBCode code to native HTML for us, I think you’d find there are only a handful of custom BBCode’s not covered by this library and is why I add them manually.

    p.s. I haven’t packaged up a new release with the changes just yet, but you can always get the latest version (with the above updates) from:

    https://bbpress.trac.wordpress.org/browser/trunk/src/includes/admin/converters/XenForo.php

    At the bottom of that page is a link to download the file in “original format” and that will get you the file, the link is dynamic and changes each revision so that’s why no direct link.

    Probably the most noticeable issue after the import are the attachments. They are basically a number with opening and closing ATTACH bbcodes.

    I’m not quite sure what to do with attachments as bbPress import system does not yet support attachments ¯\_(ツ)_/¯

    I could add some code to “hide” the BBCode whilst still keeping it as a refernce?

    Also I’ve added support for YouTube, Daily Motion and Vimeo BBCode conversion

    Then there are the quotes to other posts. These simply just come in as text and the post IDs don’t match those in bbpress. In xenForo, the quoted posts link back to the post that was quoted.

    I’ve added some styling to the quotes now, so it wraps that quotes in “blockquote” and cites the authors name, e.g “wendellh wrote:”

    For now we can’t link to the quoted post, this is on my radar to do but requires some pretty big changes, maybe bbPress 2.8.

    I’ve also noticed that soft deleted posts (only viewable by mods and admins) in xenForo are coming in as public posts.

    Ah, I didn’t know about these types of posts, I’ve now done this, for topics/threads replies/posts that were “soft deleted” these are now imported with bbPress/WordPress “pending” status.

    I appreciate bbPress may add an extra 2 seconds to your site, though I’m not sure why.

    That said, if your site was taking 10 seconds before bbPress I would stop visiting your site, honestly, even the best content in the world would not be enough for me to endure a 10 second page load.

    As Pascal’s detailed reply points out above, I would take a look at the cause of your sites poor performance and get that fixed before adding anything new to your site.

    p.s. I wanted you to run that query to see if it failed, if it did fail that would have meant you and I have different database schemas for our Xenforo databases.

    o are the reply authors all correct now or still having issues with them?

    Awesome 🙂

    If you look at the phpBB and SMF importers they have near the end of the file a bunch of regular expressions for converting custom BBCode into native HTML for WordPress.

    Get me a list of what you want copied from the SMF/phpBB importers to Xenforo and I’ll add them.

    If you need more, or tweaks to them happy to help out here also.

    So it worked for you?


    Stephen Edgar
    Moderator

    @netweb

    The queries in this post should do what you need:
    http://www.scriptol.com/wordpress/mass-delete-users.php

    Following up with research complete….New Relic is really awesome for this type of stuff.

    It is, I’m not using New Relic but am using similar services on various sites

    There are some example views here if that helps https://gist.github.com/ntwb/8167699

    We have a plan to switch forums from custom post types to a taxonomy in most like 2.7 which will open up all kinds of views…


    Stephen Edgar
    Moderator

    @netweb

    A quick search reveals this https://core.trac.wordpress.org/ticket/35958

    @aaachiaki Can you look up what your WordPress database character set and collation are being used?


    Stephen Edgar
    Moderator

    @netweb

    I wrote a reply here yesterday, it’s vanished 🙁

    I have an idea what it might be but today has run out of hours, I’ll test this tomorrow and let you know 🙂


    Stephen Edgar
    Moderator

    @netweb

    I’m a bit nervous about changing anything in the live xenForo database…

    There is nothing changed in the XenForo database, the query only “reads” data it does not write anything to the database 🙂

    p.s. It still pays to have a backup 😉


    Stephen Edgar
    Moderator

    @netweb

    I’ve just pushed a new 2.6-alpha that includes a fix for deleting imported users, it wasn’t behaving as it should.

    https://downloads.wordpress.org/plugin/bbpress.zip


    Stephen Edgar
    Moderator

    @netweb

    I’ve just bumped 2.6-alpha with the above changes and also a fix for deleting imported users that wasn’t playing nice 😉

    https://downloads.wordpress.org/plugin/bbpress.zip


    Stephen Edgar
    Moderator

    @netweb

    I’ve just added support to the XenForo importer to support deleted users.

    https://bbpress.trac.wordpress.org/ticket/2922

    If you update your 2.6-alpha via this zip file you’ll have that included for your import.

    What this does is if a user has been deleted from XenForo their topics and replies are not actually deleted (they are kept to maintain context) but during import because that user no longer exists they cannot be imported and the topic/reply would then be attributed to the anonymous user. Now the topic/reply is still attributed to the anonymous user but includes the original author name, basically the same way XenForo handled this.

    Edit: You can see the difference from when the Member Two user still existed and was imported per https://cloudup.com/c_epfx4Q4z8/f, I then deleted Member Two and the result looks like this https://cloudup.com/cNnYv-3eSyl https://cloudup.com/c5iQ-iIOoW4


    Stephen Edgar
    Moderator

    @netweb

    I’ve just got my copy of Xenforo up and running locally, I don’t have an issue with reply authors here, see this screenshot https://cloudup.com/c_epfx4Q4z8

    Can you open up phpMyAdmin and run this SQL query on your Xenfor database:

    
    SELECT 
    convert(post.post_id USING "utf8mb4") AS post_id,
    convert(thread.thread_id USING "utf8mb4") AS thread_id,
    convert(post.thread_id USING "utf8mb4") AS thread_id,
    convert(post.user_id USING "utf8mb4") AS user_id,
    convert(post.message USING "utf8mb4") AS message,
    convert(post.post_date USING "utf8mb4") AS post_date 
    
    FROM xf_post AS post 
    LEFT JOIN xf_thread AS thread 
    USING (thread_id) 
    WHERE thread.first_post_id != post.post_id 
    

    You might have to change the following two lines if your database does not use xf_ as the forum prefix:

    From:

    
    FROM xf_post AS post 
    LEFT JOIN xf_thread AS thread 
    

    To:

    
    FROM myprefix_post AS post 
    LEFT JOIN myprefix_thread AS thread 
    

    Stephen Edgar
    Moderator

    @netweb

    @wendellh Thanks for the info on that error, not sure why that error occured, nothing really changed between 2.5.8 and 2.6 in regard to this table creation. I’ll try to duplicate the issue later today.


    Stephen Edgar
    Moderator

    @netweb

    I changed the default value to “special” in this part below.

    I don’t think this would cause that error, the fact that I’ve no idea what is causing that error “could” be in fact the cause of the error.

    The “Reset Forums” tool includes the ability to delete all bbPress forum content and imported users, run this and that should get rid of your ~30k imported users.

    After that, try changing that “special” back to “Snitz” (I think thats what it was) and se what happens.


    Stephen Edgar
    Moderator

    @netweb

    Yes

Viewing 25 replies - 1 through 25 (of 3,020 total)