http://bbpress.org/forums/ bbPress Support Forums Tag: caching en Fri, 09 Jan 2009 01:07:03 +0000 http://bbpress.org/forums/topic/caching-in-bbpress#post-9777 Thu, 02 Aug 2007 06:20:07 +0000 _ck_ 9777@http://bbpress.org/forums/ <p>I solved all spam on my blogs quite easily - any post with more than one url never gets approved, never displayed. I've yet to see spammers not be greedy and only post one url. </p> <p>I had forgotten about the OpenID standard! We need to try to suggest that to the right people making WP/BB. That would be one of the most useful features ever (wordpress.com has nearly a quarter million registered members!)</p> <p>update: WAIT! It's been done?!?!?<br /> <a href="http://wordpress.com/blog/2007/03/06/openid/" rel="nofollow">http://wordpress.com/blog/2007/03/06/openid/</a><br /> How do we get openid support into bbpress then?!</p> <p>added: here's a wordpress plugin to allow openid, now we need to port it to bbpress...<br /> <a href="http://verselogic.net/projects/wordpress/wordpress-openid-plugin/" rel="nofollow">http://verselogic.net/projects/wordpress/wordpress-openid-plugin/</a></p> <p>I'll start a new topic on this... </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9775 Thu, 02 Aug 2007 06:15:35 +0000 HowToGeek 9775@http://bbpress.org/forums/ <p>We are in perfect sync on that one... having xml-rpc pingbacks in a forum is the most worthless feature idea to ever be thought of. I've completely disabled them on wordpress because I don't think they provide any true value to the reader, and most of them are spam anyway. I've written my own simple spam plugin to run in conjunction with Akismet because I was unsatisfied with what I was getting.</p> <p>Your idea of the wordpress logins would work if they implemented OpenID in bbPress and had wordpress.com as an openid server. Would actually be a killer feature, I'd think.</p> <p>I've hacked up my wp-cache2 to allow for more dynamic code to be called on each post. Most of my content is really very static, so I don't need it to be updated often.</p> <p>I've never had any issues with it caching the wrong versions though. </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9773 Thu, 02 Aug 2007 05:46:09 +0000 _ck_ 9773@http://bbpress.org/forums/ <p>Oh I didn't realize xcache is just an opcode cache. I already use eaccelerator which seems to have zero quirks compared to other solutions. But yeah, any opcode cache for wordpress/bbpress is a must for any active site.</p> <p>I already create the sidebar statically across my sites, saves a lot of work and repetition on the db. </p> <p>the wp-cache "plugin" has flaws in it's logic. I noticed that unregistered visitors were getting edit links on posts, not good, even if they couldn't actually edit. Then it has an exclude feature to keep certain parts dynamic, but you can't have wordpress calls in those dynamic parts because wordpress isn't actually loaded, which is the whole point. so it won't work and gives error (<a href="http://trac.bbpress.org/ticket/1">#1</a> confusion to most people trying to use it)</p> <p>In the end, I hacked wp-cache to only cache the RSS feeds which were causing the most requests, yet the most static of all the content. Caching rss feeds on bbpress should be an easy, useful thing too, but then on a forum I highly doubt the use of rss feeds on anything but the latest discussions.</p> <p>What really worries me about the 0.84 release is the xml-rpc pingbacks. bbpress is going to become known as the spammers forum of choice with a bad rep, until novices are given an easy option to turn it off, or better yet it's off by default. I cannot disagree more highly with the entire feature idea. It defeats the entire purpose of a forum. What they are trying to do is have a universal way to cross post across forums but the whole point of a forum is *community* and getting people to actually visit, not stay away. </p> <p>What they really should do instead of pingbacks if they want easy cross communication, is have a universal login based on a database at wordpress.com - Basically anyone with a wordpress account could visit your wordpress or bbpress site and instantly post if they wanted as "wp.membername" without having to register again and again. Sure there are security issues to be tackled but it's better than anonymous spam heaven on pingbacks. Akismet won't protect pingbacks, I see spam in my wordpress.com account every week. </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9772 Thu, 02 Aug 2007 05:28:30 +0000 HowToGeek 9772@http://bbpress.org/forums/ <p>I'm using xcache with very good luck for wordpress, wordpress mu and bbpress on the same server. Also using mysql caching with very good success.</p> <p>On a forum, the cache probably shouldn't be the entire page, but rather sections of it or at least the more expensive queries. A visitor who isn't logged in should probably see an almost completely cached version of the page.</p> <p>wp-cache2 for wordpress seems to handle this pretty well, and the built-in caching in wordpress mu also seems to work quite well. </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9771 Thu, 02 Aug 2007 05:25:04 +0000 sambauers 9771@http://bbpress.org/forums/ <p>&gt; I have to eventually code it to store the country data in the usermeta. But there's the issue that their IP/location can change on a per-post basis</p> <p>An upcoming feature is post tagging, you'll be able to store this data in an "invisible" post tag I believe. </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9770 Thu, 02 Aug 2007 05:18:43 +0000 sambauers 9770@http://bbpress.org/forums/ <p>From what I remember the inbuilt cache in bbPress (when turned on) is just an optimised list of topics, posts, forums etc. Not entire pages of html.</p> <p>MySQL caching is definitely a good idea. I've had trouble with eAccelerator in the past though - it used to munge multi-dimensional session data (can't say if that's still the case, or if it is a problem for bbPress). </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9768 Thu, 02 Aug 2007 03:59:01 +0000 _ck_ 9768@http://bbpress.org/forums/ <p>How do you handle caching a page with items only a moderator should see, and then pages that are okay for subscribers, and then pages that are for open public? The cache will have to be rather smart. And then you can't show any personal information on the page like the user's name if it's going to be cached.</p> <p>bbpress still has some non-optimised routines that don't use the soft cache, for example on the topic page, I've noticed it does a query at the end to fetch all the forums names for the moderator "move this topic" tool. Those should definitely be in the cache but it's not used.</p> <p>For a logged out user, I have my topic pages down to <strong>15</strong> queries. That's the most "expensive page". It uses 3 more queries for a logged in user (one of them listed above).</p> <p>But I've got this geoip flag function that I wrote to show country flags and unfortunately it's very "expensive" and adds an extra query for every unique poster on the topic page. There's no way to stack requests since it must search by range (researched it like crazy but no solutions). I have to eventually code it to store the country data in the usermeta. But there's the issue that their IP/location can change on a per-post basis and that sometimes I have to patch the geo information because the db gets it wrong. Oh well. </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9767 Thu, 02 Aug 2007 03:56:55 +0000 HowToGeek 9767@http://bbpress.org/forums/ <p>I've been posting my optimizations into each of the official forum threads for the plugins... I'm not sure if any of yours were affected or not... can't remember at this point. </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9762 Thu, 02 Aug 2007 02:46:02 +0000 sambauers 9762@http://bbpress.org/forums/ <p>@HowToGeek</p> <p>Would you mind sharing the work you did to optimise the plugins, I'd be interested if any of them are ones I take care of? </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9742 Wed, 01 Aug 2007 21:46:21 +0000 fel64 9742@http://bbpress.org/forums/ <p>There is soft user/topic caching, but there's no hard caching yet. If you look at the code, in cache.php, you'll see that it's written to enable file-based caching in bb-cache/, but doesn't seem to do so at the moment. It probably will in future I guess? If you fiddle you could probably turn it on. mdawaffe is now working on xml-rpc when he's working on bb at all, so it's not the next feature at least. I also think he was planning something else for .8.4. </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9731 Wed, 01 Aug 2007 17:42:49 +0000 HowToGeek 9731@http://bbpress.org/forums/ <p>I'm using xcache and mysql query caching with quite a bit of memory assigned to each, I just don't like going to the database unless there's an actual need for it.</p> <p>Few queries? That doesn't seem right. If you are logged in, the amount of queries is ridiculous, especially if you are using plugins.</p> <p>I've hacked most of the plugins to make them more efficient, but a topic with 5 posts is doing 20 queries or so.</p> <p>Right now, it's not a big deal since my forum isn't even doing 1k pageviews/day, but I'm planning ahead for growth, and would like to have some type of caching somewhere. </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9729 Wed, 01 Aug 2007 17:30:27 +0000 _ck_ 9729@http://bbpress.org/forums/ <p>bbpress uses so few queries that caching has got to be a low priority, especially when the point of a forum is to have very dynamic updates customised for the logged in member - it's very different than a wordpress environment</p> <p>as long as you have the mysql cache turned on, it should be very responsive - just look at the main wordpress support forum - eaccelerator would take care of caching the php opcode and that can't be too far behind a static page</p> <p>the bonus is that on an active forum, everything will be very dynamic as it happens... </p> http://bbpress.org/forums/topic/caching-in-bbpress#post-9728 Wed, 01 Aug 2007 17:01:09 +0000 HowToGeek 9728@http://bbpress.org/forums/ <p>Looking in the code, I see a lot of references to object caching, but I don't think it's actually used anywhere.</p> <p>Does anybody know the state of the caching system, or what the problems were that required disabling it? Will it ever be enabled again?</p> <p>And yes, I already posted to the mailing list quite a while ago and got nothing. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9676 Tue, 31 Jul 2007 18:09:56 +0000 riddle 9676@http://bbpress.org/forums/ <p>Thanks for all your help, CK! I'll look into eaccelerator -- although I think I'll finish building the site first. :-) </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9671 Tue, 31 Jul 2007 16:31:20 +0000 _ck_ 9671@http://bbpress.org/forums/ <p><em>I'm now getting a median response time of about 0.125 seconds for 8 queries on the top page and 0.205 seconds for 12 queries on a topic page.</em></p> <p>That's like night and day compared to what you had before. It was taking almost a full second in some cases, look at the bottom source of the static.html !!! </p> <p>Now can you believe most shared hosting environments have mysql cache turned off by default!!! Even your VPS neighbours may have it turned off which is causing high disk load that's affecting you. This is where all those who claim how VPS is superiour are wrong. Disk access is the achilles heel of VPS (and shared hosting).</p> <p>Next performance improvement you can do is install eaccelerator. Though it's nowhere near as easy as editing mysql and restarting services.</p> <p>Do you know how much guaranteed ram you have on your vps? Because the mysql and eacellerator cache will eat into that. If you have less that 128mb it will limit the sheer number of simultaneous connections you can have. Though for your needs I don't think it's a big deal unless all the search engines start scanning you at once.</p> <p>ps. don't worry any more about mysql tuning and phpmyadmin status reports, it's really all you can do for now - the rest is a limit of how wordpress/bbpress works and can't be avoided</p> <p>pps. most of your pages are now coming up in 1.5 seconds for me when they were taking up to 6 seconds before - there are still some weird delays sometimes though which must be OS loads </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9670 Tue, 31 Jul 2007 16:14:20 +0000 riddle 9670@http://bbpress.org/forums/ <p>P.S. I wrote a quick and dirty perl script to do a bunch of page retrievals, grep for bbPress's self-reporting string in the footer, and report median times. Let me know if anybody wants it. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9668 Tue, 31 Jul 2007 14:52:20 +0000 riddle 9668@http://bbpress.org/forums/ <p>Restart mystery solved: WestHost changed something so mysqld required an IP bind address in my.cnf. Once I formally reported the problem to WestHost support, they had it fixed in minutes and were even kind enough to apologize. (I sure wish that init.d gave some diagnostics!)</p> <p>That done, I turned on query caching:</p> <p>query_cache_type=1<br /> query_cache_limit=1M<br /> query_cache_size=32M</p> <p>The result is significant improvement but there may be more I can do. I'm now getting a median response time of about 0.125 seconds for 8 queries on the top page and 0.205 seconds for 12 queries on a topic page. </p> <p>In phpMyAdmin the indicators are greatly improved but I still have a couple in the red zone:</p> <p>Handler_read_rnd_next 15<br /> ("The number of requests to read the next row in the data file. This is high if you are doing a lot of table scans. Generally this suggests that your tables are not properly indexed or that your queries are not written to take advantage of the indexes you have.")</p> <p>Key_reads 6<br /> ("The number of physical reads of a key block from disk. If Key_reads is big, then your key_buffer_size value is probably too small. The cache miss rate can be calculated as Key_reads/Key_read_requests." My key buffer size is 16M.)</p> <p>Opened_tables 2<br /> ("The number of tables that have been opened. If opened tables is big, your table cache value is probably too small." My table cache is 64.)</p> <p>I'm inclined to say this is good enough for now, but I'm always open for further suggestions. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9644 Tue, 31 Jul 2007 06:24:46 +0000 _ck_ 9644@http://bbpress.org/forums/ <p>Looks like they are really trying to hide "load" from you.<br /> I know of only two ways to grab it from php (there might be more?)<br /> <pre><code>echo &quot;method 1: &quot;.file_get_contents(&#39;/proc/loadavg&#39;); echo &quot;method 2: &quot;.shell_exec(&quot;uptime&quot;);</code></pre> <p>Really though, should not be this hard.<br /> It's possible to get better getting hosting for $150/year. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9643 Tue, 31 Jul 2007 06:19:08 +0000 _ck_ 9643@http://bbpress.org/forums/ <p>I should point out that even your static.html serves up fairly slowly, though a little faster than the dynamic pages. Getting mysql caching may not be as big a boost as it hopefully should be. I can't even see what your guaranteed VPS ram is.</p> <p>If you are on a VPS there is usually a seperate VPS control panel that will also let you restart services, including mysql.</p> <p>my setup lets me do a "service mysql restart" but that's probably not universal. This is what I have in my.cnf<br /> <pre><code>[mysqld] # myisam-recover = BACKUP # delay-key-write = ALL max_connections = 400 key_buffer = 16M myisam_sort_buffer_size = 32M join_buffer_size = 1M read_buffer_size = 1M sort_buffer_size = 2M table_cache = 1024 thread_cache_size = 286 interactive_timeout = 25 wait_timeout = 1000 connect_timeout = 10 max_allowed_packet = 16M max_connect_errors = 10 query_cache_limit = 1M query_cache_size = 16M query_cache_type = 1 tmp_table_size = 16M skip-innodb old-passwords = 1 basedir = /var/lib/mysql datadir = /var/lib/mysql long_query_time = 1 log-slow-queries = /var/log/mysql/mysql-slow.log log-error = /var/log/mysql/mysqld.err [mysqld_safe] open_files_limit = 8192 [mysqldump] quick max_allowed_packet = 16M [myisamchk] key_buffer = 32M sort_buffer = 32M read_buffer = 16M write_buffer = 16M</code></pre> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9621 Mon, 30 Jul 2007 22:20:50 +0000 riddle 9621@http://bbpress.org/forums/ <p>Chris, thanks for the tips. Yes, WestHost is a little peculiar in what it chooses to make available to shell customers -- there's no tcsh, either.</p> <p>"/etc/rc.d/init.d/mysqld restart" was what killed my MySQL and "/etc/rc.d/init.d/mysqld start" is a no-op. Sigh. I've got a query in to WestHost support.</p> <p>And thanks for the warning about the diagnostics. Makes sense. I'll disable them for now. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9619 Mon, 30 Jul 2007 21:24:27 +0000 chrishajer 9619@http://bbpress.org/forums/ <p>And those files you posted aren't a security threat per se, but they do give a lot of info about the server. I would take them down so you don't forget about them. If someone were looking to exploit your server, they could start by finding out what options your php and perl were compiled with, and attack from there. Just take them down so you don't forget about them. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9618 Mon, 30 Jul 2007 21:22:49 +0000 chrishajer 9618@http://bbpress.org/forums/ <p>How about apache bench?<br /> <a href="http://httpd.apache.org/docs/1.3/programs/ab.html" rel="nofollow">http://httpd.apache.org/docs/1.3/programs/ab.html</a> </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9616 Mon, 30 Jul 2007 21:00:17 +0000 chrishajer 9616@http://bbpress.org/forums/ <p>If you have shell access, I imagine you would have access to <code>top</code> ? My guess is the load on the server is pretty crazy, with lots of sites hosted there.</p> <p>edit: just read where you don't have <code>top</code> in your path. Hmm. But you have access to my.cnf? That's odd. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9615 Mon, 30 Jul 2007 20:56:18 +0000 chrishajer 9615@http://bbpress.org/forums/ <p>/etc/rc.d/init.d/mysqld restart or /etc/init.d/mysqld restart ? </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9607 Mon, 30 Jul 2007 19:27:59 +0000 riddle 9607@http://bbpress.org/forums/ <p>Well, drat, while trying to get mysqld to reread my.cnf, I managed to kill it. So any of you kind souls reading this, please try back in a while (or tell me how to restart mysqld!). </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9606 Mon, 30 Jul 2007 18:45:52 +0000 riddle 9606@http://bbpress.org/forums/ <p>I do have access to my.cnf so I'm now off educating myself about the basics of mySQL configuration so I can enable caching without screwing something up.</p> <p>Meanwhile, though, I have some more data points. In phpMyAdmin &gt; Runtime Information the following variables are highlighted in red, meaning they are outside desirable range. </p> <p>Slow_queries 5</p> <p>Handler_read_rnd 39k</p> <p>Handler_read_rnd_next 437k</p> <p>Slow_launch_threads 1</p> <p>Created_tmp_disk_tables 56</p> <p>Opened_tables 84</p> <p>The last is supposed to be a strong indication that my table cache value is too small (no surprise since it's zero!). phpMyAdmin provides useful tips in interpreting these values, but as a mySQL newbie I'm still having trouble deciding how to act on them. Suggestions welcome.</p> <p>As always, thanks! </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9604 Mon, 30 Jul 2007 17:36:30 +0000 _ck_ 9604@http://bbpress.org/forums/ <p>Well its a P4 (single core) @ 3ghz with 4gb of ram.<br /> The question is how many clients is it hosting, and since you have your own ip, there's no real way to determine that.</p> <p>It's taking almost a full second for 9 queries. Something is very, very, very wrong. You might want to enquire. If you do have access to /etc/my.cnf, you can turn on the mysql query cache and that should cause a radical improvement.</p> <p>Not related to the mysql speed but just in general, any external javascript that you don't need to execute immediately on a page, you should add the word DEFER to it. There are two flickr scripts you should try adding it to, if it still works with it in both IE and Firefox, it will make your pages seem a little faster.<br /> ie.<br /> <code>&lt;script DEFER type=&quot;text/javascript&quot; ...blah...blah</code></p> <p>Last but not least if they can't fix it, you can do better for your almost $150 a year. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9602 Mon, 30 Jul 2007 16:59:51 +0000 Ziyphr 9602@http://bbpress.org/forums/ <p>It felt slow to me.. there shouldn't be that 2-3 second pause on each page.</p> <p>If it has been over 48 hours I'd find another host. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9599 Mon, 30 Jul 2007 16:23:28 +0000 riddle 9599@http://bbpress.org/forums/ <p>Thanks, CK. I'm a trusting soul, so here you go (on the same server and database):</p> <p><a href="http://riddle.whsites.net/bbpress/phpinfo.php" rel="nofollow">http://riddle.whsites.net/bbpress/phpinfo.php</a><br /> <a href="http://riddle.whsites.net/bbpress/static.html" rel="nofollow">http://riddle.whsites.net/bbpress/static.html</a><br /> <a href="http://riddle.whsites.net/cgi-bin/perlinfo.cgi" rel="nofollow">http://riddle.whsites.net/cgi-bin/perlinfo.cgi</a></p> <p>If I've just opened a big security hole, I hope someone will tell me!</p> <p>I'm paying about $12 a month so this shouldn't be absolute bottom-of-the-barrel service.</p> <p>As for the shell: yes, I'm an old Unix guy, I built the site in SSH and vi. There's no top, w or uptime in my path. If there's a Red Hat-specific bin directory where I should look, I'll do so. </p> http://bbpress.org/forums/topic/how-to-evaluate-server-speed#post-9598 Mon, 30 Jul 2007 15:44:18 +0000 _ck_ 9598@http://bbpress.org/forums/ <p>Page transfer time alone was not-so-hot.<br /> Front page, non-cached, no-images, no external js/css was 2.84 seconds. Loading a fresh topic took over 6 seconds in my browser.</p> <p>No gzip web compression enabled.<br /> PHP5 (~10%+ slower than PHP4)<br /> There's definitely no mysql cache - way, way too slow.</p> <p>Can you put make yourself a phpinfo.php page and put <code>&lt;? phpinfo(); ?&gt;</code> in there for us to check for other stuff? I don't think it's a security issue but others will have to agree or not.</p> <p>Another neat way to look at unknown servers is with this <a href="http://ckon.wordpress.com/files/2007/07/perlinfo.txt">perlinfo cgi</a> I found and hacked at a bit a few years ago. Rename that to perlinfo.cgi upload to your cgi-bin and chmod it to 755. Then we can maybe see a bit more. If you don't know how to do all this, then nevermind.</p> <p>I need at least one static page to compare it all to.</p> <p>If you don't mind saying, how much are you paying for this hosting? According to westhost's page ALL clients are on their own VPS, even @ $4/mo which is kinda strange. If true, that means you can customize mysql yourself and install eaccelerator.</p> <p><em>top w and uptime</em> are all done from a "shell" via SSH. You need to email them and ask them how you access your shell. If you are indeed on a VPS you should have access to one. Many shared hosting hosts block shell access because of security issues. </p>