[@rafio Member 14 years, 3 months ago]

>Oh come on, the average person who looks at a graph that says product B is

>slower than product A doesn’t know how to be critical about the testing

>methods. If they did, every other commercial you see on TV would be >useless.

I can agree with that, but only in part. Person with right knowledge will read bench results correctly. Others? Not neccessary. From my own experience I know that casual bread eaters (lets call them CBE for short and comic relief) take different approach for this. Before forum generates serious traffic on user’s host, it goes like this:

* It works for me.

* Its slower, but I like it.

* Who Cares?

* Its not so bad

I am not making this up, those are real testimonies i received when working on web apps.

[@rafio Member 14 years, 3 months ago]

Can you quote me where on bb-bench it claims those tests aim to reproduce production enviroment?

Thats only comparision between systems. Everywhere I see people taking this as real-live scenario, but it doesnt. Its just to show people differences between softwares with same forum size (topics, posts and forums).

[@rafio Member 14 years, 3 months ago]

Hey Everyone!

I am tracking opinions on bb-bench.com on internet from my curiosity (I am NOT associated with that initiative in any way).

I find this thread interesting in negative way. Hovewer responses on those results are not suprise to me. Every dev unsatissfied with results attacks test itself ignoring bad solutions (or lack of countersolutions) in his code.

You say “test is bad because we dont implement cache while others do”. That indeed has its effect on BBPress results hovewer as end-user I am interested in performace. Caching algorithms are necessary if you aim your software for bigger communities.

Ofcourse you can say “hey, if load is too big, you can always switch to more powerful hosting plan”. Thats true, however whats heaper for user? Change hosting solution or community software for faster one?

What I am especially disgusted with is how you claimed other solutions use full-page cache, while none of them does. Lying about other software to make your one appear “more fair” is really cheap shot.

If your code lacks features like caching, you implement those, dont argue over how cache is bad and gives others unfair advantage in tests. How hard it is to implement basic cache mechanism to code? Implementing it will make software better.