[@_ck_ Participant 16 years, 1 month ago]

Oh come on, the average person who looks at a graph that says product B is slower than product A doesn’t know how to be critical about the testing methods. If they did, every other commercial you see on TV would be useless.

Making a benchmark is a learning process. I am certainly not critical of the effort, I think it’s great someone took the time to do it. All I am saying the concept can be improved and expanded.

Early on I wrote bb-benchmark to analyze how bbPress performs from the server-side. It can be very helpful. But as fancy as the analysis is, in the end something I wrote much later on that gives much simpler data is far more practical for real-world results (browser-timer).

AB could be considered the parallel of bb-benchmark. It has it’s usefulness.

But one day there will be something more real-world like browser-timer.