Hacker News Reader

Comment by WoodenChair | Hacker News Reader

Dart dominated the multiple queries test type.

That is quite surprising. Anyone have an idea why that is?

Actually, not really. We checked the code to ensure that there was no gaming the system and it definitely APPEARS to be making separate database queries as we require in our rules. In fact, we had this same question in round 9 and had a number of people audit it. We cannot explain it other than it might be pretty darn fast.

The benchmark requirements aren't specific about durability requirements of the database. https://www.techempower.com/benchmarks/#section=code

This is where a difference between Redis and other databases will exist depending on configuration.

A better requirement would be to define some minimum level of durability, and some minimal level of freshness in the face of concurrent modifications.

Frankly, who cares if a caching driver avoids some database queries entirely if it still provides the same level of durability and freshness guarantees? If mongo+redis are OK, what's wrong with a plain hashtable?

That's easy to answer, instead of using a relational database or even PostgreSQL's JSON data store, it's using MongoDB. I hate MongoDB but for tests like these where there's absolutely no writes what so ever, Mongo is going to fly. Hence, I read this as comparing MongoDB read performance to PostgreSQL, MySQL or SQL Server perf (or any of the other DB that are listed.)

That's why benchmarks like these have to be scrutinized. I like looking them over but in reality, they're not Apples to Apples.

If each framework use different DB, then all results with DB queries are useless (for me). Very frustrating. Really, any framework with Redis will have HUGE allowance

You can filter by DB, and most of the frameworks (including the Dart ones) are run against multiple DBs.

Thanks, I see it, but it significantly reduces set of results. For example, there is no MySQL+Dart runs.

Reply on news.ycombinator.com