Hacker News Reader

What would be representation of some real work scenarios? I think their test suite covers wide spectrum of operations enough so to be able to draw conclusions from them.

https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Proj...

View on HN

Unfortunently, after looking at the .net core implementation of this benchmarks, I wouldn't trust it at all. The code is just overengineerd to perform best at benchmark - everything hardcoded, custom routing to cover 2-3 routes with minimal overhead etc. It has nothing in common with real world code.

The Techempower entries are heavily gaming the system.

They often strip out framework functionality and hyper-optimise for the specific benchmark, including things like pre-allocating the exact amount of memory needed to serve the request, not doing route matching et all, etc.

They are basically an exercise in "how clever can we be to win the benchmark" rather than a realistic portrait of real world performance.

at least for .NET the versions that strip out framework functionality are marked separately, though this part is not that easy to understand if you don't know about it. There are several .NET entries from very low-level without MVC and without ORM up to the full stack.

But still, these benchmarks have their uses but there are a lot of caveats you need to consider when looking at the results.

Reply on news.ycombinator.com