Would be nice to domain/product experts to some tweaking and host this at a third party a la "The benchmark game"[1]. A nice little graph-oriented benchmark would be great, especially avoiding things like:
https://news.ycombinator.com/item?id=16378157
[ed: and:
"For comparison, we used three leading single-model database systems:... and PostgreSQL for relational database."
Jsonb with indexes doesn't rate as "document db", how about postgis for domain specific graph db?]
Some agreement on hw (virtual or otherwise), dataset and queries might make this actually rather useful.
[1] https://benchmarksgame.alioth.debian.org/