News for hackers. Stuff that matters.

A comment on Bullshit Graph Database Performance Benchmarks.

Re:Bullshit Graph Database Performance Benchmarks by szarnyasg on Friday January 13, 2023 @03:13AM (#34365173)
A plug: if you are looking for TPC-style application-level benchmarks for database systems, check out the LDBC Social Network Benchmark [1]. It has workloads for both OLTP and OLAP systems. We designed both of these to prevent many of the common benchmarking mistakes. To ensure that implementations follow the specification and their results are reproducible, we have a rigorous auditing process (similarly to TPC's benchmarks) [2].

[1] https://ldbcouncil.org/docs/presentations/ldbc-snb-2021-12.p...

[2] https://ldbcouncil.org/benchmarks/snb/

[ Parent | on HN ]
Re:Bullshit Graph Database Performance Benchmarks by mapleeman on Friday January 13, 2023 @03:31AM (#34365274)
This is indeed a good industry leading benchmark.
[ Parent | on HN ]
Re:Bullshit Graph Database Performance Benchmarks by mbuda on Friday January 13, 2023 @06:48AM (#34366545)
LDBC is really great, it is and it should be the standard non-biased benchmark to look at. The point with https://memgraph.com/benchgraph is to be more tilted towards some specific workloads, easy to extend and run, etc. Time will tell to which extend that could be achieved, but definitely a place to look for some interesting workloads and results. + the whole thing is super early and it's going to evolve!

Again, definitely take a look at LDBC benchmarks they are in general the most relevant.

[ Parent | on HN ]