Battle of the Analytics Engines

Aug 29, 2025·
Georg Heiler
Georg Heiler
,
Albert Wong
· 1 min read

Who’s the Best Analytics Engine? Let’s Find Out.

Benchmarks lie. Vendors cherry-pick. Reality lies somewhere in the middle - so we got it all together and let the numbers duke it out.

We use ELO rankings - the same methodology used in chess - pitting analytics/OLAP engines against one another, track their wins, and see who actually dominates.

How it works

  1. Ingest: We gather public performance benchmarks (TPC-DS, TPC-H, SSB Wide Table, etc. - even the messy ones).
  2. Matchmaking: Each result is a “match.” Sometimes it’s head-to-head, sometimes it’s a 3–4 way combat.
  3. Rating updates: Each match concludes with the ELO system revising ratings based on who beat whom.

This converts loose, apples-to-oranges benchmarks into a uniform, relative strength score across engines.

Why ELO?

  • Relative, not absolute: More forgiving of noisy, heterogeneous benchmarks better than individual best run” charts.
  • Continuously improving: Every new result updates the leaderboard.
  • Robust to cherry-picking: One fluke run won’t beat an enduring record.

👉 Kick the tires: Take a look at the live scores

👉 Contribute: Found a public benchmark or ran your own? Add it and help make the rankings even sharper.

We’re excited to announce the launch of this open ELO ranking database—built for practitioners, by practitioners: data-inconsistencies.datajourney.expert

Georg Heiler
Authors
senior data expert
My research interests include large geo-spatial time and network data analytics.