News for hackers. Stuff that matters.

MLoffshore

Author here, appreciate you running it and posting the hashes.

Re: whether this is useful beyond being a cool exercise:

sklearn: Yeah, sklearn is obviously faster and great for day to day work. The reason this project doesn’t use it is because even with fixed seeds, sklearn can still produce different results across machines due to BLAS differences, CPU instruction paths, etc. Here the goal isn’t speed, it’s to make sure the same dataset always produces the exact same artifacts everywhere, down to the byte.

Where that matters: A few examples from my world:

Maritime/industrial auditing: a lot of equipment logs and commissioning data get “massaged” early on. If later analysis depends on that data, you need a way to prove the ingest + transformations weren’t affected by the environment they ran on.

Medical/regulatory work: clinical models frequently get blocked because the same run on two different machines gives slightly different outputs. Determinism makes it possible to freeze analytics for compliance.

Any situation where you have to defend an analytical result (forensics, safety investigations, audits, etc). People assume code is reproducible, but floating-point libraries, OS updates, and dependency drift break that all the time.

So yeah sklearn is better if you just want clustering. This is more like a “reference implementation” you can point to when you need evidence that the result wasn’t influenced by hardware or environment.

Happy to answer questions if anyone’s curious.

Direct link to the 3-machine deterministic ingest demo video: https://github.com/bryanziehl/prima-veritas/releases/downloa...

Ran on: • Laptop A (Node 22) • Laptop B (Node 18) • Mobile SSH terminal → Docker

All producing bit-for-bit identical outputs.

Feedback or reproducibility tests welcome.

Show HN: Prima Veritas – Deterministic Analytics Engine for Reproducible ML

https://github.com/bryanziehl/prima-veritas

Hi HN — I built a bit-for-bit deterministic analytics engine.It runs classical ML pipelines (normalization → canonical transform → deterministic K-Means) with zero nondeterminism:• no floating-point divergence • no randomness • no environment drift • no timestamp or locale sensitivity • Docker-pinned numeric behavior • reproducible across machines, OSes, and hardwareThe OSS drop includes:•...

( Read More... | 4 comments | on HN )