News for hackers. Stuff that matters.

A comment on Nanosecond timestamp collisions are common. Parent comment

Re:Nanosecond timestamp collisions are common by Dylan16807 on Saturday July 22, 2023 @04:08PM (#36829377)
"it allows easy/cheap write combining" is not "completely unnecessary". What the heck, at least be consistent.

And it's not shenanigans! You could shard based on the first bytes of a key, or you could shard based on the last bytes of the key. Neither one should be harder. Neither one is shenanigans.

> It's square peg, round hole.

Going entirely random is an even worse peg.

[ Parent | on HN ]
Re:Nanosecond timestamp collisions are common by wood_spirit on Sunday July 23, 2023 @05:49AM (#36833873)
Wow a long thread of back and forth and confusion :)

Fwiw I’m with Dylan on this one!

I have direct experience of absolutely humongous data processing using random bits for shard selection where each shard uses sorted storage and benefits from the sortability of the time bits so, with just the smallest buffering, all inserts are basically super fast appends.

This is super normal in my experience. And I can’t wait for the new UUID formats to land and get widely supported in libs to simplify discussions with event producers :)

[ Parent | on HN ]