Listen to your to PostgreSQL database in realtime via WebSockets

Re:Listen to your to PostgreSQL database in realtime via Web... by derefr on Friday April 30, 2021 @02:34PM (#26997462)

I wish I could do this, but I already have more than four billion As, so my A IDs need 64 bits. I use composite keys for my Bs (A ID + sequence number per A), which allows me to search on the pkey index using just the A column; but by the time I get to C, that gets unwieldy. So my Cs have UUIDs, my Bs also have UUIDs (secondary unique ID, not the pkey) and my Cs have a foreign key pointing to their B. While also having an indexed A ID field.

I'd love to just just have "A-B-C" as my Cs' IDs... but it'd only work for my use-case (i.e. be performant) if it was running on a computer with 256-bit registers.

[ Parent | on HN ]

Re:Listen to your to PostgreSQL database in realtime via Web... by skyde on Friday April 30, 2021 @02:49PM (#26997638)

Curious why your primary key are GUID? Also if the primary key of table C is made of 3 column (A GUID, B GUID, C GUID) the index in PostgreSQL will not be that big with compression enabled because all the common prefix will not be stored redundantly.

Also having a single compound index on table C covering column (A ForeingKey, B ForeingKey, C GUID) is much better than having multiple index on table C.

[ Parent | on HN ]

Re:Listen to your to PostgreSQL database in realtime via Web... by tehlike on Friday April 30, 2021 @08:40PM (#27001629)

Having the primary key generatable at application level has performance benefits especially on inserts. You can write all related entities in one go vs waiting for db to generate the the pk, and passing that to dependent entities.

[ Parent | on HN ]

Re:Listen to your to PostgreSQL database in realtime via Web... by skyde on Thursday May 06, 2021 @01:04AM (#27059339)

Also the problem with clustered indexes in a GUID field are that the GUIDs are random, so when a new record is inserted, a significant portion of the data on disk has to be moved to insert the records into the middle of the table.

[ Parent | on HN ]

Re:Listen to your to PostgreSQL database in realtime via Web... by skyde on Thursday May 06, 2021 @12:41AM (#27059224)

you can have "id" Generatable at application level without using GUID. This is what twitter is doing "snowflake".

It generate tens of thousands of ids per second. Those id fit in 64 bits. And those id are sortable, meaning that if tweets A and B are posted around the same time, they should have ids in close proximity to one another.

See: https://blog.twitter.com/engineering/en_us/a/2010/announcing...

[ Parent | on HN ]

Re:Listen to your to PostgreSQL database in realtime via Web... by Ombudsman on Friday April 30, 2021 @04:47PM (#26999092)

GUIDs are extremely useful if you want to move and merge data around without having to worry about primary key collisions.

[ Parent | on HN ]