News for hackers. Stuff that matters.
Re:We Don’t Use Docker by arnaudsm on Tuesday March 16, 2021 @08:18AM (#26475710)
Had a similar problem recently. Ended up creating a custom system using a file-based index (append to files named by the first 5 char of the SHA1 of the key) Took 10 hours to parse my Terabyte. Uploaded it to Azure Blob storage, now I can query my 10B rows in 50ms for ~10^-7$. It's hard to evolve, but 10x faster and cheaper than other solutions.
Re:We Don’t Use Docker by ramraj07 on Tuesday March 16, 2021 @08:53AM (#26476057)
My original plan was to do a similar S3 idea, but I forgot about it’s charge per 1000 gets and puts and had a 700 dollar bill I had to bargain with them to waive! Does azures model not have that expense?
Re:We Don’t Use Docker by arnaudsm on Tuesday March 16, 2021 @05:34PM (#26483350)
I recall Azure was much cheaper and 30ms faster on average.