News for hackers. Stuff that matters.

nycjay

Re:Ask HN: Why it is hard for US to move to metric system? on Thursday January 12, 2023 @12:44PM (#34357526)
Isn't the gram a unit of mass, not weight?

https://en.wikipedia.org/wiki/Gram

Re:Sqlfluff the SQL Linter for Humans on Thursday October 07, 2021 @05:30PM (#28792336)
Thanks, I'll take a closer look there...
Re:Sqlfluff the SQL Linter for Humans on Wednesday October 06, 2021 @10:05AM (#28773343)
Sorry - didn't get a chance to go through the documentation much yet... A problem we are looking to catch early in the development process is for things we don't want folks to do, even if they are technically correct. For example, dropping a column or altering the datatype/nullability in such a way that the table goes into reorg pending. I know we can write our own regex to look for that specific syntax, but I've not yet found a tool with those kinds of rules either build out already, or easy to add/maintain.
Re:Partitioning GitHub’s relational databases to handle scale on Wednesday October 06, 2021 @10:01AM (#28773296)
I see a lot of value of using separate users in both dev/test and production environments. That gives you an "easy" way to physically separate your database/schema into multiple databases with minimal changes to your application other than pointing your connection pools/config to the new database endpoint. We do this often - separating the task of breaking up our monolith databases with two phases - logical then physical.
Re:Partitioning GitHub’s relational databases to handle scale on Tuesday September 28, 2021 @11:41AM (#28684116)
Would it double the number of connections? If you are doing the same volume of total work and not looking to increase concurrency, wouldn't you end up with something closer to two connection pools with ~1/2 the size compared to one connection pool with your old size?
Re:MinIO: A Bare Metal Drop-In for AWS S3 on Thursday August 12, 2021 @09:26AM (#28155997)
If you are writing a ton of small files (we have billions of audit blobs we write) the API put costs can quickly creep up on your. We pay much more for those than on the actual storage costs. If you want to use tags on your objects, they charge you per tag per object per month - again, another huge cost. We missed that when pricing S3 out, and needed to do a project to pull out all of the tags we had, and are currently working on batching up multiple blobs into one larger blobs to hopefully reduce our API costs by an order of magnitude. This is purely a cost decision for us, adding complexity to our application and its operation. S3 seems better suited for fewer larger files. Our backups and other use cases like that work perfectly.
Does that really guarantee in-order processing, or just that messages can be picked up in order. If you have multiple consumers on your queue and consumer A picks up message x from the head of the queue then consumer B picks up message y next, it is possible for y to get processed before x. Maybe consumer A is slow (gc pause?) for some reason, and now we are processing out of order, even though the queuing infrastructure does not see it. If you truly need to guarantee strict processing order (x must complete before you start processing y) I think you may need to build that into your app. Or, I misread, which is very possible.