News for hackers. Stuff that matters.

fuhrysteve

Re:Time to retire the CSV? on Thursday August 19, 2021 @04:30PM (#28238969)
Doesn't require a whole lot of elaboration.

",".join(["a,b","c","d\ne","\"f\",g\""])

yields:

a,b,c,d

e,"f",g"

Try opening that in any csv reader.

Re:Time to retire the CSV? on Wednesday August 18, 2021 @11:25AM (#28222482)
Yeah, this is pretty much it. The author complains about CSVs being "notoriously inconsistent" as though switching to some other format would magically change that. They're only inconsistent because sometimes lazy programmers do ",".join(mylist) instead of using an RFC4180 compliant CSV writer. Lazy programmers will just use non-compliant methods of creating whatever magic format OP is dreaming about. Case in point: trailing commas in JSON objects, and other ridiculous things that people have come up with such as encoding a date in JSON like this: "\/Date(628318530718)\/" https://docs.microsoft.com/en-us/previous-versions/dotnet/ar...

CSVs also are great because you can parse them one row at a time. This makes for a very scale-able and memory-efficient way of processing very large files containing millions of rows.

Let there be no mistake: Everyone reading this today will retire long before CSVs retire. And that's just fine by me.

Re:An Earth-sized rogue planet discovered in the Milky Way on Saturday October 31, 2020 @04:21PM (#24954880)
If it's so uninteresting to you, why participate in the discussion?
Re:What’s so exciting about Postgres? on Friday October 30, 2020 @04:35PM (#24946625)
Great practical note by Josh Berkus on why Uber left Posgresql. Basically: runaway table bloat because Uber had a usecase that postgres doesn't address as well as InnoDB.

https://www.postgresql.org/message-id/5797D5A1.5030009%40agl...

Re:How the pandemic might play out in 2021 and beyond on Friday August 21, 2020 @09:50AM (#24234861)
> I think just a mere existence of flu or cold was a mistake. We should have eradicated those years ago.

It's not clear to me how eradicating these would have ever been possible in the past, or will be in the foreseeable future. The flu has (probably) been around since at least 6000 BC, and numerous strains can be spread by birds & many other species.

Re:Git: Deletion of merged branches taken beyond shell hacks on Wednesday August 12, 2020 @06:36PM (#24137879)
To be fair, python isn't the only language whose package management system is all but incoherent to folks who don't use python every day (and sometimes even to them!). npm is pretty rough to get setup too, and you run into a lot of issues similar to this.

Launch HN: TPA Stream Connect – Connecting Users' Health Insurance to an App

Hey HN!My name is Steve Fuhry, and I'm one of three Co-founders of https://tpastream.com. TPA Stream was founded in 2014 to make health benefits easier for employees and administrators. Users can connect their Health Insurance portals to our backend, and we provide the user's claims data on their behalf to third party applications.We recently launched TPA Stream Connect, which is The Easiest...

( Read More... | no comments | 3 points | on HN )
> What are the tradeoffs vs using docker? Just curious.

Probably some combination of memory usage and complexity, depending on your application. If you're already familiar with using docker as a development environment, definitely go for it.

I don't use pipenv, I'm still using plain old virtualenv for development. Mostly it's just a matter of familiarity. If there's not an itch, why scratch?

Re:Coronavirus: Oxford vaccine triggers immune response on Monday July 20, 2020 @01:25PM (#23899973)
Certainly not, but considering there should be 100M available by the end of the year, it seems like they are scaling up the production line considerably
Re:Pwned Passwords, Version 6 on Friday June 19, 2020 @10:56AM (#23575125)
Good article explaining how they use k-anonymity here:

https://blog.cloudflare.com/validating-leaked-passwords-with...

How much do you trust k-anonymity?

Ask HN: Is a 10Gb Docker image with the haveibeenpwned db on it a bad idea?

We have a site with sensitive data on it, and need to verify that when users create a new password that the password has not been previously exposed in a known breach. The way everyone seems to be doing this is by downloading and searching the 10gb haveibeenpwned database for sha1 matches of the candidate password.We know that it's best practice to keep docker images small, however this seems...

( Read More... | 3 comments | 2 points | on HN )
Re:Google Search Operators: A Complete List (2018) on Thursday January 24, 2019 @01:55PM (#18991719)
Honestly I bet it's a learning algorithm that they used to identify bots, rather than something a human decided.

Spam detection algorithms usually have a training set. One of the features could have been "uses_feature_x", which, according to the training set, is known to have a high probability of being a spam bot (because humans rarely use those features)

I find that it doesn't get too frustrating if you don't let it get out of hand.

Routinely prioritize keeping dependencies up to date, clearly depreciate "old" / bad code, and focus on coming up with good product designs that have reasonable compromises between time-to-market and high quality engineering.

You just can't let stuff slip. Don't let 6 months go by without at least trying to upgrade to the new version of whatever or without making some some progress moving from the "old way" to the "new way" for some component.

Re:Everything old is new again: Microservices on Wednesday May 09, 2018 @08:13AM (#17029191)
Yes, my experience with SOAP is that even well written and maintained clients only work out-of-the-box with like half of the vendor-supplied services you come across.

In many cases, I'll simply formulate xml requests myself and use a generic http request client because the implementation ended up being simpler & easier to maintain than all the confusing hacks I had to do to make zeep or suds (the most popular SOAP clients implemented in python) function properly.

Re:High-Level Problems with Git and How to Fix Them on Tuesday December 12, 2017 @09:04AM (#15905605)
> If you screw up a rebase, the old commits are still there with the same hash they always had.

Disclaimer, if you're compelled for none other than neurotic reasons to run `git gc` periodically like me, these old commits will get thrown out. I found this out the hard way :(

I'd say that's the appeal of Amazon prime - not Walmart. Amazon is much less affected by local market dynamics
I suspect that if they haven't already, they will now
> attributed to increased driving, encouraged by economic factors such as higher employment and lower gas prices

Interesting - I always assumed that the increase in road deaths was at least largely due to increased cellphone usage, resulting in distracted drivers.

Gene manipulation maybe? Won't work very well I suppose for existing humans, but i imagine we could eventually learn to modify genes in embryos to make them more adaptable to different environments
I believe marshmallow v3, which is not yet released, claims to solve the error handling / swallowing exception issue.

I use marshmallow all the time and love it - I agree that error handling is its weakest area, even using strict mode.

Price is not a competitive differentiator. Didn't have to go to business school to learn that one!
While I don't agree that eliminating JQuery is necessarily something to strive for, I do like to see these sorts of projects because they help me learn how to reduce my dependency on jQuery when it makes sense to

For example, there are new native language features in ES6 that make little utility functions like $.inArray obsolete.

Re:Flexbox Cheatsheet on Wednesday March 15, 2017 @04:21PM (#13879418)
Well JavaScript isn't really relevant here, but bootstrap v4 is using flexbox now
Re:A Physicist Who Denies That Dark Matter Exists on Monday February 27, 2017 @08:50AM (#13744095)
> I've always felt this way about dark matter, but as a lay person with no background in physics, it's an opinion I'm hesitant to express.

I have always had the same inclination. It seems like a classic candidate for using Occam's razor. Would love to hear someone who knows more about physics weigh in with a more nuanced viewpoint.

Re:Quick, How Might the Alien Spacecraft Work? on Thursday January 19, 2017 @09:17PM (#13441277)
15 yrs ago we were impressed that an apple computer could turn text into audio. Imagine giving us another 10,000yrs (blink of an eye to a blink of an eye in terms of the scale of the galaxy) before deciding how much we're really capable of there
Re:Quick, How Might the Alien Spacecraft Work? on Thursday January 19, 2017 @09:12PM (#13441245)
Please elaborate? What did we learn in 2016?
Re:Modern Tech inside an Amish Horse-Drawn Buggy on Monday January 16, 2017 @06:27PM (#13413985)
In the area I grew up, inflated rubber tires and bicycles were not allowed, but wooden tires on scooters were fine. Reason being, inflated tires made it too easy to travel far from home, which was generally discouraged.

So many people I grew up with seemed to think that Amish were being hypocritical by paying for taxi drivers to drive them around. That's an over-simplistic view. To an Amish community, taxi fees are a tariff intended to encourage finding a job close to home - or if at all possible - in your backyard. The ideal Amish are taught to strive for and desire is to have a farm and provide for your family with your hands.

Here is a great documentary about an Amish couple that gave the rare opportunity to be filmed and interviewed. It's not about the Amish that I grew up with, however their flavor of Amishness is philosophically equivalent https://www.youtube.com/watch?v=HtNXvE_rLoE

One way to do this is to setup an HRA (Health Reimbursement Arrangement). The most common way to do this is to buy cheap high-deductible insurance plans, then setup a tax-advantaged account with which you can reimburse employees for eligible medical expenses out of (in your case, you could choose to pay out 100% of expenses before they hit the insurance deductible). There are a lot of different ways to do this, but the way to set it up is to contact a third party administrator to do the administration for you (depending on the size of your company it's usually somewhere in the range of $5-$15 / employee / month to manage the administration). I believe there are significant tax advantages to this approach as well, but I'm less familiar with that area.

If you PM me your general location, I can probably give you a few companies to contact in your area who do this sort of arrangement.

Re:Amazon RDS now supports PostgreSQL 9.6.1 on Tuesday November 15, 2016 @10:08AM (#12958583)
Where can I find out more? All I see on their marketing site is "database containers" which I interpreted as little more than a container that happens to run a database, not as something that manages backups, point-in-time restoration, multi-az failover, upgrades, and all the other things that RDS has built in that many folks would otherwise prefer to have an (expensive) postgres specialist setup and manage for you.

Older »