You don’t need all that complex/expensive/distracting infrastructure (2019)

Re:You don’t need all that complex/expensive/distracting inf... by mumblemumble on Thursday March 11, 2021 @09:37AM (#26424416)

What I tend to see missing is clear explanations of, "What problems does this solve?" Usually you see a lot of, "What does it do?" which isn't quite the same thing. The framing is critical because it's a lot easier for people to decide whether or not they have a particular problem. If you frame it as, "Do we need this?" though, well, humans are really bad at distinguishing need from want.

Take Hadoop. I wasted a lot of time and money on distributed computing once, almost entirely because of this mistake. I focused on the cool scale-out features, and of course I want to be able to scale out. Scale out is an incredibly useful thing!

If, on the other hand, I had focused on the problem - "If your storage can sustain a transfer rate of X MB/s, then your theoretical minimum time to chew through Y MB of data is Y/X seconds, and, if Y is big enough, then Y/X becomes unacceptable" - then I could easily have said, "Well my Y/X is 1/10,000 of the acceptable limit and it's only growing at 20% per year, so I guess I don't really need to spend any more time thinking about this right now."

[ Parent | on HN ]

Re:You don’t need all that complex/expensive/distracting inf... by braveyellowtoad on Thursday March 11, 2021 @04:37PM (#26429309)

Yep. All of us tech folks read sites like hackernews and read all about what the latest hot Silicon Valley tech startup is doing. Or what Uber is doing. Or what google is doing. Or what Amazon is doing. And we want to be cool as well so we jump on that new technology. Whereas for the significant majority of applications out there, older less sexy technology on modern fast computers will almost certainly be good enough and probably easier to maintain.

[ Parent | on HN ]

Re:You don’t need all that complex/expensive/distracting inf... by XorNot on Thursday March 11, 2021 @05:09PM (#26429641)

Uber is one of those alleged behemoths I'm incredibly skeptical about the scaling problems of.

The service they provide can't be anywhere near the Facebook/Google league of scale, nor Netflix level of data/performance demand.

[ Parent | on HN ]

Re:You don’t need all that complex/expensive/distracting inf... by mumblemumble on Thursday March 11, 2021 @06:16PM (#26430276)

I've had several experiences where I attended a tech talk by someone from Uber, and never once did I come away with the impression that the problem they were trying to solve was the kind of thing Fred Brooks had in mind when he coined the term "essential complexity."

That said, volume and velocity aren't the only kinds of scale that technical teams have to grapple with. I've spent enough time at a big organization to understand that Conway's Law costs CPU cycles. Lots of them.

[ Parent | on HN ]

Re:You don’t need all that complex/expensive/distracting inf... by barbazoo on Thursday March 11, 2021 @10:08PM (#26431842)

They struggle with the size of their mobile apps so they've got that going for them

[ Parent | on HN ]

Re:You don’t need all that complex/expensive/distracting inf... by 908B64B197 on Thursday March 11, 2021 @08:19PM (#26431199)

> And we want to be cool as well so we jump on that new technology.

I would rather have cool tech on a resume rather than boring tech. Helps if someone decides to jump to a cool company.

[ Parent | on HN ]

Re:You don’t need all that complex/expensive/distracting inf... by edejong on Thursday March 11, 2021 @11:24AM (#26425737)

We don't have data sheets, like professional electronic components have. I guess we value Turing/Church more than predictability.

[ Parent | on HN ]

Re:You don’t need all that complex/expensive/distracting inf... by 6510 on Thursday March 11, 2021 @06:13PM (#26430247)

> What I tend to see missing is clear explanations of, "What problems does this solve?"

This still sounds like one (like a scientist) starts out by looking at something for it being cool, hip and perhaps useful before considering if it solves any of the problems. The proper working-order is to start by having the problem. Hardly any problem requires a state of the art solution.

When one is wiring a house (where I live) the regulation says you should use the same standards for everything on a group on the switchboard. This hilariously means that if you need to extend iron pipes with canvas isolated wires you have to use metal pipes with canvas wrapped wires.(or rip everything out and replace it with something modern)

[ Parent | on HN ]