News for hackers. Stuff that matters.

A comment on Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf]. Parent comment

Re:Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf] by ternaryoperator on Friday August 19, 2022 @05:10PM (#32525926)
This! I am frustrated at how often devs will not accept that simple things become incredibly complicated at scale. That favorite coding technique? That container you wrote? Those tests you added? All good, but until you've tested them at scale, don't assert that everyone should use them. This dynamic is true in the other direction too: that techniques often taken for granted simply are not feasible in highly resource-constrained environments. With rare exception, the best we can say with accuracy is that "I find X works well enough in the typical situations I code for."
[ Parent | on HN ]
Re:Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf] by throwaway012377 on Friday August 19, 2022 @07:10PM (#32527189)
> simple things become incredibly complicated at scale

In a way it's the opposite. Things scale up by removing complex interactions. Software gets faster by solving the same problem with less steps.

Any beginner can write to much code and pile up too many software and hardware components.

It takes knowledge to simplify things.

[ Parent | on HN ]
Re:Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf] by ProZsolt on Sunday August 21, 2022 @08:17AM (#32539417)
It reminds me of a saying: "Any idiot can build a bridge that stands, but it takes an engineer to build a bridge that barely stands."
[ Parent | on HN ]
Re:Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf] by maerF0x0 on Saturday August 20, 2022 @01:08AM (#32529263)
> Any beginner can write to much code and pile up too many software and hardware components.

I'd take it a step further, the beginner has no choice but to write too much code/cruft. By definition they lack the experience required to know the options before them, many of which are simpler.

[ Parent | on HN ]
Re:Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf] by throwaway012377 on Saturday August 20, 2022 @08:20AM (#32531483)
Indeed, but it's also about having the wrong mindset: piling up stuff gives people the idea that they are building something.

Removing complexity and saving CPU cycles does not feel as good to beginners.

[ Parent | on HN ]
Re:Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf] by closeparen on Friday August 19, 2022 @07:33PM (#32527386)
People have career and ego incentives to overestimate the constraints of the environment they're working in, and will use lazy heuristics like rounding some number to "a lot" and assuming that it justifies pulling out all the stops. Computers are fast. One or a few of them can accomplish quite a lot. Some people really do exceed those limits, and godspeed to them, but even in the companies they work at, the vast majority of applications do not.
[ Parent | on HN ]
Re:Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf] by trasz on Saturday August 20, 2022 @05:03AM (#32530558)
This goes both ways - things written “to scale” often, or usually, do worse in more typical, smaller scenarios, because of all the bloat that’s irrelevant to 98% of use cases.

That’s one of the fundamental problems in todays Open Source world: everything’s being optimized for a very rare case.

[ Parent | on HN ]