News for hackers. Stuff that matters.
Re:How Bezos built his data machine by femto113 on Tuesday February 18, 2020 @12:06AM (#22353610)
Marvel at the feat of operations, not the engineering. The techniques used to process this information over the years have mostly been quite banal. Look behind the scenes and much of it is just batch processes written in old school languages (Perl, Java, even C) reading text files from one folder, filtering or enhancing them, and writing them out to another. I once taught a PM how to use a Perl hash to do a join instead of nested for loops and she spent the next year feeling godlike because she could do this stuff in O(n) instead of O(n^2).
Re:How Bezos built his data machine by anongraddebt on Tuesday February 18, 2020 @12:32AM (#22353727)
> I once taught a PM how to use a Perl hash to do a join instead of nested for loops and she spent the next year feeling godlike because she could do this stuff in O(n) instead of O(n^2).

Loved this.

Re:How Bezos built his data machine by willberman on Tuesday February 18, 2020 @01:27PM (#22358669)
Correct I think that would be a better way to put it. None of the individual building blocks seem very technically challenging, but to consistently enforce it at a company wide scale seems quite cool.
Re:How Bezos built his data machine by auggierose on Tuesday February 18, 2020 @05:49AM (#22355007)
What’s a PM, prime minister?
Re:How Bezos built his data machine by capableweb on Tuesday February 18, 2020 @06:28AM (#22355157)
Because of the context, I'd assume "Project Manager", basically a low-level manager of sorts.
Re:How Bezos built his data machine by femto113 on Tuesday February 18, 2020 @10:31AM (#22356726)
At Amazon "Program Manager", in this case really was a TPM or "Technical Program Manager". TPMs are effectively serial project managers, often charged with shepherding complex projects that require the efforts of more than one business or development group. Dealing with the data produced by those projects sometimes fell on them since it was difficult enough to persuade the developers to write the primary functionality.