News for hackers. Stuff that matters.
Re:Imaginary Problems Are the Root of Bad Software by TuringNYC on Sunday June 18, 2023 @02:21PM (#36382840)
I was interviewing with a company that had barely any customers and they were asking scaling questions with Spark, etc. The salaries they paid could barely hire a team capable of dealing with the complexities of Spark, so they asked, "what would you do."

I told them I'd buy another stick of RAM and scale vertically until I had more customers, and save money on staff in the meantime. The interviewer went cold, I didnt get the job.

Re:Imaginary Problems Are the Root of Bad Software by baq on Sunday June 18, 2023 @02:38PM (#36382995)
Sounds like a dodged bullet.
Re:Imaginary Problems Are the Root of Bad Software by icedchai on Sunday June 18, 2023 @07:12PM (#36385502)
About 10 years ago, I worked on a project where I had to develop some sort of elaborate chain of map/reduce jobs because "big data" and "Hadoop." We were processing about 10 megabytes for each run. Most of the processing was consumed in job scheduling / overhead.