News for hackers. Stuff that matters.
Re:Estimating PaLM's Training Cost by the8472 on Sunday April 10, 2022 @01:29PM (#30979401)
The model itself didn't take all those authors a full-time work year to build from scratch. They build other models and release other papers throughout the year. Of course those works build on each other, but that turns it into a much more complicated question how we account for the value and costs of prior work.
Re:Estimating PaLM's Training Cost by axg11 on Sunday April 10, 2022 @02:05PM (#30979831)
To counter that, there were likely other people with smaller contributions not listed as authors. Some of the leadership are likely earning 2-3x my estimate salary.
Re:Estimating PaLM's Training Cost by platers on Sunday April 10, 2022 @03:23PM (#30980725)
Everyone on the paper is likely making at least 300k. And double that again for taxes, healthcare, and perks.
Re:Estimating PaLM's Training Cost by hansvm on Sunday April 10, 2022 @06:35PM (#30982409)
Double is a good rule of thumb for a median liquidatable income, but healthcare, food, gyms, 401k matching, ... are all bounded by reasonable constants, and taxes only add <10% from the employer's side of things. I'd be surprised if the fully loaded cost were more than an extra 50%.