News for hackers. Stuff that matters.

A comment on SEQUOIA: Exact Llama2-70B on an RTX4090 with half-second per-token latency. Parent comment

Re:SEQUOIA: Exact Llama2-70B on an RTX4090 with half-second ... by torginus on Sunday May 05, 2024 @04:47AM (#40263227)
Honestly I'm pretty puzzled by this mystical fog that hangs over OpenAIs skunkworks projects - don't people leave for other jobs/go to conferences etc.?

I'm surprised that nobody call tell what they infact do or do not have.

[ Parent | on HN ]
Re:SEQUOIA: Exact Llama2-70B on an RTX4090 with half-second ... by lightbritefight on Sunday May 05, 2024 @07:12AM (#40263949)
Truth tends to take the wind out of hypes sails.

With hundreds of billions on the line for the founders and a whole lot of likely unvested stock options for the employees, it doesnt seem like anyone wants to open up about whats actually going on day to day.

[ Parent | on HN ]