News for hackers. Stuff that matters.
Re:How to make LLMs go fast by __loam on Friday December 22, 2023 @12:08PM (#38736189)
The best technology doesn't necessarily win. First to market matters, especially when models on the scale of gpt-4 cost 100mln to train.
Re:How to make LLMs go fast by evilantnie on Friday December 22, 2023 @12:31PM (#38736446)
"best" is subjective, but I do think the industry will eventually converge onto an architecture that is significantly more cost effective than current state of the art. Regardless of who is first to market, everyone is incentivized to continue down this path with their research on improving LLM performance.
Re:How to make LLMs go fast by realusername on Friday December 22, 2023 @01:50PM (#38737208)
While the first mover advantage exists, I don't think it's a sufficient moat in the long term.

OpenAI's moat is the high cost of training as you mentioned but this might be obsolete in a few papers down the road.

They themselves realized this by trying to turn it into a platform but I don't think it's enough.