News for hackers. Stuff that matters.

A comment on Mistral CEO confirms 'leak' of new open source AI model nearing GPT4 performance. Parent comment

Re:Mistral CEO confirms 'leak' of new open source AI model n... by jtonz on Wednesday January 31, 2024 @04:50PM (#39209897)
I think it's fair to say when you hit the hundreds of millions of dollars mark the diminishing returns for making things happen faster have well and truly kicked in.

Perhaps the only benefit would be extra computational power yet I would struggle to understand the benefit of jumping from 500 million to 5 billion with such short timeframes.

[ Parent | on HN ]
Re:Mistral CEO confirms 'leak' of new open source AI model n... by Zuiii on Wednesday January 31, 2024 @10:37PM (#39212501)
The ability to truly not think about training run costs, throw random things on the wall to see what sticks. 10x resources is definitely a competitive advantage in LLM training.
[ Parent | on HN ]