News for hackers. Stuff that matters.
Re:Eliezer Yudkowsky on large language model economics by radu_floricica on Tuesday March 14, 2023 @11:53AM (#35153529)
The point is that you can split the work in two: the one you mentioned, creating and training the model, and a separate step of shaping it with reinforcement learning. Which is quite expensive, because it uses human operators in one of its steps. But apparently you can duplicate easily enough this with an API of an already educated engine, which makes the second step not be a moat anymore.
Re:Eliezer Yudkowsky on large language model economics by Imnimo on Tuesday March 14, 2023 @12:01PM (#35153675)
How expensive do you imagine collecting human feedback data is compared to the cost of doing the original language modelling training?
Re:Eliezer Yudkowsky on large language model economics by cubefox on Tuesday March 14, 2023 @12:58PM (#35154557)
But that's not a new point?! The second, expensive step (RLHF) was already automated by Anthropic with their Constitutional AI approach several months ago.