News for hackers. Stuff that matters.
Re:Ask HN: How many at OpenAI know the recipe for the secret... by m_ke on Tuesday November 21, 2023 @09:10AM (#38363807)
The secret sauce is spending millions on collecting a great human curated dataset and scaling up training as much as possible.
Re:Ask HN: How many at OpenAI know the recipe for the secret... by muzani on Tuesday November 21, 2023 @11:41AM (#38366031)
It's all stone soup. Everyone chucked something into the pot. Now it's an eldrich horror that they attempt to steer with evals and system prompts.
Re:Ask HN: How many at OpenAI know the recipe for the secret... by cenan on Tuesday November 21, 2023 @12:31PM (#38366833)
It's no secret. OpenAI isn't the only player in the field. The whole world has seen the power of Generative Pre-Trained Transformers and many organizations and even governments are going to develop and fine-tune their own custom LLMs. Of course it demands huge amount of training data and computing power but that's no secret.