Re:Ask HN: Why is it taken for granted that LLM models will ...
by throwaway4aday on Tuesday December 05, 2023 @03:24PM
(#38536449)
Cleaning and preparing the dataset is a huge part of training. Like the OP mentioned, OpenAI likely have some high quality automation for doing this and that's what's given them a leg up above all other competitors. You can apply the same automation to clear out low quality AI content the same way you remove low quality human content. It's not about the source, just the quality matters.
[ Parent
| on HN ]
There are no comments on this comment yet.