News for hackers. Stuff that matters.
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by visarga on Saturday October 28, 2023 @07:22AM (#38048943)
I believe they are using much more synthetic data than others. That's the secret sauce besides their larger training set and model. Synthetic data makes the model more consistent.
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by washadjeffmad on Saturday October 28, 2023 @09:33AM (#38049656)
For all of the novel interest in the tech and service side, I can't understand why so many overlook the value of the datasets. I've been promoting them as potential products to license, similar to textbook publishing, and a bit reminiscent of how Google used its search appliances. Automating methods of creation will be an immensely valuable service.

I've already introduced methods of instruct formatting within our org, because as the architectures change, what we learn from performing the work to organize and account for our internal knowledge will continuously pay off.