News for hackers. Stuff that matters.
Re:GPT 4.5 level for 1% of the price by viraptor on Sunday March 16, 2025 @09:01AM (#43378700)
You can't "give up bias". You can choose what you prefer, but an "unbiased" model doesn't exist. If you put in information, you're adding bias.
Re:GPT 4.5 level for 1% of the price by buyucu on Sunday March 16, 2025 @09:11AM (#43378776)
what people mean by an "unbiased" model is a model that just reflects the underlying distribution in the data.
Re:GPT 4.5 level for 1% of the price by viraptor on Sunday March 16, 2025 @11:39AM (#43379864)
So biased by both the choice of the sources and the information contained in the sources.
Re:GPT 4.5 level for 1% of the price by milesrout on Sunday March 16, 2025 @08:20PM (#43383920)
But crucially not biased by RLHF being applied afterwards to stop the models from making basic biological observations, telling jokes about left wing politics, or saying anything nonnegative about European historical impact on the world, and so on.