Re:Training open-source LLMs on ChatGPT output is a really b...
by rvnx on Monday April 24, 2023 @04:08AM
(#35684887)
Especially, it's not that it can't give you an opinion, it totally can, but the authors at OpenAI don't want you to hear that specific opinion because of their political biases.
Re:Training open-source LLMs on ChatGPT output is a really b...
by pixl97 on Monday April 24, 2023 @07:29AM
(#35686259)
In converse, the authors at OpenAI don't owe you a service that caters to your own political biases.
Re:Training open-source LLMs on ChatGPT output is a really b...
by ChatGTP on Monday April 24, 2023 @08:19AM
(#35686706)
Lol yet they enjoy a monopoly on the industry so there are no alternative world views as far as LLMs are concerned
Re:Training open-source LLMs on ChatGPT output is a really b...
by pixl97 on Monday April 24, 2023 @09:17AM
(#35687273)
They do?
Google doesn't have their own LLMs? Microsoft isn't running and training their own copies?
Hell, if you have enough money you could run your own. This doesn't sound like a monopoly in any definition that I use (and I cast a very wide net with my use of monopoly).
Re:Training open-source LLMs on ChatGPT output is a really b...
by ChatGTP on Monday April 24, 2023 @11:33AM
(#35688913)
Name one company which has an product as popular as ChatGPT-4?
Re:Training open-source LLMs on ChatGPT output is a really b...
by dragonwriter on Monday April 24, 2023 @11:35AM
(#35688947)
By what measure of popularity?
Re:Training open-source LLMs on ChatGPT output is a really b...
by amanaplanacanal on Monday April 24, 2023 @12:12PM
(#35689490)
I don’t have an opinion on whether chatgpt-4 is a monopoly, but I’m pretty sure popularity has nothing to do with whether something is a monopoly.
Re:Training open-source LLMs on ChatGPT output is a really b...
by laprise on Monday April 24, 2023 @09:09AM
(#35687204)
yes exactly, this "as an ai model I can/can't" you're mentioning is precisely what is learned during the RLHF alignment phase.
Re:Training open-source LLMs on ChatGPT output is a really b...
by laprise on Monday April 24, 2023 @09:14AM
(#35687252)
Btw, this kind of language is already all over the place:
https://twitter.com/d_feldman/status/1649466422018318338
Which is hilarious and sad at the same time.
Re:Training open-source LLMs on ChatGPT output is a really b...
by avereveard on Monday April 24, 2023 @12:17PM
(#35689583)
It is a funny tweet but I cannot replicate the results.
I hate gpt style of "as an ai model I can/can't" answers, any model distilled from that corpus becomes very hard to use for tasking.
Like you may just want the category of a text, but all your equals now become contains. It eats up a lot of token space. It begins as a sentence so categories now are strongly biased toward sentence case and not your original input.
I know at least one model purposefully removing these utterances, but still. Everyone else is chasing the agent feel, and I'm here pulling my hair out because prosumer were this close to be able to access a proper AI for tasking and now it's slipping away.