News for hackers. Stuff that matters.
Re:Training open-source LLMs on ChatGPT output is a really b... by laprise on Monday April 24, 2023 @09:09AM (#35687204)
yes exactly, this "as an ai model I can/can't" you're mentioning is precisely what is learned during the RLHF alignment phase.
Re:Training open-source LLMs on ChatGPT output is a really b... by laprise on Monday April 24, 2023 @09:14AM (#35687252)
Btw, this kind of language is already all over the place: https://twitter.com/d_feldman/status/1649466422018318338 Which is hilarious and sad at the same time.
Re:Training open-source LLMs on ChatGPT output is a really b... by avereveard on Monday April 24, 2023 @12:17PM (#35689583)
It is a funny tweet but I cannot replicate the results.