News for hackers. Stuff that matters.
Re:Tracking the Fake GitHub Star Black Market by lanternfish on Saturday March 18, 2023 @08:55AM (#35208702)
The black box nature of the model means this isn't something you can really 'patch out'. It's a byproduct of the way the system processes data - they'll get less frequent with targeted fine tuning and improved model power, but there's no easy solve.
Re:Tracking the Fake GitHub Star Black Market by permo-w on Saturday March 18, 2023 @02:39PM (#35211863)
this is clearly untrue. it’s an input, a black box, then an output. openai have 100% control over the output. they may not be able to directly control what comes out of the black box, but a) they can tune the model, and they undoubtedly will, and b) they can control what comes after the black box. they can—for example—simply block urls
Re:Tracking the Fake GitHub Star Black Market by Sai_ on Sunday March 19, 2023 @07:46AM (#35218055)
They don’t have control over the output. They created something that creates something else. They can only tweak what they created, not whatever was created by what they created.

E.g., if I create a great paintbrush which creates amazing spatter designs on the wall when it is used just so, then, beyond a point, I have no way to control the spatter designs - I can only influence the designs to some extent.

Re:Tracking the Fake GitHub Star Black Market by permo-w on Monday March 20, 2023 @10:06PM (#35241675)
did you read what I said?
Re:Tracking the Fake GitHub Star Black Market by lanternfish on Sunday March 19, 2023 @08:58AM (#35218488)
This is true, but detecting and omitting code hallucinations is (functionally) as hard as just not hallucinating in the first place.