News for hackers. Stuff that matters.
Re:TLDR explains what a piece of code does by curl-up on Friday September 23, 2022 @04:08AM (#32949221)
Ha, do I feel stupid now! Just checked, and seems like I misconfigured my system (the part that builds the Codex prompt from the schema info) - Invoice and InvoiceLine tabls got confused. After fixing it now, it works as expected (using IL.Total).

Here are some more examples if someone's interested: https://pastebin.com/5Vr08N7z

Re:TLDR explains what a piece of code does by Izkata on Friday September 23, 2022 @09:34AM (#32951740)
This non-cherry-picked example is exactly one of the problems people are talking about though: It easily creates something that looks correct, and the users sees what they expect, so things get through that wouldn't have if they thought through the problem themselves.
Re:TLDR explains what a piece of code does by curl-up on Friday September 23, 2022 @12:46PM (#32954251)
Yeah, agree - building and verifying apps built on this models is very hard as they are hard to test extensively. But so are most other ML-based apps. The error in that example was on my side, not on the model. I mean, to me this seems simillar to saying that high-abstraction programming languages are a problem because their compilers are hard to develop and probably loaded with bugs.