Re:Where's the shovelware? Why AI coding claims don't add up
by vkou on Wednesday September 03, 2025 @08:36PM
(#45122046)
As I thought.
And for the record - my eyes are open. I'm aware I'm being bullshitted. I don't trust, I verify.
But I also don't have a magical lever that I can pull to make it stop hallucinating.
... and every time I ask if one exists, I get either crickets, or a response that doesn't answer the question.
Re:Where's the shovelware? Why AI coding claims don't add up
by manwe150 on Wednesday September 03, 2025 @11:51PM
(#45123364)
Ask it to write tests, then let it run until the tests pass (preferably in a sandbox, far from your git credentials). It is quite good at developing hypotheses and tests for them, if that is what you explicitly ask for. It doesn’t have (much) ego, so it doesn’t care if it is proven wrong and will accept any outcome fairly if it is testable. Although sometimes it comes to the wrong conclusion and doubles down that the fact should be true so it prepares to write and publish a library to make it true
Re:Where's the shovelware? Why AI coding claims don't add up
by mandeepj on Wednesday September 03, 2025 @11:46PM
(#45123330)
Sorry! Didn't mean to BS you. I've not come across a scenario where it hallucinated me with a non-existent library. Can you share what you were trying to do when that happened?
Re:Where's the shovelware? Why AI coding claims don't add up
by vkou on Thursday September 04, 2025 @02:07PM
(#45130277)
I wish I had the transcript. I don't, and I'm afraid that the passage of time has muddied the interaction to the point of uselessness (when it comes to listing specifics).
Re:Where's the shovelware? Why AI coding claims don't add up
by rsynnott on Thursday September 04, 2025 @05:30AM
(#45125328)
Okay, so at this point it is strictly worse than just searching for and reading the very simple docs for the Ruby CSV parser, surely?
Because, as part of your verification, you will have to do that _anyway_.
Maybe keep your eyes open? :-)