News for hackers. Stuff that matters.
Re:Testing Generative AI for Circuit Board Design by Terr_ on Friday June 21, 2024 @01:22PM (#40751693)
Yeah, when the author was writing about that initial query about delay-per-unit-length, I'm thinking: "This doesn't tell us whether an LLM can apply the concepts, only whether relevant text was included in its training data."

It's a distinction I fear many people will have trouble keeping in-mind, faced with the misleading eloquence of LLM output.

Re:Testing Generative AI for Circuit Board Design by Kuinox on Friday June 21, 2024 @09:41PM (#40755493)
I think you are looking at the term generalizing and memorisation. It have been shown that LLM generalize, what is important to know is if they generalized it or memorized it.