News for hackers. Stuff that matters.
Re:Claude 3.5 Sonnet by squigz on Thursday June 27, 2024 @12:02AM (#40807074)
> it was able to compare/contrast various levels of support for high-bandwidth USB 3 and Ethernet in multiple frameworks and languages.

How do you know such information is correct though?

Re:Claude 3.5 Sonnet by aappleby on Thursday June 27, 2024 @12:07AM (#40807107)
Some of it I was able to verify immediately, some I confirmed by poking around in Github repos once I knew the magic words, some I haven't verified yet.

For example, I wasn't sure if there was good support for USB devices in Rust. Just not something I'd ever bothered to investigate. Claude knew that there was a libusb wrapper and a "rusb" crate, and claimed that support for USB in Rust was stable. I verified the existence of the crates, and I'll take Claude at its word for stability unless I discover otherwise.

Re:Claude 3.5 Sonnet by panarky on Thursday June 27, 2024 @12:22AM (#40807187)
The same way as when you learn something new from some random internet person.

Does what they say conflict with anything you already know to be true?

Is their argument internally inconsistent, does it contradict itself?

Can you corroborate parts of their argument from other independent sources?

Re:Claude 3.5 Sonnet by squigz on Thursday June 27, 2024 @06:46AM (#40809106)
The key difference is that I can reasonably trust (depending on the audience) that the other human is not simply hallucinating facts in order to provide a response.
Re:Claude 3.5 Sonnet by panarky on Thursday June 27, 2024 @02:25PM (#40813474)
Not only do humans invent stuff that didn't happen (hallucination), we're also prewired with a very long list of cognitive biases.

It depends a lot on the domain of course, but I'd bet that frontier LLMs already exhibit superhuman capabilities in providing accurate answers in the vast majority of domains.

Re:Claude 3.5 Sonnet by squigz on Thursday June 27, 2024 @05:23PM (#40815288)
The fact that we can notice our own biases and correct them is irrelevant to you?