News for hackers. Stuff that matters.
Re:GPT-4 Details Leaked by jstarfish on Tuesday July 11, 2023 @05:57PM (#36687793)
> Yes, this is done in lieu of actually looking up extended details on what something means.

If they were capable of understanding the extended details, they would already have an academic background in the subject. Laymen aren't going to have a clue what MoE means even if they went to the trouble of digging up the paper.

> Many developers who are self taught utilize a similar method of learning, essentially using pattern recognition to make “educated guesses” that are then internalized as potential facts and tested at the earliest opportunity.

Using pattern recognition skills to make an educated guess that is internalized as a potential fact sounds an awful lot like what LLMs do. At least when humans do it, we bother with the verification step instead of just acting like we know what we're talking about.

Re:GPT-4 Details Leaked by jprd on Tuesday July 11, 2023 @10:07PM (#36689654)
> If they were capable of understanding the extended details, they would already have an academic background in the subject. Laymen aren't going to have a clue what MoE means even if they went to the trouble of digging up the paper.

This is, hopefully, an accidental thought experiment gone awry. "IF THEY WERE CAPABLE of understanding the extended details, they would already have an academic background in the subject" can and should == "I spent a ton of time in the library", and an follow-up apology for putting "capable" and "academic background" in the same sentence.

The whole friggin' point of this glorified LAN is that we can break down those dumb walled gardens and let kids learn from random BBS textfiles, MIT YT videos and the gathered wisdom of HN.

If you are going to just dismiss auto-didacts, you're going to have to re-write the complete higher education History in Western society. I won't even begin to try and validate how wrong this is for Eastern History as well.

Re:GPT-4 Details Leaked by mvkel on Tuesday July 11, 2023 @11:35PM (#36690190)
> At least when humans do it, we bother with the verification step instead of just acting like we know what we're talking about

We do??

Re:GPT-4 Details Leaked by lobocinza on Wednesday July 12, 2023 @12:25AM (#36690466)
We ask Google (and now ChatGPT) if it's true. It goes round.