News for hackers. Stuff that matters.
Re:How Do Large Language Models Generate Text? by k3ntaki on Thursday October 10, 2024 @05:41PM (#41803863)
Large Language Models (LLMs) have transformed the way artificial intelligence interacts with human language. While these systems are immensely powerful, their inner workings can feel like a mystery to most. This article aims to simplify the complexity behind LLMs, breaking down advanced concepts such as neural networks, and transformers in a way that's easy to grasp.
Re:How Do Large Language Models Generate Text? by cratermoon on Thursday October 10, 2024 @08:46PM (#41805053)
Step 1. Indiscriminately hoover up any text you can find in the name of training data.

Step 2. ???

Step 3. Profit.

Re:How Do Large Language Models Generate Text? by k3ntaki on Thursday October 10, 2024 @11:03PM (#41805606)
That sounds about right! but Step 3 seems working well for them...
Re:How Do Large Language Models Generate Text? by cratermoon on Tuesday October 15, 2024 @11:26AM (#41849584)
I'm not so sure about that. Companies are burning through huge amounts of money to train and run these models, but the revenue isn't keeping up. Billions of investment, but where's the revenue? https://www.axios.com/2024/07/12/ai-bubble-revenue-missing
Re:How Do Large Language Models Generate Text? by k3ntaki on Sunday October 27, 2024 @02:26AM (#41960274)
Yeah, Nvidia's pocketing the revenue, but it seems we’re in an era where revenue and profit do not matter, money goes where the hype is...