News for hackers. Stuff that matters.
Re:There Are No New Ideas in AI Only New Datasets by petesergeant on Tuesday July 01, 2025 @06:02AM (#44432283)
> I've done the research

Great. What's the 1970s equivalent of word2vec or embeddings, that we've simply scaled up? Where are the papers about the transformer architecture or attention from the 1970s? Sure feels like you think LLMs are just big perceptrons.

> The problem with the models is they require exponential cost growth

Let's stick to the assertion I was disputing instead.

There are no comments on this comment yet.