News for hackers. Stuff that matters.
Re:I'm Bearish OpenAI by msoad on Friday May 17, 2024 @07:53PM (#40395290)
It’s not just OpenAI. I think AI winter is coming much sooner than expected. Throwing more compute at the current solution is not yielding better results it seems. Reasoning will not be solved by a bigger LLM
Re:I'm Bearish OpenAI by prng2021 on Friday May 17, 2024 @08:10PM (#40395390)
How has throwing compute at the problem not yielded better results? Are you denying that generative AI has been improving by leaps and bounds throughout the last few years?
Re:I'm Bearish OpenAI by og_kalu on Friday May 17, 2024 @08:34PM (#40395539)
Some people are convinced that because we don't have a next gen LLM model (i.e GPT-5) 14 months after 4 and that the best 3rd party models are 'only' GPT-4 level, there must be a plateau or something. Nevermind the 33 month gap between 3 and 4 or the 18 month gap between GPT-3 and the first 3rd party >= GPT-3 level model (Gopher).
Re:I'm Bearish OpenAI by coffeebeqn on Friday May 17, 2024 @10:47PM (#40396150)
Yeah this is like saying after the Intel Pentium came out that welp no one has built an exponentially better CPU in the last year so we’ve peaked as a CPU building species. Even AMDs latest only brought it up up to the same level... CPU winter 1994
Re:I'm Bearish OpenAI by pedalpete on Friday May 17, 2024 @11:26PM (#40396270)
I actually think it's worse than that. HTML5 came out in 2008, so nobody could possibly come up with a new internet business until we progress to HTML6! So without a new release of the language, all development stops!
Re:I'm Bearish OpenAI by faeriechangling on Friday May 17, 2024 @07:58PM (#40395324)
I’ve sure seen better results from throwing more compute at the problem and we’re going to have a lot more compute in 20 years than we have now.
Re:I'm Bearish OpenAI by Davidzheng on Friday May 17, 2024 @07:58PM (#40395320)
To quote Geoff Hinton

"AI winter !!!!????"

Re:I'm Bearish OpenAI by CamperBob2 on Friday May 17, 2024 @08:18PM (#40395436)
What did he mean by that?
Re:I'm Bearish OpenAI by bloppe on Friday May 17, 2024 @11:14PM (#40396226)
https://en.m.wikipedia.org/wiki/AI_winter

It's been a pattern in AI research since the 70s. Sure, the current boom is unprecedented, but that doesn't mean there won't be a relative bust. AI winter doesn't mean chatgpt will disappear. It just means research funding may get significantly scaled back of the hundred billion dollar investments of today don't generate trillion dollar returns

Re:I'm Bearish OpenAI by CamperBob2 on Saturday May 18, 2024 @10:52AM (#40399517)
I know. What did Hinton mean by his comment, though?
Re:I'm Bearish OpenAI by tim333 on Saturday May 18, 2024 @02:54PM (#40401142)
After spending more time researching than I really should have done I found the quote. https://x.com/pmddomingos/status/1728628326968021100

He was expressing doubt that there is an AI winter near. He's more of the:

>Geoffrey Hinton, dubbed the 'Godfather of AI,' warns technology will be smarter than humans in five years"

school of thought. https://www.dailymail.co.uk/sciencetech/article-12610845/geo...

Re:I'm Bearish OpenAI by doubloon on Friday May 17, 2024 @10:02PM (#40395965)
disagree. AI has not even begun to penetrate its potential in corporate America. you could enhance so much middleware stuff with a good unstructured data organization AI and slap voice recog on top of it, you have massively multiplied the effectiveness of a whole bunch of mid level people from operations staff to sales reps, who are very good at their domain but continually stymied by computer syntax and lack of programmers to make the computer do stuff.
Re:I'm Bearish OpenAI by megadal on Saturday May 18, 2024 @02:33AM (#40396897)
The use case you described can be achieved with a subset of NLP, and has basically already been possible for years.

Named-Entity Recognition (NER) and Text Classification will allow you to figure out what kind of text you're looking at and extract structured data.

LLMs are not good at this because they're not specialized for it, but you can build a specialized NER model to extract custom entities from unstructured data today.

That said, I don't really think this is some yet untapped potential of AI so much as an area of ML that just hasn't been applied enough.

ETA: also, in general I think AI is going in the direction of basically just having an LLM route tasks to more specialized ML models (for corporate tasks at least). That's what Google's Vertex AI agents sort of do (and I am guessing the GPT 4 agents as well).

Re:I'm Bearish OpenAI by KoolKat23 on Saturday May 18, 2024 @06:37AM (#40397851)
But this is the thing, that requires expertise and infrastructure.

"AGI" LLM's can handle all the nuance, quite simply, they don't need specialist infrastructure or specialist programming, way cheaper, upfront cost. Way easier to scale.

Individual employees can ask it for specific things that make their lives easier and it'll give it to them/or do it. No need to ask your manager, motivate for funding and hire an engineer/purchase new software/equipment.

Re:I'm Bearish OpenAI by megadal on Saturday May 18, 2024 @11:46AM (#40399942)
If I'm not mistaken LLMs contain NER and text classification pipelines so you can leverage the exact same infrastructure.

I can't see how AGI from that perspective _isnt_ just an LLM routing tasks to more specialized NLP models to be honest.

Unless you're proposing that a bigger LLM (training data, neural network, etc..) will develop the emergent capability to accomplish this without the need for specialized agents.

In which case, I can't see how that would perform more efficiently than an LLM routing requests appropriately amongst agents, as it necessarily requires processing much more data.

But even if somehow it did perform more efficiently while needing much more data, I don't think the no-agent AGI approach will cover all use cases appropriately.

It might be an easier drop in solution, but if I need it to behave a specific way in a specific context, I don't see how an AGI is going to consistently do that more accurately than fine tuning a model for the specific use case and having an LLM routing to it.

Re:I'm Bearish OpenAI by KoolKat23 on Sunday May 19, 2024 @09:45AM (#40406928)
I agree that's probably how they will work best.my point was that AGI allows everyone to leverage those tools without the steep learning curve or having to custom build each component for each specific use case themselves.
Re:I'm Bearish OpenAI by LightFog on Saturday May 18, 2024 @02:53AM (#40396965)
You are assuming all stakeholders want the mid level people gone. We already have the technology to automate most of this stuff - bullshit jobs exist for a different reason.
Re:I'm Bearish OpenAI by grob-gambit on Saturday May 18, 2024 @06:50AM (#40397904)
I partially agree, there are huge delusions of Homo economicus.

There is also this other process at work that is shaped by quarterly earnings reports in public markets. Maybe if we started over with a mirror economy that we rebuild from the ground up, most of these things could be automated.

I think there are many inefficiencies in the system that Homo economicus wouldn't be able to deal with even if Homo economicus actually existed.

Re:I'm Bearish OpenAI by doubloon on Saturday May 18, 2024 @11:37PM (#40404076)
that is the exact opposite of what i said. i said it multiplies the effectiveness of people in the middle of a company. so they dont have to be stuck with middleware interfaces from dead software that hasnt been maintained in 10 years.
Re:I'm Bearish OpenAI by pesfandiar on Saturday May 18, 2024 @02:55AM (#40396972)
AI winter is more about the outlook of the research. Nobody can deny there are huge untapped opportunities in the applications.
Re:I'm Bearish OpenAI by renegade-otter on Wednesday May 22, 2024 @12:45PM (#40443058)
Most businesses do not even have their data game on properly. AI is an iteration of Big Data, and BOTH need proper source material, or the value will be zero AT BEST.

https://hbr.org/2013/12/you-may-not-need-big-data-after-all

Re:I'm Bearish OpenAI by yxgao on Friday May 17, 2024 @11:10PM (#40396217)
I don’t think it’s going to be a “winter”, but there are definitely some bubbles to burst. Especially when LLMs become half-assed products and the general public’s heightened expectations are not met.
Re:I'm Bearish OpenAI by megadal on Saturday May 18, 2024 @02:39AM (#40396920)
I think the biggest bubble that needs to burst is probably the whole "AGI" thing.

The definition of it isn't clear but from what I gather it's basically an aggregate of emergent capabilities that work together to produce a singularity.

Maybe with enough resources it's possible but I highly doubt it'll be economically feasible given how much has gone into it so far and how far we really are away from something like that with current models.

Re:I'm Bearish OpenAI by adammarples on Saturday May 18, 2024 @03:44AM (#40397164)
In my opinion you could make an LLM 100x bigger and it would only get better at generating the next token in a sentence. And everyone knows that the best sentences are not constructed by the most intelligent people with the most accurate world model, but by the people who are best at constructing sentences. It's a dead end in terms of real intelligence and reasoning imo.
Re:I'm Bearish OpenAI by KoolKat23 on Saturday May 18, 2024 @06:47AM (#40397893)
People that make the best sentences don't necessarily make the world go round. In most scenario's, a barely adequate sentence is enough to keep the world turning..
Re:I'm Bearish OpenAI by notarobot123 on Saturday May 18, 2024 @06:30AM (#40397833)
AGI, in the sense you mention, is an imagined/hoped-for supreme-power that will save/destroy us all (or maybe just the "worthy"/"unworthy" ones).

In an age of such hopelessness about the future, this looks a lot like an emotional crutch wrapped in the veil of rationality - just the thing an anxious materialist needs to make sense of the world.

Like many cults and religions it mistakes the plausible for possible and possible for probable.

The problem with religious beliefs like these is that they don't just disappear with evidence or sufficient reasoning.

I don't think that particular bubble is bursting anytime soon.

Re:I'm Bearish OpenAI by tim333 on Saturday May 18, 2024 @11:06AM (#40399631)
Well, that's one definition but I think most people are thinking of general intelligence like humans have rather than godlike. That is more doable.
Re:I'm Bearish OpenAI by megadal on Saturday May 18, 2024 @11:56AM (#40400005)
If that's the goal then perhaps we already surpassed it and I personally am not impressed.

It's useful but basically every method of quality control requires a human.

I've found that components of general intelligence specialized beyond human capability are much more useful than a model that can mimic a human.

I think an LLM is just trying to do too much at once, all of the individual NLP algorithms most of them are made of are very useful to us, but an LLM is just not specialized enough to be any more useful than a human without specialization.

Which isn't to say they're _useless_, but obviously not as useful as a specialist (in special contexts, denoted by whatever kind of specialist they are)

ETA: as an aside, I'd like to contextualize my presumption that AGI is about AI singularity with the fact that Sam Altman casually stated that he doesn't care if it takes $50 billion to reach AGI.

In the real world, with 50 billion dollars, you can do something much more useful than trying to build a product that's basically contradictory by definition.

An LLM is a general intelligence model but it's implicitly touted as being extremely useful for specialized tasks (because, humans can specialize), but once you specialize, I would argue your general intelligence tends to weaken. (For example I wouldn't expect a Harvard PhD to be 100% up to date with modern slang terms, but I'd be shocked if I went to a local bar and met someone who didn't know what rizz means).

This is basically just trying to squeeze two opposite ends of a spectrum together, which sounds kind of like a singularity to me.

Re:I'm Bearish OpenAI by tim333 on Saturday May 18, 2024 @02:10PM (#40400816)
Some of the reasons people like Altman get excited are that if AI is as good as humans all round then you can replace the workforce. Also given the way of these things it will get better each year. We'll see.
Re:I'm Bearish OpenAI by megadal on Saturday May 18, 2024 @03:04PM (#40401208)
> people like Altman get excited are that if AI is as good as humans all round then you can replace the workforce.

I get that. I guess my point is this already seems to exist. We could combine AI with machinery to replace almost everything humans can do already, someone just has to build for that solution (e.g. train some models).

AGI just sounds like a sort of automation of that process. And I don't think a bigger LLM will accomplish that task. I think more developers will.

Which I wager would be cheaper and arguably more fortuitous to the human race than $50 billion thrown into one pot

Re:I'm Bearish OpenAI by tim333 on Sunday May 19, 2024 @04:05AM (#40405180)
Current AI is pretty patchy in it's abilities. Chess is great, chatbot stuff has recently become quite good, but hook it to a robot and tell it to pop down Tescos to get some milk and then come back and tidy the house and it's hopeless!
Re:I'm Bearish OpenAI by megadal on Sunday May 19, 2024 @05:43AM (#40405645)
The use case you describe hardly describes what most workers do though. That's a robot Butler, not a desk worker who takes calls and fills out forms based on what the customer on the other end of the line says, or a factory worker (where automation has already been replacing tons of dangerous jobs without AI since the advent of engineering really).

Also, I still think you can probably build something (or rather, many, many somethings) with existing tooling to accomplish exactly that.

> A bigger LLM won't fix everything

I'm not sure if there's a camp that says it probably won't fix anything, but I'm in that camp if it exists.

If you think about how humans actually work, I think a basic, non AGI LLM routing information to different agents/models is closer to how most humans behave (when productivity is their goal).

E.g. a person's behavior is driven almost entirely by the current context they are in most of the time.

It's not that our minds become overexcited by loads of previous information and we magically are able to do other specialized tasks, we decide based on context what specialty in our toolset best fits the scenario.

> The money's a funny one. Global GDP is about $85,000 bn/yr so if someone can spend $50bn on getting AGI and taking it over it's a bargain. But if you spend $50bn and just get a loss making chatbot then less so.

If that's true then the same could be said of just dumping $50 billion into grants/research/funding for education around AI so that developers worldwide have an easier time developing AI enabled technologies and services.

At least with that plan, there is extremely little risk of creating nothing more than a chatbot (and extremely low risk of tech companies monopolizing labor the same way they try and monopolize everything else; I don't have much faith that if a few companies automate all or most labor that they'll redistribute wealth)

Re:I'm Bearish OpenAI by LightFog on Saturday May 18, 2024 @03:04AM (#40397004)
Years ago so many ‘machine learning’ startups failed because their predictions were 90% accurate but 99.99% was needed for businesses to pay for them. These old scars seem to be missing in LLM mania - why will businesses pay for them now when the previous non hallucinating ML models weren’t reliable enough.
Re:I'm Bearish OpenAI by mvkel on Friday May 17, 2024 @11:25PM (#40396262)
On what evidence are you making this statement?

We don't even know how existing LLMs work, not really, yet we're done?

All signs are pointing to there still being no upper limit on results. Not yet.

Just because it's not on the leaderboard yet, doesn't mean we've heard the bell.

Re:I'm Bearish OpenAI by bozey07 on Saturday May 18, 2024 @01:10AM (#40396577)
Of course "we" know how LLMs work. Nobody would be able to make one, otherwise.
Re:I'm Bearish OpenAI by mvkel on Saturday May 18, 2024 @01:41AM (#40396685)
Just because you can make something doesn't mean you know why it's made.

There are thousands of people around the world trying to reverse engineer what is going on in the billions or trillions of parameters in an LLM.

It's a field called "Mechanistic Interpretability." The people who do the work jokingly call it "cursed" because it is so difficult and they have made so little progress so far.

Literally nobody can predict before they are released what capabilities new models will have in them.

And then, months after a model is released, people discover new abilities in it, such as decent chess playing.

They are black boxes.

Re:I'm Bearish OpenAI by irthomasthomas on Saturday May 18, 2024 @05:19AM (#40397580)
I predict that this is largely an illusion staged by the lack of publishing of the datasets and training regime used.

Also an artefact of how evals have been done on a pass fail basis. So that an LLM that gets 90% of a question right is just as much a failure as one that gets 0% of the question.

So that skills appear to emerge suddenly and surprisingly only due to the flawed way that we are forced to study them. Consider the training regime, and partial success towards a goal, and emergence is far less prevalent. There was a paper on that recently, I'll see if I can find.

Re:I'm Bearish OpenAI by mvkel on Saturday May 18, 2024 @11:20AM (#40399744)
Until <5 years ago, AI was almost entirely a purely academic field, theoretical at that.

Those same academics admit themselves that they're surprised at how well LLMs do considering how simple(?) rudimentary(?) the logic underneath is.

I don't quite understand what you're saying. That these academics were being lazy by not properly investigating/publishing their findings? That doesn't seem right.

Re:I'm Bearish OpenAI by alsetmusic on Saturday May 18, 2024 @09:56PM (#40403557)
They may be black boxes but that doesn't change that they are operating on statistics. I see no evidence that "AI" so far is anywhere near to cracking reasoning. It doesn't matter how magical their inner-workings. They have been trained to spit out plausible text and images (and more limited, video).

All of that is imitation, nothing near thought.

Re:I'm Bearish OpenAI by aprilthird2021 on Saturday May 18, 2024 @03:18AM (#40397059)
It's very commonly understood by those of us who actually produce and consume AI research that "knowing how" LLMs (and Neural Nets for that matter) work doesn't mean knowing how to build one. It means mathematically proving and understanding "how" the steps we put the LLM through when training are able to produce the output we get when testing.

We know how to build it. We don't understand how it's producing the output it does based off what we give it

Re:I'm Bearish OpenAI by AstralStorm on Saturday May 18, 2024 @04:48AM (#40397456)
It's a bit similar to the problem of neuroscience. We understand how a single neuron works pretty well, or even a small count of them. Even a few subsystems like balance or lower level vision. A bit on muscle control and endocrine system.

We do not understand language, grammar, music, only partly emotions, or especially sentience and consciousness. Further, we don't understand how the disparate systems are integrated together.

Re:I'm Bearish OpenAI by mvkel on Saturday May 18, 2024 @11:24AM (#40399773)
Great comparison.

The comparison itself is pretty telling; that the brain and AI work so similarly in specific ways

Re:I'm Bearish OpenAI by kybernetikos on Saturday May 18, 2024 @06:24AM (#40397805)
This still doesn't make sense to me. As far as I'm concerned the gold standard of understanding something is being able to construct a program that replicates it, which is exactly what we can do with LLMs.

We know exactly how llms work (relatively simple maths), and to a large extent even why they work (backpropagation updates weights to more closely approximate the desired function). There are open questions relating to LLMs of course - we don't understand what the space of potential LLM-like things looks like and how the features in that space relate to subjective performance (although note that transformers were designed based on a theory that they would perform better, not just randomly generated or inspired by the muse). We also don't know to what extent the output of LLMs can be approximated by simpler symbolic systems, or how to extract such systems from LLMs when they do exist. Those are really interesting questions, but they're not questions about 'how LLMs work'.

I dislike the 'LLMs are magic' framing that seems to be taking over the world. Nobody thinks that Taylor expansion is magical, but LLMs are doing the same sort of thing - approximating a function through a bunch of weights on a bunch of simpler functions. Just because the function we're approximating (intelligent output) is not known in advance (but can be sampled), and multi-dimensional does not fundamentally change how mysterious the process is.

Re:I'm Bearish OpenAI by OrderlyTiamat on Saturday May 18, 2024 @08:12AM (#40398348)
> As far as I'm concerned the gold standard of understanding something is being able to construct a program that replicates it which is exactly what we can do with LLMs.

But we actually can't! We can build a program that can build a program that is the LLM, which is not the same! I'd argue that you're right insofar as training is concerned. We understand training very well. But the actual model, how it operates, what it actually knows, we don't know how to build that, we don't know what weights to put where.

Re:I'm Bearish OpenAI by Izkata on Sunday May 19, 2024 @03:10AM (#40404882)
We actually have another example of this as well:

Malbolge is an esoteric programming language designed to be impossible to use. The first program written in it wasn't written by a human, it was written by another program.

But since then, with that working program to learn from, people have figured out how to write programs in malbolge: https://lutter.cc/malbolge/tutorial/cat.html

Re:I'm Bearish OpenAI by aprilthird2021 on Thursday May 23, 2024 @05:29PM (#40460126)
> the gold standard of understanding something is being able to construct a program that replicates it

Cloning animals or even humans did not automatically make us understand how brains work. In fact, these were quite unrelated endeavors.

> I dislike the 'LLMs are magic' framing that seems to be taking over the world

Don't take that out on me. That's not what I'm saying. I'm saying there is a lack of determinism (mathematically provable, per se) in our current understanding of all AI (LLM included). There are many attempts to solve this problem. I've sat in on seminars about it myself. So far, we're not there yet

Re:I'm Bearish OpenAI by kybernetikos on Friday May 24, 2024 @05:31AM (#40464454)
> Cloning animals or even humans did not automatically make us understand how brains work. In fact, these were quite unrelated endeavors.

I agree. It's not copying that I'm saying is understanding, it's modelling.

> I'm saying there is a lack of determinism (mathematically provable, per se)

What do you mean by a lack of determinism in this case?

Re:I'm Bearish OpenAI by Gooblebrai on Saturday May 18, 2024 @02:52AM (#40396962)
We were making and using electricity before we knew about the electron
Re:I'm Bearish OpenAI by visarga on Saturday May 18, 2024 @02:22AM (#40396845)
The upper limit is on human text, especially of very high quality and original. But if LLMs use other sources of learning signal, like AlphaZero who trained in pure self play, that has no upper limit. It's just a slow, iterative process, and it requires social aspects.

The path ahead to AGI is deceitful, there are no gradients leading towards it. It's based on exploration and discovery. It works in populations for reasons of diversity - evolution is that way. And evolution is a slow process, not a singularity kind of event.

Re:I'm Bearish OpenAI by binkethy on Saturday May 18, 2024 @04:56AM (#40397490)
I find the presumption of an AGI to be an article of religious faith. I realized, at some point this past year, that silicon valley is a religious center emitting theology and doctrine.

I am an apostate. Technology does not have any innate vector for linear development.

The choice to amplify dystopian social trends remains a wrongful choice.

So-called AI is bad for humanity and the planet, in finite terms at this moment in time. It's essence is wrongful.

Turning bad ideas up to 11 does not make them good ideas.

Re:I'm Bearish OpenAI by lumost on Sunday May 19, 2024 @10:22AM (#40407163)
The bearish case would be that companies are now putting tens of billions into compute/data to beat GPT-4 - but aren't. However I think the initial ~6 month gap between ChatGPT and GPT-4 set unrealistic expectations on the people time required to turn out a new AI product.
Re:I'm Bearish OpenAI by vivzkestrel on Saturday May 18, 2024 @12:57AM (#40396537)
because the amount of data you can train any model on is limited. After training your AI model on the 1st quadrillion images, trillion videos, where do you find the next quadrillion? This is going to be the limitation on top of law of diminishing returns
Re:I'm Bearish OpenAI by echelon on Saturday May 18, 2024 @03:35AM (#40397131)
> After training your AI model on the 1st quadrillion images, trillion videos,

As far as images and video are concerned, we're done. Frame generation is almost perfect, and we don't really need any more training data. Now it's time to build product and enhance how the models work.

LLMs, though? That field appears to have hit a wall for now.

AI for media is going to be a rocket ship. AI for knowledge and text and reasoning will take longer. People will recognize this soon.

Re:I'm Bearish OpenAI by vineyardmike on Saturday May 18, 2024 @05:31AM (#40397614)
> AI for media is going to be a rocket ship.

Is there actually enough data to train an AI on? Photos seem to be a success, like you say, but everything else?

I’ve heard many people make claims about where AI content will be most useful. A persistent theme is an AI made VR world, customized video games, and endless AI generated TikTok videos.

I genuinely question if the training data exists for these use cases. Photos are cheap and easy, but quality annotated 3D models? Short form videos? What about long form video? Are we really there (assuming inference was cheap)?

Re:I'm Bearish OpenAI by echelon on Saturday May 18, 2024 @04:46PM (#40401971)
> Short form videos? What about long form video?

These are being solved as we speak. I'm working on this problem directly and the level of control and consistency achievable is incredible. Video is just a special case of images.

Take a look at the ComfyUI space and the authors of plugins and papers.

> quality annotated 3D models

The research is progressing at a fast pace. We can get good surface topologies, textures, and there are teams working on everything from rigging to animation.

Re:I'm Bearish OpenAI by falcor84 on Saturday May 18, 2024 @06:03AM (#40397717)
You release the agents into the wild as robots, to interact with the environment and continue collecting data of all modalities.
Re:I'm Bearish OpenAI by rvnx on Saturday May 18, 2024 @06:10AM (#40397750)
Totally, the next stage is that Tesla is copying to copy Unitree G1 robots, and let them loose, and learn and listen from the real world, and this where we are going to make very very interesting discoveries.
Re:I'm Bearish OpenAI by renegade-otter on Wednesday May 22, 2024 @12:43PM (#40443036)
Yes, robots will be just walking/crawling/driving "in the wild", on sidewalks and streets. Think about what you are saying.
Re:I'm Bearish OpenAI by hackerlight on Saturday May 18, 2024 @01:40AM (#40396683)
4o uses less compute and performs better.
Re:I'm Bearish OpenAI by tonyhart7 on Saturday May 18, 2024 @01:49AM (#40396717)
thats why microsoft want to build supercomputer to do it, You know that microsoft is backing Open AI right.

They dont want lose to Apple,Google and Meta

Re:I'm Bearish OpenAI by yawpitch on Saturday May 18, 2024 @04:39AM (#40397401)
The main question is what will be the Venn overlap between AI Winter 2.0 and Nuclear Winter 1.0?
Re:I'm Bearish OpenAI by cedws on Sunday May 19, 2024 @08:28PM (#40410853)
It can't come soon enough. Expectations and hype have reached stratospheric levels and are due for a hard correction. Every company is jamming "AI" into places it isn't needed to juice their share price and please the clueless shareholders. Despite LLMs popping up everywhere there's limited evidence to support the claimed productivity boosts. Other than using GitHub Copilot I don't know a single person who seriously uses language models for work, whether it's by prompting directly or pressing a magic "AI" button that performs some RAG.

I've half seriously considered the possibility a large portion of the hype has been manufactured in an attempt to shock stagnating economies back to life, post-COVID, post low interest rates.