News for hackers. Stuff that matters.
Re:No One Knows Anything About AI by setr on Thursday July 24, 2025 @01:08PM (#44673197)
I think the problem with this one is that LLMs are somehow both unreasonably effective as well as unreasonably ineffective. Letting the code editor llms do their suggestions, I’ve gotten a ton of useless boilerplate garbage suggestions, but periodically, a couple times of day, it suggests blocks of code that are far more complete, comprehensive and correct than it has any right to be.

Whether you’ll get the high IQ or low IQ LLM on the next suggestion is a crapshoot; how much consideration you give to either outcome (focus on the random instances of brilliance, or the constant stream of bullshit) drives the final perception.

Re:No One Knows Anything About AI by awfulneutral on Thursday July 24, 2025 @01:13PM (#44673260)
That has been my experience too. I recently turned it all off because I decided the amount of times it takes me 5x longer to accomplish something, in addition to the subtle increase of bugs, is not currently worth it. I guess I'll try it again in a few months.
Re:No One Knows Anything About AI by abalashov on Thursday July 24, 2025 @01:15PM (#44673301)
> Whether you’ll get the high IQ or low IQ LLM on the next suggestion is a crapshoot

I have heard theories from people--whose ideas I don't ordinarily consider to be in the realm of purely uninformed speculation--that this can vary depending on system-wide GPU load, and is throttled accordingly based on real-time demand by the major LLM providers.

Whether it's true, I have no idea.

Re:No One Knows Anything About AI by emp17344 on Thursday July 24, 2025 @01:24PM (#44673434)
Sounds like conspiratorial thinking to come to terms with the fact that LLMs are fundamentally non-deterministic text predictors. You can get dramatically different responses to the same question, and that’s just how the system works.
Re:No One Knows Anything About AI by abalashov on Thursday July 24, 2025 @01:31PM (#44673538)
That was my reaction as well, but I wondered.