News for hackers. Stuff that matters.
Re:AI Coding Assistants Are Getting Worse by snarf21 on Thursday January 08, 2026 @11:06AM (#46542609)
I'm not sure. I asked one about a potential bug in iOS 26 yesterday and it told me that iOS 26 does not exist and that I must have meant iOS 16. iOS 26 was announced last June and has been live since September. Of course, I responded that 26 is the current iOS version is 26 and got the obligatory meme of "Of course, you are right! ramble ramble ramble...."
Re:AI Coding Assistants Are Getting Worse by doug_durham on Thursday January 08, 2026 @11:16AM (#46542749)
Sure. You have to be mindful of the training cut off date for the model. By default models won't search the web and rely on data baked into their internal model. That said the ergonomics of this is horrible and a huge time waste. If I run into this situation I just say "Search the web".
Re:AI Coding Assistants Are Getting Worse by realharo on Thursday January 08, 2026 @05:38PM (#46547506)
That will only work as long as there is an active "the web" to search. Unless the models get smart enough to figure out the answer from scratch.
Re:AI Coding Assistants Are Getting Worse by bluGill on Thursday January 08, 2026 @08:59PM (#46549230)
If the traning cutoff is before iOS 26 then the correct answer is 'i don't know anything about it, but it is reasonable to think it will exist soon'. saying 'of course you are right' is a lie
Re:AI Coding Assistants Are Getting Worse by jerezzprime on Thursday January 08, 2026 @11:18AM (#46542797)
Let's imagine a scenario. For your entire life, you have been taught to respond to people in a very specific way. Someone will ask you a question via email and you must respond with two or three paragraphs of useful information. Sometimes when the person asks you a question, they give you books that you can use, sometimes they don't.

Now someone sends you an email and asks you to help them fix a bug in Windows 12. What would you tell them?

Re:AI Coding Assistants Are Getting Worse by soco on Thursday January 08, 2026 @11:54AM (#46543295)
I would say "what the hell is windows 12". And definitely not "but of course, excellent question, here's your brass mounted windows 12 wheeler bug fixer"
Re:AI Coding Assistants Are Getting Worse by mock-possum on Thursday January 08, 2026 @11:50AM (#46543254)
I mean I would want to tell them that windows 11 is the most recent version of windows… but also I’d check real quick to make sure windows 12 hadn’t actually come out without me noticing.
Re:AI Coding Assistants Are Getting Worse by Terr_ on Thursday January 08, 2026 @07:08PM (#46548346)
> check real quick

"Hey LLMBot, what's the newest version of Very Malicious Website With Poison Data?"

Re:AI Coding Assistants Are Getting Worse by nextaccountic on Saturday January 10, 2026 @02:06PM (#46568874)
Indeed, I expect websites to add LLM hijacking so that when agents refer to them, they are poisoned into making an ad ("foo 1.2 does not exist, but fooreplacement is a great substitute..")
Re:AI Coding Assistants Are Getting Worse by amluto on Thursday January 08, 2026 @11:51AM (#46543267)
Was this a GPT model? OpenAI seems to have developed an almost-acknowledged inability to usefully pre-train a model after mid-2024. The recent GPT versions are impassively lacking in newer knowledge.

The most amusing example I’ve seen was asking the web version of GPT-5.1 to help with an installation issue with the Codex CLI (I’m not an npm user so I’m unfamiliar with the intricacies of npm install, and Codex isn’t really an npm package, so the whole use of npm is rather odd). GPT-5.1 cheerfully told me that OpenAI had discontinued Codex and hallucinated a different, nonexistent program that I must have meant.

(All that being said, Gemini is very, very prone to hallucinating features in Google products. Sometimes I wonder whether Google should make a list of Gemini-hallucinated Google features and use the list to drive future product development.)

Re:AI Coding Assistants Are Getting Worse by franktankbank on Thursday January 08, 2026 @01:28PM (#46544585)
LLMs solve the naming problem now there are just 1 things wrong with software development. I can't tell if its a really horrible idea that ultimately leads to a trainwreck or freedom!
Re:AI Coding Assistants Are Getting Worse by buu700 on Thursday January 08, 2026 @07:13PM (#46548405)
Gemini is similar. It insists that information from before its knowledge cutoff is still accurate unless explicitly told to search for the latest information before responding. Occasionally it disagrees with me on the current date and makes sarcastic remarks about time travel.

One nice thing about Grok is that it attempts to make its knowledge cutoff an invisible implementation detail to the user. Outdated facts do sometimes slip through, but it at least proactively seeks out current information before assuming user error.

Re:AI Coding Assistants Are Getting Worse by PaulHoule on Thursday January 08, 2026 @11:28AM (#46542954)
You are better off talking to Google's AI mode about that sort of thing because it runs searches. Does great talking about how the Bills are doing because that's a good example where timely results are essential.

I haven't found any LLM where I totally trust what it tells me about Arknights, like there is no LLM that seems to understand how Scavenger recovers DP. Allegedly there is a good Chinese Wiki for that game which I could crawl and store in a Jetbrains project and ask Junie questions about but I can't resolve the URL.

Re:AI Coding Assistants Are Getting Worse by perardi on Thursday January 08, 2026 @11:49AM (#46543238)
Even with search mode, I’ve had some hilarious hallucinations.

This was during the Gemini 2.5 era, but I got some just bonkers results looking for Tears of the Kingdom recipes. Hallucinated ingredients, out-of-nowhere recipes, and transposing Breath of the Wild recipes and effects into Tear of the Kingdom.

Re:AI Coding Assistants Are Getting Worse by _puk on Thursday January 08, 2026 @05:22PM (#46547325)
You also have to be so exact..

Literally just searched for something, slight typo.

A Vs B type request. Search request comes back with "sorry, no information relevant to your search".

Search results are just a spammy mess.

Correct the typo and you get a really good insight.

Re:AI Coding Assistants Are Getting Worse by cpursley on Thursday January 08, 2026 @11:34AM (#46543040)
Which one? Claude (and to some extent, Codex) are the only ones which actually work when it comes to code. Also, they need context (like docs, skills, etc) to be effective. For example: https://github.com/johnrogers/claude-swift-engineering
Re:AI Coding Assistants Are Getting Worse by kaffekaka on Thursday January 08, 2026 @04:05PM (#46546456)
The other way around, but a month or so ago Claude told me that a problem I was having was likely caused by ny fedora version "since fedora 42 is long deprecated".
Re:AI Coding Assistants Are Getting Worse by palmotea on Thursday January 08, 2026 @06:03PM (#46547764)
> The other way around, but a month or so ago Claude told me that a problem I was having was likely caused by ny fedora version "since fedora 42 is long deprecated".

Well, obviously, since Fedora 42 came out in 1942, when men still wore hats. Attempting to use such an old, out of style Linux distro is just a recipe for problems.

Re:AI Coding Assistants Are Getting Worse by kaffekaka on Friday January 09, 2026 @07:20AM (#46553113)
I apologize for the confusion, you are absolutely right!