Re:If an AI agent can't figure out how your API works, neith...
by jtrn on Tuesday May 20, 2025 @12:00PM
(#44043089)
I wanted to just reply “this”, but i feared it would be seen as unbecoming on hn, but really truly and deeply mean it: this!!!
Re:If an AI agent can't figure out how your API works, neith...
by koakuma-chan on Tuesday May 20, 2025 @12:04PM
(#44043131)
I agree, sometimes API docs are missing key details and LLM has to make assumptions
Re:If an AI agent can't figure out how your API works, neith...
by lesser23 on Tuesday May 20, 2025 @12:04PM
(#44043141)
“AI” can’t use X so we have to dumb it down to the point a next token predictor can figure it out. Every day it seems like we are using spicy autocomplete as a measure of understandability which seems entirely silly to me. My own employer has ascribed some sort of spiritual status to prompts. The difference between prompting an LLM and a seance with psychedelics is getting smaller and smaller.
The next AI winter is going to be brutal and highly profitable for actual skilled devs.
Re:If an AI agent can't figure out how your API works, neith...
by kurthr on Tuesday May 20, 2025 @12:12PM
(#44043232)
I don't know, man. I also find AI slop to be uncanny and strangely repulsive, but the other side is that, if there's not enough information in your API and documentation for an LLM, then there's a clever intern that will get it just exactly wrong.
The challenge with making things idiot proof is the ingenuity of idiots. Remember 50% of people are "bellow" median.
Re:If an AI agent can't figure out how your API works, neith...
by john-h-k on Tuesday May 20, 2025 @02:25PM
(#44044410)
> a next token predictor can figure it out
Describing LLMs as "next token predictors" is disingenuous and wrong
Re:If an AI agent can't figure out how your API works, neith...
by poly2it on Tuesday May 20, 2025 @02:32PM
(#44044475)
How so? Autoregressive LLMs are quite literally "next token predictors", just very sophisticated ones.
Re:If an AI agent can't figure out how your API works, neith...
by nativeit on Tuesday May 20, 2025 @05:24PM
(#44046066)
Your description of your employer struck a chord that's been resonating in me for the last several months. I'm legitimately concerned about the knowledge gap with regards to how LLMs work, and a new generation of cults using them as quasi-deities (in both good/bad faith, as it were).
Re:If an AI agent can't figure out how your API works, neith...
by syklemil on Wednesday May 21, 2025 @02:32AM
(#44048843)
> My own employer has ascribed some sort of spiritual status to prompts.
You may want to get them away from the prompts asap. They might be headed down the route to heavy spiritual delusions: https://www.rollingstone.com/culture/culture-features/ai-spi...
It seems that just like how some people predisposed to psychosis should stay away from certain recreational drugs, some people should stay away from LLMs.
If AI can't use X, then there is something wrong with X.
X in { website, codebase, function, language, library, mcp, ...}