News for hackers. Stuff that matters.
Re:73% of AI startups are just prompt engineering by analogpixel on Sunday November 23, 2025 @12:04PM (#46025089)
Where is this guy sitting that he is able to collect all of this data? And why is he able to release it all in a blog post? (my company wouldn't allow me to collect and release customer data like this.)
Re:73% of AI startups are just prompt engineering by InsideOutSanta on Sunday November 23, 2025 @12:11PM (#46025162)
It sounds like some of these companies call the OpenAI or Anthropic APIs directly from their frontend. Later, the author also mentions "response time patterns for every major AI API," so maybe there's some information about the backend leaking that way even if the API calls are bridged.

But I'd like to know an actual answer to this, too, especially since large parts of this post read as if they were written by an LLM.

Re:73% of AI startups are just prompt engineering by cess11 on Sunday November 23, 2025 @12:34PM (#46025433)
"I found 12 companies that left API keys in their frontend code. I reported them all. None responded."

They claim to have found that.

Re:73% of AI startups are just prompt engineering by hn_throwaway_99 on Sunday November 23, 2025 @12:56PM (#46025735)
> It sounds like some of these companies call the OpenAI or Anthropic APIs directly from their frontend.

Which would be a major security hole. And sure, lots of startups have major security holes, but not enough that he could come up with these BS statistics.

I'm a little dismayed at how high up this has been voted given the data is guaranteed to be made up.

Re:73% of AI startups are just prompt engineering by kllrnohj on Sunday November 23, 2025 @02:42PM (#46026623)
> > It sounds like some of these companies call the OpenAI or Anthropic APIs directly from their frontend.

> Which would be a major security hole.

An officially supported security hole

https://platform.openai.com/docs/api-reference/realtime-sess...

Re:73% of AI startups are just prompt engineering by rs186 on Saturday November 29, 2025 @07:52AM (#46087159)
Realtime API is a very small use case that most products don't touch.
Re:73% of AI startups are just prompt engineering by jmogly on Sunday November 23, 2025 @12:07PM (#46025120)
Im also wondering how he is able to see calls to AI providers directly in the browser, client side api calls? Thats strange to me. Also how is he able to peer into the rag architectures? I don’t get that, maybe GpT4.1 allows unauthenticated requests? Is there an OAuth setup that allows client side requests to OpenAI?
Re:73% of AI startups are just prompt engineering by muppetman on Sunday November 23, 2025 @12:16PM (#46025215)
Yea I just posted a similar comment. I'm sure some websites just skin OpenAI/Claude etc, but ALL of them? It makes no sense.
Re:73% of AI startups are just prompt engineering by teiferer on Sunday November 23, 2025 @12:20PM (#46025261)
Another red flag with the article is that the author's LinkedIn profile link at the bottom leads to a non-existing page.

Is Teja Kusireddy a real person? Or is this maybe just an experiment from some AI company (or other actor) to see how far they can push it? A Google search by that name doesn't find anything not related to the article.

The article should be flagged. Otoh, this should get discussed.

Re:73% of AI startups are just prompt engineering by zkmon on Sunday November 23, 2025 @12:43PM (#46025546)
He seems real. Goes by Teja K. Seems a startup founder.
Re:73% of AI startups are just prompt engineering by hn_throwaway_99 on Sunday November 23, 2025 @12:46PM (#46025585)
He may be real, but the article is fake BS. There is simply no way he'd be in a position to intercept the calls, and he never explains it.
Re:73% of AI startups are just prompt engineering by less_penguiny on Sunday November 23, 2025 @12:58PM (#46025748)
There is nothing difficult about monitoring network traffic in this way for desktop or native apps.
Re:73% of AI startups are just prompt engineering by teiferer on Sunday November 23, 2025 @01:24PM (#46025975)
Did you read the article? It claims to have knowledge of network traffic between the startup's devices and the AI providers' devices.
Re:73% of AI startups are just prompt engineering by hn_throwaway_99 on Sunday November 23, 2025 @03:38PM (#46027117)
So? The vast majority of these startups would still do the wrapping on their own backend.
Re:73% of AI startups are just prompt engineering by teiferer on Sunday November 23, 2025 @12:46PM (#46025599)
Do you have any link that supports this?
Re:73% of AI startups are just prompt engineering by hn_throwaway_99 on Sunday November 23, 2025 @12:21PM (#46025271)
Yeah, TBH my BS detector is going off because this article never explains how he is able to intercept these calls.

To be able to call the OpenAI directly from the front end, you'd need to include the OpenAI key, which would be a huge security hole. I don't doubt that many of these companies are just wrappers around the big LLM providers, but they'd be calling the APIs from their backend where nothing should be interceptable. And sure, I believe a few of them are dumb enough to call OpenAI from the frontend, but that would be a minority.

This whole thing smells fishy, and I call BS unless the author provides more details about how he intercepted the calls.

Re:73% of AI startups are just prompt engineering by chmod775 on Sunday November 23, 2025 @12:59PM (#46025763)
> Yeah, TBH my BS detector is going off because this article never explains how he is able to intercept these calls.

You mean, except for explaining what he's doing 4-5 times? He was literally repeating himself restating it. Half the article is about the various indicators he used. THERE'S EXAMPLES OF THEM.

There's this bit:

> Monitored their network traffic for 60-second sessions

> Decompiled and analyzed their JavaScript bundles

Also there's this whole explanation:

> The giveaways when I monitored outbound traffic:

> Requests to api.openai.com every time a user interacted with their "AI"

> Request headers containing OpenAI-Organization identifiers

> Response times matching OpenAI’s API latency patterns (150–400ms for most queries)

> Token usage patterns identical to GPT-4’s pricing tiers

> Characteristic exponential backoff on rate limits (OpenAI’s signature pattern)

Also there's these bits:

> The Methodology (Free on GitHub next week):

> - The complete scraping infrastructure

> - API fingerprinting techniques

> - Response time patterns for every major AI AP

One time he even repeats himself by stating what he's doing as playwright pseudocode, in case plain English isn't enough.

This was also really funny:

> One company’s “revolutionary natural language understanding engine” was literally this: [clientside code with prompt + direct openai API call].

And there's also this bit at the end of the article:

> The truth is just an F12 away.

There's more because LITERALLY HALF THE ARTICLE IS HIM DOING THE THING YOU COMPLAIN HE DIDN'T DO.

In case it's still not clear, he was capturing local traffic while automating with playwright as well as analyzing clientside JS.

Re:73% of AI startups are just prompt engineering by teiferer on Sunday November 23, 2025 @01:55PM (#46026243)
> Monitored their network traffic for 60-second sessions

How can he monitor what's going on between a startup's backend and OpenAI's server?

> The truth is just an F12 away

That's just not how this works. You can see the network traffic between your browser and some service. In 12 cases that was OpenAI or similar. Fine. But that's not 73%. What about the rest? He literally has a diagram claiming that the startups contact an LLM service behind the scenes. That's what's not described, how does he measure that?

You are not bothered by the only sign that the author even exist is this one article and the previous one? Together with the claim to be a startup founder? Anybody can claim that. It doesn't automatically provide credibility.

Re:73% of AI startups are just prompt engineering by kllrnohj on Sunday November 23, 2025 @02:21PM (#46026453)
I believe he's saying that a large number of the startups he tested did not have their own backend to mediate. It was literally direct front-end calls to openai. And if this sounds insane, remember that openai actually supports this: https://platform.openai.com/docs/api-reference/realtime-sess...

Presumably OpenAI didn't add that for fun, either, so there must be non-zero demand for it.

Re:73% of AI startups are just prompt engineering by hn_throwaway_99 on Sunday November 23, 2025 @03:41PM (#46027140)
It's a fair point that OpenAI officially supports ephemeral keys.

But I still believe the vast majority of startups do wrapping in their own backend. Yes, I read what he's doing, and he's still only able to analyze client-side traffic, which means his overall claims of "73%" are complete and total bullshit. It is simply impossible to conclude what he's concluding without having access to backend network traces.

EDIT: This especially doesn't make sense because the specific sequence diagram in this article shows the wrapping happening in "Startup Backend", and again, it would be impossible for him to monitor that network traffic. This entire article is made-up LLM slop.

Re:73% of AI startups are just prompt engineering by chmod775 on Sunday November 23, 2025 @10:59PM (#46030230)
> How can he monitor what's going on between a startup's backend and OpenAI's server?

He is not claiming to be doing that. He says what and how he's capturing multiple times. He says he's capturing what's happening in browser sessions. Reflect on what else you may to re-evaluate or discard if you misunderstood this.

> That's just not how this works. You can see the network traffic between your browser and some service.

Yes, the author is well aware of that as are presumably most readers. However for example if your client makes POST requests to the startup's backend like startup.com/api/make-request-to-chatgpt and the payload is {systemPrompt: "...", userPrompt: "..."}, not much guessing as to what is going on is necessary.

> You are not bothered by the only sign that the author even exist is this one article and the previous one?

Moving goalposts. He may or not be full of shit. Guess we'll see if/when we see the receipts he promised to put on GitHub.

What actually bothers is the lack of general reading comprehension being displayed in this thread.

> Together with the claim to be a startup founder? Anybody can claim that.

What? Anybody can be a startup founder today. Crazy claim. Also... what?

> It doesn't automatically provide credibility.

Almost nobody in this space has credibility. That could turn out to be Sam Altman's alias and I'd probably trust it even less.

In any case evaluating whether or not a text is credible should preferably happen after one has understood what was written.

Re:73% of AI startups are just prompt engineering by hn_throwaway_99 on Tuesday November 25, 2025 @06:41PM (#46052218)
> He is not claiming to be doing that.

He literally is. Look at the sequence diagram in the article, which specifically labels "Startup Backend". The whole article is made-up LLM slop.

Re:73% of AI startups are just prompt engineering by DetroitThrow on Sunday November 23, 2025 @02:04PM (#46026310)
>Response times matching OpenAI’s API latency patterns (150–400ms for most queries)

This also matches the latency of a large number of DB queries and non-OpenAI LLM inference requests.

>Token usage patterns identical to GPT-4’s pricing tiers

What? Yes this totally smells real.

He also mentions backoff patterns, which I'm not sure how he'd disambiguate extremely standard backoff in a normal API.

Given the ridiculousness of these claims, I believe there's a reason he didn't include the fingerprinting methodology in this article.

Re:73% of AI startups are just prompt engineering by chmod775 on Sunday November 23, 2025 @11:18PM (#46030343)
Why is this comment here? Am I supposed to defend that guy's article now?

Just because I'm frustrated with someone's inability to understand a text does not imply I want to defend or even personally believe what was written.

Re:73% of AI startups are just prompt engineering by cess11 on Sunday November 23, 2025 @12:33PM (#46025421)
There's a link in the preview of TFA that unlocks the rest of the article, looks like this for me:

https://medium.com/@teja.kusireddy23/i-reverse-engineered-20...

The article is basically a description of where to look for clues. Perhaps they've contracted with some of these companies and don't want to break some NDA by naming them, but still know a lot about how they work.

Re:73% of AI startups are just prompt engineering by hn_throwaway_99 on Sunday November 23, 2025 @12:49PM (#46025633)
> Perhaps they've contracted with some of these companies and don't want to break some NDA by naming them, but still know a lot about how they work.

This makes literally no sense. Why would any companies (let alone most of them) contract with this guy who seems hell bent on exposing them all.

The article is simple made up, most likely by an LLM.