News for hackers. Stuff that matters.
Re:AI App Graveyard by babl-yc on Monday November 06, 2023 @11:09PM (#38173146)
There are a ton of companies that are basically a wrapper around GPT-4 with some minimal amount of application code. These folks can create impressive demos that wow minimally informed investors, but the reality is that if it took a few weeks to make there's no defensibility.

I see the profits in the current AI hype cycle going to the leading foundational model company (why pay for the 2nd best?) and the companies that already own customer relationships and integrate AI into their existing products (Microsoft, Adobe, Autodesk, etc).

Re:AI App Graveyard by SomethingNew2 on Monday November 06, 2023 @11:49PM (#38173370)
That’s a compelling story. But that doesn’t make it accurate. We are early on and it’s hard to determine how large or small the ecosystem and value that will be created on top. Some went big, like personal computers, the internet, databases, Java, electricity, and so on. Others did not (yet), web3 (maybe), other databases, low code platform, website builders, workstations, many old personal computing systems, etc.

Yes, it’s easier for incumbents to capture value because they own customer relationships. However, if that was always the case open ai wouldn’t exist. So some do breakthrough.

Early on could people see the future and know what Ms dos, Oracle, or google would become? No because it’s new and it’s the future. It’s only obvious in hindsight. Yes, all of these ai companies on top of chatgpt could become nothing. On the flip side the complexity and depth of chat gpt and other models will continue to expand, creating more possibilities for potential value creation. Or the whole thing can turn into an overvalued version of Clippy. It’s hard to see how it will play out.

Re:AI App Graveyard by babl-yc on Tuesday November 07, 2023 @12:10AM (#38173510)
Good points here.

I certainly see the opportunity for start-ups to break through here. I just don't have much faith in ones where GPT-4 is their core tech.

On the other hand, companies going after the entire vertical where AI is a feature and not the product, or well-funded companies with innovative models that outperform OpenAI is totally a possibility.

Re:AI App Graveyard by XenophileJKO on Tuesday November 07, 2023 @02:05AM (#38174017)
I'm not convinced of the alternative either though. If you think of the AI as an intelligence akin to an employee.. at some level it becomes a commodity and then it becomes what is the AI doing.. what is it harnessed into?
Re:AI App Graveyard by abraae on Tuesday November 07, 2023 @12:05AM (#38173478)
> Early on could people see the future and know what Ms dos, Oracle, or google would become? No...

In the case of Oracle, yes, because Oracle was created directly to compete with DB2 (which was already a success) but as a product that could run on all the popular platforms of the day. So success of their early RDBMS-based-business was predictable, assuming they could execute.

Re:AI App Graveyard by yieldcrv on Monday November 06, 2023 @11:58PM (#38173425)
I used to think I wouldn’t rationalize a losing position while I was invested, but after a hedge fund I was in divested from a large position, I was able to see the other way so clearly
Re:AI App Graveyard by danielmarkbruce on Tuesday November 07, 2023 @12:35AM (#38173638)
This is quite funny. If it weren't for tax (and maybe liquidity in certain situations), this suggests a quarterly "sell everything" day might make sense. You'd sell everything on a friday perhaps, and come monday buy again after having the weekend to freshen your eyes.
Re:AI App Graveyard by yieldcrv on Tuesday November 07, 2023 @11:34PM (#38186835)
alternatively you could take unbalanced bearish positions, like too many at the money put options, everyone can start thinking about the ways that becomes profitable by noticing the bear thesis and rooting for that for a little while.

then people could see which thesis is stronger and more probable, the bullish or the bearish ones.

Re:AI App Graveyard by j45 on Tuesday November 07, 2023 @12:03AM (#38173462)
Good points. Premature optimization and over engineering when one hasn’t been part of either not having any esoteric or unfair knowledge is like shooting in the dark.

YC’s premise to start small, serve the problems and solving them and they will light a path has merit to it especially since they took on a B2B focus.

Re:AI App Graveyard by raverbashing on Tuesday November 07, 2023 @01:22AM (#38173819)
Except PCs, Internet, etc were new things or in case of Java, improvements

These "AI Startups" were just 2 lines of code wrapping a call to OpenAI (or 10 lines if js with langchain - which already makes it easier for devs to use features like "string templates" or such /s)

> if that was always the case open ai wouldn’t exist

Because there were no incumbents offering a ChatGPT similar product

Re:AI App Graveyard by est31 on Tuesday November 07, 2023 @02:16AM (#38174079)
There is value created, but the argument was that it is the big ones with existing customer relationships that are going to benefit, not the 100th startup that offers an AI assistant to schedule appointments via voice commands. I think all of that second group of thin GPT wrappers will be eaten by the entities developing and running the foundational models like OpenAI.

In general, AI is data hungry and college kids in their dorm room will always be at a disadvantage in that regard compared to large companies (many of which locked down scraping on their properties, even if "their" content is mainly generated by users, i.e. non-employees).

Re:AI App Graveyard by JeremyNT on Tuesday November 07, 2023 @11:39AM (#38178993)
> In general, AI is data hungry and college kids in their dorm room will always be at a disadvantage in that regard compared to large companies (many of which locked down scraping on their properties, even if "their" content is mainly generated by users, i.e. non-employees).

It's a two-way street too. The big players have more data to start with and they're already the "place" that you go to add more data.

Google's ML/AI stuff (the behind the scenes stuff, not the consumer facing chatbot type stuff) in gmail/calendar/etc is already useful because of their vertical integration. They "see" everything and can add new records in any part of their productivity suite, then make correlations / recommendations across the entirety of their offerings in a way that ChatGPT wrappers outside of their walled garden will never be able to replicate.

Now with OpenAI, MS has the same opportunity. Issues on github? Code? Emails? Teams conversations? Calendar appointments? Bing search history? It's all just part of the same bundle to them and it's all read/write.

Re:AI App Graveyard by j45 on Monday November 06, 2023 @11:56PM (#38173408)
Many mobile and web apps are database wrappers too.

Replicability isn’t the only part of value.

Solving a valuable problem is. What about the tools quietly moving mountains and not seeking the spotlight?

Most customers of software are not in the software development space.

Re:AI App Graveyard by bealuga on Tuesday November 07, 2023 @12:01AM (#38173445)
I think that those tools not seeking the spotlight might also be at risk. I'm fairly sure some of these tools have a 'twin' that has found success by securing early adopters and has become the de-facto tool for 'X' job, largely due to marketing.
Re:AI App Graveyard by j45 on Tuesday November 07, 2023 @02:17AM (#38174085)
Very plausible.

Still it feels like there’s way more problems that software hasn’t quite solved yet that LLMs may only go near.

Re:AI App Graveyard by meiraleal on Tuesday November 07, 2023 @05:34AM (#38175281)
What risk? Most of those tools are created by inexperienced people that will only notice how bad it was in the future (and they will fail to achieve the same success with much better products later)
Re:AI App Graveyard by meiraleal on Tuesday November 07, 2023 @05:32AM (#38175272)
yes the HN bubble is real. A no-coder developing a successful GPT wrapper won't care about moat
Re:AI App Graveyard by Der_Einzige on Tuesday November 07, 2023 @12:04AM (#38173468)
There are still many use-cases where further control offered by open-source models (i.e. fully supporting all constrained text generation techniques) is superior. Stable Diffusion XL fine-tunes with controlnet, regional prompting, and the further extension ecosystem is still better than DALL-E-3 in the hands of skilled users.

But yes, the distance between the leading foundation models and the leading open source foundation models for LLMs seems to be getting farther, not closer.

Re:AI App Graveyard by gfodor on Tuesday November 07, 2023 @01:34AM (#38173875)
This is a prediction that there will be zero surprises. An obvious prediction to make, but probably wrong.
Re:AI App Graveyard by echelon on Tuesday November 07, 2023 @02:17AM (#38174083)
> I see the profits in the current AI hype cycle going to the leading foundational model company (why pay for the 2nd best?)

Because it's a race to the bottom. Look at crowded spaces like TTS. Eleven Labs looks like hot shit, but in actuality they have over a dozen well-funded direct competitors. Including OpenAI.

There won't be a "Twilio of [X] Model Inference", nor will there be a "Best Foundational Model for [Y]". These are features, not moats.