Francois Chollet is leaving Google

Re:Francois Chollet is leaving Google by paxys on Wednesday November 13, 2024 @08:14PM (#42132119)

More generally, there is unlimited opportunity in the AI space today, especially for someone of his stature, and staying tied to Google probably isn't as enticing. He can walk into any VC office and raise a hundred million dollars by the end of the day to build whatever he wants.

[ Parent | on HN ]

Re:Francois Chollet is leaving Google by hiddencost on Wednesday November 13, 2024 @10:43PM (#42132971)

$100M isn't enough capital for an AI startup that's training foundation models, sadly.

A ton of folks of similar stature who raised that much burnt it within two years and took mediocre exits.

[ Parent | on HN ]

Re:Francois Chollet is leaving Google by NitpickLawyer on Thursday November 14, 2024 @12:34AM (#42133404)

I think we'll start to see a differentiation soon. The likes of Ilya will raise money to do whatever, including foundation models / new arch, while other startups will focus on post-training, scaling inference, domain adaptation and so on.

I don't think the idea of general foundational model from scratch is a good path for startups anymore. We're already seeing specialised verticals (cursor, codeium, both at ~100-200m funding rounds) and they're both focused on specific domains, not generalist. There's probably enough "foundation" models out there to start working on post-training stuff already, no need to reinvent the wheel.

[ Parent | on HN ]

Re:Francois Chollet is leaving Google by zxexz on Thursday November 14, 2024 @01:16AM (#42133563)

Interesting, I think $100M is totally enough to train a SotA "foundation model". It's all in the use case. I'd love to hear explicit arguments against this.

[ Parent | on HN ]

Re:Francois Chollet is leaving Google by hiddencost on Thursday November 14, 2024 @02:04AM (#42133765)

There's a bunch of failed AI companies who raised been $100M and $200M with the goal of training foundation models. What they discovered is that they were rapidly out paced by the large players, and didn't have any way to generate revenue.

You're right that it's enough to train one, but IMO you're wrong that it's enough to build a company around.

[ Parent | on HN ]

Re:Francois Chollet is leaving Google by AuryGlenz on Thursday November 14, 2024 @03:06AM (#42134050)

I imagine Black Forest Labs (Flux) is doing alright, at least for now. I still feel like they’re missing out on some hanging fruit financially though.

But yeah, you’re not going to make any money making yet another LLM unless it’s somehow special.

[ Parent | on HN ]

Re:Francois Chollet is leaving Google by ak_111 on Thursday November 14, 2024 @07:52AM (#42135726)

can you please name names? I can't think of any (but am not an expert on the space).

[ Parent | on HN ]

Re:Francois Chollet is leaving Google by versteegen on Thursday November 14, 2024 @04:51AM (#42134587)

Chollet is a leading skeptic of the generality of LLMs (see arcprize.org). He surely isn't doing a startup to train another one.

[ Parent | on HN ]

Re:Francois Chollet is leaving Google by dmafreezone on Thursday November 14, 2024 @12:31AM (#42133388)

Really? Unlimited opportunity? Or is it unlimited stupidity?

    Two things are infinite, the universe and human stupidity, and I am not yet completely sure about the universe. - Einstein

I have to concede here. For a grifter, what is stupidity if not opportunity?

[ Parent | on HN ]