News for hackers. Stuff that matters.
Re:From Deep Learning Foundations to Stable Diffusion (Part 2) by frabia on Wednesday April 05, 2023 @04:56AM (#35451239)
Maybe odd question, but: would you recommend taking this course if my goal is to build (and sell) products leveraging ML? (e.g. SaaS)

As in, with the pace of improvements from other AI startups and general availability of their APIs (e.g. GPT-4), is there a specific advantage (aside from maybe cost) to learning to build my own models? Or is the course more suitable for people wanting to become ML engineers (or similar) and to find a job as such? Thanks in advance

Re:From Deep Learning Foundations to Stable Diffusion (Part 2) by jph00 on Wednesday April 05, 2023 @05:30AM (#35451495)
Part 1 would probably be best for that: https://course.fast.ai . Lots of alums have gone on to do what you describe -- it's probably a good idea to have the level of understanding introduced there even if you mainly use external APIs. Part 2 is more for folks who want to go deeper in order to try new research ideas, optimize their models beyond standard approaches, etc.
Re:From Deep Learning Foundations to Stable Diffusion (Part 2) by bravura on Wednesday April 05, 2023 @06:20AM (#35451847)
Just my two cents, as someone with 8000 academic citations and one AI SaaS exit, on AI entrepreneurship:

The more time you spend on marketing, the better.

We found that as our AI got worse, our product got better.

Re:From Deep Learning Foundations to Stable Diffusion (Part 2) by frabia on Wednesday April 05, 2023 @06:36AM (#35451940)
Thanks for your reply, though I'm not sure if I get your comment correctly. As in, I agree that marketing is super important but if I had an idea about a certain SaaS product that requires a certain ML model, I need to decide either to build it myself, or using somebody else's APIs.

> We found that as our AI got worse, our product got better.

Interesting. Could you elaborate on this too?

Re:From Deep Learning Foundations to Stable Diffusion (Part 2) by bravura on Wednesday April 05, 2023 @12:48PM (#35456999)
I guess my last sentence was confusing. What I meant was that we fell into the common trap that scientists want to do as fancy science as possible when they leave academia and enter the startup world. Because there's an issue of pride and desire for uniqueness. Whereas good business is not like art, where the mandate is to be as creative and unique as possible. The analogy from sports (which I don't watch) applicable to business is that teams just copy each other's plays and focus on out-executing each other.

So, specifically, our startup started with the idea that high-brow tech would be a key differentiator and give the best user experience. This is the common story trotted out by survivorship bias stories that make good tech news articles.

Whereas making cuts to our R&D time and focusing on UI/UX and working with simpler science ultimately led to better product.

From consulting, sales, and corporate work, one learns that the dirty secret of big-iron large tech companies is that all stuff sold as ML is just nicely packaged logistic regression. Or it was was five years ago. Nowadays I guess it would MAYBE be transformers, but the point being that off-the-shelf ML is what drives 99% of good products.

I guess one could take this lesson from science. What you learn from a good PhD advisor is: a) read the latest work b) note the simple baseline approach constantly trashed as scoring 2% worse than the sophisticated intricate new things proposed and c) implement the simple baseline. Achieve impact not by hillclimbing on a standard metric but define a new problem or arbitrage insights from adjacent fields, etc.

Re:From Deep Learning Foundations to Stable Diffusion (Part 2) by frabia on Thursday April 06, 2023 @03:54AM (#35465564)
I see. Much clearer! Thanks for the explanation.
Re:From Deep Learning Foundations to Stable Diffusion (Part 2) by lmpdev on Wednesday April 05, 2023 @07:16AM (#35452238)
Could you elaborate on your last sentence?
Re:From Deep Learning Foundations to Stable Diffusion (Part 2) by tomcam on Wednesday April 05, 2023 @12:21PM (#35456615)
> We found that as our AI got worse, our product got better.

I’m not smart enough to decode this. I can imagine multiple conflicting answers.