I mean GPT-4 is just so good. Have you compared GPT-4 vs. other models for coding? I'd pay more for GPT-4.

Concur. GPT4 is like having an infinite-energy L3 engineer reporting to me. That's worth $10,000 per month according to the labor market. Sam has been giving away the farm!

People overestimating LLMs like this terrifies me so much

I'd upgrade the parent comment to l4 with broad experience in every single open source tool in existence.

Historically, I'm a backend and distributed systems engineer, but integrating GPT4 into my workflows has unlocked an awe-inspiring ability to lay down fat beads of UI-heavy code in both professional and personal contexts.

But it's still an L3: gotta ask the right questions and doubt every line it produces until it compiles and the tests pass.

I had this disagreement with people on this site just the other day. People basically were like "you're asking it too complicated questions", but my response was then why does everyone make statements like the commenter you replied to?

Because 99.9% of people who say things like this are just using ChatGPT itself and not any of the various awe-inspiring tools with full access to your codebase dynamically inserted into context via RAG. I have yet to talk to anyone who has actually worked for any amount of time against the GPT4 API or through Cursor, say, who underestimates their capabilities. Sincerely hoping this 'coup' doesn't mean the beginning of the end of that experience for most...

> who underestimates their capabilities

Did you happen to mean overestimates? Just trying to make sure I understand.

I just mean people who have actually used the API directly or through task-specific applications like Cursor that are meant to maximize use of AI for their needs know how much of a breakthrough we’ve had this year. People who doubt or downplay the already existing capabilities of this technology tend to have just played with ChatGPT a little bit (or have whatever ideological or other reason to do so).

Context is very important in these kinds of use cases. If you work with something niche, I think these tools are less valuable because the training data becomes sparse.

For example, GPT-4 produces Javascript code far better than it produces Clojure code. Often, when it comes to Clojure, GPT-4 produces broken examples, contradictory explanations, or even circular reasoning.

Have you tried Cursor out of curiosity? No ties to the company and long-time dev (Scala mostly), just genuinely found it to be transformative to my development practice like no tool before.

Why?

It’s wild, I actually downgraded back to gpt 3.5 cuz gpt 4 just wasn’t worth the money.

lol. This is like the HN opposite of the infamous dropbox post.

L3 engineer is a net negative bro.

GPT-4 is so expensive. for reading and editing a text I usually use 6k tokens ends up being 25 cents via api. do it 1000s times you are going to spend a fortune. 0.03 + 0.06 is extremely expensive.

OpenAI’s models are, quality wise, pretty far ahead of competition. So that’s what they’re spending so much money on. There’s a history of creating things that are expensive then rapidly bringing down the cost, which is what they’ve been doing rather than creating GPT-5

Try using Mistral, Lama first then see if your statement is true.

Extrapolate the trends dude. One day, those models will be just as good - you will be able to train them on your codebase’s context, and they will have similar performance.

They have no moat other than training data and computing power - over the long term, while they may become a huge company, Apple will keep making M chip computers.

Feels like something like this plus some deal with microsoft for further funding and sama getting too aggressive with terms and them having him ousted

This also doesn't fit with their recent announcements significantly lowering prices. If they were that worried about losing $ they wouldn't have cut prices, they're the clear leader from a performance perspective and can command a premium.

And up to today they probably had one of the best fundraising prospects of any private company in the world.

How does firing the CEO help in your scenario? Now they just burnt a tonne of trust.

I just bumped our integration with anthropic to P1 above all other priorities - we need a backup plan. I'm also going to be putting more time and money into investigating ways of running a llama2 model on our own hardware financially viable compared to openai and anthropic.... not sure but this is definitely the motivation i needed to see openai could be gone tomorrow.