News for hackers. Stuff that matters.
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Saturday August 09, 2025 @08:53PM (#44851845)
One of the things that I have realised is, at this moment in time, it's absolutely a bad idea to buy a subscription for any of the models right now.

The offerings are evolving and upgrading at quite a rapid pace, so locking into one company's offering, or another's, is really wasted money (Why pay 200/year upfront for something that looks like it will be outdated within the next month (or quarter))

> The real story is running these models at true performance max likely could go into the thousands per month per user.

A loss leader model like that failed for Uber, because there really wasn't any other constraints on competition doing the same, including under pricing to capture market share - meaning it's a race to the bottom plus a test on whose pockets were the deepest.

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by wood_spirit on Saturday August 09, 2025 @09:18PM (#44851967)
AI pricing is stuck on subscription rather than metering which means that it’s a race to the bottom. It’s not obvious how AI providers can change that as the service they offer is just a game to users who can, even reluctantly, switch off.
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Saturday August 09, 2025 @09:41PM (#44852087)
I THINK that they are going to have to change pretty soon, I would guess that they would either drop their free tier offerings OR find another way to pay for things (advertising maybe?)

I'm not enough of a Business Major to know how they could monetise things, but I am enough of a realist to think that they can't stay like this forever

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by disgruntledphd2 on Monday August 11, 2025 @09:48AM (#44864030)
> I THINK that they are going to have to change pretty soon, I would guess that they would either drop their free tier offerings OR find another way to pay for things (advertising maybe?)

I would be incredibly surprised if OpenAI didn't go for advertising, given that they hired Fidji Simo (who PM'd feed ads at Facebook, and introduced ads to Instacart).

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by wood_spirit on Monday August 11, 2025 @12:09PM (#44865879)
The OpenAI pitch deck for product placement was leaked over a year ago now
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by heyoni on Saturday August 09, 2025 @09:13PM (#44851939)
Just pay per month then.
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Saturday August 09, 2025 @09:20PM (#44851988)
Even a monthly payment is unnecessary at this moment - again the evolution of the quality of the models, but also the free tier offerings for each model (you can still use the older model's free tier, it was working enough before)

I personally haven't tried GPT 5 yet, but I am getting all I need from Claude and Gemini.

Once I start experimenting with GPT 5.0 - I will still use Claude and Gemini when I run out of free uses.

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by heyoni on Saturday August 09, 2025 @10:58PM (#44852449)
Your argument was not to get into a long term commitment because then you might have to wait a year to be able to use the best model again...not that you could get by using a rotating cast of free tier AI models...
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Saturday August 09, 2025 @11:51PM (#44852627)
You are complaining that i have multiple options available to me for not paying for a subscription.

The reason for not buying into a monthly subscription is not a reason thati should put shouldn't buy a year long one and is not negated in any way

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by heyoni on Saturday August 09, 2025 @11:58PM (#44852657)
No one's mad at you. You just switched your arguments.

As for why pay for access when you can get on free tiers? Well, because the pay models are far far better than the free ones. That's it.

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Sunday August 10, 2025 @01:02AM (#44852869)
See, you keep making these accusations. Nothing got switched.

Your idea wasn't valid, no need for all the nastiness

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by diego_sandoval on Saturday August 09, 2025 @10:25PM (#44852310)
The annoyance of having to switch to a different model and losing my context is enough for me to pay the 20 dollars a month.

These models make me much more productive anyway. That is worth far more than $20.

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Sunday August 10, 2025 @01:07AM (#44852896)
I've had Claude tell me that I've reached the maximum messages for a session, which was painful.

Having said that it was a good circuit breaker, Claude was stuck on three wrong solutions to an issue, and having to re explain it meant that I realised what the bug was without further input from Claude

edit: FTR where Claude was stuck (and where it helped me)

First, I have a TUI application, written in Go, that is using https://github.com/rivo/tview - I chose tview basically at random, having no background in any of the TUI libraries available, but tview looked like it was easy to understand.

I had written some of the code, but it wasn't doing what I wanted of it. I had gotten Gemini to help me, but it still wasn't doing what I wanted.

Claude first suggested that the application needed to be refactored to make it into an Event Driven MVC TUI app, which I absolutely agreed with.

Claude counselled me on my understanding of the Run() command, and how it was a blocking call (which I hadn't realised). The refactor/re-architecture fixed the way things were being run a great deal.

However I still had a bug that I could not fix, and Claude was equally stumped (as was Gemini)

When I clicked on any of the components in a flex row, the first component behaved as though it was the one that was clicked. When I clicked on any of the components in another flex row the last one behaved as though it was the one that had been clicked.

Claude repeatedly told me that the problem was that the closure that used the index of components (inside a loop) was the problem.

This was outright wrong because

1. That bug has been fixed in Go.

2. The code I was sharing with Claude had the "fix" of local := index - meaning that the local version should have been correct

3. I repeatedly showed Claude logs (that it suggested I create) that showed that ALL of the components were in fact receiving the click event.

The second solution that Claude was fixated on was that th components overlapped one another inside the flex box.

This was partially incorrect.

I told Claude that I could visually see that the components weren't overlapping.

I also told Claude that there were borders around each component that clearly weren't overlapping.

I gave Claude debug logs that showed that the mouse click co-ordinates were inside a single component.

The third issue that Claude claimed was the problem was a click propagation bug in the library.

Claude repeated these claims several times, despite me showing that it wasn't either of the first two things, and I could not find a bug/issue for the third.

The circuit breaking made me stop and think about things, and I realised that all I really had to do was say inside the box "If a click event has been received AND (and this was the fix) You (the component) now have focus then behave".

What I suspect is happening is that the flex box container receives the click, and then tells all of its children that a click happened.

What disappoints me is, if what I suspect is true, then I would have expected Claude to have known that either from the tview documentation OR from reading the tview code (Claude does seem well acquainted with the library)

If my suspicion is correct then the second and third issues Claude claimed were causing me the bug were partially true, that is the flex container is on top of the components, which is an overlap, just not the components themselves overlapping.

The second partial correctness is that the way that the click is being propagated to the components seems to be that the flex box container is telling all of its child components that a click occurred. This isn't really a bug, it's likely well documented (as if I would RTFM...) or clear from the code.

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by jgb1984 on Sunday August 10, 2025 @03:07AM (#44853343)
I don't understand how you can have the patience to deal with an LLM like that. As if you're dealing with a low skilled but highly stubborn intern. Sounds like an awful waste of time to me.
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Sunday August 10, 2025 @03:22AM (#44853408)
Ha!

I have been a SWE for about 15 years, the majority of my career has been dealing with people that have about the same understanding as the LLMs, who scream abuse at me because their suggested solutions were invalid (in fact you can see someone heading down that path in another thread on this page)

The LLMs are less likely to run to HR when I tell them to eff 0ff with their stupidity (tested - told Claude that it had already effing suggested the bad index one and it was wrong because..., to which it politely apologised.. and re-suggested another one of its three suggestions)

So, from that point of view - LLMs are superior to some of the "senior" developers I have the misfortune of having to deal with previously.

As for my patience - I don't think I am being patient so much as doggedly determined to finding what I know is a fixable bug, that is, I will just keep gnawing at what I think should be fixable until a solution comes along, or I find something else shiny to occupy my spare time with (this being two side projects - the code and the testing of how good LLMs really are)

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by heyoni on Sunday August 10, 2025 @11:22AM (#44855816)
If people are constantly running to HR in your midst then you might not be the mentor you think you are.
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Sunday August 10, 2025 @05:05PM (#44858268)
exhibit c - this is the guy that is also exhibit a

FTR, me being told what to do by the other individual hardly sounds like I'm the one mentoring... but failure to read and comprehend has already proved to be your style.

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by heyoni on Sunday August 10, 2025 @06:19PM (#44858800)
The last word.
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Sunday August 10, 2025 @06:42PM (#44858946)
Oh dear.
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by ahartmetz on Sunday August 10, 2025 @06:36AM (#44854244)
A click event being sent to all elements inside a container if it clearly occurred on just one is what I'd consider an event propagation bug. I've never seen that happen before. Even if it's documented, it's pretty strange.
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by awesome_dude on Sunday August 10, 2025 @05:03PM (#44858255)
exhibit b.
Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by theshrike79 on Tuesday August 12, 2025 @05:03AM (#44874001)
Yep, LLMs tend to get into weird snags like this, usually with either niche or state of the art stuff.

I tried to get a game prototype up and running with https://spacetimedb.com - GPT-5 was clearly working with outdated information and couldn't get anything done. It just reverted back to things that didn't exist (commands had changed, their arguments were different).

Same project, same GPT-5. This time it went in weird circles when I tried to use Deno as the backend. First it understood how to import Phaser to Deno, then it forgot. Then it remembered. Then it forgot. All within the same conversation with us trying to get SOMETHING on the browser =)

Re:GPT-5: Overdue, overhyped and underwhelming. And that's n... by kldg on Sunday August 10, 2025 @07:01AM (#44854361)
I can definitely understand that it feels like looking at early adopters of technology with hindsight. Calculators, home/office computers, media players.

BUT, of course, if you can get more value out of it inside a month or year than you put in, it doesn't really matter. Differences between frontier models feels pretty low to me currently, which was not always the case; even so, they're certainly far ahead of free models for my uses.

I did pay for OpenAI both in a $20/mo subscription and later for API tokens (came out cheaper than the subscription). Since Gemini 2.5 came out, though, I just abuse Google's free AI Studio (at least free in the US; idk what kind of geo-gating they do). I'm not paying Google, but they are keeping me from paying their competitors. It will take a large and hard-gated leap forward (or Google deciding my $150-250 worth of unpaid use has gone on long enough) to get me to pay again.