News for hackers. Stuff that matters.
Re:ChatGPT Pro by xandrius on Thursday December 05, 2024 @03:06PM (#42332138)
Thank you! I always feel so weird to actually use chatgpt without any major issues while so many people keep on claiming how awful it is; it's like people want it 100% perfect or nothing. For me if it gets me 80% there in 1/10 the time, and then I do the final 20%, that's still heck of a productivity boost basically for free.
Re:ChatGPT Pro by lumb63 on Thursday December 05, 2024 @04:17PM (#42332863)
Famously, the last 10% takes 90% of the time (or 20/80 in some approximations). So even if it gets you 80% of the way in 10% of the time, maybe you don’t end up saving any time, because all the time is in the last 20%.

I’m not saying that LLMs can’t be useful, but I do think it’s a darn shame that we’ve given up on creating tools that deterministically perform a task. We know we make mistakes and take a long time to do things. And so we developed tools to decrease our fallibility to zero, or to allow us to achieve the same output faster. But that technology needs to be reliable; and pushing the envelope of that reliability has been a cornerstone of human innovation since time immemorial. Except here, with the “AI” craze, where we have abandoned that pursuit. As the saying goes, “to err is human”; the 21st-century update will seemingly be, “and it’s okay if technology errs too”. If any other foundational technology had this issue, it would be sitting unused on a shelf.

What if your compiler only generated the right code 99% of the time? Or, if your car only started 9 times out of 10? All of these tools can be useful, but when we are so accepting of a lack of reliability, more things go wrong, and potentially at larger and larger scales and magnitudes. When (if some folks are to believed) AI is writing safety-critical code for an early-warning system, or deciding when to use bombs, or designing and validating drugs, what failure rate is tolerable?

Re:ChatGPT Pro by avarun on Thursday December 05, 2024 @04:22PM (#42332906)
> Famously, the last 10% takes 90% of the time (or 20/80 in some approximations). So even if it gets you 80% of the way in 10% of the time, maybe you don’t end up saving any time, because all the time is in the last 20%.

This does not follow. By your own assumptions, getting you 80% of the way there in 10% of the time would save you 18% of the overall time, if the first 80% typically takes 20% of the time. 18% time reduction in a given task is still an incredibly massive optimization that's easily worth $200/month for a professional.

Re:ChatGPT Pro by km3r on Thursday December 05, 2024 @04:35PM (#42333033)
Using 90/10 split: that 10% of the time before being reduced to only take 10% of that makes 9% time savings.

160 hours a month * $100/hr programmer * 9% = $1400 savings, easily enough to justify $200/month.

Even if 1/10th of the time it fails, that is still ~8% or $1200 savings.

Re:ChatGPT Pro by daveguy on Friday December 06, 2024 @03:41AM (#42337701)
Does that count the time you spend on prompt engineering?
Re:ChatGPT Pro by xanderlewis on Thursday December 05, 2024 @04:15PM (#42332841)
It depends what you’re doing.

For tasks where bullshitting or regurgitating common idioms is key, it works rather well and indeed takes you 80% or even close to 100% of the way there. For tasks that require technical precision and genuine originality, it’s hopeless.

Re:ChatGPT Pro by daveguy on Friday December 06, 2024 @03:43AM (#42337712)
Well, that is a very specific set of skills. I bet the C-suite loves it.
Re:ChatGPT Pro by xandrius on Friday December 06, 2024 @05:26AM (#42338351)
I'd love to hear what that is.

So far, given my range of projects, I have seen it struggle with lower level mobile stuff and hardware (ESP32 + BLE + HID).

For things like web (front/back), DB, video games (web and Unity), it does work pretty well (at least 80% there on average).

And I'm talking of the free version, not this $200/mo one.

Re:ChatGPT Pro by crindy on Thursday December 05, 2024 @03:28PM (#42332393)
Yep, I’m with you. I’m a solo dev who never went to college… o1 makes far fewer errors than I do! No chance I’d make it past round one of any sort of coding tournament. But I managed to bootstrap a whole saas company doing all the coding myself, which involved setting up a lot of guard rails to catch my own mistakes before they reached production. And now I can consult with a programming intelligence the likes of which I could never afford to hire if it was a person. It’s amazing.
Re:ChatGPT Pro by thelastparadise on Thursday December 05, 2024 @04:19PM (#42332884)
Is it working?
Re:ChatGPT Pro by crindy on Thursday December 05, 2024 @05:49PM (#42333742)
Not sure what you're referring to exactly. But broadly yes it is working for me - the number of new features I get out to users has sped up greatly, and stability of my product has also gone up.
Re:ChatGPT Pro by daveguy on Friday December 06, 2024 @03:37AM (#42337676)
Are you making money with your saas idea?
Re:ChatGPT Pro by crindy on Friday December 06, 2024 @11:01AM (#42340968)
Yep, been living off it for nine years now
Re:ChatGPT Pro by daveguy on Friday December 06, 2024 @08:10PM (#42346335)
Congratulations! That is not an easy task. I am just starting the journey.
Re:ChatGPT Pro by JamesBarney on Thursday December 05, 2024 @03:27PM (#42332381)
Well now at $200 it's a little farther away from free :P
Re:ChatGPT Pro by thelastparadise on Thursday December 05, 2024 @04:20PM (#42332887)
I could a car for that kind of money!
Re:ChatGPT Pro by xandrius on Friday December 06, 2024 @05:27AM (#42338359)
What do you mean? ChatGPT is free, the Pro version isn't.

I'm talking of the generally available one, haven't had the chance to try this new version.

Re:ChatGPT Pro by CamperBob2 on Thursday December 05, 2024 @05:29PM (#42333581)
I always feel so weird to actually use chatgpt without any major issues while so many people keep on claiming how awful it is;

People around here feel seriously threatened by ML models. It makes no sense, but then, neither does defending the Luddites, and people around here do that, too.