News for hackers. Stuff that matters.
Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @04:52PM (#40869881)
How can anyone not see just how impactful it's going to be? Or already is? I can't think of a single recent technology that was so widely adopted by tech and non-tech people alike, immediately integrated into day-to-day experience. The rise of mobile phones and e-commerce in the 90s would be the last time I've seen this happen (I'm not counting smartphones, as those are more of an iteration). Or social media, in purely software space.

I've just had GPT-4o write me a full-featured 2048 clone in ~6 hours of casual chat, in between of work, making dinner, and playing with kids; it cost me some $4 in OpenAI bills, and I didn't write a single line of code. I see non-tech people around me using ChatGPT for anything from comparison shopping to recipe adjustments. One person recently said to me that their dietitian is afraid for their career prospects because ChatGPT is already doing this job better than she is. This is a small fraction of cases in my family&friends circle; anyone who hasn't lived under the rock, or wasn't blinded by the memetic equivalent of looking at a nuclear weapon detonation, likely has a lot of similar things to say. And all of that is not will, it's is, right now.

Re:AI's $600B Question by cfeduke on Wednesday July 03, 2024 @06:14PM (#40870494)
Okay I guess I've just had a different experience entirely. Maybe I'm jaded by hallucinations.

The code ChatGPT generates is often bad in ways that are hard to detect. If you are not an experienced software engineer, the defects could be impossible to detect, until you/ChatGPT has gone and exposed all your customers to bad actors, or crash at runtime, or do something terribly incorrect.

As far as other thought work goes, I am not consulting ChatGPT over, say, a dietician or a doctor. The hallucination risk is too high. Producing an answer is the not the same as producing a correct answer.

Re:AI's $600B Question by itsoktocry on Wednesday July 03, 2024 @06:59PM (#40870855)
If your procees is asking it to "write me all this code", then you slap it in production, you're going to have a bad time. But there's intermediate ground.

>I am not consulting ChatGPT over, say, a dietician or doctor

Do you know any doctors, by chance? You have way more faith in experts than I do.

Re:AI's $600B Question by kortilla on Wednesday July 03, 2024 @07:37PM (#40871092)
ChatGPT is just statistically associating what it’s observed online. I wouldn’t take dietary advice from the mean output of Reddit with more trust than an expert.
Re:AI's $600B Question by interstice on Wednesday July 03, 2024 @07:46PM (#40871142)
Doctors can be associating what they’ve learned, often with heavy biases from hypochondriacs and not enough time per patient to really consider the options.

I’ve had multiple friends get seriously ill before a doctor took their symptoms seriously, and this is a country with decent healthcare by all accounts.

Human biases are bad too.

Re:AI's $600B Question by abraae on Thursday July 04, 2024 @12:22AM (#40872310)
> Doctors can be associating what they’ve learned, often with heavy biases from hypochondriacs

So true. And it's hard to question a doctor's advice, because of their aura of authority, whereas it's easy to do further validation of an LLMs diagnosis.

I had to change doctor recently when moving towns. It was only when chancing on a good doctor that I realised how bad my old doctor was - a nice guy but cruising to retirement. And my experience with cardiologists has been the same.

Happy to get medical advice from an LLM though I'd certainly want prescriptions and action plans vetted by a human.

Re:AI's $600B Question by throwaway2037 on Thursday July 04, 2024 @01:17AM (#40872482)

    > It was only when chancing on a good doctor that I realised how bad my old doctor was
How did you determine the new doctor is "good"?
Re:AI's $600B Question by theshackleford on Thursday July 04, 2024 @02:19AM (#40872748)
By the time a doctor paid me enough attention to realise something was wrong I had suffered a spinal cord injury whose damage can never be reversed. I’m not falling all over myself to trust chatgpt, but I got practically zero for doctors either. Nobody moved until I threatened to start sueing.
Re:AI's $600B Question by XajniN on Wednesday July 03, 2024 @10:40PM (#40871908)
I’ve seen so many doctors advertising or recommending homeopathic “medicines” or GE-132 [1], that I would be fairly more confident in an LLM + my own verification from reliable sources. I’m no doctor, but I know more than enough to recognize bullshit, so I wouldn’t just recommend this approach to everyone.

[1] https://pubmed.ncbi.nlm.nih.gov/1726409/

Re:AI's $600B Question by TeMPOraL on Thursday July 04, 2024 @02:09AM (#40872704)
You realize that "online" doesn't just mean Reddit, but also Wikipedia and arXiv and PubMed and other sources perused by actual experts? ChatGPT read more academic publications in any field than any human.
Re:AI's $600B Question by kortilla on Friday July 05, 2024 @11:26AM (#40883561)
Yes, but because ChatGPT doesn’t think, it doesn’t know which arxiv papers are absolute garbage and which ones are legit.

Wikipedia does not have dietary advice. It’s an encyclopedia.

Re:AI's $600B Question by aworks on Thursday July 04, 2024 @12:48PM (#40876298)
I sometimes use ChatGPT to prepare for a doctor's visit so I can have a more intelligent conversation even if I may have more trust overall in my doctor than in AI.
Re:AI's $600B Question by fennecfoxy on Friday July 05, 2024 @11:31AM (#40883619)
Will be cool once we have active agents tho. Surely the learning/research process isn't that difficult even for current LLMs/similar architectures. If it can teach itself, or it can collate new (never seen) data for other models then that's the cool part.
Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:28PM (#40870593)
My experience actually agrees with you. It's just that the set of use cases that either:

- Are hard (or boring) to do, but easy to evaluate - for me, e.g. writing code, OCR, ideation; or

- Don't require a perfectly correct answer, but more of a starting point or map of the problem space; or

- Are very subjective, or creative, with there being no single correct answer,

is surprisingly large. It covers pretty much everything, but not everything for everyone at the same time.

Re:AI's $600B Question by ignoramous on Wednesday July 03, 2024 @06:40PM (#40870700)
> Okay I guess I've just had a different experience entirely.

I've seen both the good and the bad. I really like the good parts. Most recently, Claude Sonnet 3.5 fixed a math error in my code (I prompted it to check for it from a well-written bug report, and it did it fix it ever so perfectly).

These days, it is pretty much second nature for me to pull up a new file & prompt Copilot to complete writing the entire code from my comment trails. I don't think I've seen as much change in my coding behaviour since Borland Turbo C -> NetBeans.

Re:AI's $600B Question by nvarsj on Wednesday July 03, 2024 @06:47PM (#40870765)
I agree. I've just seen it hallucinate too many things that on the surface seem very plausible but are complete fabrications. Basically my trust is near 0 for anything chatgpt, etc. spits out.

My latest challenge is dealing with people that trust chatgp to be infallible, and just quote the garbage to make themselves look like they know what they are talking about.

Re:AI's $600B Question by gwervc on Wednesday July 03, 2024 @07:10PM (#40870931)
> things that on the surface seem very plausible but are complete fabrications

LLMs are language model, it's crazy people expect them to be correct in anything beyond surface level language.

Re:AI's $600B Question by nvarsj on Thursday July 04, 2024 @05:09AM (#40873470)
Yeah, I was probably being a bit too harsh in my original comment. I do find them useful, you just have to be wary of the output.
Re:AI's $600B Question by sumedh on Wednesday July 03, 2024 @06:32PM (#40870626)
> The code ChatGPT generates is often bad in ways that are hard to detect.

Does it work though, yes it does. There are many human coders who write bad code and life goes.

Re:AI's $600B Question by CuriouslyC on Wednesday July 03, 2024 @07:12PM (#40870939)
Easy answer. Ask ChatGPT to write testable code, and tests for the code, then just verify the tests. If the tests don't work, have ChatGPT use the test output to rewrite the code until it does.

If you can't have ChatGPT write testable code because of your architecture, you have other problems. People with bad process and bad architecture saying AI is bad because it doesn't work well with their dumpster fire systems, 100% facepalm.

Re:AI's $600B Question by aleph_minus_one on Thursday July 04, 2024 @12:33PM (#40876179)
> If you can't have ChatGPT write testable code because of your architecture, you have other problems.

There exist lots of reasons why code is hard to test automatically that have nothing to do with the architecture of the code, but with the domain for which the code is written and runs.

Re:AI's $600B Question by ern on Wednesday July 03, 2024 @09:30PM (#40871627)
I recently needed to help a downstream team with a problem with an Android app. I never did mobile app dev before, but I was able to spin up a POC (having not coded in Java for 22 years) and solve the problem with the help of ChatGPT 4.0.

Sure I probably would have been able to do it without ChatGPT, but it was so much easier to have something to bounce ideas off-of. A safety net, if you will.

The hallucination risk was irrelevant: it did hallucinate a little early on. I told it it was a hallucinating, and we moved onto a different way of solving the problem. It was easy enough to verify it was working as expected.

Re:AI's $600B Question by gexla on Thursday July 04, 2024 @12:10AM (#40872267)
Seems to me this is the equivalent of fast retrieval and piecing together from a huge amount of examples in the data. This might take far more time if you were to do this yourself. That's a plus for the tools. In other words, a massively expensive (for the service provider) auto-complete.

But try to do something much more simple but has much fewer examples (a typical case is something which has bad documentation) in the data, and it falls apart. I even tried to use Perplexity to create a dead simple CLI command, and it hallucinated an answer (looking at the docs, it misused the parameter, and may have picked up on someone who gave an incorrect answer in the data.)

Re:AI's $600B Question by dmix on Thursday July 04, 2024 @01:55AM (#40872636)
It's already gotten significantly better and faster in a few yrs. Maybe LLMs will hit a wall in the next 5yrs but even if it does it's still extremely useful and there are always other ways to optimize the current technology where this is already a major development for society.
Re:AI's $600B Question by jakderrida on Thursday July 04, 2024 @02:52AM (#40872899)
>The code ChatGPT generates is often bad in ways that are hard to detect. If you are not an experienced software engineer, the defects could be impossible to detect

I keep hearing this, but it's incorrect. While I only know R, which is obviously a simple language, I would never type out all my code and go without testing to ensure it does what I intended before using it regularly.

So I can't imagine someone that knows a more complex language just typing out all of it before integrating it into business systems at their work or anything else before testing it.

Why would AI be any different?

Why the hell are AI skeptics acting like getting help from an LLM would involve not testing anything? Of course I test it! Why on earth wouldn't I? Just as I tested code made by freelancers I hired on commission before using the code I bought from them. Do AI skeptics really not test their own code? Are you all insane?

Re:AI's $600B Question by disgruntledphd2 on Thursday July 04, 2024 @04:54AM (#40873423)
> While I only know R, which is obviously a simple language

Take it from someone who started with R, R is 100% not a simple language. If you can write good R, you're probably a surprisingly good potential SE as R is kinda insane and inconsistent due to 50+ years of history (from S, to R etc).

Re:AI's $600B Question by jakderrida on Thursday July 04, 2024 @06:01AM (#40873697)
Hmmm.. I'm trying to imagine interviewing for SE and telling them I got wealthy from a crypto market-making algorithm I coded in R during Covid and the interviewer responding with anything but laughter or with silence as they ponder legal ways to question my mental health.

It's an excellent language, I think, for many reasons. One is that you can work with data within hours because even before learning what packages or classes are, you got native objects for data storage, wrangling, and analysis. Even import my Excel data and rapidly learn the native function cheat sheet so fast that I was excited to learn what packages are because I couldn't wait to see what I could do.

That was my experience in like 2010, maybe, and after having C++ and Python go in and out my head during college multiple times. I view R as simple only because I actually felt more helpless to keep learning it than helpless to ever learn coding at all. Worth noting that I was a Stat/Probability tutor with a Finance degree and much Excel experience.

Re:AI's $600B Question by disgruntledphd2 on Thursday July 04, 2024 @06:18AM (#40873756)
> That was my experience in like 2010, maybe, and after having C++ and Python go in and out my head during college multiple times. I view R as simple only because I actually felt more helpless to keep learning it than helpless to ever learn coding at all. Worth noting that I was a Stat/Probability tutor with a Finance degree and much Excel experience.

Ah yeah, makes sense. That's the happy path for learning R (know enough stats etc to decode the help pages).

That being said, R is an interesting language with lots of similarities to both C based languages and also Lisp (R was originally a scheme intepreter), so it's surprisingly good at lots of things (except string manipulation, it's terrible at that).

Re:AI's $600B Question by remarkEon on Thursday July 04, 2024 @03:31AM (#40873064)
>The code ChatGPT generates is often bad in ways that are hard to detect. If you are not an experienced software engineer, the defects could be impossible to detect, until you/ChatGPT has gone and exposed all your customers to bad actors, or crash at runtime, or do something terribly incorrect.

I wonder about this a lot, because there's a future here where a decent amount of software engineering is offloaded to these AIs and we reach a point, in the near future, where no one really knows or understands what's going on. That seems bad. Put another way, suppose that your primary care doctor is really just using MedAI to diagnose and recommend treatment for whatever it is you went in to see him about. Over time, these sorts of shortcuts metastasize and the doctor ends up not really knowing anything about you, or the other patients, or what he's really doing as a doctor ... it's just MedAI (with whatever wrongness rate is tolerable for the insurance adjusters). Again, seems bad. There's a palpable loss of human knowledge here that's enabled by a "tool" that's allegedly going to make us all better off.

Re:AI's $600B Question by disgruntledphd2 on Thursday July 04, 2024 @04:52AM (#40873416)
The closest analogy here is that we don't have as full-featured autopilots in airplanes as we could, because they reduce safety.
Re:AI's $600B Question by remarkEon on Thursday July 04, 2024 @01:42PM (#40876695)
Right, good point. Maybe I'm making an argument that some features, or scope of features, should be highly regulated along the same lines.
Re:AI's $600B Question by dimgl on Wednesday July 03, 2024 @08:14PM (#40871277)
I actually don't think it's going to be that impactful. It often gets everything wrong. Today I asked ChatGPT questions about a game I used to play. It got it all wrong. I've recently asked questions about coding. A majority of it is also wrong. I've tried using it in a professional setting and it's also hit or miss.

I'm not saying AI is useless but it's certainly not the panacea that some say it is.

Re:AI's $600B Question by tempusalaria on Wednesday July 03, 2024 @06:37PM (#40870681)
Being able to create 2048 in 6 hours has basically zero economic value.

Can ChatGPT materially and positively impact the code written by big companies? Can it do meaningful work in excel? Can it do meaningful PowerPoint work? Can it give effective advice on management?

Right now we don’t know the answer to those questions. LLM apps can still improve in many ways - better base models, better integration with common enterprise applications, agentic processes, verifiability and so on - so there is definitely hope that there will be significant value created. Companies and people are excited because there’s huge potential. But it is really just potential right now … current systems aren’t creating real enterprise value at this moment in time

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:43PM (#40870734)
> Can ChatGPT materially and positively impact the code written by big companies? Can it do meaningful work in excel? Can it do meaningful PowerPoint work? Can it give effective advice on management?

> Right now we don’t know the answer to those questions.

I know the answer to the first three. Yes, yes, and yes. I've done them all, including all of them in the past few weeks.

(Which is how I learned that it's much better to ask ChatGPT to use Python evaluation mode and Pandoc and make you a PPTX, than trying to do anything with "Office 365 Copilot" in PowerPoint...)

As for the fourth question - well, ChatGPT can give you better advice than most advice on management/leadership articles, so I presume the answer here is "Yes" too - but I didn't verify it in practice.

> current systems aren’t creating real enterprise value at this moment in time

Yes, they are. They would be creating even more value if not for the copyright and exports uncertainty, which significantly slows enterprise adoption.

Re:AI's $600B Question by WgaqPdNr7PGLGVW on Wednesday July 03, 2024 @06:54PM (#40870817)
> I know the answer to the first three. Yes, yes, and yes.

You say this but from a management perspective at a large enterprise software company I have not seen it.

Some of our developers use copilot and gpt and some don't and it is incredibly difficult to see any performance difference between the groups.

We aren't seeing higher overall levels of productivity.

We aren't seeing the developers who start using copilot/gpt rush ahead of their peers.

We aren't seeing any ability to cut back on developer spend.

We aren't seeing anything positive yet and many developers have been using copilot/gpt for >1 year.

In my opinion we are just regaining some of the economic value we lost when Google Search started degrading 5-10 years ago.

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:59PM (#40870858)
> We aren't seeing higher overall levels of productivity.

You can't measure productivity for shit, otherwise companies would look entirely differently. Starting from me not having to do my own finances or event planning or hundred other things that are not my job description, not my specialty, and which were done by dedicated staff just a few decades ago, before tech "improved office productivity".

> We aren't seeing the developers who start using copilot/gpt rush ahead of their peers.

That's because individual productivity is usually constrained by team productivity. Devs rushing ahead of their teammates makes the team dysfunctional.

> We aren't seeing any ability to cut back on developer spend.

Devs aren't stupid. They're not going to give you an opportunity if they can avoid it.

> We aren't seeing anything positive yet and many developers have been using copilot/gpt for >1 year.

My belief is that's because you aren't measuring the right things. But then, no one is. This is a problem well-known to be unsolved.

Re:AI's $600B Question by WgaqPdNr7PGLGVW on Wednesday July 03, 2024 @07:17PM (#40870969)
> You can't measure productivity for shit

We can't measure small changes and we aren't great at comparing across orgs.

However, at the director level we can certainly see a 50% or 100% productivity improvement in our teams and with individuals in our teams.

We aren't seeing changes of this magnitude because they don't exist.

Re:AI's $600B Question by WgaqPdNr7PGLGVW on Wednesday July 03, 2024 @07:26PM (#40871030)
There are other potential explanations.

Perhaps developers are now slacking off.

Perhaps we have added more meetings because developers have more free time.

Or perhaps developers were never the bottleneck.

We can see large productivity improvements when we make simple changes like having product managers join the developers daily standup meetings. We can even measure productivity improvements from Slacks/Zooms auto-summary features. Yet gpt/copilot doesn't even register.

Re:AI's $600B Question by Vegenoid on Wednesday July 03, 2024 @08:42PM (#40871406)
> We can even measure productivity improvements from Slacks/Zooms auto-summary features.

While not code generation, this auto-summary is powered by the same tech. I think using it to sift through and surface relevant information, as opposed to generation of new things, will have the biggest impact.

By far the greatest value I get out of LLMs is asking them to help me understand code written by others. I feel like this is an under-appreciated use. How long has this feature been in Copilot? Since February or so? Are people using it? I do not use Copilot.

Re:AI's $600B Question by SanderNL on Thursday July 04, 2024 @04:01AM (#40873189)
> Or perhaps developers were never the bottleneck.

Now that's dangerous thinking, but I think you are onto something.

Re:AI's $600B Question by bongodongobob on Wednesday July 03, 2024 @08:18PM (#40871294)
I use ChatGPT copilot etc to reduce my cognitive load and get a lot of things done quicker so I also have more time to fuck around. You're out of your goddamn mind if you think I'm going to increase my output for the mere chance that maybe I'll get an above inflation raise in a year. "We gave our devs a magic 10% productivity boost machine, but their output hasn't increased? I guess the machine doesn't work..." It's amusing how out of touch you are.
Re:AI's $600B Question by amanaplanacanal on Thursday July 04, 2024 @10:06AM (#40875077)
There is an ethical question in here that I don’t have an answer for. As an employee, I find a way to do my job more efficiently. Do I hand those efficiencies to my employer so I can get a pat on the head, or do I keep them to myself to make my own life less stressful? If I give them to the boss, do they even have the ability to increase my pay? Using the extra time to slack off rather than enriching the employer might be the best choice.

Edit: and now I see chillfox made the same point.

Re:AI's $600B Question by bongodongobob on Monday July 08, 2024 @01:54AM (#40902908)
Keep it to yourself. Your reward is just going to be more work.
Re:AI's $600B Question by mbernstein on Wednesday July 03, 2024 @07:32PM (#40871067)
Out of curiosity what are you using to measure developer productivity platform or metrics wish (if beyond typical sprint metrics)?
Re:AI's $600B Question by afro88 on Wednesday July 03, 2024 @07:12PM (#40870942)
Writing code is just one part of the process. Other bottlenecks might prevent you from seeing overall productivity improvements.

For example:

- time between PRs being created and being picked up for review and merged

- time spent on releasing at end of sprint cycles

- time spent waiting for QA to review and approve

- extreme scrum practices like "you can only work on things in the sprint, even if all work is done"

How are you measuring developer productivity? Were those that adopted copilot and chatgpt now enabled to finally keep up with their faster peers (as opposed to outstrip them)? Is developer satisfaction improved, and therefore retention?

Re:AI's $600B Question by WgaqPdNr7PGLGVW on Wednesday July 03, 2024 @07:38PM (#40871101)
Yes, other bottlenecks might be preventing us from seeing overall productivity improvements. We might require large organisational changes across the industry in order to take advantage of the improvements.

I guess we will see if smaller startups without many of our bottlenecks are suddenly able to be much more competitive.

> How are you measuring developer productivity?

We use a host of quantitative and qualitative measures. None of them show any positive improvements. These include the basics like roadmap reviews, demo sessions, feature cycle time, etc as well as fairly comprehensive business metrics.

In some teams every developer is using copilot and yet we can't see any correlation with it and improved business metrics.

At the same time we can measure the impact from changing the label on a button on our UI on these business metrics.

> Were those that adopted copilot and chatgpt now enabled to finally keep up with their faster peers

No.

> Is developer satisfaction improved, and therefore retention?

No.

Re:AI's $600B Question by afro88 on Thursday July 04, 2024 @12:20AM (#40872302)
> We use a host of quantitative and qualitative measures. None of them show any positive improvements. These include the basics like roadmap reviews, demo sessions, feature cycle time, etc as well as fairly comprehensive business metrics.

Those are very high level. If there's no movement on those, I'd guess there are other things bottlenecking the teams. They can code as fast as possible and things still move at the same pace overall. Nice thing to know.

If you want to really test the hypothesis that Copilot and ChatGPT have no impact on coding speed, look at more granular metrics to do with just coding. The average time from the moment a developer picks up a work item to the time it gets merged (assuming code reviews happen in a timely fashion). Hopefully you have historical pre-AI data on that metric to compare to.

Edit: and average number of defects discovered from that work after merge

Re:AI's $600B Question by WgaqPdNr7PGLGVW on Thursday July 04, 2024 @02:24AM (#40872774)
> look at more granular metrics to do with just coding. The average time from the moment a developer picks up a work item to the time it gets merged (assuming code reviews happen in a timely fashion)

We do collect this data.

I personally don't put a lot of stock in these kinds of metrics because they depend far too much on the way specific teams operate.

For example perhaps Copilot helps developers understand the codebase better so they don't need to break up the tasks into such small units. Time to PR merge goes up but total coding time could easily go down.

Or perhaps Copilot works well with very small problem sizes (IMO it does) so developers start breaking the work into tiny chunks Copilot works well with. Time to PR merge goes way down but total code time for a feature stays the same.

For what it is worth I do not believe there have been any significant changes with these code level metrics either at the org level.

Re:AI's $600B Question by afro88 on Thursday July 04, 2024 @04:29PM (#40877797)
Have a chat to the developers and see if having copilot / chatgpt available has influenced how they break their PRs down first.
Re:AI's $600B Question by CuriouslyC on Wednesday July 03, 2024 @07:08PM (#40870913)
If you write a spaghetti system where collecting the context for the AI is a big time sink, and there are so many service/language barriers that AI get confused, of course AI is going to suck. Of course, if you give your programmers a game pad and tell them to use it to program with a virtual keyboard, they're gonna suck ass too, so you should consider where the fault really lies.
Re:AI's $600B Question by Sysreq2 on Wednesday July 03, 2024 @07:36PM (#40871089)
Is it the superstars or the line holders that have been the first adopters? I could speculate, but I am actually curious what you are seeing in practice.
Re:AI's $600B Question by WgaqPdNr7PGLGVW on Wednesday July 03, 2024 @07:46PM (#40871145)
The first adopters seem to be the same group / personality type that is always first to adopt new technologies.

Very few of these are the superstars. But plenty are good solid senior developers.

Re:AI's $600B Question by chillfox on Wednesday July 03, 2024 @09:08PM (#40871517)
Passing on personal productivity gains to management is always a HUGE L for the individual worker.

As a dev, you can use the saved time to slow down and not be stressed, spend more time chatting with colleagues, learn new skills, maybe improve the quality of the code, etc. Or you can pass it on to management which will result in your workload being increased back to where you are stressed again and your slower colleagues will be let go, so now you get to feel bad about that and they won't be around to chat with.

I have never in my life seen workers actually get rewarded with pay raises for improved productivity, that is just a myth the foolish chase, like the pot of gold at the end of the rainbow.

I have also tried being the top performer on a team before (using automation tools to achieve it), and all I got was praise from management. That's nice, but I can't pay for my holidays with praise, so not worth it.

Re:AI's $600B Question by SanderNL on Thursday July 04, 2024 @03:58AM (#40873173)
> We aren't seeing higher overall levels of productivity.

> We aren't seeing the developers who start using copilot/gpt rush ahead of their peers.

You think we are antsy worker bees, hastily rushing forwards to please the decision maker with his fancy car?

You are leadership. It's not hard. Cui bono, follow the money, etc. The incentives are clear.

If me and my peers were to receive a magic "do all my work for me" device I can assure you exactly zero percent of that knowledge will reach your position. Why would it? The company will give me a pat on the back. I cannot pay with pats on the back. Your Tesla cannot be financed with pats on the back. Surely you understand the nature of this issue.

Re:AI's $600B Question by tempusalaria on Wednesday July 03, 2024 @07:42PM (#40871121)
I think you’re thinking about things very locally. Of course ChatGPT can help with some coding - I use it for regex quite often cause I never really learned that well.

The problem is that at the average medium sized company code looks like this - you have 1mln lines of code written over a decade by a few hundred people. A big portion of the code is redundant, some of it is incomplete, much of it is undocumented. Different companies have different coding styles, different testing approaches, different development dynamics. ChatGPT does not appreciate this context.

Excel has some similar problems. First of all Excel is 2 dimensional and LLMs really don’t think in 2 dimensions well. So you need to flatten the excel file for the LLM. A common approach to do this with LLMs is using pandas and then using the column and row names to index into the excel.

Unfortunately, excels at companies cannot be easily read using pandas. They are illogically structured, have tons of hardcoding, intersheet referencing is weird circular ways and so on. I spent some time in finance and sell side equity research models are written by highly trained financial analysts and are substantially better organized than the average excel model at a company. Even this subset of real world models is far from suitable for a direct pandas interpretation. Parsing sell side models requires a delicate and complex interpretation before being fed into an LLM.

Re:AI's $600B Question by kortilla on Wednesday July 03, 2024 @07:40PM (#40871110)
>Which is how I learned that it's much better to ask ChatGPT to use Python evaluation mode and Pandoc and make you a PPTX, than trying to do anything with "Office 365 Copilot" in PowerPoint...

Can you elaborate on what this saved over just making the ppt the old fashioned way?

Re:AI's $600B Question by TeMPOraL on Thursday July 04, 2024 @03:35AM (#40873079)
"I have this set of notes attached below; would you kindly group them by X and tabulate, and then use Python with Pandoc to make me a PowerPoint with that table in it, plus an extra slide with commentary from the notes?"

Attach notes, paste, press Enter, wait half a minute, get back a PPTX you can build on, or just restyle[0].

Sure, it's faster to build the presentation yourself than to make ChatGPT make the whole thing for you. But the more time-consuming and boring parts, like making tables and diagrams and summaries from external data or notes, is something ChatGPT can do in a fraction of time, and can output directly into PPTX via Pandoc.

(There's a lot of fun things you can do with official ChatGPT and Python integration. The other day I made it design, write and train a multi-layer perceptron for playing tic-tac-toe, because why waste my own GPU-seconds :).)

--

[0] - In contrast, if you make the same request in PowerPoint's O365 Copilot, it'll barf. Last time I tried, it argued it has no capability to edit the document; the time before that, it made a new slide with text saying literally "data from the previous message".

Re:AI's $600B Question by mdorazio on Wednesday July 03, 2024 @07:11PM (#40870935)
> Can ChatGPT materially and positively impact the code written by big companies?

It already has at a Fortune 100 company I contract with currently.

> Can it do meaningful work in excel?

We can quibble about what "meaningful" means, but it satisfactorily answered questions for two friends about how to build formulas for their datasets and is currently being used to summarize data insights from a database at a different large client (Excel =/= database, but the point stands).

> Can it do meaningful PowerPoint work?

I've used Midjourney multiple times a month to generate base imagery for various things in PowerPoint (usually requires modification in Photoshop, but saves me several hours each time compared to digital painting or photobashing from scratch).

> Can it give effective advice on management?

Again, what does "effective" mean in the context of management? I've seen VP-level individuals with hundreds of people in their orgs using AI tools for different things.

It really feels like a significant chunk of the HN crowd is living in a bubble with respect to AI in the real world right now. It's absolutely invading everything. As for how much revenue that will translate into long-term vs. the investment dollars being poured into it, that's a more interesting question to discuss.

Re:AI's $600B Question by reaperman on Wednesday July 03, 2024 @08:31PM (#40871342)
> Can it give effective advice on management?

My friends at McKinsey say that while it can’t fine-tune reports and presentations with quite enough nuance, it does a good job sifting through lots of shit to pick out important parts they should pay more attention to, highlighting data/talking points that contradict a working hypothesis, assisting in writing emails, and other time-consuming or very nit-picky tasks.

That said, no one I know has fed it real customer data, that would be a career-ending event. But self-hosted models like Gemma2 open up the possibility for using LLMs against real customer info.

Re:AI's $600B Question by munificent on Wednesday July 03, 2024 @08:40PM (#40871392)
Hard to tell if that says more about the value of LLMs or the lack of value of McKinsey...
Re:AI's $600B Question by throwaway2037 on Thursday July 04, 2024 @02:08AM (#40872697)

    > the lack of value of McKinsey
Leaving McKinsey's specific brand value aside, people always miss the value of "hiring (business) consultants". You basically get insider knowledge about how competitors businesses and systems work. So if you ask for advice about how to build a healthcare app for smartphones, you hire McKinsey (or whomever) to tell you "about the market". But really, they are just telling you about what they saw at other competitors. For some business decisions, it is very valuable.
Re:AI's $600B Question by ern on Wednesday July 03, 2024 @09:33PM (#40871644)
Can it do meaningful PowerPoint work

Yes, it absolutely can. I threw together a PowerPoint presentation with a script for a low-value, high visibility meeting a couple of weeks ago with ChatGPT 4.0 and a PowerPoint plugin. Everyone loved it.

Re:AI's $600B Question by throwaway2037 on Thursday July 04, 2024 @02:09AM (#40872705)

    > low-value, high visibility meeting
This is such a gem. Can you tell us more about the meeting? A senior manager kicking the tyres, or what? Any funny bike-shedding stories to tell?
Re:AI's $600B Question by ern on Thursday July 04, 2024 @02:39AM (#40872843)
Corporate values. Drew the short straw, but had to present something.
Re:AI's $600B Question by nl on Wednesday July 03, 2024 @10:18PM (#40871821)
> Can it do meaningful work in excel?

Yes it can.

But more importantly have you tried ChatGPT Data Analyst?: https://openai.com/index/improvements-to-data-analysis-in-ch...

It drops the barrier for "pretty good data analysis" to effectively zero.

> Can it do meaningful PowerPoint work?

Canva and Figma are both building this and they are pretty decent right now. Better than most PowerPoints I've seen.

The aforementioned Data Analyst does good presentations in a different way, too.

> Can it give effective advice on management?

Yes. Unfortunately can't talk about this except it is mindblowingly good.

Re:AI's $600B Question by TeMPOraL on Thursday July 04, 2024 @03:38AM (#40873088)
> The aforementioned Data Analyst does good presentations in a different way, too.

And on top of that, it can do PowerPoint presentations too - magic keywords are "use Python and Pandoc".

Re:AI's $600B Question by fragmede on Thursday July 04, 2024 @12:50AM (#40872386)
> Being able to create 2048 in 6 hours has basically zero economic value.

That's actually a really good point. In the realm of programming, things that were previously not done because they were too expensive can now be done. Prior to ChatGPT, GP could have a) done it themselves, but the cost was too high/it wasn't worth their time, b) found enough time to write a spec, found someone on upwork/etc, paid them to make it, except that costs money they didn't want to spend, or c) just not do it. Now, GP can code this thing up while watching netflix with the kids or whatever. What programs do not exist that previously did not have the economic value to exist, but now can, thanks to programming time getting cheaper?

Now apply that to fields outside of programming. LLMs' ability to program is front and center here, since many of us can program, but they do other things as well.

Re:AI's $600B Question by elicksaur on Wednesday July 03, 2024 @06:43PM (#40870729)
>I can't think of a single recent technology that was so widely adopted by tech and non-tech people alike, immediately integrated into day-to-day experience.

This is not meant to be an offense, but you are in a bubble. The vast, vast majority of people do not use LLMs in their day-to-day life. That’s ok, we’re all in our own bubbles.

You should also post the 2048 clone as proof. Lots people saying they built X in Y minutes with AI. But, when it’s inspected, it’s revealed it very obviously doesn’t work right and needs more development.

Re:AI's $600B Question by williamcotton on Wednesday July 03, 2024 @07:05PM (#40870901)
I hand-wrote perhaps 10-20 lines of this project:

https://github.com/williamcotton/guish

The rest is Claude 3.5 (with a dash of GPT-4o) with a LOT of supervision!

I'd say I'm about 8 hours deep and that this would have taken me at least 30+ hours to get it to the current state of polish.

I used it to make some graphs at work today!

Re:AI's $600B Question by bomewish on Wednesday July 03, 2024 @09:18PM (#40871578)
Quite interesting — but how is it fundamentally more productive than being in VS code in R or python? You don’t get any of the benefits of an IDE here. I often find myself doing very similar workflows but default to either VS Code or the shell. Trying to imagine this truly making workflows faster/easier/more efficient, but can’t figure it.
Re:AI's $600B Question by williamcotton on Wednesday July 03, 2024 @09:26PM (#40871612)
Maybe it isn’t? I am just experimenting with new UX! Maybe it could be integrated into an editor of… the fuuuturrre!

But seriously, do you have any thoughts or suggestions?

Re:AI's $600B Question by bomewish on Saturday July 13, 2024 @09:56AM (#40954136)
Unfortunately not! I do very similar workflows honestly but have basically defaulted to the norm or compromises like: - write own cli in python that does the sql wrapping and basic transforms and cleaning - read in the csv with R to make plots and tables.

Boring.

Cursor with 3.5 sonnet has made all this way faster so that’s nice. Often LLMs are now featuring in these pipelines and I see libraries like data bonsai and instructor being helpful. But yeah idk. No bright ideas here but always on the lookout to optimise.

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:53PM (#40870809)
> You should also post the 2048 clone as proof.

I posted it twice already in this thread, but I guess third time's the charm: http://jacek.zlydach.pl/v/2048/ (code: https://git.sr.ht/~temporal/aider-2048).

It's definitely not 100% correct (I just spotted a syntactic issue in HTML, for example), and I bet a lot of people will find some visual issue on their browser/device configuration. I don't care. It works on my desktop, it works on my phone, it's even better than the now-enshittified web and Android versions I used to play. I'm content :).

Re:AI's $600B Question by cout on Wednesday July 03, 2024 @07:17PM (#40870965)
It is too large for my phone display (iphone SE). Do you think chatgpt can fix it?
Re:AI's $600B Question by TeMPOraL on Thursday July 04, 2024 @04:13AM (#40873238)
Yes. It does so trivially, but in the process it breaks the CSS for larger screens. I couldn't get it to get both to work at the same time in 5 minutes of trying. My modern CSS skills aren't good enough to quickly notice what the problem is, so it's beyond my horizon of caring (but I do encourage hints I could pass on to the AI).
Re:AI's $600B Question by elicksaur on Thursday July 04, 2024 @09:42AM (#40874891)
>Yes. It does so trivially

>but in the process it breaks the CSS for larger screens.

So, no, it doesn’t fix it trivially. Also isn’t correctly sized on iPhone 11 Safari.

Re:AI's $600B Question by TeMPOraL on Thursday July 04, 2024 @01:35PM (#40876645)
It does fix it trivially, just in a way that causes regression on larger screens :).

As mentioned above, I don't care. It's sized correctly for the devices I use to play it, and I'm not going to put any more work into this. I mean, even junior web devs get paid stupidly high salaries for doing Responsive Web Design; I ain't gonna work on this for free.

(But I will accept AI-generated patches, or human-generated advice I could paste into the prompt to get a correct solution :P.)

Re:AI's $600B Question by somesortofthing on Wednesday July 03, 2024 @07:13PM (#40870946)
> I can't think of a single recent technology that was so widely adopted by tech and non-tech people alike, immediately integrated into day-to-day experience.

I've heard this asserted sometimes, and I just don't think it's true. ChatGPT's use cases as consumer software were discovered basically immediately after GPT 3 came out, and nothing new has really emerged since then. It's great for automating high school/undergrad B-quality writing and the occasional administrative email. Beyond that, it sometimes does better than 2024 Google(though probably still worse than 2019 Google) on knowledge questions.

ChatGPT is software. The barrier to entry is almost zero, and the tech industry has had decades of practice in enticing people into walled gardens and making sure they can never leave. If it's not completely taken over the world in the time it's had, I wouldn't bet on it doing so without a massive jump in capability or accuracy.

Re:AI's $600B Question by myworkinisgood on Wednesday July 03, 2024 @07:24PM (#40871019)
Scientific computing is going to be overhauled with this. We have essentially standardized a way to approximately solve optimization problems. And people are now going to design methods to fit this kind of solution, just like people did with linear solvers.

Not to mention all the proof-writing that will become simpler with this optimization/searcher now.

Re:AI's $600B Question by somesortofthing on Wednesday July 03, 2024 @07:36PM (#40871084)
Sure, AI represents a substantial improvement over other heuristic methods in some areas. But that's a long way down from the "AI is going to be a permanent fixture in most people's day to day lives" claim that the tech industry is betting the farm on right now.
Re:AI's $600B Question by reaperman on Wednesday July 03, 2024 @08:34PM (#40871361)
I think you’re missing that “every” K-12 student is using ChatGPT for all their work right now. Yes, the state of education is in peril (with ChatGPT actually being pretty far down the pareto chart), but the generation coming up after us is absolutely growing up using LLMs the way we used calculators, and using it for everything.

We may not see universal adoption in people who are currently >30 but I think we will in the generations that are <25 now.

Re:AI's $600B Question by threeseed on Wednesday July 03, 2024 @11:11PM (#40872041)
Of course students are using ChatGPT. It helps them to write assignments.

But it isn't translating into better across the board test results and at least in Australia we would be able to tell because we have yearly standardised testing.

And so schools are looking at it as more of a form of cheating and simply moving back to in-person, hand-written tests.

Re:AI's $600B Question by somesortofthing on Wednesday July 03, 2024 @11:35PM (#40872120)
But are they using it for anything else? Even GPT-2 was "good enough" for high school writing assignments. The fact that this power user class of young people hasn't found any other use cases for LLMs despite vast improvements in LLM capability doesn't reflect well on the merits of LLMs as consumer software.
Re:AI's $600B Question by TeMPOraL on Thursday July 04, 2024 @03:41AM (#40873102)
> The fact that this power user class of young people hasn't found any other use cases for LLMs

Why are you assuming they haven't? High school writing assignments and homework are the majority of the problems teenagers face daily, but they're also having fun with it, and why wouldn't they try it on new problems as they come along?

Re:AI's $600B Question by reaperman on Thursday July 04, 2024 @06:50PM (#40878667)
I think you may be having a failure of imagination. That generation will be creating additional tooling to use this wherever possible, and taking advantage of any interoperability they or their peers can hack onto any interface. Our generation will be hesitant but they will not be, and many of the upcoming generation will have a deep understanding of where LLM’s have appropriate vs. awkward application.
Re:AI's $600B Question by pas on Wednesday July 03, 2024 @07:36PM (#40871083)
with what? how? there's already a lot of bad python/R code out there, how more of it will "overhaul" scientific computing?

> We have essentially standardized a way to approximately solve optimization problems.

.. what does this mean? we had simplex solvers before. do you mean things like protein folding prediction?

Re:AI's $600B Question by ryandrake on Wednesday July 03, 2024 @05:02PM (#40869974)
> How can anyone not see just how impactful it's going to be? Or already is? I can't think of a single recent technology that was so widely adopted by tech and non-tech people alike, immediately integrated into day-to-day experience. The rise of mobile phones and e-commerce in the 90s would be the last time I've seen this happen (I'm not counting smartphones, as those are more of an iteration). Or social media, in purely software space.

You can't know this for certain until you look back on it in retrospect. We did not know mobile phones and e-commerce were going to be huge back in the 90s. We know now, of course, looking back, and the ones who guessed right back then can pat themselves on the back now.

Everyone is guessing. I'll admit it's totally possible LLMs and AI are going to be as earth shattering as its boosters claim it will be, but nobody can know this now with as much certainty as is being written.

Re:AI's $600B Question by doe_eyes on Wednesday July 03, 2024 @06:01PM (#40870401)
> We did not know mobile phones and e-commerce were going to be huge back in the 90s.

Eh? We did. The whole dot-com boom was predicated on that assumption. And it wasn't wrong. But most of the dot-com investments went sideways. In fact, they imploded hard enough to cause a recession.

In the same vein, even if we all agree that AI is fundamentally transformative, it doesn't mean that it's wise to invest money into it right now. It's possible that most or all of these early products and companies will go bust.

Re:AI's $600B Question by ganoushoreilly on Wednesday July 03, 2024 @08:52PM (#40871455)
I think this is the right sentiment. I know a handful of AI startups that have raised 10's to 100's of millions. All of them were crushed with gpt-3 and subsequent models. None of them have any real revenue, have crazy burn rates with their compute spend, and generally haven't proven any value with their AI platforms. Most seem to be working on tech to find a problem rather than the inverse. Funds are throwing money on ideas.. that haven't panned out for years now. I worked with one and they were spending 10's of millions per researcher on AI compute... which makes sense if it's directed but most of the researchers were just running off on their own and the company hoped one would figure something out. Very disorganized for the stacks of cash being spent. Similar things have happened in the Cyber Security field just at a lesser scale.

But hey, Nvidia is investing in companies.. to spend money on Nvidia .. infinite money glitch!

Re:AI's $600B Question by anon-3988 on Wednesday July 03, 2024 @06:14PM (#40870488)
That's his point, we _know_ this. People can already use OpenAI as a replacement for Google search and people are already doing this. You might not think this is a good thing yadda yadda go to the library, but we already know that chat bots are here to stay.
Re:AI's $600B Question by staunton on Wednesday July 03, 2024 @06:28PM (#40870595)
There is a huge spectrum between "here to stay" and "changing everything". On another note, I think if the people arguing here would work out quantitative predictions, they would find that a not insignificant part of the "disagreement" about how big we should expect this to really be is in the framing.
Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @05:07PM (#40870018)
> You can't know this for certain until you look back on it in retrospect.

Correct, but the thing is, AI blown up much faster than phones - pretty much a decade in a single year, in comparison. Mobile phones weren't that useful early on, outside of niche cases. Generative AI is already spreading to every facet of peoples' lives, and has even greater bottom-up adoption among regular people, than top-down adoption in business.

Re:AI's $600B Question by Quothling on Wednesday July 03, 2024 @05:39PM (#40870236)
> Correct, but the thing is, AI blown up much faster than phones

What do you base that on though? Two years into the iPhone, Apple reported a $6.75b revenue on iPhone related sales. ChatGPT may reach or surpass that this year considering they're currently at $3.4b. That's not exactly what I would call growing faster than phones, however, and according to this article, very few people outside of nvidia and OpenAI are actually making big money on LLM's.

I do think it's silly to see this wave of AI to be referred to as the next blockchain, but I also think you may be hyping it a little beyond its current value. It being a fun and useful tool for a lot of things isn't necessarily the same thing at it being something that's actually worth the money investors are hoping it will be.

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @05:43PM (#40870268)
> What do you base that on though?

My childhood? I was a teen when mobile phones started to become widely used, and soon after pretty much necessary, in my part of the world. But, to reiterate:

> Two years into the iPhone, Apple reported a $6.75b revenue on iPhone related sales.

That's just an iteration, and not what I'm talking about. Smartphones were just different mobile phones. I'm talking about the adoption of a mobile phone as a personal device by general population.

> It being a fun and useful tool for a lot of things isn't necessarily the same thing at it being something that's actually worth the money investors are hoping it will be.

That's probably something which needs to be disentangled in these conversations. I personally don't care what investors think and do. AI may be hype for the VCs. It's not hype for regular Janes and Joes, who either already integrated ChatGPT into their daily lives, or see their friends doing so.

Re:AI's $600B Question by dragontamer on Wednesday July 03, 2024 @06:02PM (#40870415)
Its a lot easier to use AI when its basically given away for free than when it cost $399 for a Palm Pilot in the 90s.

For a $399 device, Palm Pilot did well and had an excellent reputation for the time. Phones really took over the PDA market as a personal pocket-computer more-so than being used as ... a phone...

Really, I consider the modern smartphone a successor to the humble PDA. I grew up in that time too, and I remember the early Palm adopters having to explain why PDAs (and later Blackberries) were useful. That was already all figured out by the time iPhone took over.

Re:AI's $600B Question by kortilla on Wednesday July 03, 2024 @07:46PM (#40871150)
Calling the iPhone an iteration is pure nonsense. Mobile phones had tiny utility compared to smartphones.

A phone on the go didn’t fundamentally alter anything except for making coordination while traveling easier. I went through both the cell phone adoption curve and the smartphone curve.

The latter was the massive impact that brought computing to the remaining 85% of the planet and upended targeting desktop operating systems for consumers by default.

Calling smartphones an iteration on cellphones is like calling ChatGPT an iteration on the neural networks we had 10 years ago.

Re:AI's $600B Question by throwup238 on Thursday July 04, 2024 @12:20AM (#40872304)
> Mobile phones had tiny utility compared to smartphones

They had tiny utility compared to modern smartphones but the first iPhone was a glorified iPod with a touchscreen and a cellular radio. It didn’t have an app store and the only thing it really did better than other mobile phones was web browsing, thanks to the touchscreen keyboard.

It wasn’t as revolutionary as hindsight now makes it seem. It was just an iteration on PalmPilots and Blackberries.

Re:AI's $600B Question by throwaway2037 on Thursday July 04, 2024 @02:27AM (#40872789)
Another thing that is forgotten about the first iPhone: I think Apple negotiated with AT&T (?) to change the voice mail system so you could select from your iPhone (voicemail app?) which message you wanted to listen. Prior, you always needed to call the mobile provider voice mail system, then listen the messages in order (or skip them). That was a huge early selling point for the iPhone. I know -- no one cares about voice mail in 2024, but it used to be very important.
Re:AI's $600B Question by kortilla on Friday July 05, 2024 @11:21AM (#40883534)
I remember getting it. Having a real browser was revolutionary. And having the maps app (backed by google maps at the time) was a huge deal.

I had a blackberry before and it was just a glorified email and texting device.

It was immediately obvious how revolutionary the iPhone was. That’s why Android immediately pivoted hard to replicate the experience.

Re:AI's $600B Question by threeseed on Wednesday July 03, 2024 @06:03PM (#40870419)
This is all just meaningless anecdotes.

And regular Janes and Joes are not using ChatGPT. Revenues would be 10-100x if that were the case.

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:10PM (#40870450)
> And regular Janes and Joes are not using ChatGPT. Revenues would be 10-100x if that were the case.

3/4 of the people I know are actively using it are on free tier. And based on all the HN conversations in the last year, plenty of HNers commenting here are also using free tier. I'd never go back to GPT-3.5, but apparently most people find it useful enough to the point they're reluctant to pay that $20/month.

As for the rest, OpenAI is apparently the fastest-growing service of all time ever, so that says something.

Re:AI's $600B Question by Avshalom on Wednesday July 03, 2024 @06:36PM (#40870666)
>>apparently most people find it useful enough to the point they're reluctant to pay that $20/month.

Or they find it useless enough that they're unwilling to pay for the upgrade.

Re:AI's $600B Question by ben_w on Wednesday July 03, 2024 @06:30PM (#40870614)
I'm one of the free tier people.

A while back I used 3.5 to make a chat web page so I could get the better models as PAYG rather than subscription… and then OpenAI made it mostly pointless because they gave sufficient 4o access to the free tier to meet my needs.

Re:AI's $600B Question by Quothling on Thursday July 04, 2024 @01:47AM (#40872604)
> I personally don't care what investors think and do.

Isn't this a an odd take when you're discussing things on a VC website? In any case, if you like LLM's you probably should care considering it's the $10b Microsoft poured into OpenAI that's made the current landscape possible. Sure, most of those money were fuled directly into Azure because that's where OpenAI does all it's compute, but still.

> It's not hype for regular Janes and Joes, who either already integrated ChatGPT into their daily lives, or see their friends doing so.

Are they paying for it? If they aren't then will they pay for it? I think it's also interesting to view the numbers. ChatGPT had 1.6 billion visitors in January 2024, but it had 637 million in May 2024.

Again. I don't think it's all hype, I think it'll change the world, but maybe not as radically as some people expect. The way I currently view it is another tool in the automation tool-set. It's useful, but it's not decision making and because of the way it functions (which is essentially by being very good at being lucky) it can't be used for anything important. You really, really, wouldn't want your medical software to be written by a LLM's programmer. Which doesn't necessarily change the world too much because you really, really, didn't want it to be written by a search engine programmer either. On the flip-side, you can actually use ChatGPT to make a lot of things and be just fine. Because 90% (and this a number I've pulled out my ass, but from my anecdotal experience it's fairly accurate) of software doesn't actually require quality, fault tolerance or efficiency.

Re:AI's $600B Question by reaperman on Wednesday July 03, 2024 @08:38PM (#40871388)
The iPhone was not the first cell phone. Initial adoption of cell phones was much slower than ChatGPT. Think 1980’s/1990’s.

Even when cell phones started getting popular, often only one or two family members would get one. The transition time between “started becoming popular” and “everyone has one” was >5 years and even then it was relatively normal that people would just turn off their cell phone for a few days (to mixed reactions from friends and family).

Re:AI's $600B Question by sib on Wednesday July 03, 2024 @08:40PM (#40871396)
>> Correct, but the thing is, AI blown up much faster than phones

>What do you base that on though? Two years into the iPhone, Apple reported a $6.75b revenue on iPhone related sales. ChatGPT may reach or surpass that this year considering they're currently at $3.4b.

But the iPhone was launched more than 10 years past mobile phones (in fact, more than 20, but that's stretching it). There were more than 1B mobile phones shipped in 2006, the year before the iPhone launched.

Re:AI's $600B Question by tuatoru on Wednesday July 03, 2024 @07:47PM (#40871151)
> Mobile phones weren't that useful early on, outside of niche cases.

Truck drivers, construction crew, couriers, lawyers, sales people of all kinds, stock brokers, ... Most of the economy that isn't at a desk 996. Pretty big niche, bigger than the non-niche possibly.

You are in a bubble.

Re:AI's $600B Question by relativ575 on Wednesday July 03, 2024 @08:01PM (#40871219)
Huh? Mobile phone was available commercially in 1980s, and started to proliferate in 1990s. It was definitely not popular in those groups early on. Any of them.
Re:AI's $600B Question by disgruntledphd2 on Thursday July 04, 2024 @05:39AM (#40873617)
It was in Europe. I remember that people started to get them in the mid 90's and they were everywhere by the end of that decade.
Re:AI's $600B Question by ryandrake on Wednesday July 03, 2024 @05:52PM (#40870340)
Any talk of "regular people" inside the HN bubble is fraught with bias. Commenters here will sometimes tell you that "regular people" work at FAANG, make $400K/yr and have vacation homes in Tahoe. Actual "regular people" use Facebook occasionally, shop at the grocery store, watch Sportsball on TV, and plan their kids' birthday parties or their next vacation. They're not sitting there augmenting their daily lives with ChatGPT.

You're a long time HN contributor and I admit when I see your username, I stop and read the comment because it's always insightful, polite, and often makes me think about things in ways I never have before! But this discussion borders on religious fervor. "Every facet of peoples' lives?" Come on, man!

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:07PM (#40870435)
> Actual "regular people" use Facebook occasionally, shop at the grocery store, watch Sportsball on TV, and plan their kids' birthday parties or their next vacation. They're not sitting there augmenting their daily lives with ChatGPT.

I'm aware of the HN bias, but in this case, I'm talking regular, non-tech, sportsball or TikTok watching crowd. Just within my closest circles, one person is using ChatGPT for recipes, and they're proficient at cooking so I was surprised when they told me the results are almost always good enough, even with dietary restrictions in place (such as modifying recipes without exceeding nutrient limits). Another person used it for comparison shopping of kids entertainment supplies. Another actually posted a car sale ad and used gen-AI to swap out background to something representative (no comment on ethics of that). Another is evaluating it for use in their medical practice.

(And I'm excluding a hundred random uses I have for it, like e.g. making colorbooks for my kids when they have very specific requests, like "dancing air conditioners" or whatever.)

Re:AI's $600B Question by ryandrake on Wednesday July 03, 2024 @07:03PM (#40870879)
Without data, we're trading anecdotes. Your circle is in the bubble, mine isn't. This user[1] shared a Pew survey, which looks like the best we're going to get. The survey asked what % of people ever used ChatGPT, which I'd interpret as "at least one time ever" and the number is less than 1 in 4. I'd love to see actual data on what percentage of people use it at least once daily, which is the bar I'd accept for "integrated with their daily lives."

1: https://news.ycombinator.com/item?id=40870205

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @07:07PM (#40870911)
Fair enough. My circle may be in a bubble, and come to think of it, selection bias is a factor - I can think of all the people close to me who use it, but there's more equivalently close friends and relatives who (as far as I know) don't. I do think the survey is giving quite a big results, given we're barely a year into the whole ChatGPT craze - but we can revisit this topic when more data becomes available. I'm sure it'll come up again :).
Re:AI's $600B Question by slidehero on Wednesday July 03, 2024 @10:01PM (#40871745)
My dad used AI to generate artwork with pictures hung up across the house.

He's intersted in meditation and mindfulness. He's not a native English speaker, so he's using AI to help him write content. He's then using AI text to voice to turn his scripts into YouTube videos. The videos have AI generated artwork too.

My dad is a retired welder in his late 60s. He's as "regular people" as it gets.

I'm a high school teacher and GPT has completely changed teaching. We're using it to help with report writing, lesson planning, resource creation, even for ourselves to get up to speed on new topics quickly.

I'm working on a tool for teachers that's only possible with GPT.

It's by far the single, most transformative technology I've ever encountered.

Re:AI's $600B Question by fennecfoxy on Friday July 05, 2024 @11:36AM (#40883649)
And how much of an influence have you had on him to encourage or assist with this behaviour? What about the average person that doesn't know anybody (at least closely) working in tech.
Re:AI's $600B Question by slidehero on Tuesday July 09, 2024 @06:54AM (#40914590)
Fair point.
Re:AI's $600B Question by throwaway2037 on Thursday July 04, 2024 @02:37AM (#40872830)

    > work at FAANG, make $400K/yr
Or: work at an unnamed high frequency trading hedge fund, make $800K/yr. (The number of people on HN claiming to be this person surely exceeds the number in the Real World by ... multiples.)
Re:AI's $600B Question by mrbungie on Wednesday July 03, 2024 @05:14PM (#40870072)
Any evidence backing up these claims about adoption?

I thought the same about adoption (across multiple audiences, not just tech workers and/or young people), was faced with surprising poor knowledge about GenAI when making surveys about it in my company. Maybe investors are asking the same questions right now.

Re:AI's $600B Question by PaulHoule on Wednesday July 03, 2024 @05:34PM (#40870205)
Pew Research asked Americans this March:

https://www.pewresearch.org/short-reads/2024/03/26/americans...

23% said they'd used ChatGPT, 43% said they hadn't, 34% didn't know what it was.

Re:AI's $600B Question by fragmede on Wednesday July 03, 2024 @05:41PM (#40870255)
the article states

> The Information recently reported that OpenAI’s revenue is now $3.4B, up from $1.6B in late 2023.

and links to

https://www.theinformation.com/articles/openais-annualized-r...

That's a lot of $20/month subscriptions. it's not all that but that's a lot of money, regardless.

Re:AI's $600B Question by threeseed on Wednesday July 03, 2024 @06:05PM (#40870428)
OpenAI’s revenue is not exclusively subscriptions.

There are a lot of companies building private GPTs and using their API.

Re:AI's $600B Question by Workaccount2 on Wednesday July 03, 2024 @05:33PM (#40870196)
IIRC openai was the fastest growing service by subscriptions of all time.
Re:AI's $600B Question by neta1337 on Thursday July 04, 2024 @02:12AM (#40872720)
You are in a bubble, hyping this up way too far
Re:AI's $600B Question by LouisSayers on Wednesday July 03, 2024 @06:26PM (#40870579)
> You can't know this for certain

Except AI is already being used by people (like myself) every day as part of their usual work flow - and it's a huge boost in productivity.

It's not IF it will make an impact - it IS currently making an impact. We're only just moving past early adopters and we're still in the early stages in terms of tooling.

I'm not saying that AI will become sentient and take over humanity, but to think that AI isn't making an impact is to really have your head in the sand at this point.

Re:AI's $600B Question by VirusNewbie on Wednesday July 03, 2024 @06:16PM (#40870504)
> I'll admit it's totally possible LLMs and AI are going to be as earth shattering

You don't need earth shattering though. The PC revolution was huge because every company got a bit more productive with things like word processors and printing and email.

The internet (and then later mobile) was big because every company got a revenue boost, from a small one with online presence to a a huge one for e-commerce to transformative with Netflix and streaming services.

Ignoring the more sci-fi claims of AGI or anything, if you just believe that AI is going to make every office worker 10% more productive, surely each company is goign to have to invest in AI, no? Anytime you have an industry that can appeal to every other company, it's going to be big.

Re:AI's $600B Question by wongarsu on Wednesday July 03, 2024 @06:26PM (#40870586)
I wouldn't be surprised if in large companies (say >500 office workers) 10% of all office work becomes redundant. Not in the form of each worker getting 10% more productive, but in form of some roles getting eliminated completely and others losing 80% of their workload.
Re:AI's $600B Question by VirusNewbie on Wednesday July 03, 2024 @07:18PM (#40870980)
Why? You could make the same argument about PCs or mobile or the Internet?
Re:AI's $600B Question by fennecfoxy on Friday July 05, 2024 @11:37AM (#40883657)
That's been true even for traditionally programmed replacements tho, there are plenty of office out there with a bunch of people banging on excel when everything they do could be automated.
Re:AI's $600B Question by LorenzoBloedow on Wednesday July 03, 2024 @05:06PM (#40870016)
I personally attribute this FOMO to so called AI influencers who love "shilling" AGI as something that's as true as 1 + 1 = 2
Re:AI's $600B Question by llm_trw on Wednesday July 03, 2024 @05:16PM (#40870093)
I don't get why people insist this is agi any more than a ship is artificial general swimming.

It doesn't matter if it's general, what matters is that its useful. And if you don't find it useful just remember a lot of people in the 00s didn't find google useful either since they already had the yellow pages.

I strongly suggest paying for a subscription to either openai or anthropic and learning quickly.

Re:AI's $600B Question by fragmede on Wednesday July 03, 2024 @05:44PM (#40870275)
You don't even have to do that, just go to http://ChatGPT.com and type at it. you don't even need to make an account.
Re:AI's $600B Question by llm_trw on Wednesday July 03, 2024 @05:52PM (#40870346)
You get what you pay for, despite what everyone is saying the 4o gpt model is really bad for long form reasoning.

Buy the subscription and use the turbo4 model.

After that api credits so you get access to the playground and change the system prompt. It makes a huge difference if you don't want to chat for 10 minutes before you get the result you want.

Re:AI's $600B Question by okdood64 on Wednesday July 03, 2024 @09:32PM (#40871637)
> learning quickly.

Learning what quickly exactly?

Re:AI's $600B Question by namaria on Thursday July 04, 2024 @04:49AM (#40873403)
Swimming and 'intelligenting' are definitely not in the same category.
Re:AI's $600B Question by lend000 on Wednesday July 03, 2024 @06:07PM (#40870436)
GPT-4 is an upgrade over a search engine (on the 2010 internet, which was much easier to search than the internet today) and there is certainly opportunity in using it to chain together complex programming tasks fully programmatically, but we are stuck right on the cliff of a truly reliable and generalizable AI, and it isn't clear that we can just train an AI with the next generation of GPU's and more data and bridge that gap. Most of the truly high value add activities (fully autonomous programs and AGI that creates novel inventions) rely on a model more intelligent and more consistent than the current state of the art. So I think most of the valuation is in speculative potential.
Re:AI's $600B Question by prng2021 on Wednesday July 03, 2024 @07:50PM (#40871168)
The article explains a $600B gap in AI revenue expectations vs actuals. Rather than addressing that, you're posting about some dietician you know who worries their job will get replaced, as if it has any relevance whatsoever to the big picture.

We should have seen massive revenue growth and raises in future quarter revenue forecasts in the most recent round of SaaS company earnings reports. I think tons of companies have hyped up AI as if it's just on the cusp of AGI. The lack of massive top line growth has proven we're not even close, but the enormous investor speculation these companies triggered is the main reason for this $600B gap.

I'm not at all saying AI won't be transformational because it definitely does bring revolutionary capabilities that weren't possible before.

Re:AI's $600B Question by woodruffw on Wednesday July 03, 2024 @06:20PM (#40870538)
I don't think the uptake of LLMs by non-technical people has been that dramatic. Nobody in my familial or social circles (which spans doctors, lawyers, artists, waitresses, etc.) has really mentioned them outside of asking my what I think about them.

As for what I think about them: I've been impressed with some aspects of code generation, but nothing else has really "wowed" me. Prose written with the various GPT models has an insincere quality that's impossible to overlook; AI-generated art tends to look glossy and overproduced in the same way that makes CGI-heavy movies hard to watch. I have not found that my Google Search experience was made better by their AI experiments; it made it harder, not easier, for me to find things.

Re:AI's $600B Question by falcor84 on Wednesday July 03, 2024 @06:39PM (#40870698)
> ... makes CGI-heavy movies hard to watch

While I absolutely agree that many movies over-use CGI, even with the relative decline in superhero movies, CGI-heavy movies still top the box office. Going over the list of highest-grossing movies each year [0], you have to go back about three decades to find a movie that isn't CGI-heavy, so apparently they're not that difficult for the general public to watch.

[0] https://en.wikipedia.org/wiki/List_of_highest-grossing_films

Re:AI's $600B Question by woodruffw on Wednesday July 03, 2024 @06:48PM (#40870771)
True. It's also a rude reality that much of the US uses word art and comic sans to advertise things, so I might just be a snob. Then again, impressing the snobs is a relevant part of the mass adoption curve :-)
Re:AI's $600B Question by PaulHoule on Wednesday July 03, 2024 @05:25PM (#40870142)
One difference between AI and mobile is this.

The mobile revolution needs three kinds of investment:

(A) The carrier has to build out a network

(B) You need to buy a handset

(C) Businesses need to invest in a mobile app.

The returns that anybody gets from investing in A, B or C depend on the investments that other people have made. For instance, why should I buy a handset if the network and the apps aren't there? Why should a business develop an app if the network and users aren't there? These concerns suppress the growth of mobile phones in the early phase.

ChatCPT depends on the existing network and existing clients for delivery so ChatGPT can make 100% of the investment required to bring their product to market which means they can avoid the two decades of waiting for the network and handsets to be there in order to motivate (C).

---

Note another thing that younger people might never have noticed was that the US was far behind the rest of the world in mobile adoption from maybe 1990 to 2005. When I changed apartments in the US in the 1990s I could get landline service turned on almost immediately by picking up the phone. When I was in Germany later I had no idea I could go into a store in most countries other than the US and walk out with a "handy" and be talking right away so I ended up waiting a month for DT to hook up my phone line.

Re:AI's $600B Question by epolanski on Wednesday July 03, 2024 @06:44PM (#40870742)
Meanwhile I have the opposite experience.

I have used chatgpt less and less, and bar copilot which is a useful autocomplete I just don't have much use for AI.

I know I'm not alone, and even though I've seen many people super excited by Dall-E first and chatgpt later they use very rarely both of them.

Re:AI's $600B Question by cageface on Wednesday July 03, 2024 @10:48PM (#40871949)
This is where I am with it now. I got bored with the image generators and tired of their plastic looking output.

I still use GPT or Claude occasionally but I find switching over to prompting breaks my mental flow so it’s only a net win for certain kinds of tasks and even there it’s not a huge step up from searching Stack Overflow.

Re:AI's $600B Question by namaria on Thursday July 04, 2024 @04:53AM (#40873418)
For me it's been great for things like generating a latex version of my cv, or CSS for a web app. It's worth an OpenAI subscription for me, but I do wonder if it's worth all the energy and resources gone into making those GPU clusters and powering them.
Re:AI's $600B Question by TeMPOraL on Thursday July 04, 2024 @01:43PM (#40876704)
The huge up-front energy costs of GPU clusters, both of making and operating them, is amortized over all subsequent uses of the models, i.e. inference. Inference itself is cheap per query. Your use cases aren't consuming that much energy. I feel the amount is in the same ballpark as what you'd use doing those things yourself.

As for whether it's worth it, I argue this is the single most useful application of GPUs right now, both economically and in terms of non-monetary value delivered to users.

(And training them is, IMO, by far the most valuable and interesting part of almost all creative works available online, but that's another discussion.)

Re:AI's $600B Question by grumbel on Wednesday July 03, 2024 @06:34PM (#40870647)
Just because it's impactful doesn't mean it's going to make much money. Take audiobooks for example, the market is valued at around $5 billion. In the very near future audiobooks will be created with AI. Does that mean anybody is making billions with those AI audiobooks? I don't think so. The value of audiobook will go towards $0 and audiobooks as a product category will completely disappear. Audiobooks will simply be the text2speech feature of your eBook reader.

Similar stuff will happen with a lot of other content, things that used to be costly will become very cheap. And then what? The amount of books people can consume doesn't scale into infinity. Their entertainment needs will be served by auto-generated AI content. Even the books themselves will be written by AI sooner or later.

Advertising industry might also start hurting badly, as while they will certainly try getting ads into AI content, users will have AI at home to filter it out. A lot of classic tricks and dark pattern to manipulate the user behavior will no longer work, since the user has a little AI helper to protect them from those tricks.

I don't doubt that the impact of AI will be gigantic, but a lot of AI produced content won't be worth anything, since it's so easy to create for everybody. And there isn't much of a moat either, since new models with better capabilities pop up all the time from different companies. Classic lock-in is also not really usable anymore, as AI can effortlessly translate between different APIs and user-interfaces.

Re:AI's $600B Question by vasco on Wednesday July 03, 2024 @06:39PM (#40870696)
Why would I watch someone else's AI content when I can watch my own with about the same work? It probably takes longer to pick something on Netflix than to shout at my TV to show me some auto-generated on the fly show about whatever I'm feeling like watching right now. Can even be building upon itself "show me yesterday's show but in space and give it some new twists that I don't expect".
Re:AI's $600B Question by mejutoco on Wednesday July 03, 2024 @07:12PM (#40870943)
You can share opinions about a common show the next day with another person and bond over it. For example, about a football match.
Re:AI's $600B Question by fennecfoxy on Friday July 05, 2024 @11:41AM (#40883693)
The conversation then becomes more about the platform than about specific content.

Similar to a game; for many games players aren't intended to have exactly the same experience but there are still common things about the game platform to discuss.

I think it would be pretty cool to have a partially AI generated plot, it would be exciting to discuss what you got in the AI lottery with someone else who had also watched the show. Something like: [set plot point] [random catastrophic event] [set plot point] [etc]. "1 character must die in some meaningful way" turns to "omg, which one was killed when you watched? Adam got eaten by the giant spiders in mine" "oh man, Sarah tried to set a spider on fire in mine, but she ended up getting herself". A la https://en.wikipedia.org/wiki/Until_Dawn

Re:AI's $600B Question by throwaway2037 on Thursday July 04, 2024 @02:44AM (#40872863)
While I agree that most audiobooks will be priced near zero, there will still be a healthy market for highly paid actors to read, like Morgan Freeman. That said, it will be a tiny segment in the market, and many famous people will need to fight/sue AI providers to remove impersonations. I expect those markets will be flooded by fan-created favourites that read like Morgan Freeman.
Re:AI's $600B Question by roenxi on Wednesday July 03, 2024 @07:05PM (#40870899)
And we seem to be in an exponential upswing of hardware capacity, so we expect extreme improvements from an already impressive base. >90% of the compute that can be used to train models doesn't exist yet.
Re:AI's $600B Question by pavel_lishin on Wednesday July 03, 2024 @06:28PM (#40870599)
> I've just had GPT-4o write me a full-featured 2048 clone in ~6 hours of casual chat

May we see it?

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:30PM (#40870615)
http://jacek.zlydach.pl/v/2048/

https://git.sr.ht/~temporal/aider-2048

There's a full transcript of the interactions with Aider in that repo (which I started doing manually before realizing Aider saves one of its own...).

Before anyone judges quality of the code - in my defense, I literally wrote 0 lines of it :).

Re:AI's $600B Question by pavel_lishin on Wednesday July 03, 2024 @06:35PM (#40870662)
That works surprisingly well! I mean that I am genuinely surprised.
Re:AI's $600B Question by saulpw on Wednesday July 03, 2024 @05:21PM (#40870122)
I canceled my GPT-4 subscription recently because it just wasn't that impactful for me. I found myself using it less and less, especially for things that matter (because I can't trust the results). The things it's good at: boilerplate text, lightweight trivia, some remixing/brainstorming. Oh and "write me a clone". Yes, it can write clones of things, because it's already seen them. I've spent WAY more time trying to get anything useful out of it for a non-clone project, than it took me when I just buckled down and did it.

Yes, "many things are clones", but that just speaks to how uncreative we are all being. A 2048 clone, seriously? It was a mildly interesting game for about 3 minutes in 2014, and it only took the original author a weekend to build in the first place. Like how was that impactful that you were able to make another one yourself for $4?

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @05:37PM (#40870226)
> Like how was that impactful that you were able to make another one yourself for $4?

It's been my "concentration ritual", an equivalent of doodling, for a few years in 2010s, so I have a soft spot for it. Tried getting back to it the other day, all my usual web and Android versions went through full enshittification. So that $4 and couple hours bought me a 2048 version that's lightweight, works on my phone, and doesn't surveil or monetize me. Scratched my own itch.

Of course, that's on top of gaining a lot of experience using aider-chat, by setting myself a goal of making a small, feature-complete app in a language I'm only moderately good at (and environment - the modern web - which I both hate and suck at), with extra constraint of not being allowed to write even a single line of code myself. I.e. a thing too boring for me to do, but easy enough to evaluate.

And no, the clone aspect wasn't really that important in this project. I could've asked it for something unique, and I expect it to work more-less the same way. In fact, this is what I'm trying right now, as I just added persistent state to the 2048 game (to work around Firefox Mobile aggressively unloading tabs you're not looking at, incidentally making PWAs mostly unusable) and I have my perfect distraction completely done.

EDIT:

BTW. did I ever tell you about the best voice assistant ever made, which is Home Assistant's voice assistant integrated with GPT-4o? I have a near-Star Trek experience at my home right now, being able to operate climate control and creature comforts by talking completely casually to my watch.

Re:AI's $600B Question by raspasov on Wednesday July 03, 2024 @06:28PM (#40870594)
(Also a Chat GPT4o,x etc user)

Try asking it something actually technologically hard or novel and see what answers you get.

In my experience, it repeatedly bails out with "this is hard and requires a lot of careful planning" regardless of how much I try to "convince" the model to live the life of a distributed systems engineering expert. Sure, it spits out some sample/toy code... that often doesn't/compile or has obvious flaws in it.

Re:AI's $600B Question by reaperman on Wednesday July 03, 2024 @08:52PM (#40871448)
Very few people are working on technologically hard or novel things. Those people have always had very special effects on society, and will continue to be special going forward - LLM's aren't going to prevent those people from delivering real value. HN has an absurdly rich concentration of these special people, which is why I like it. And many of them are surrounded by other similarly special people in real life. I only regularly talk with maybe 1-2 people in real life who are even close to that type of special. Even when I was a chemical/electrical/petroleum engineer working closely with other engineers - usually only 1-2 people at each workplace were doing really smart work.

That said, the majority of my friends are doing relatively manual work (technician, restaurants, event gigs, sex work) and are neither threatened by LLMs nor find much use for them.

Re:AI's $600B Question by raspasov on Thursday July 04, 2024 @04:26AM (#40873296)
You are likely not wrong.

Even though I do think that almost any profession can potentially find use for LLMs in some shape or form. My opinion is LLMs can increase productivity and be a net positive the way the Internet/search engines are if used correctly.

To expand on my original comment: All that being said, I think the hype/media cycle overestimates the magnitude of the potential positive LLM effect. You’ll see numbers like 5x, 10x, 100x increase in productivity thrown around. If I have to bet, I would say the likely increase is going to be in the 1x-1.5x range but not much greater.

Most things in the world are not infinitely exponential, even if they initially seem to be.

(Not sure why the downvotes.)

Re:AI's $600B Question by reaperman on Thursday July 04, 2024 @05:43AM (#40873631)
> (Not sure why the downvotes.)

Appreciated! But if we fret about a few downvotes, we're using the forum wrong. Some unpopular views need to be discussed - either because they hold some valuable truth that people are ignorant of, or because discussing them can shine a light on why the unpopular views are misguided. I suspect the downvotes are related to "Very few people are working on technologically hard or novel things" -- many HN users have been surrounded since elementary school by tons of people who do currently work on hard or novel problems, so they understandably think that >5-10% of people do that, when in fact it's closer to maybe 1-in-200. I've been part of social groups who went to high schools with absurd numbers of Rhodes' Scholars and peer groups where everyone in the group can trivially get through medical schools with top marks, receive faculty positions as professors at top-3 universities, found incredible startups through insane technical competence, and still all think they're stupid because they compare themselves to the true 1-in-a-million geniuses they grew up with who are doing research so advanced that it's far beyond their most remote chances of ever having even surface-level comprehension of that research. Their extended social group likely comprises >1% of all Americans working on "hard or novel problems", but since 75% of them are doing it, they have no idea that the real base rate is closer to 1-in-200, generously. They grossly underestimate their relative intelligence vs. the median and grossly overestimate the ability of average people (and explain away differences in outcome to personality issues like "laziness").

There are a surprising number of people from these peer groups on HN. These are the people who will never be threatened by LLM's -- they are capable of adapting to use any new tools and transcending any future paradigm, save war/disease/famine.

> To expand on my original comment: All that being said, I think the hype/media cycle overestimates the magnitude of the potential positive LLM effect. You’ll see numbers like 5x, 10x, 100x increase in productivity thrown around. If I have to bet, I would say the likely increase is going to be in the 1x-1.5x range but not much greater. Most things in the world are not infinitely exponential, even if they initially seem to be.

Yours is a very reasonable take that I wouldn't argue against. I also think it's reasonable that some people think it will be 5x-100x -- for the work some individuals are familiar with it very well might be already, or they might be more bullish on future advances in reinforcement learning / goal-seeking / "search" (iterative re-search to yield deep solutions).

> Even though I do think that almost any profession can potentially find use for LLMs in some shape or form.

I reactively feel this is stretching it for people who travel around just to load/unload boxes of equipment at events/concerts/etc. But the way you worded this is definitely not wrong - even manual laborers may find LLM's useful for determining whether they, their peers, and their bosses are following proper safety/health/HR regulations. More obviously, Sex workers will absolutely be using LLM's to screen potential customers for best mutual-fit and maintain engagement (as with lawyers who own small practices, a large number of non-billable hours goes towards client acquisition, as well as retention). LLM's are not "there" yet for transparent personalized client engagement which maintains the personality of the provider, but likely will be soon with some clever UX and RAG.

Re:AI's $600B Question by TeMPOraL on Tuesday July 09, 2024 @05:34PM (#40921441)
> I reactively feel this is stretching it for people who travel around just to load/unload boxes of equipment at events/concerts/etc. But the way you worded this is definitely not wrong - even manual laborers may find LLM's useful for determining whether they, their peers, and their bosses are following proper safety/health/HR regulations.

It's more than that when the LLMs go mutli-modal. A model (or an ensemble) that can hear you talking and see what you're showing it suddenly becomes very useful even for manual labor. Instructions, inspections, situational awareness, to think of few cases; this is a thoroughly unexplored space so far.

Re:AI's $600B Question by kortilla on Wednesday July 03, 2024 @07:36PM (#40871086)
No offense, but you’re group is just very early on the adoption curve and is not representative of at all.

I have a bunch of peers that haven’t used chatgpt at all and they are software developers. A bunch more tried it once, realized how terrible it was for anything you aren’t already knowledgeable in and then haven’t gone back to it.

Recipe adjustments has to be a joke unless they are really basic things like “cut it in half”. ChatGPT is terrible at changing recipes without fundamentally changing them and will offer multiple “substitutions” for an ingredient that have extremely different outcomes that it doesn’t warn or know about.

Re:AI's $600B Question by bamboozled on Wednesday July 03, 2024 @06:37PM (#40870675)
I've just had GPT-4o write me a full-featured 2048 clone in ~6 hours of casual chat, in between of work, making dinner, and playing with kids;

As cool as this might be, what is the actual economic value of this? 2048 is free, you didn't even have to spend a dollar to get it.

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:49PM (#40870773)
I don't give a damn about economic value of the game - I just wanted to have a 2048 that's lean and not powering the adtech economy. At the same time, I care about both economic and non-monetary value of me leveraging AI tools in creating software, so this game was a perfect little project to evaluate aider-chat as a tool.
Re:AI's $600B Question by bamboozled on Wednesday July 03, 2024 @07:22PM (#40871010)
The questions stands though: Is building all this infra so you (random internet guy) can generate a 2048 clone worth the increased emissions and the $600B of investment?
Re:AI's $600B Question by jmartin2683 on Wednesday July 03, 2024 @07:15PM (#40870955)
This is the type of thing that I’ve only ever read about on the internet and have never heard of a normal person actually doing.
Re:AI's $600B Question by madeofpalk on Wednesday July 03, 2024 @06:12PM (#40870468)
I think it’s reasonably obvious that the tech could have a lot of potential, but that’s yet to be realised. Chatbot interfaces are so primitive and clearly not the final form for LLMs, but people have to invent that.

But, tech being impactful doesn’t mean it will create and deliver value for others.

Re:AI's $600B Question by falcor84 on Wednesday July 03, 2024 @06:42PM (#40870717)
Can you come up with an example of tech that was impactful without delivering value to others?

The closest I can think of would be the atom bomb, but even that arguably brought significant value in terms of relative geopolitical stability.

Re:AI's $600B Question by madeofpalk on Thursday July 04, 2024 @06:44AM (#40873861)
Sorry, I phrased it poorly.

Very often technology advancements redistribute value, taking it away from many people and allowing companies to capture more profit and/or lower costs. Such as self-serve checkouts at supermarkets leading to less cashier jobs.

> A huge amount of economic value is going to be created by AI. Company builders focused on delivering value to end users will be rewarded handsomely.

Companies will acrue value, but 'common folk' will lose it.

Re:AI's $600B Question by falcor84 on Friday July 05, 2024 @05:20AM (#40881171)
Self-serve checkout is an interesting example. Even though it can have its issues, I personally quite like being able to move through checkout more quickly, without having to interact with the cashier and the people in line in front of me (assuming enough self-serve stations).

I haven't analyzed its economics, but I would assume that by reducing the cashier jobs (e.g. allowing 1 operator to manage 8 self-serve checkout stations), supermarkets reduce their overall operating costs, and then use that to reduce their prices (and if they won't their competitors will), leading to a benefit to us 'common folk'.

As for cashier jobs, I don't think there's anything inherently good about them or inherently bad about them disappearing from the economy. As another example, I don't know many people who miss the Elevator Operators[0], and it makes perfect sense for us to press the buttons ourselves.

[0] https://en.wikipedia.org/wiki/Elevator_operator

Re:AI's $600B Question by TeMPOraL on Tuesday July 09, 2024 @05:40PM (#40921503)
> I would assume that by reducing the cashier jobs (e.g. allowing 1 operator to manage 8 self-serve checkout stations), supermarkets reduce their overall operating costs

Unfortunately, what reduces the operating costs even more is giving the job of managing 8 self-serve checkouts to existing employee, on top of their current workload. With reliability of the checkout machines being as bad as it is, this results in a very frustrating shopping experience.

This is a pattern that we can see happening in everywhere across every sector in the market: the price for the buyer may get lower, but so does the quality. Often enough, it's impossible to retain quality and stay profitable, so the whole product or service class suddenly becomes worse. In the end, the delta between current satisfaction and the minimum satisfaction below which the customer would bounce, is a profit margin being extracted when competitive pressure is high - which, I dare say, sucks for the customer, even if they also get stuff cheaper.

Re:AI's $600B Question by mvdtnz on Wednesday July 03, 2024 @07:31PM (#40871064)
> I see non-tech people around me using ChatGPT for anything from comparison shopping to recipe adjustments.

This is baffling to me, because these are two use cases I have tried and in which ChatGPT completely fails to produce any useful information.

Re:AI's $600B Question by maxlamb on Wednesday July 03, 2024 @05:03PM (#40869988)
What’s a 2048 clone?
Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @05:04PM (#40869999)
Re:AI's $600B Question by woodruffw on Wednesday July 03, 2024 @06:10PM (#40870454)
This version seems to be using slightly different rules: my recollection is that the original 2048 prevented a move if it wouldn't cause any blocks to shift or collapse, while this one spawns a block unconditionally.
Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:17PM (#40870512)
It doesn't anymore.

You're right. I pasted your comment to aider and it fixed it on the spot :).

EDIT: see https://git.sr.ht/~temporal/aider-2048/commit/9e24c20fc7145c....

A bit lazy approach, but also quite obvious. Pretty much what you'd get from a junior dev.

(Also if you're wondering about "// end of function ..." comments, I asked the AI to add those at some point, to serve as anchors, as the diffs generated by GPT-4o started becoming ambiguous and would add code in wrong places.)

Re:AI's $600B Question by woodruffw on Wednesday July 03, 2024 @06:44PM (#40870737)
I think it's also not progressing the block size with score: IIRC the original came also begins spawning 8s and 16s once you get above your first 512 block. But I could be misremembering.

(This kind of feedback driven generation is one of the things I do find very impressive about LLMs. But it's currently more or less the only thing.)

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @06:51PM (#40870791)
I don't remember it doing progressive block sizing - I only vaguely remember being mildly annoyed by getting to 2048 taking >2x the effort it took to get to 1024, which itself took >2x the effort of getting to 512, etc. - a frustration which my version accurately replicates :).
Re:AI's $600B Question by meiraleal on Wednesday July 03, 2024 @05:34PM (#40870203)
> I've just had GPT-4o write me a full-featured 2048 clone in ~6 hours of casual chat

Honestly I'm totally in the AI camp but 6 hours to make a 2048 clone?! And that's a good result? Come on.

Re:AI's $600B Question by TeMPOraL on Wednesday July 03, 2024 @05:47PM (#40870303)
Of casual chatting in between making dinner, doing chores, playing with kids, and work. The actual time spent strictly on this was more like 2 hours. And that's with me writing zero lines of code, and using the technology stack (modern web) I hate and suck at (but I'm proficient enough to read the basics).

Also, to be honest, it would've been much faster if GPT-4o didn't occasionally get confused by the braces, forcing me to figure out ways to coerce it into adding code in the right place. This is to say, there's still plenty of low-hanging fruits for improvement here.

Re:AI's $600B Question by fragmede on Wednesday July 03, 2024 @05:50PM (#40870332)
you come on. it's not six hours of focused work, it sounds like six hours while watching Netflix and puttering around.
Re:AI's $600B Question by reaperman on Wednesday July 03, 2024 @08:54PM (#40871461)
The vast majority of devs would take much longer than 6 hours if this task were assigned to them. Yes, the vast majority of devs might suck, but its actually a shockingly low percentage who are genuinely skilled. You are probably surrounded by rare skilled devs.
Re:AI's $600B Question by chillfox on Wednesday July 03, 2024 @08:25PM (#40871318)
I think that comes down to the kind of people you hang out with.

While I use AI quite often, none of my friends or family does. A few of them will use an image gen once or twice a year. And at work, only a few of my colleagues use AI.

So my impression is that current gen AI is too hard to use correctly, has too many rough edges and is not useful enough for most people.

Progress also seems to have stalled around the GPT-4 quality. Everything after GPT-4 (GPT-4 Turbo, GPT-4o, Claude 3 Opus, Claude 3.5 Sonnet) seems to be pretty much producing the same quality output, I have been using Open WebUI to bounce around between the different models and I can't really tell a difference in the quality of them, they are all roughly the same for my use case (programming/sysadmin stuff).

So the question of if a plateau has been hit or if scale can still improve quality is real to me.

Re:AI's $600B Question by ClimaxGravely on Wednesday July 03, 2024 @08:48PM (#40871432)
can you show the 2048 clone?

EDIT : My bad, I see you posted the link elsewhere (link for posterity http://jacek.zlydach.pl/v/2048/ )

TBH 6 hours seems a lot longer than I would have expected.

Re:AI's $600B Question by TeMPOraL on Thursday July 04, 2024 @03:50AM (#40873145)
6 hours of on-and-off casual chatting while working, making dinner, playing with kids, etc. Total time spent in front of keyboard was at most half of that. And would be half of that still, if I had more experience guiding GPT-4o/Aider diffs out of stupid ruts - experience which I gained through this short project.

Also: 6 hours is a lot if you sit down to it and know exactly what to write. Not when you half-remember how the game works, don't have uninterrupted focus time for it, and deal with executive function issues to boot.

Re:AI's $600B Question by ClimaxGravely on Sunday July 07, 2024 @11:59PM (#40902500)
Thanks for the insight! I'm still skeptical that it would be great for me as someone who does this for a living but I can see how it might help me for projects outside of my domain.

I'm happy to wait for now and let the tech mature though.

Re:AI's $600B Question by shermanyo on Wednesday July 03, 2024 @09:11PM (#40871538)
> I've just had GPT-4o write me a full-featured 2048 clone in ~6 hours of casual chat, in between of work, making dinner, and playing with kids; it cost me some $4 in OpenAI bills, and I didn't write a single line of code.

This kind of example always confuses me. I don't see the value vs reading an article like this: https://www.freecodecamp.org/news/how-to-make-2048-game-in-r...

If I said I built a 2048 clone by following this tutorial, noone would be impressed. I just don't see how reading a similar tutorial via a chat interface is some groundbreaking advancement.

Re:AI's $600B Question by ern on Wednesday July 03, 2024 @10:31PM (#40871868)
The difference is that with a chat interface you can ask it questions, you can brainstorm with it, you can drill down into specific concepts and you can do it any language/framework, without waiting for a tutorial to be written for it. And it would help you do the "homework" at the end.

For the tutorial you linked to, there's a lot of prior knowledge assumed, which the author alludes to in the summary, which a chat interface would help with:

This time I decided to focus on the essence of the topic rather than building basic React and CSS, so I skipped those basic parts. I believe it makes this article easier to digest.

Re:AI's $600B Question by nl on Wednesday July 03, 2024 @10:09PM (#40871784)
I agree with this take.

The perspective I take is the 15 year view: The iPhone 1 sucked objectively but by the iPhone 3 the trajectory was clear and 15 years later the world is a very different place.

You hear people very focused on specific shortfalls: "I asked it to write code and look it made a mistake". But there are very clear routes to fixing these and there are lots of people finding it useful despite these bugs.

I think AI is bigger than mobile. I'm nearly 50, and I remember the PC boom, the Internet boom, Social Networking boom, Mobile boom, SaaS boom - probably more that I forget.

I think the PC and Internet booms are the only ones that are as impactful as AI will be in 15 years.

Maybe mobile is as big, maybe not - depends if someone can build AI devices that replace the UX of phones sometime in the next 15 years.

Re:AI's $600B Question by freediver on Thursday July 04, 2024 @11:30AM (#40875675)
Interesting takeaway if this holds true - following the analogy, people will be excited about GPT-16 as much as they are excited about iPhone 16 today, compared to the excitement about first few generations of iPhone. That may mean that LLMs may become so ubiquitous that we won't even notice. Which means there will be no AGI.
Re:AI's $600B Question by TeMPOraL on Thursday July 04, 2024 @01:45PM (#40876715)
If GPT-16 is pretty much GPT-4 but a bit faster and a bit smarter, then sure. If subsequent generations of GPT continue the trend of qualitatively improving on the predecessors, then we'll likely hit AGI somewhere around GPT-10 at the latest.
Re:AI's $600B Question by woopsn on Wednesday July 03, 2024 @11:49PM (#40872177)
Keep in mind, the "hole" takes ChatGPT and Copilot/Gemini/etc into account, at a generous rate of $5-10B per product. The remainder of $500B is about the size of the global cell phone market. Where will it come from?
Re:AI's $600B Question by aleph_minus_one on Thursday July 04, 2024 @12:26PM (#40876122)
> I can't think of a single recent technology that was so widely adopted by tech and non-tech people alike, immediately integrated into day-to-day experience.

Which technology are you talking about? ;-)

What I can clearly say is that I know no one from my social circles and extended social circles who used these AI chatbots for anything else than "simply trying out what is possible" (and ridiculing the results). A quote from a work colleague of me when I analyzed the output of some latest generation AI chatbot: "You shouldn't ask so complicated questions to the AI chat bots [with a huge smile on his face]. :-)"