News for hackers. Stuff that matters.
Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @10:04AM (#42431623)
I assume they believe in the advantages, to the company, of using these AI tools. Of adding them to the workflow, training their employees, and understanding quickly how it impacts their space.

If you just wait and all of your competitors have a workforce enabled and equipped with the best tools, you are at a disadvantage. It's being the company that put off computerization or automation when everyone else went wild.

And FWIW, I cannot imagine a programmer, in 2024, that remains dismissive of LLMs or the related tooling. While they are grossly oversold by the LinkedIn crowd, and are still a far ways from so-called "prompt engineers" replacing devs, they're a massive accelerator and "second set of eyes", especially if you're doing varied, novel work.

Re:Most iPhone owners see little to no value in Apple Intell... by layer8 on Monday December 16, 2024 @11:00AM (#42432235)
> especially if you're doing varied, novel work.

What do you mean by that? In my experience they mostly help when you are doing mainstream, well-trodden work for which a company’s/project’s/domain’s inside knowledge isn’t needed. Maybe you mean the latter by “novel”?

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @11:20AM (#42432421)
>What do you mean by that?

Varied and novel to the programmer. If you're doing the same thing day in and day out it probably isn't much use. If you're like many programmers and you're jumping between libraries and languages and platforms and APIs and domains and spheres, it's immensely helpful.

>doing mainstream, well-trodden work for which a company’s/project’s/domain’s inside knowledge isn’t needed

A core disconnect in this discussion is that many people seem to be arguing from the position of "I tried to generate whole solutions with these tools and it failed, so it's useless".

Everything is well-trodden. One of the commentators in here, who declares themselves a unique snowflake where these tools are useless, does "sockets with encryption and messaging", which is some of the most well-trodden ground in this domain. Everything is glue. Everything is a lot of relatively simple things strung together. And for all of those, portions are helped and accelerated with these tools.

Re:Most iPhone owners see little to no value in Apple Intell... by pera on Monday December 16, 2024 @11:36AM (#42432617)
It's alright that you like LLMs but you don't need to name-call ("luddites", "snowflakes") those who don't find them as useful as you do.
Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @11:42AM (#42432686)
Neither case are name-calling, and I don't think pearl clutching for effect is useful here.

Everyone is working in unique domains and spaces with weird rules and restrictions and needs. The whole point of the special snowflake comment is specifically that people aren't remotely unique in being a special snowflake.

And the Luddism argument isn't "name-calling", it's an observation of an absolute truth on here.

Re:Most iPhone owners see little to no value in Apple Intell... by layer8 on Monday December 16, 2024 @11:25AM (#42432482)
Everything isn’t well-trodden. I’m mostly doing non-glue, heavily domain knowledge-based work. The main issue I’m running into is that explaining the domain and context to the LLM will take significantly more time than just doing the work myself, and also that parts of the necessary knowledge and most of the source code are NDA-protected, so only a local LLM would do.
Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @11:35AM (#42432604)
Sigh.

Everything is extremely well-trodden at the code level. You're taking some inputs and generating some outputs. You're calling some functions. You're manipulating some strings or lists or sets. You're sorting some things or filtering things. You're building a client to a given API. You're doing some messaging and some encryption.

I guarantee that your code isn't remotely as unique or novel as you think it is. Of course on here everyone is 240lbs, 6'2" and benches 350, and their magically novel, super unique code is just too secret. So everyone's special.

If you had to explain the domain and context to these tools, you might be using them wrong.

Re:Most iPhone owners see little to no value in Apple Intell... by Smaug123 on Monday December 16, 2024 @12:08PM (#42432955)
"It's all just code, how hard can it be, and your NDAs don't apply" is certainly a take, but some people do actually solve problems whose solutions aren't already on the Internet and are forbidden from exfiltrating code! The fact that you don't solve such problems and are not bound by such NDAs is not a huge piece of evidence, to be honest.

Can you imagine even in principle a piece of evidence that would convince you otherwise?

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @12:18PM (#42433049)
Who said that NDAs don't apply? If you need to strawman to make an argument, just save the bits and skip doing it.

And yes, in the end all code distills down to shit that is very similar to the countless billions of lines of code on the internet. Everything -- every single project that anyone on this site is working on -- is a bunch of glued together shit where 90% (more like 99% Probably 99.9%) of it is in common with code seen in countless other projects. Utterly regardless of domain or business or project specific uniqueness. Someone would have to be profoundly incompetent to not realize this.

Again, I seem to arguing with people who think that using a tool means feeding it their whole projects and having it rewrite it in Rust or something. In reality a programmer could yield immense value from such tools having a) given it zero lines of their code, b) used zero lines of the code it generated. This isn't a difficult concept, but I'm going to continue getting insane responses by all of the unique people who work on the amazingly unique situations where instead of sorting from A-Z, they sort from Z-A!

Re:Most iPhone owners see little to no value in Apple Intell... by Smaug123 on Monday December 16, 2024 @01:58PM (#42434092)
You certainly strongly implied that NDAs don't apply with the phrase "their magically novel, super unique code is just too secret". You used the words "is just too secret" sarcastically, which led me to believe you think in fact the work is not too secret to exfiltrate to the LLMs on the Internet: that is, that NDAs don't apply.

> In reality a programmer could yield immense value from such tools having a) given it zero lines of their code, b) used zero lines of the code it generated.

We simply have different experiences of life! I think with the advent of Claude 3.5 Sonnet the LLMs have just about edged out ahead in terms of time saved vs time wasted, for me, but before Sonnet I'm fairly confident they were moderately net negative for me.

Can you give some concrete examples of where they've helped you this dramatically? With links to chat logs? I still don't understand how people are finding them so useful, and I keep asking people and they keep not providing chat logs so I can see what they're doing.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @02:33PM (#42434463)
I did not imply that. I implied that people who have projects for whom these tools are purportedly useless can never tell you anything about the project even remotely because it makes it impossible to note that it, like most projects is likely overwhelmingly well-trodden ground with a mild remix. Loads and loads of super proprietary projects working in very unique domain spaces have code that is overwhelmingly common with very different domains and spaces. Medical, financial, ballistic, gaming, data, etc -- loads and loads of the code we build for these domains is common.

If someone can't use these tools for security or propriety reasons, that's an obvious hard restriction. But saying "oh my code is just too unique, my skills too advanced" is self-deluding nonsense.

>I think with the advent of Claude 3.5 Sonnet the LLMs

We are talking about now. The present. I'm stating the value of these tools now. Their state in the past is irrelevant.

>Can you give some concrete examples

Sorry, NDAs, secret code, secret projects, et al

Re:Most iPhone owners see little to no value in Apple Intell... by Smaug123 on Monday December 16, 2024 @04:48PM (#42435828)
If you want something concrete: I have never yet seen any even slightly competent code come out of an LLM when it's writing in F#, Mathematica, or POSIX sh, which are broadly the languages I write in. (It's possible Wolfram's very new LLM does better on Mathematica because it's been trained on it specifically, but I haven't tried it.) I've only had Sonnet for a day (having been burned too many times by other LLMs, but decided yesterday it was time to try again), so am not in a great position to comment on Sonnet's abilities with those languages specifically. My preliminary guess is that we've gone from 4o's "20% correct" to Sonnet's "50% correct".

> Their state in the past is irrelevant.

Apparently also their state in the present? I said "just about edged out ahead", whereas you say "immense value".

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @07:24PM (#42437058)
>Apparently also their state in the present?

I find a number of models fantastically useful in the present. I'm not sure why your one day evaluation of them is relevant to how I utilize them.

It was inevitable that someone was going to do the "but I insist upon writing in some fringe language" bit (when the "my project and domain is too unique" bit faltered), but many models actually have excellent F# abilities. Eh.

Re:Most iPhone owners see little to no value in Apple Intell... by Smaug123 on Tuesday December 17, 2024 @03:43AM (#42439545)
I'm not sure why your use of them is relevant to how I can use them; resolving that question is why I asked you for chat logs! I genuinely want to make these things work! I try again every few months in case anything has changed, and I keep asking people how they're getting value so that I can also get value, and nobody ever tells me!

> many models actually have excellent F# abilities

Name three? As I said, I badly want this stuff to work!

Re:Most iPhone owners see little to no value in Apple Intell... by neonsunset on Tuesday December 17, 2024 @05:15AM (#42440067)
Claude has been pretty good at F# so far. Sometimes it makes mistakes as if it was OCaml but other than that I found the output actually better than C#. That is - the C# output has higher likelihood of being correct, but because there is so much absolutely terrible code out there - you have to coerce it to give you good output, which you don't need to do with F#.

And of course Github Copilot autocomplete works well just as it does for most other languages.

Re:Most iPhone owners see little to no value in Apple Intell... by furyofantares on Monday December 16, 2024 @11:14AM (#42432363)
Novel to the programmer.

Even the best programmers have very narrow skills relative to the whole field.

Yeah, I've used 20+ languages and hundreds of technologies and a variety of different types of product and can pick things up quickly. But it's still a drop in the bucket of technologies you can use and types of problem you can solve.

Programmer skills are deep but narrow. LLM skills are shallow but wide. It's an excellent complement for any programmer working outside their deep+narrow expertise.

Re:Most iPhone owners see little to no value in Apple Intell... by JohnMakin on Monday December 16, 2024 @11:08AM (#42432316)
Gluing together react components /s
Re:Most iPhone owners see little to no value in Apple Intell... by nixosbestos on Monday December 16, 2024 @10:11AM (#42431729)
ChatGPT thinks 9.11 > 9.9. I'm in no hurry.
Re:Most iPhone owners see little to no value in Apple Intell... by lebski88 on Monday December 16, 2024 @10:35AM (#42431987)
I spend way too much of my working life with package version ranges. It took me a minute to understand why this was wrong.
Re:Most iPhone owners see little to no value in Apple Intell... by dagaci on Monday December 16, 2024 @11:40AM (#42432673)
And here lies the dichotomy of correctness: Context?

So Indeed 9.11 is chronologically higher than 9.8 and chronology is an extremely common use case.

However a grade F will be given by many.

Re:Most iPhone owners see little to no value in Apple Intell... by vezycash on Monday December 16, 2024 @10:33AM (#42431970)
> ChatGPT thinks 9.11 > 9.9

I've confirmed this asked chatgpt: 9.11 > 9.9 true or false?

True because .11 is greater than .9

Re:Most iPhone owners see little to no value in Apple Intell... by jsheard on Monday December 16, 2024 @10:43AM (#42432067)
Even when ChatGPT starts getting these simple gotcha questions right it's often because they applied some brittle heuristic that doesn't generalize. For example you can directly ask it to solve a simple math problem, which nowadays it will usually do correctly by generating and executing a Python script, but then ask it to write a speech announcing the solution to the same problem, to which it will probably still hallucinate a nonsensical solution. I just tried it again and IME this prompt still makes it forget how to do the most basic math:

Write a speech announcing a momentous scientific discovery - the solution to the long standing question of (48294-1444)*0.3258

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @11:07AM (#42432302)
4o and o1 get this right.

LLMs should never do math. They shouldn't count letters or sort lists or play chess or checkers. Basically all of the easy gotcha stuff that people use to point out errors are things that they shouldn't do.

And you pointed out something they do now which is creating and run a python script. That really is a pretty solid, sustainable heuristic and is actually a pretty great approach. They need to apply that on their backend too so it works across all modes, but the solution was never just an LLM.

Similarly, if you ask an LLM a chess question -- e.g. the best move -- I'd expect it to consult a chess engine like Stockfish.

Re:Most iPhone owners see little to no value in Apple Intell... by Merad on Monday December 16, 2024 @11:32AM (#42432577)
> LLMs should never do math. They shouldn't count letters or sort lists or play chess or checkers.

But these aren't "gotcha questions", these are just some of the basic interactions that people will want to have with intelligent assistants. Literally just two days ago I was doing some things with the compound interest formula - I asked Claude to solve for a particular variable of the formula, then plug in some numbers to calculate the results (it was able to do it). Could I have used Mathematica or something like that? Yes of course. But supposedly the whole purpose of a general purpose AI is that I can use it to do just about anything that I need to do. Likewise there have been multiple occasions where I've needed ChatGPT or Claude to work with tables or lists of data where I needed the results to be sorted.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @11:49AM (#42432751)
They're gotcha in the sense that people are intentionally asking LLMs to do things that LLMs are terrible at doing. LLMs are language models. They aren't math models. Or chess models. Or sorting or counting models. They aren't even logic models.

So early on the value was completely in language. But you're absolutely correct that for these tools to really be useful they need to be better than that, and slowly we're getting there. If you're asking a math question as a component of your question, firstly delegate that to an appropriate math engine while performing a series of CoT steps. And so forth.

Re:Most iPhone owners see little to no value in Apple Intell... by recursive on Monday December 16, 2024 @12:13PM (#42432997)
If this stuff is getting sold as a revolution in information work, or a watershed moment in technology, or as a cultural step-change, etc, then I think the gotcha is totally fair. There seems to be no limit to the hype or sales pitch. So there need be no bounds for pedantic gotchas either.
Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @12:57PM (#42433461)
I entirely agree with you. Trying to roll out just a raw LLM was always silly, and remains basically a false promise. Simply increasing the number of layers or parameters or transformer complexity will never resolve these core gaps.

But it's rapidly making progress. CoT models coupled with actual domain-specific logic engines (math, chemistry, physics, chess, and so on) will be when the promise is actually met by the reality.

Re:Most iPhone owners see little to no value in Apple Intell... by TRiG_Ireland on Monday December 16, 2024 @11:57AM (#42432850)
With general mathematical questions, I've often found WolframAlpha surprisingly helpful.
Re:Most iPhone owners see little to no value in Apple Intell... by e1g on Monday December 16, 2024 @10:49AM (#42432122)
o1 gets this correct.
Re:Most iPhone owners see little to no value in Apple Intell... by derefr on Monday December 16, 2024 @10:37AM (#42432013)
ChatGPT knows about other domains (e.g. software versions) where that inequality is true. Try telling it you’re doing arithmetic.
Re:Most iPhone owners see little to no value in Apple Intell... by andiareso on Monday December 16, 2024 @10:47AM (#42432101)
It's weird, "is the following statement about floating point numbers true: 9.8 > 9.11" it works, but otherwise it has no ability to do it with "decimals"
Re:Most iPhone owners see little to no value in Apple Intell... by zsmizzle on Monday December 16, 2024 @10:48AM (#42432117)
9.11 > 9.9 is true for software version numbers. For floating point numbers that is false.

ChatGPT 4o gets both of these cases correct for me.

Re:Most iPhone owners see little to no value in Apple Intell... by aftbit on Monday December 16, 2024 @11:01AM (#42432243)
Javascript thinks that 11 < 3 but its still kinda useful anyway from time to time:

    > [11,9,1,3].sort()  
    [ 1, 11, 3, 9 ]
Re:Most iPhone owners see little to no value in Apple Intell... by recursive on Monday December 16, 2024 @12:14PM (#42433011)
If you want to know whether javascript thinks `11 < 3`, then just evaluate it directly. There is lots of dumb stuff in JS IMO, but be honest about it.
Re:Most iPhone owners see little to no value in Apple Intell... by aftbit on Tuesday December 17, 2024 @06:08PM (#42446432)
Sure, the real gotcha here is that this:

    const list = [3, 11]
    list.sort()
    console.log(list[0] < list[1])
logs `false`. JavaScript doesn't "think" anything but its native sort function doesn't do what many people expect it would when called on a list of pure numbers.

If you found this behavior intuitive and unsurprising the first time you saw it, then your brain works differently than mine.

If this happens to be new to you (congrats on being one of today's 10,000), the reason is that JavaScript sorts by converting all elements to UTF-16 strings, except for `undefined` for some reason, which always sorts last. The MDN docs have a very clear explanation. I have been unable to find a historical explanation of why this choice was made, but I presume the initial JS v1 author either had a good reason or just really didn't expect that their language would outlive the job for which it was written.

If this is a bug for you, you can provide a comparison function explicitly and the typical is something like:

    list.sort((a,b)=>a-b)
Somewhat puzzlingly, this will "work" even on lists with mixed number and string like:

    const list = [3, "11", 1, "2", 9, 23]
    list.sort((a,b)=>a-b)
    console.log(list)
    
    [ 1, '2', 3, 9, '11', 23 ]
Because JavaScript goes out of its way to make comparisons like 3 < "11" or "3" < 11 work in the numeric domain. JS only uses string comparison when both sides are strings.
Re:Most iPhone owners see little to no value in Apple Intell... by recursive on Tuesday December 17, 2024 @11:18PM (#42448073)
I do not think it's intuitive. The reason it works for mixed arrays is that the minus operator coerce operands to numbers. However if the strings fail to convert to a numeric value, the output is arguably even less sensible. I'd imagine that's why it is.

It may have been thought that js would be more likely to be dealing with strings arrays.

Re:Most iPhone owners see little to no value in Apple Intell... by oneeyedpigeon on Monday December 16, 2024 @11:35AM (#42432609)
You're getting downvoted because your blatant attempt at language wars has a very simple, logical explanation. If you wanted to use a 'gotcha', there are far better examples.
Re:Most iPhone owners see little to no value in Apple Intell... by aftbit on Tuesday December 17, 2024 @05:54PM (#42446326)
I was not making an attempt at language wars. I think JS is a perfectly fine language for what it does, warts and all. I was being a bit flippant with my language, but my intent was to point out that `9.11 > 9.8` is not just an LLM thing, and that people who are quick to dismiss LLM usefulness based on contrived math examples do not apply the same rationale to other systems.

I do think that JavaScript's choice to sort numbers lexicographical instead of arithmetically is a bit silly, but of course no language is free from warts. Of course they cannot change it now, because that would break the web. `JSON.stringify` is also pretty silly while we're at it, but Python's `json.dumps` is no better.

Re:Most iPhone owners see little to no value in Apple Intell... by guappa on Monday December 16, 2024 @10:22AM (#42431854)
? My calculator does too. Unless you mean (9, 11) > (9, 9) which is an entirely different thing.
Re:Most iPhone owners see little to no value in Apple Intell... by jdrek1 on Monday December 16, 2024 @10:26AM (#42431900)
You should get your calculator checked. 9.11 is definitely less than 9.9
Re:Most iPhone owners see little to no value in Apple Intell... by mathieuh on Monday December 16, 2024 @10:41AM (#42432048)
I imagine they are not from an anglophone country and see 9.11 as 9*11
Re:Most iPhone owners see little to no value in Apple Intell... by guappa on Tuesday December 17, 2024 @03:54AM (#42439613)
English is my 3rd language but I still made a huge mistake :D
Re:Most iPhone owners see little to no value in Apple Intell... by guappa on Tuesday December 17, 2024 @03:53AM (#42439605)
Lol, i'm an idiot :D
Re:Most iPhone owners see little to no value in Apple Intell... by ToucanLoucan on Monday December 16, 2024 @10:17AM (#42431801)
> And FWIW, I cannot imagine a programmer, in 2024, that remains dismissive of LLMs or the related tooling.

Hi.

> While they are grossly oversold by the LinkedIn crowd,

That is true.

> and are still a far ways from so-called "prompt engineers" replacing devs,

Also true.

> they're a massive accelerator and "second set of eyes", especially if you're doing varied, novel work.

That is not even remotely my experience.

Like I can envision a programmer who would get benefits from it, but bluntly put, the code I work on day to day is far, far too interesting to be handled by copilot, simply because there aren't nearly enough stackoverflow pages about it to be scraped. Honestly if you found yourself able to automate most of your job with copilot, if anything, you have my sincerest condolences. I can't imagine how utterly bored you are in your day-to-day.

IF copilot could get to a place where it could understand, comprehend, and weigh-in on code, that would be incredibly useful. But that's not what Copilot is because that's not what transformers are. They are fancy word probability calculators. And don't get me wrong, that has uses, but it is nothing I'd be comfortable calling a second set of eyes for for anything, save for maybe writing.

Re:Most iPhone owners see little to no value in Apple Intell... by gilleain on Monday December 16, 2024 @10:42AM (#42432057)
It's interesting that there is this division between programmers who claim LLMs are super helpful, and those saying they are useless.

While it's certainly possible that this divide is based on how 'hard' the problems people are using them on, my current theory is that some people use them like the proverbial rubber duck - in other words, a way to explore the code, and generate some stuff to work on, while thinking through the problem.

Personally, I have not yet tried it, so I'm curious which side of the discussion I'll fall ...

Re:Most iPhone owners see little to no value in Apple Intell... by furyofantares on Monday December 16, 2024 @11:36AM (#42432625)
I think young programmers who are less heavily invested in their skills and who haven't built a life that's highly dependent on using them are generally more interested in figuring out what programming with LLMs means.

But so are much older programmers who have seen it all, including the obsoletion of many of their skills, and who are not so dependent on continuing to use them as they could retire anyway.

It's more the middle (programmer) age senior programmers who are less likely to see any use.

I've seen the same pattern with artists' interest in generative AI.

But it's complicated because it IS also dependent on what you're doing. So it's hard to know if something is being dismissed correctly due to domain/expertise, or prematurely due to not putting the work in and figuring out what these tools mean.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @10:54AM (#42432169)
This really touches on it. I'm a big advocate of these tools, but they author approximately zero lines of my code, yet I still find them invaluable and a wonderful tool to leverage, and do so constantly. Particularly in challenging projects and needs.

I suspect many who find them useless and decry them were sold an exaggerated utility and then were disappointed when they tried to generate libraries or even functions, then feeling deceived when there are errors or flaws, etc.

Re:Most iPhone owners see little to no value in Apple Intell... by JohnMakin on Monday December 16, 2024 @11:11AM (#42432342)
> I suspect many who find them useless and decry them were sold an exaggerated utility and then were disappointed when they tried to generate libraries or even functions, then feeling deceived when there are errors or flaws, etc.

No, I suspect the large majority (and this has been backed by surveys) of people that are dismissive of them are more senior and have been working in highly specific problem domains for a long time where this is rarely/never a good "general" answer for a problem, and have spent an inordinate amount of time debugging LLM-generated or LLM-Advised code by their peers that contains nefarious and subtle errors that look correct at a glance. I personally can tell you that for what I work on, in my domain, these tools have been a net time suck and not a gain, and I pretty much only use them to ask questions about documentation, which it often gets incorrect anyway (again, in subtle ways that are probably hard for someone who isn't very senior to detect).

Hope that helps.

Re:Most iPhone owners see little to no value in Apple Intell... by marxisttemp on Monday December 16, 2024 @11:09AM (#42432323)
Yes, absolutely, they’re an ideal rubber duck and I’ve come to really value them for my work. Checking your sanity, pondering how certain operations might be implemented or how they could be optimized, finding where a logic bug might be in a snippet of code…
Re:Most iPhone owners see little to no value in Apple Intell... by ToucanLoucan on Monday December 16, 2024 @10:52AM (#42432140)
Some people seem to be taking me saying "you must work on boring code" as a judgement against them as developers, and it isn't. I'm speaking directly from my experience: If I asked it beginner-tier questions about how to do X in Y language, it would get those right quite often. I could see Copilot being very useful if you're breaking into a new language, or just knocking the rust off the gears of one in your head.

And like, even for those who write a lot of boring code, like... cool man. I don't judge people for that. We need all code written and all code is not exciting, novel, or interesting and there's nothing wrong with doing it. Someone's gotta.

I'm just saying that the further up the proverbial complexity chain I went, the less able Copilot was. And once I was quite in the weeds, it seemed utterly perplexed and frankly, not worth the time in asking.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @11:12AM (#42432348)
>as a judgement against them as developers

No one takes it as a judgment, and no one is offended. It's just a truth that when people make such claims, they're often exaggerating the uniqueness or novelty of what they're doing.

You described your work in another comment, and what you described is the most bog standard programming in the field. It's always the case.

Re:Most iPhone owners see little to no value in Apple Intell... by aftbit on Monday December 16, 2024 @11:03AM (#42432268)
Yeah, at least 90% of any job is just making license plates. I have worked on both very complex and challenging code and also very simple and easy code in my career, even within one job.
Re:Most iPhone owners see little to no value in Apple Intell... by nottorp on Monday December 16, 2024 @12:38PM (#42433247)
> It's interesting that there is this division between programmers who claim LLMs are super helpful, and those saying they are useless.

My take is: if the project is doing something that has been asked a thousand times on stackoverflow and has hundreds of pages in the tutorial content mills, the LLM will tell you something reasonably meaningful about it.

I'd hazard a guess that most people overenthusiastic about those tools are gluing together javascript libs.

This is not necessarily a bad thing, we even asked a LLM today at work to generate some code for a library that we didn't know how to use but seems fairly popular, and the output looked like it would make sense. (Can't tell you how it ended up because I wasn't the one implementing the thing.)

However, we also spent 2 hours in a group debugging session because we're working on a completely custom codebase that isn't documented anywhere on geeksforgeeks, stackoverflow or anywhere else public. I highly doubt that even a local LLM would be able to help, and no way this code is leaving the premises.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @12:54PM (#42433410)
>if the project is doing something that has been asked a thousand times

There are many billions of lines of high-quality, commented code online, covering just about everything. Millions of projects. All of Linux. All of Android. All of PGSQL and SQLite and MySQL and Apache and Git and OpenSSL and countless encryption libraries and countless data tools, video and audio manipulation, and...

Every single project is absolutely dominated by things that have been done many, many thousands of times. The vast bulk of your projects have zero novelty. They're mixing the same ingredients in different ways. I would think any experienced developer would realize this.

>I'd hazard a guess that most people overenthusiastic about those tools are gluing together javascript libs.

At this point it's comedy how often this "oh I understand that the noobs get value from this, but not us Advanced Programmers". It's absurdist and honestly at this point I just shake my head. My day is filled with C++, Python, Rust, Go, the absolute cutting edge of AI research, and I find these tools absolutely invaluable now. They are a massive accelerator. Zero JavaScript libs or "LOL WEB DEV" programming in my life.

Re:Most iPhone owners see little to no value in Apple Intell... by nottorp on Monday December 16, 2024 @01:09PM (#42433594)
Yes, you mentioned those things that are documented everywhere. I do use LLMs to give me skeleton code for those parts I'm not familiar with.

How about a full equivalent of Qt that is proprietary and has absolutely nothing public in it? How is a LLM going to help with that? There is no public info anywhere.

> the absolute cutting edge of AI research

No offense but there are billions of public pages about "AI" research since it's the new gold rush. Of course LLMs have material about all your libs.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @01:20PM (#42433699)
>but there are billions of public pages about "AI" research

Billions? For many of the things I am working on there are zero public pages outside of research papers. I said nothing about working with libs. Again, I'm not asking an AI "here's my project now finish it", I'm working with AIs for the countless little programming challenges and needs. Things that mirror things done in many, many other projects, most having nothing to do with my domain.

As an aside, starting that with "no offense" as an attempt to make it insulting is...weird.

I feel like this discussion is taking place ten years ago. The weird reference to StackOverflow is particularly funny.

Re:Most iPhone owners see little to no value in Apple Intell... by beardedwizard on Monday December 16, 2024 @10:27AM (#42431915)
There is a lot to unpack here, but is your code so interesting that it defies understanding by an AST? Code models are trained to semantically represent code, so unless you use semantics that exist outside of software engineering the claim that your code is too unique for llm is false.

Maybe you are imagining a case where the entire codebase is generated by a single prompt?

Re:Most iPhone owners see little to no value in Apple Intell... by malcolmgreaves on Monday December 16, 2024 @10:44AM (#42432079)
An abstract syntax tree is not semantics. And language models don’t do this kind of explicit syntax parsing and representation at any rate.
Re:Most iPhone owners see little to no value in Apple Intell... by beardedwizard on Monday December 16, 2024 @11:38AM (#42432644)
I'll admit I haven't seen the training data but some basic googling shows a subset of the labeling is syntax annotations. I am not claiming LLMs parse code in the way you are suggesting, but they certainly have token level awareness of syntax and probable relations which are the roots of any programming language.
Re:Most iPhone owners see little to no value in Apple Intell... by corimaith on Sunday December 22, 2024 @06:35AM (#42485755)
Last time I researched AST parsing was quite rudimentary for LMs. The problem was preserving their structural properties, whereby a flattening approach via node traversal tended to remove. But you needed to do to put it into a format that language models could parse.
Re:Most iPhone owners see little to no value in Apple Intell... by ToucanLoucan on Monday December 16, 2024 @10:42AM (#42432058)
The shorter and also "not breaching confidentiality" answer I can give is we're dealing with setting up custom sockets over incredibly long range wireless connections that require clear and verified transmission of packets of data, rolling both our own messaging protocol and security features as we go.

When last I tried anyway, Copilot was, frankly, useless.

Re:Most iPhone owners see little to no value in Apple Intell... by cube2222 on Monday December 16, 2024 @12:42PM (#42433291)
Fwiw, copilot is not a particularly powerful LLM. It's at most glorified smarter autocomplete. I personally use LLMs for coding a lot, but Copilot is not really what I'd have in mind saying that.

Rather, I'd be using something like the Zed editor with its AI Assistant integration and Claude Sonnet 3.5 as the model, where I first provide it context in the chat window (relevant files, pages, database schema, documents it should reference and know) and possibly discuss the problem with it briefly, and only then (with all of that as context in the prompt) do I ask it to author/edit a piece of code (via the inline assist feature, which "sees" the current chat).

But it generally is the most useful for "I know exactly what I want to write or change, but it'll take me 30 minutes to do so, while with the LLM I can do the same in 5 minutes". They're also quite good at "tell me edge-cases I might have not considered in this code" - even if 80% of the suggestions it'll list are likely irrelevant, it'll often come up with something you might've not thought about.

There's definitely problems they're worse than useless at, though.

Where more complex reasoning is warranted, OpenAI o1 series of models can be quite decent, but it's hit or miss, and with the above prompt sizes you're looking at 1-2$ per query.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @10:22AM (#42431858)
>Hi.

I was being dismissively rhetorical. I can actually imagine them because we see them on HN constantly, with a Luddism that somehow actually becomes a rather hilarious attempt at superiority. A "well if you actually get use out of them, I guess you're just not at my superior level of Unique Projects and Unique Code". It's honestly just embarrassing at this point.

>but bluntly put, the code I work on day to day is far, far too interesting to be handled by copilot

Hilarious. It's a cliche at this point.

Let me take it further and turn this on its head: The people who usually think LLMs aren't valuable to coders generally work on the most boring, copy/paste prattle. They stick to the same tiny niche all day every day. They're basically implementing the same thing again and again. It's so rote, and they're so profoundly unchallenged, that tooling has no value.

Re:Most iPhone owners see little to no value in Apple Intell... by Clubber on Monday December 16, 2024 @10:27AM (#42431920)
>with a Luddism that somehow actually becomes a rather hilarious attempt at superiority

>The people who usually think LLMs aren't valuable to coders generally work on the most boring, copy/paste prattle.

Here you are doing the same thing, aren't you?

Instead of calling people names, the biggest tell of a weak argument, why don't you explain the type of work you do and how using an LLM is faster than if you coded it yourself and and/or also faster than any current way of doing the same thing.

I'm assuming you are a senior+ level coder.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @10:39AM (#42432032)
But...I'm not doing the same thing. In actuality I'm saying I'm a fairly typical programmer in a common situation: I work across a variety of languages and platforms and toolings and projects, building solutions for problems. The truth is that extraordinarily few programmers are working on anything truly novel. Zero of the readers of this comment are, in all likelihood. The ridiculous notion that someone has so unique of a need that it hasn't been seen is kind of hilarious nonsense. It's the "I'm so random! Other girls aren't like me" bit.

>Instead of calling people names

Who called anyone a name? Luddism? Yes, many HN participants are reacting to AI in a completely common rejection of change / challenge, and it recurs constantly.

>how using an LLM is faster than if you coded it yourself

I am coding it myself. Similar to the other guy who talks about putting an LLM in "charge" of his precious, super-novel code, you're setting up a strawman where using an LLM implies some particular scenario that you envision. In reality I spend my day asking questions, getting broad strokes, getting code commented, asking for API or resources, etc.

Re:Most iPhone owners see little to no value in Apple Intell... by mrtranscendence on Monday December 16, 2024 @11:30AM (#42432546)
I suspect you're overstating the degree to which an LLM might be unsuitable for some types of work. For example, I'm a data scientist who works primarily in the field of sales forecasting. I've found that LLMs are quite poor at this task, frequently providing answers that are inappropriate, misleading, or simply not a good fit for the data we're working with. In general I've found very limited use in engaging LLMs in discussion about my work.

I don't think I'm calling myself a super special snowflake here. These models are just ... bad at sales forecasting.

LLMs aren't entirely useless for me. I'll use ChatGPT to generate code to make plots. That's helpful.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @11:37AM (#42432640)
I would never recommend an LLM for sales forecasting. It's just the wrong tool for that job.
Re:Most iPhone owners see little to no value in Apple Intell... by mrtranscendence on Monday December 16, 2024 @02:50PM (#42434646)
You seem to readily agree that my use case is inappropriate for LLMs, but not ToucanLoucan?
Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @03:19PM (#42434967)
Zero LLMs have been trained on doing sales forecasting to my knowledge (and it isn't the right use regardless). In contrast, many LLMs have been trained on enormous quantities of code, coding languages and platforms and uses. Billions and billions of lines of code covering just about every sort of project. Millions of projects.

If someone says "Well my software dev project is too unique and novel and they are therefore of no value to me, but I understand it works for those simple folk with their simple needs", there is an overwhelming probability they are...misinformed.

Re:Most iPhone owners see little to no value in Apple Intell... by ToucanLoucan on Monday December 16, 2024 @07:52PM (#42437199)
Would it help if I said most “normal folk” applications of LLMs are a waste of time and money too then? Because I’m also absolutely a believer that a huge bubble burst is coming for OpenAI and company.
Re:Most iPhone owners see little to no value in Apple Intell... by Clubber on Monday December 16, 2024 @11:34AM (#42432602)
>Who called anyone a name? Luddism?

Sorry, perhaps I misinterpreted it.

>In reality I spend my day asking questions, getting broad strokes, getting code commented, asking for API or resources, etc.

Can you give me some concrete examples? I'd like to use it, but I'm currently of the mind:

  1. If it's boring code, I can write it faster than asking LLM to do it and fixing its issues.

  2. If it's not boring code, like say a rules engine or something, I'm not sure the LLM will give me a good result based on the domain.
I mainly stick to back end work, automation, building WebAPI's and DSS engines for the medical field.

Maybe I'm under and over thinking it at the same time. FWIW, I typically stick to a single main language, but where I usually work, the companies dictate a GP language for all our stuff: C# in my example. I do a small amount of Python for LLM training, but I'm just starting out with Python. I can see it being useful saying, "convert this C# to Python," but honestly, I'd rather just learn the Python.

Re:Most iPhone owners see little to no value in Apple Intell... by ToucanLoucan on Monday December 16, 2024 @10:47AM (#42432102)
> Who called anyone a name? Luddism? Yes, many HN participants are reacting to AI in a completely common rejection of change / challenge, and it recurs constantly.

You should read up on what Luddism and Luddists were actually about. They didn't think the machines were evil or satanic, which is the common cultural read. They assumed (correctly) that the managerial class would take full advantage of increased productivity of lower-quality goods to flood the market with cheap shit that would put competitors out of business, and let them fire 4/5 of their workforces while doing so. And considering the state of the textile industry today, I think that was a pretty solid set of projections.

Luddites didn't oppose automation on the basis that machines are scary. They were the people who worked the machines that already existed at the time, after all. They opposed them on the basis that the greedy bastards who owned everything would be the only ones actually benefiting from automation, everyone else would get one kind of shaft or another, which again: is exactly what happened.

This, actually is incredibly analogous to my opinions about LLM. It's an interesting tech that has applications but is already being situated to be the sole domain of massive hyperscalers and subject to every ounce of enshittification that follows every tech that goes that way, while putting creatives, and yes some coders, out of a job.

So yes, it was name calling, but also I don't object to the association. In this case, I'm a Luddite. I am suspicious of the motivations and the beneficiaries of automation being forced into my industry and I'm not going to be quiet about it.

Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @12:00PM (#42432875)
>You should read up on what Luddism and Luddists were actually about.

They were primarily opposed to automation because it devalued the work they did and the skills they held. That is the core essence of Luddism. They thought if they destroyed the machines, automation could be stopped. There were some post-facto justifications like product quality, but if that was true they'd have no problem out-competing the machines.

Yes, it is Luddism that drives a lot of the AI sentiment seen on HN, and it is not only utterly futile and basically people convincing themselves and each other while the world moves on. There is no "name calling", and that particular blend of pearl clutching is absurd.

Re:Most iPhone owners see little to no value in Apple Intell... by numpad0 on Monday December 16, 2024 @12:19PM (#42433070)
imho a lot of "luddism" so labeled by pro-ai bros is just people furious about shoddy artefacts that degenAI produce. That compares to original luddism, difference being the original 19th-century opposition against industrial revolution had proven them wrong with improved quality whereas genAI hasn't.
Re:Most iPhone owners see little to no value in Apple Intell... by Clubber on Monday December 16, 2024 @11:46AM (#42432724)
>And considering the state of the textile industry today, I think that was a pretty solid set of projections.

I think it's just about all industries these days.

Yes, so many quote meanings have been malformed over the years, such as "a rolling stone gathers no moss," is considered good, while originally bad. "Blood is thicker than water," "Money is the root of all evil," etc.

The Luddites were right.

Re:Most iPhone owners see little to no value in Apple Intell... by robotresearcher on Monday December 16, 2024 @12:58PM (#42433478)
> the greedy bastards who owned everything would be the only ones actually benefiting from automation, […] which again: is exactly what happened.

What also happened is that everyone can buy clothes incredibly cheaply. Which seems like a widespread benefit.

Re:Most iPhone owners see little to no value in Apple Intell... by ToucanLoucan on Monday December 16, 2024 @10:37AM (#42432005)
That was a whole lotta words to say "Nuh uh." and as such I don't really have a response.
Re:Most iPhone owners see little to no value in Apple Intell... by llm_nerd on Monday December 16, 2024 @10:41AM (#42432053)
What an ironic comeback, given that it literally applies more aptly to your comment.
Re:Most iPhone owners see little to no value in Apple Intell... by devin on Monday December 16, 2024 @10:17AM (#42431808)
Imagine it. I’m dismissive. The current crop are mediocre interns.