1) Wouldn't want to go back
2) Wouldn't believe that it's about to replace human intellectual work
In other words AI got advanced enough to do amazing things but not 500B or T level of amazing and people with the money are not convinced that it will be anytime soon.
I’ve tried to use it as a web search replacement and often the information is generic or tells me what I already know or wrong.
I’ve used a code suggestions variant long before OpenAI hype started and while sometimes useful, rarely is it correct or helpful on getting over the next hurdle.
Any code from my coworkers is now just AI slop they glanced over once. Then I spend a long time reviewing and fixing their code.
I really don’t find spending time writing long form questions so a bot can pretend to be human all that time saving, especially if I have to clarify or reword it to a specific “prompt-engineer” quality sentence. I can usually find the results faster typing in a few keywords and glancing at a list of articles. My built in human speed reading can determine if what I need is probably in an article.
LLM seriousness has made my job more difficult. I would prefer if people did go back.
It's very good at handling the BS part of coding but also its very good at knowing things that I don't know. I recently used it to hack a small bluetooth printer which requires its own iOS app to print, using DeepSeek and ChatGPT I was able to reverse engineer the printer communication and then create an app that will print whatever I want from my macOS laptop.
Before AI I would have to study how Bluetooth works now I don't have to. Instead, I use my general knowledge of protocols and communications and describe it to the machine and I'm asking for ideas. Then I try things and ask the stuff that I noticed but I don't understand, then I figure out how this particular device works and then describe it to the machine and ask it to generate me code that will do the thing that I discovered. LLMs are amazing at filling the gaps in a patchy knowledge, like my knowledge of Bluetooth. Because I don't know much about Bluetooth, I ended up creating a CRUD for Bluetooth because that's what I needed when trying to communicate and control my bluetooth devices(it's also what I'm used to from Web tech). I'm bit embarrassed about it but I think I will release it commercially anyway.
If I have a good LLM under my hand, I don't have to know specialised knowledge on frameworks or tools. General understanding of how things works and building up from there is all I need.
It's like a CNC machine but for coding.
LLMs so far seem to be good at developing prototype apps. But most of my projects already have codegen and scaffolding tools so I guess I don’t get that use out of them.
I predict that once you release your embarrassing app, you will find all the corner cases and domain secrets come rearing out with little ability of the LLM to help you (especially with Bluetooth).
For other stuff, I still find it very useful because why would I bother to code something non-novel when I can just tell the LLM what I need?
For example, if I need a code that finds the device that given characteristics belongs(bluetooth stuff, again) to I can just tell the LLM to write it for me. It doesn't take a genius to write such a code, its elemental stuff and I would rather not spend my working memory on remembering the structures and names of variables. I copy+paste the current class that handles the bluetooth comms, tell it that I need a function for sending data to the printer and it gives me back the result. There's no art in writing such a code, its standard code for an API and I would prefer not to bother with it.
And
“It's very good at handling the BS part of coding…”
This is the part that I think is difficult in a team situation.
Learning and understanding is the important part, and certainly isn’t BS.
I understand that it really can make it seem like velocity has increased when you really are shipping things that more or less “work”, but it’s really a good practice to understand your code.
I’ve had to spend a significant amount of time fixing work that was admittedly generated using AI by other engineers, and I really fear engineers are beginning to trade deep understanding for the high of getting something that “works” with little effort.
It might “work” but you might be ignoring the work everyone around you is doing to clean up your brittle code that doesn’t scale and wasn’t thought through at inception.
Code quality actually doesn't matter when you remove the human from the loop as long as it works correctly because it becomes something made by a machine to be interpreted by a machine.
As for security, that mostly stems from the architecture. LLMs mediocracy also helps with following industry conventions and best practices.
In my case I never get the code being written at once, instead I make LLMs write pieces that I put together myself. Never got used to copilot or Cursor, I feel in control only with the chat interface.
Bugs happen but its not that different from any other type of bugs. Also, you end up learning about Bluetooth as bugs and other unexpected behavior happen. The great thing about LLMs is that they are interactive, so for example when collecting Bluetooth packets for analysis I ended up learning that the communication with Bluetooth is a bit like talking through a middleman and some packet types are only about giving instructions to the Bluetooth chip and others are actually about communicating with a connected device.
Using LLM for coding something you don't understand is much different than Googling something, then copy+paste a snippet from Stackoverflow because you can ask for instant explanation and modifications for testing edge cases and other ideas.
For example just today, I dumped a crash log from the Mac version of Microsoft Remote Desktop into it. This damn app locks up 10 times a day for me causing a "Force Quit" event and subsequent crash dump to be generated. Normally what can I do with that crash dump other than send it off to Apple/Microsoft? It identified where it thought the crash was coming from: excessive right clicking causing some sort of foundational error in their logic. Avoiding right clicking has solved the issue for me. Now that I write this out, I could have spent hours upon hours finding a needle in a haystack and that would probably made me a better developer but the bar is too high, there is too much other work I have to get done than to chase this. Instead I would have just lived with it. Now I have some closure at least.
Again it seems like everyone has got their own unique stories. Is AI taking everything over? Not yet. Can I go back to pre-AI? No, its like going back to Windows 95.
I got into coding about a decade ago when cheap outsourcing had been all the rage for a number of years. A lot of my early experience was taking over very poorly written apps that had started off with fast development and then quickly slowed down as all of the sloppy shortcuts built up and eventually ground development to a halt. There's a decent chance LLMs lead to another boom in that kind of work.
For products that won't be scaled, I imagine it becomes just another abstraction layer, with the cost of human input outweighing the cost of the additional infrastructure / beefing up hardware to support the inefficiencies created.
For search, try kagi fastgpt (no subscription required):
For code completion, I’ve found it’s not good at jumping hard hurdles, but it is a bit better than find replace (e.g. it finds things that are syntactically different, but semantically related), and can notice stuff like “you forgot to fix the Nth implementation of the interface you just extended”.
It’s also good at “I need to do something simple in a language I do not know”.
I’ve definitely encountered ai slop from coworkers. I’m sure they also produce stack overflow copy paste garbage too. Dealing with their newly-found increased “productivity” is an open problem.
Insisting on strict static typing helps. The LLMs can’t help with that, and it forces a higher bar before compilation succeeds.
It's buying into the hype. AI is crypto 2.0, the true believers live in their own bubble and their own fantasy world.
I went back. It sucks pretty bad, actually.
RLHF trains it to fool humans into thinking it’s authoritative, not to actually be correct.
Yea idk about that one chief. I have been working in ML (specifically scaling of large model training) at FAANG for the past 8 years, and have been using AI for my work since basically the first time this became even slightly usable, and I don’t share your optimism (or pessimism depending on how you see it). Yes it’s still pretty bad, but you have to look at rate of improvement, not just a static picture of where we are today.
I might still be wrong though and you may be right, but claiming that anyone using AI believes like you do is flat out false. A lot of my colleagues also working in ML researcher think like me btw.
In my opinion, this generation of AI is amazing but isn't it.
But, I am also having more fun building things than perhaps the earliest days of my first code written, which is just over 7 years now. Insofar as 1) goes, yes, I never want to go back. I can learn faster and more deeply than I ever could. It's really exciting!
(Not entirely sure what the next fad will be, but some sort of quantum computing thing doesn't feel unlikely. Lot of noise in that direction lately.)
That seems like a low bar because it already is- it's just not equally distributed yet.
My own productivity has grown far more than 10% thanks to AI, and I don't just mean in terms of dev. It reads my bloodwork results, speeds up my ability to repair a leak in my toilet tank, writes a concise "no I won't lend you money; I barely know you" message... you name it.
Normally all of those things would take much longer and I'd get worse results on my own.
If that's what I can do at the personal level, then surely 10% is an easily-achievable improvement at the enterprise level.
For the last year, I've tried all sorts of models both as hosted services and running locally with llama.cpp or ollama. I've used both the continue.dev vscode extension and cursor more recently.
The results have been frustrating at best. The user interface of the tools is just awful. The output of any models from Deepseek to quen to Claude to whatever other model is mediocre to useless. I literally highlight some code that includes comments about what I need and I even include long explicit descriptions etc in the prompts and it's just unrelated garbage out every time.
The most useful thing has just been ChatGPT when there's something I need to learn about. Rubber ducking basically. It's alright at very simple coding questions or asking about obscure database questions I might have, but beyond that it's useless. Gotta keep the context window short, or it starts going off the rails every single time.
From what I have seen the people that have the most success have AI building something from scratch using well known tooling (read: old tooling).
The problem is that doesn't immediately help most people. We are all stuck in crap jobs with massive, crusty code bases. Its hard for AI because its hard for everyone.
They're still useful tools for exploring new disciplines, but if you're say a programmer and you think ChatGPT or DeepSeek is good at programming, that's a good sign you need to start improving.
I do believe the benefit decreases the more senior or familiar the work is but there is still a noticeable benefit and I think it largely depends on the velocity and life cycle of the product. I think you get less benefit the slower the velocity or the more mature of a product. To deny it like in your post is simply being an intellectual minimalist.
You make a polite but still ad hominem "attack" about me instead of addressing my points with demonstrations of evidence.
Make a video or blog article actually showing how your use of LLMs in coding is making you more productive. Show what it's doing to help you that has a multiplier effect on your productivity.
I don't think it deserves a video or blog, like I already said the multiple posts that have made HN front page have covered it well. - Autocomplete saves me keystrokes usually - Features like Cursor's composer/agent allow me to outsource junior level changes to the code base. I can copy/paste my requirements and it gives me the diffs of the changes when its done. Its often at a junior level or better and tackles multi-file changes. I usually kick this off and go make other changes to the code base.
Now like I have said before, this depends a lot on the velocity of the team and the maturity of the code base. I think more mature products you will have less benefit on feature implementation and most likely more opportunity in the test writing capabilities. Likewise, teams with a slower cadence, thinking a bluechip software company compared to a startup, are not going to get as much benefit either.
Instead of being so aggressive, simply say why it does not work for you. These tools strive in web dev which you may not be involved in!
they don't let me walk at the pace of a SUV.
AI is like the good shoes. they help, and make many tasks a bit easier. but they can't make me into an SUV.
and if they can, then no programmers will have jobs. which is the end-state of this whole LLM thing as far as I can tell.
https://www.youtube.com/watch?v=VHHT6W-N0ak&pp=ygUMTGludXMgQ...
It wrote a daemon for me today with a basic spec in 20 minutes of chat. Would have been a day or so between me and a junior dev. Maybe 2 hours if I wrote it and reminded myself of all the little bits and bobs.
Maybe whatever language you are coding it or whatever project you are working on is not a good fit? It is an equally perplexing situation for myself when I hear anecdotes like yours which don't align with my experience. The fact that you say everything is garbage calls into question either how you are using the tool or something else.
I can reliably use cursor's composer to reference a couple files, give a bullet list of what we are trying to do and point it to one of the better models and the output is junior engineer level or better output. When I say junior, I mean a junior who has experience with the codebase.
It's very difficult to measure productivity of most people, certainly most people in office jobs, so while you can have a gut feeling that you're doing better, it's no more measurable than pre-AI individual productivity measurement was
Maybe you should stop using the Ai slop tools that don't work?
This comment is like saying, “This diet didn’t work for me” without providing any details about your health circumstances. What’s your weight? Age? Level of activity?
In this context: What language are you working in? What frameworks are you using? What’s the nature of your project? How legacy is your codebase? How big is the codebase?
If we all outline these factors plus our experiences with these tools, then perhaps we can collectively learn about the circumstances when they work or don’t work. And then maybe we can make them better for the circumstances where they’re currently weak.
Whereas measuring productivity and usefulness is way more opaque.
Many simple software systems are highly productive for their companies.
Myself, I do find it quite useful in a few respects. First and foremost, as a "better Google/StackOverflow." If something's not working, I can describe my exact scenario and usually get pointed in the right direction. Sometimes the LLM just wastes my time by very confidently telling me some function/library that solves my exact problem exists when in fact it doesn't.
Second, IntelliJ's local LLM is sort of a smarter autocomplete. It makes some outright wrong suggestions, but when there's areas where I have to do a lot of repetitive tasks that follow a simple pattern (like for instance, mapping fields from one type of object to another), it does a pretty good job of making correct suggestions. I definitely appreciate it but it's certainly not doing things like writing a significant portion of code in my style.
I might go back and tweak some stuff, add some extra tags and what not, but often its pretty good at doing what I ask.
Sometimes its suggestions aren't what I was really wanting to do in my codebase, a handful of times it has made up methods or parameters of even well-known libraries. But usually, its suggestions are better than a basic IntelliSense-style autocomplete at least in my experiences.
I haven't used many of the other developer assistant plugins like say GitHub Copilot. I couldn't really say which is better or worse. But I do think using Q Developer has made me faster in many tasks.
I wouldn't expect a tool that doesn't have access to the context of my editor and the files I have open to be very useful for actually coding. There's a lot of context to understand in even a basic application. If you're just asking a locally running app in ollama "give me a method to do x", don't be surprised if it doesn't know everything else happening in your app. Maybe it'll give you a halfway decent example of doing something, but devoid of how it actually plugs in to whatever you're making it might be entirely worthless.
And this is coming from someone who uses LLMs daily at the subscription, API (vscode and 3 nextjs apps) and local level. I have a custom langchain stack, prompt repo, you name it. And regardless of how little or how much I use what I have, or what soup de jour prompt or process (from Keep it simple to Prompt enhancers) I can’t say it’s made a meaningful difference in my life. Even with all of the customization and planning.
It’s a great search engine though.
I swear half the time when I use it to look up the nuances of system API stuff, it's replaying forum, mailing list or Stackoverflow conversations that Google ought to be able to find but somehow can't.
We have been living in a fake economy for quite some time where money is printed and distributed to the "tech" sector. Which isn't really "tech", but mostly entertainment (YouTube, Netflix, Facebook, ...).
Growth of the economy means nothing. The money that has been printed goes to shareholders. What the common man gets is inflation and job losses.
If you want to grow the real economy, build houses and reduce the cost of living.
Yes, I wonder why it is so hard for Western countries to understand that there's no future in a place where housing is more expensive than your average salary. If may look cool for a few years until most people have left or are living on the streets.
don't get me wrong, everyone want cheaper housing but not their house
https://www.cnbc.com/2023/06/26/microsoft-ceo-nadella-said-r...
during the industrial revolution(steam/electricity/internet), the world was growing, there're trains, cars, netflix
bussiness grown with productivity growing, even so, we lived through 2 world wars and dozens of economic crisis
but now is very different, when you repair the tank with LLM's help, when the labour value of repairers is decreased, there's no addition value are produced
there's a very simple thought experiment abt the result of productivity growing alone:
let's assume robotics become to a extremely high level, everything humen work can be reduced to 1/100 with help of robots, what will happen next?
We work 35 hour years instead of 35 hour weeks?
Prior to computerization and databases, millions of people were required for filing, typing, and physically transporting messages and information. All of those jobs, entire fields of work were deleted by computerization.
Because improving the productivity of every employee by 10% does not translate to the company being 10% more productive.
Processes and systems exist precisely to slow employees down so that they comply with regulations, best practices etc rather than move fast and break things.
And from experience with a few enterprise LLM projects now they are a waste of time. Because the money/effort to fix up the decades of bad source data far exceeds the ROI.
You will definitely see them used in chat bots and replacing customer service people though.
All of the things you site are available via search engines, or better handled with expertise so you know how much of the response is nonsense.
Every time I use AI, it's a time waste.
On balance AI gets more things wrong than the best humans and fewer things wrong than average humans.
I get a lot of correct answers from llms, but sometimes they make shit up. Most of the time, it's some function in a library that doesn't actually exist. Sometimes even the wrong answers are useful because they tell me where to look in the reference docs. Ask it to search the web and cite sources, makes it easier to verify the answer.
I don't appreciate what's going on with AI art and AI generated slop, but the idea that they aren't a useful tool is just wild to me.
Some regions or sectors might have experienced higher growth spurts, but the main point stands: the overall economic growth was quite low by modern standards - even though I don't think GDP numbers alone adequately describe the huge societal changes of such sustained growth compared to agrarian cultures before the Industrial Revolution.
[0] https://web.archive.org/web/20071127032512/http://minneapoli... [1] https://www.bankofengland.co.uk/explainers/how-has-growth-ch... [2] https://academic.oup.com/ereh/article/21/2/141/3044162
More seriously though: unless you have privileged information or have done truly extensive research, do not short stocks. And if you do have privileged information, still don't short stocks because unless you have enough money to defend yourself against insider trading like Musk and it's ilk, it's not going to be worth it.
It's perfectly reasonable to determine that a particular high growth stock is not going to perform as well going forward, in which case I'd shift allocation to other, better candidates.
Generally, being long equities is a long term positive expected value trade. You don't have to time the market, just be persistent. On the other hand, as you correctly alluded to, shorting equities requires decently precise timing, both on entry and exit.
With DeepSeek it’s been demonstrated you can get pretty damn for a lot cheaper. I can only imagine that there are tons of investors thinking that it’s better to invest their dollars in undercutting the costs of new models vs investing billions in hardware.
The question is, can Nvidia maintain their grip on the market in the face of these pressures. If you think they can’t, then a short position doesn’t seem like that big of a gamble.
I have an AMD minipc running linux that I use for steam gaming, light development, etc. The kernel taint bit is off.
There is one intel device on the pci/usb buses: wifi/bt, and it’s the only thing with a flaky driver in the system. People have been complaining about my exact issue for something like 10 years, across multiple product generations.
If AMD really cared about making money, they would’ve sent MI300s to all of the top CS research institutions for free and supported rocm on every single product. Investing any less than nvidia, the trillion dollar behemoth, is just letting big green expand their moat even more.
That didn’t work out all that well in the medium term (it did in the short term), though it gave them runway to take a big chunk of intel’s server market.
Whether or not that was a good move, it’s not evidence of some engineering shortcoming.
AMD wants it to be them, but the reality is that the moat is wide.
The closest for AI is Apple, but even then, I’m not certain its a serious competitor; especially not in the datacenter.
For Gaming there’s practically no worthwhile competition. Unreal Engine barely even fixes render bugs for Intel and AMD cards, and I know this for fact.
FD: I’m recently holding shares in nvidia due to the recent fluctuation, and my own belief that the moat is wider than we care to believe, as mentioned.
See further: https://www.morningstar.com/news/marketwatch/20250123167/six...
other markets s like Taiwan are preferable
It doesn't take billions of dollars and all human knowledge to make a single human level intelligence. Just some hormones and timing. So LLMs are mostly a dead end. AGI is going to come from differenst machine learning paradigms.
This is all mostly hype by and for investors right now.
LLM based MoE architectures with some kind of reasoning process ( Claude 3+, o series, R1, grok 3 with thinking ), are the equivalent of v0.2 atm, and they're showing a lot of promise.
But I don't think you can blame users if they're given an immature tool, when it really is on companies to give us a product that is obvious to use correctly.
Its not an exact analogy, but I always like to think of how doors are designed - if you have to put a sign on it, its a bad design. A well designed door requires zero thought, and as such, if "AI" usage is not obvious to 99% of the population, its probably a bad design.
I don't use AI to write code if that code is not short and self contained. It's great at explaining code, great at strategy and design about code. Not so much at actually implementing code larger than 1/4 to 1/3rd it's output context window. After all, it's not "writing code", it's statistically generating tokens that look like code it's seen before. It's unknown if the training code in which the LLM is statistically generating a reply actually ran, it could have been pseudo code explaining that computer science concept, we don't know.
People seem to want a genie that does what they are thinking, and that is never going to work (at least with this technology.) I'm really talking about effective communications, and understanding how to communicate with a literal unreal non-human construct, a personality theater enhanced literary embodiment of knowledge. It's subtle, it requires effort on the user's side, more than it would if one were talking to a human expert in the area of knowledge you operate. You have to explain the situation so the AI can understand what you need, and developers are surprising bad at that. People in general are even worse at explaining. Implied knowledge is rampant in developer conversation, and an LLM struggles with ambiguity, such as implied references. Too many same acronyms in different parts of tech and science. It does work, but one really needs to treat LLMs like idiot savants.
Most people have no clue how to use AI or where to use it in their lives. There was a guy at work who was submitting command-like queries (give meeting summary) and complained about how it left out XYZ. Then I told him to ask "Give me the meeting summary with X, Y, Z" or "what did so and so say about Y."
His mind was blown.
We are in the first inning. We haven't figured out how to integrate this into everything yet.
Maybe we don't need to. The world is fine without a sci-fi chatbot.
"Us self-claiming some [artificial general intelligence] milestone, that's just nonsensical benchmark hacking to me. So, the first thing that we all have to do is, when we say this is like the Industrial Revolution, let's have that Industrial Revolution type of growth. The real benchmark is: the world growing at 10 percent. Suddenly productivity goes up and the economy is growing at a faster rate. When that happens, we'll be fine as an industry."
That's a completely different statement from "AI is generating no value"!
(I always thought that this 'evil microsoft' trope is a sign of stupidity, now i am having second thoughts...)
Bit of a click bait title, but it certainly seems like the realization is setting in that the hype has exceeded near term realistic expectations and some are walking back claims (for whatever reason; honesty, derisking against investor securities suits, poor capital allocation, etc).
Nadella appears to be the adult in the room, which is somewhat refreshing considering the broad over exuberance.