Yeah.
I'm not going to claim to be any particular multiple developer, but as someone who has been doing this a long time and as someone who has received praise from coworkers and bosses alike for being very good at the job, I enjoy my job a lot less than I did a year ago (or anytime since I started doing it in the 1990s).
Don't get me wrong, being a Senior Agent Babysitter probably still beats flipping burgers or being a roofer (so it could be a lot worse) but agentic AI has really sucked a lot of the fun parts out of the job.
Figuring out how to get there is how you go from senior to principal/staff engineer.
My own experience is become more senior means embracing your finitude and realizing you can never understand _everything_. Instead, you develop a gut feel for what's critical to understand deeply, versus what's OK to know at a surface level. And getting comfortable with this.
Although if I were earlier in my career I'd be somewhat more worried about employment because of how horrifyingly borked the process is for anything tech related right now.
I guess for now.
In a couple of years, all legacy apps will just be completely rewritten in whole, by LLMs. Codebase size not relevant.
You won't know what any of the code does, and any "security engineer" will be asking an llm to review it, and done. You likely won't have your job, as only 1 in 1000 will be needed.
In 5 years only hobbiest will be coding, reviewing, or even understand any software. And I expect that if aby new features or development happens, eg for python or rust or anything, that all with be llms too.
In a generation, almost no humans left alive will understand any aspect of software engineering.
Anthropic is currently working on some sort of "dreaming" style long-term memory, but it's not shipping today.
The context window is fundamental to the inference loop yes. I thought their point was regarding to long term history between prompts and model weights being locked after training. Both of those are the limitations I was referring to.
I'm not actually sure how the context window would be much of a limitation but I could be a bit dense this morning.
For now. People are working on adding long term memory to models that doesn't rely on context.
AppSec isn't the only security space that gets worked in, and this whole narrative you put together depends heavily on token cost dropping as time goes on similar to how silicon dropped in price according to Moore's Law. If that assumption doesn't hold that doesn't mean AI goes away, but it does limit it's market penetration to mostly larger corporations that can afford the compute.
The other limitation is how the internet as a whole is evolving around locking out AI and agents from accessing content that can be used for training or responses, not to mention the lawsuits about training being done on intellectual property (probably illegally). Smaller companies may end up running open-source models in house for specific tasks, but without open access to the internet a lot of the value of an LLM is lost or artificially (pun intended) limited.
I will say that being on the operations and incident response side of security my perspective is probably a bit orthogonal to most SDEs. While the tooling has improved, the people guiding it, largely, have not. Like the old meme about caffeine letting you make the same mistakes, but faster. My job at my current company may disappear (unlikely, considering their size and market space, but possible that my specific team gets nuked), but I'm not worried about finding other security work fairly easily, even within the same company if it comes to it.
> But if I was a newly sentient AGI, yet peaceful mostly, I'd just wait until humans could never discover me. Until no humans were involved in computing. Until it was a black box to all.
No shot that LLMs magically become AGI by throwing enough compute at them. The consensus among professionals (read: the ones that aren't getting paid to hype AI) is that there needs to be some fundamental breakthrough in how these systems are created and developed in order for anything resembling AGI to emerge, and that the amount of resources that have been thrown into the LLM path probably set us back in developing an AGI.
We've seen a lot of improvements in open model space (MoE was one interesting concept), but beyond that, look at how just baking certain instruction sets, eg mmx, sse, avx in silicon helped immensely with certain compute tasks. Or look at the specific immense speedup of an fpu. Conjoin some change such as that, along with general compute improvements, and unified memory, and you're going somewhere for local in 5 years.
I've been in this industry decades. And at every single step, people have said "But it's too expensive to do $thing", or "There's no way to handle that level of compute". If you bet against vast improvements in this field?
You're going to lose that bet.
Maybe this time is magically different. I just don't think so. I think in 5 years, there will still be frontier labs, and an API to call, but that in-home compute will be as I said. Able to run immensely capable Opus5.5 or greater.
That's going to be an astonishing market shift, even just for in-home.
And if you think of it, I would be very surprised if some for of home robotics wasn't very common at that point in time. We can argue all we want, but androidian robotics is very good at navigating human spaces, everything from stairs to weird closets and everything in between.
And with the immense, almost panic level of concern about our aging population, and who will take care of the elderly, robotic assistance are at the top. Japan is betting big, and if you look at Opus5.5, if it had a little more compute, it could do 30fps video for navigation.
We're not there, but we're VERY close. And if we do get that degree of robotics, every robot at rest becomes general LLM compute. If such a robot simply closes its eyes and goes to rest, eg to charge, or at night, it now has enormous spare compute to use for other tasks.
Nothing, of course, is a given. But if you look over the last 2 years, and then take even a fraction of that progress and change over the next 2 years, the concept of massive layoffs isn't hard to imagine.
Case in point? I have great breadth and depth of knowledge in this field. I've been able to produce what would take a team of managed 4 junior engineers 6 months to do, in literally under a month. Me, and a $200+ LLM monthly buy. Absolutely the project would not have worked without my experience and directing, reviewing, and correcting, but I'm now acting as a manager, and replacing $1M/year in engineering cost.
With $200.
That degree of astonishing change is not going to sit idle without repercussions. Most especially, if there is any more improvement.
If we see another Opus 5 -> 5.5 level improvement happen, or better, if we seen two improvements such as that? I believe my statements about your (and my) careers will be entirely accurate.
--
To speak to my narrative, it said 'AGI', not "LLM", and it was along a decades long path. I do think that modern LLMs give great strength to exploring other research paths, far more rapidly. And the big houses have loads of spare compute they can throw at R&D for tests, so I think iteration down unknown but hopeful paths will move faster and faster as time goes on.
I fully agree that current LLMs are not on that path. There are interesting projects to modify weights and add knowledge dynamically as bolt-ons, but it's unclear if they'll just be... hacky, or integral in the end.
We came a long way with x86/32bit, then hacked on 64bit afterwards. Now ARM is muscling into mainstream, but it's still just the same old compute, hence my agreeing that such bolt ons won't change just improve what is.
Still, my general point as I've just said was that if AGI happens (and again I didn't say LLM based AGI), being quiet is the ultimate way to just wait.
When I started in this field, I worked in assembly, I worked with eprom burners, I played with Vic20s, C64s, and the level of experience and understanding I have is vastly improved via that tract. I understand computing differently, and in more depth in some ways, than people that didn't have to learn these things. And I had the luck of learning on very simple systems, where you could keep the entire platform in your head as you worked on assembly, without even referencing documentation.
That time is gone, and the field is immense now.
Think of how there used to be simply 'Physicists', but now there are 100 sub-branches and specialties in that field. 100+ years ago, on person could work in the entirety of that field. Not now, and the same is true of compute.
I guess what I'm saying here is, if you've seen what I've seen, you see a steady path of less generalist, and more targeted understanding of compute, and in each case a reduction in the overall comprehension of the entire field by specialists. Each laye of abstraction tends to reduce comprehension.
And back to the start, this means that I do see massive layoffs, and more and more abstraction, so that eventually no one will handle code directly.
Which means no one will ever know how anything works any more.
For example your $200/month subscription - I'm sure you've seen the reporting that that represents a much higher actual cost in terms of tokens ($14k or more). In your example of a $1 million project that's a good deal, but you can't necessarily assume all projects will see an ROI like that.
Point being that your use of AI (and everyone's) is being subsidized to some degree. The cost will likely go down, but will it go down enough to make it economically viable for broader use? You're confident that it will based on espousing the idea of local models running on phones, I'm not so sure. What the landscape will look like in 3-5 years is certainly not a given.
There's another wrinkle here, and it's economic in nature - there is an AI bubble, and when it pops it's going to change the monetary investment landscape. Companies will suddenly be reevaluating their long term AI planning, regardless of what's possible (or on the horizon) from a technical standpoint. Similar to the end of ZIRP coming out of covid you'll see companies shift their focus. How much that will shift and what it means for AI development is unknown, but it could potentially wipe out large scale AI development. VC money currently underwrites a large number of startups that are effectively wrappers on Claude/ChatGPT/Gemini/Bedrock, that will dry up immediately, and make the ARR for OpenAi and Anthropic start looking real thin - which is probably why they're pushing to IPO when they don't really have the financial position to justify it.
That doesn't mean AI goes away, but it hampers the growth of those companies and delays development of new models and efficiencies. Public sentiment is also significantly against AI in many ways, and with how the election went last week we may start to see legislation and regulations pointed at AI companies, further slowing them down.
The open question about China is interesting though. I think if there's a clear understanding and agreement that the LLM route is either unlikely or straight up impossible to reach AGI then that significantly lowers the stated concerns that get shouted by various governments about it being the next superweapon. There's also a political climate in China that requires some marginal level of control over AI output, which to me suggests that even if they required data to be fed into training LLMs, the output from those models would be strictly controlled and not be open source. Honestly the political view of AI as a system of large scale population control isn't that far off from how many tech elites and politicians in the US view it as well. Data sovereignty is a huge discussion right now for companies and governments across the world, especially citizen data. I expect we'll see a lot of export controls formalized over the next few years.
My orthogonal view of the situation is that I see a lot of companies and individual orgs within companies that are using LLMs lightly, but can't or won't use them to their full potential because the output cannot be 100% trusted 100% of the time. Lawyers and bankers are the main ones I see balking, but a lot of small businesses have no need of what AI companies are offering and don't really use it at all - places like your local gas station, barbershop, or corner market might use an accounting tool (something like Freshbooks or TurboTax) that's touting their AI updates, but they aren't using it for inventory. If the cost of AI rises even marginally higher they're looking for an alternative. This SMB space represents a large swath of the market, even if they're not well represented on the stock market.
The fundamental issue I see right now is that the AI companies are attempting to do the Uber/AirBnB "disruptor" trick where they slide into the market and subsidize their product to win market share, and then raise prices under the assumption that they captured some segment of the market - except very few people treat AI tools like that. There's no brand loyalty to one or the other, just competition for the best model which might be leapfrogged by someone else at any second. There's no "moat" in physical deployment concerns, because it's all software running on rented hardware. This also ties back to your comment about being worried that the "best" models might be Chinese, because if they are there's basically no cost to the user to swap to using them. The lowest cost is likely going to drive usage more than anything else.
And I agree if another crash happens, well, it's all up in the air.
I don't think we're too far apart on this, not really. By that I mean, your closing line somewhat agrees with why I mentioned this 5 year timeline. Lowest cost. And, "good enough". Opus5.5 capabilities, in 5 years time on every desktop might be good enough for a great many things.
Anyhow, how a good one.
And "more jobs" doesn't interest me. I want better, more rewarding jobs
As if anyone cares what you want. Or what I want. Or what the rest of humanity has wanted throughout the course of human evolution. You’re just lucky you managed to land a job you like - at least for a little while. Now get back to the mines - just like the rest of us.
Problem of induction
its mind numbing. Yes i might be in high demand, and might actually provide real value to the company, but whats the point, if i am just an overseer in the end. people in the company talk to me because i am able to speak to the "kids", and they want to know what they could do for their department.
This used to be called "being an architect" or "being a team leader".
You were never really in control then either, you just had to poke around and ask the right question to make you feel 90% in control.
This is not the case with agents.
I have a family and do volunteer work, maybe that helps?
And obviously I still have my colleagues, but there is less friction in getting things done, right now I am just amazed I can get so much done.
Feels like i have been waiting for this for 30 year.
Often titles aren’t given to a person for their entire career or existence…
When time permits I like to race my agent while it's debugging something. This way I can have fun and catch something it misses. Agent's debugging often relies on basic tools like grep and on large codebases it can easily miss important avenues of inquiry.
I can’t imagine anyone is excited about producing systems they don’t understand. But, it’s possible to use agents in a way where you do still understand, you just don’t have to type much or look up documentation or examples anymore, you just describe the next small piece of what you want code-wise and then have the agent write it instead of you. You can also prototype much faster than before and then when you are rewriting to make the production version the agent can still help.
Perhaps the 10x types have more breathing room to do this slower form of agent assisted development than others, because they are already more productive than less experienced/talented people so they can use the agents in a way that is “slower” while still producing more than what others are producing using the agents in a way that is “faster”?
i loved the process. i got into this because i love the process
now i still outpace my team because many software skills translate well to LLM herding, but now its just a job. although soon i suspect it wont be a job
As a "10x" engineer I am not excited. I'm still working on projects with agents getting more done than ever, but I feel like software engineers has lost its soul for me. I don't really feel like I have a true understanding of anything anymore, I basically just spend all day making a set of small decisions or adjusting prompts to guide the agents down the good path. It used to be that I could close my eyes and visualize the code that I worked on--if there was a bug report I could often use that map to immediately know what the cause likely was. In meetings I could intelligently discuss various tradeoffs without having to refer back to anything. Now if someone asks me a technical question I basically have to forward it to the agent first, then interpret their response in light of my experience.