Worst case scenario is that it gets SO good at writing code that software engineering teams are severely downsized or are made obsolete altogether, and I find myself out of a job. I’m not expecting UBI to start falling out of the sky any time soon, especially while there are still manual labor jobs that robots can’t do.
Alternative scenario is that individual developers get somewhere around a 2x-5x productivity increase, but why would I want that? That doesn’t give me more free time - that just means I’ll be expected to do more work. Non-technical management already expects ridiculous delivery timelines; now I’ll have to deal with them asking “why can’t you have the whole project done by tomorrow? Why can’t you just have the robot do it?”
It’s a lose-lose situation and none of us asked for this.
It'll be interesting to see what happens when AI truly surpasses human level intelligence, as in, being able to completely replace human jobs, but we're not there yet. It's likely that when we reach that stage, the world will change dramatically and we will either live lives of abundance and leisure or face extinction :)
Third option, the workers no longer control the means of production, and we see levels of inequality that make the railroad barons look like they were middle class.
The bottom line is, at some point in time, automation is going to reduce the amount of human work which needs to be done, and render some folks unemployable --- how does society cope with that? Universal Basic Income is the only reasonable suggestion I've yet seen, but doesn't address the age-old problem of socialism --- it only works until one runs out of other people's money.
Back when computers were first announced, taxing CPUs so as to cover benefits for newly unemployed folks was suggested --- can we put that back on the table?
For a fictional take on this see:
Jevons paradox [0] proposes that as automation reduces the cost of labor then people will find new uses for automation, and this seems to be the historical trajectory. Hundreds of years since the industrial revolution and we still haven't run out of work to do (this could be better or worse given your philosophical premises).
> and render some folks unemployable
If automation truly causes more actually productive work to be done, then as a first-order effect there should be a surplus available to support these people without making anyone else (much) worse off. However as you observe the higher-order consequences of this are very much an open issue.
the current climate crisis suggests that we are running out:
https://dothemath.ucsd.edu/2012/04/economist-meets-physicist...
But we are there. This is a reality we live in for a lot of people. That's why the existential crisis in the OP.
If you're writing react/python/angular or something popular it seems to do amazing things and spit out entire websites (per demos).
Unfortunately, when I try to put together C++, Rust, or even C# using recent libraries like Blazor it chokes up. I fully understand at least one reason why (libraries and language features not being in the training data from 2021) but that makes me feel that perhaps software engineering at the cutting edge or niche is safe and still requires human reasoning. Not to mention things like properly understanding when and why to use certain data structures, real-world impact of coding choices, pricing, esoteric speed/efficiency improvements, etc.
I think there's still a broad general area where good, great, and amazing+ developers can operate without much threat and in fact using their knowledge and experience to leverage GPT-4 (or others) as a force multiplier.
With 32k tokens coming that's like 90kb total chars which 80kb could library or API docs.
Also it can easily be connected to things like pip or GitHub or Google to check documentation. And many tools are coming over the next few months that will put it in a debugging loop.
So maybe it's "safe" in the very near term but that issue of out of date training in no way prevents it from taking software engineering jobs.
I am working hard to build an AI system that can replace me before someone else does.
>...and I find myself out of a job.
Tell me you are the problem in the industry without telling me you are the problem in the industry.
Think about the hunter gatherer who was given a bow, but stuck with throwing rocks because he didn't want to get too efficient.
But more relevantly the instant bows were invented you're quota of mammoths to kill a day didn't go up to that maximum possible number + 1 (because sales guys). It stayed at 1 per week or whatever. It's not efficiency, it's management's unrealistics expectations of productive output that I hear being complained about.
Expect with more efficient hunting methods you could kill more than you did before per day, which meant less hunting days, which meant more time with the wife which in turn meant bigger tribe, which in turn meant you actually had to increase your quota.
Just because you are more efficient doesnt mean your manager becomes an idiot and starts to demand unreasonable output (and if you have an idiotic manager already then you already have the problem).
I have no fucking clue what you are even arguing for.
More, more, more, always more, the ideology of infinite growth belongs to a cancer. Quite literally a self-defeating, pathological mindset. More brought us here, to the present day, and it will probably bring us over a Seneca cliff too.
That's the thing about ambition. It means you will never be content.
As for the latter...I'd say GPT has increased my productivity and therefore allowed me to focus on the more interesting aspects of my work, rather than writing annoying boilerplate code and doing boring tasks where I don't learn anything. I almost never write my own boilerplate anymore.
More productivity doesn't necesarily mean more work. It does mean more focus on interesting work.
You mean the same YouTube that routinely ruins people's livelihoods when it closes their accounts with no recourse? Because I'm totally looking forward to the day when that happens to my development tools.
"We detected that you are using our code to kill vulnerable children (aka orphans). This is against our TOS and we have permanently disabled your account. If you believe this was in error please log into your account and talk to our ChatGPT-powered tech support".
For example, I've been predicting the financial demise of Facebook for over a decade now (amongst other things for being too greedy), but Zuck's still doing well enough. Even if Meta is declining now, it still might have been rational for him to be so greedy over the past decade.
Date Weakly General AI is Publicly Known https://www.metaculus.com/questions/3479/date-weakly-general...
Date of Artificial General Intelligence https://www.metaculus.com/questions/5121/date-of-artificial-...
The latter includes this criterion: "Able to get top-1 strict accuracy of at least 90.0% on interview-level problems found in the APPS benchmark introduced by Dan Hendrycks, Steven Basart et al."
The APPS benchmark: https://arxiv.org/abs/2105.09938
Note that the predicted date of "stronger" AGI has moved quite a lot since GPT-4 is revealed, from late 2030s to 2033 at this moment.
> By the late 2020s, it's entirely possible that a "weaker" AGI will emerge.
We will surely have self-driving cars by then? Right? Right?What I didn’t say but should be a given is that these AI tools won’t be able to completely eliminate the need for any human touch, it will just reduce the need to the point where there won’t be the current huge demand for developers, and thus, the only people that travel down that path will be the ones that are truly passionate about development.
The question then is how exactly does one become better than AI at making software if no one is going to pay you to make software until you are better than AI?
The same issue with art - we need a sea of mediocre artists and a market for their work for great artists to emerge. AI takes over mediocre art market - all commercially driven art disappears.
But even then, self-proclaimed seniors are too scared to start their own startup(s) now because of (1) Unfavourable market conditions (2) VCs hesitant to raise money (3) ChatGPT will extinguish their startup; even if it uses "AI".
I guess this was the result of a decades long quantitive easing, near zero interest rate bubble of cheap money that had to collapse.
And so-called "senior engineer" salaries will now be brought down and deflated since they were inflated and unjustifiably high in the first place and are the main reason why startups run themselves into the ground with little to no path to profitability.
I guarantee you that so far, the only winner in this is OpenAI. Not the 'senior engineers' building on top of someone else's AI API.
In fact, why hire 3 over-priced seniors when one junior with ChatGPT is significantly much cheaper? I quite find it funny that somehow, all hope is instantly lost because of a "AI" spitting out code will replace them. It just shows that the majority of these tech startups were just good at loosing money and being solely dependent on VC cash.
You are overestimating the vast amount of "software engineers" in the world. The overwhelming majority of us are just programmers, we are just gluing together CRUD spaghetti in the random language we grew up with. We don't care too much about work or a career. And most of us don't want to do more, we want to get a decent salary for our boring work. And we certainly do not want to be "solo founders", build products of our dreams or increase our productivity.
This way of living feels threatened now.
Yikes. Productive work is not just a way to earn a living but also a way to achieve personal fulfillment and happiness. It's a means of creating value and contributing to society. A person who works just for the salary and does not find any meaning in his work is not living up to his full potential.
If I could make money doing something I found a lot of meaning in I'd be doing that instead. Thing is, we usually don't have that option.
How many jobs in modern society are complete bullshit? A good deal of them, I would say. Why should people measure their happiness and self worth from these?
I wholeheartedly agree! I do know a few people that love their jobs and I envy them to no end, they are inspiring, shining suns. But I remain firm on my opinion that this is far out of reach for most people.
Capitalism maximizes profits, not happiness. The market for software development jobs is much bigger for people who know popular frameworks and are content with validating forms, querying databases, aligning buttons, sending reports, etc. It's a lot easier (and rewarding) to find fulfillment elsewhere.
For all but a select few this is an unrealistic fairy tail. Most of us just want to make money to better enjoy our lives. We were given or acquired certain skills to make money, out of juvenile interests or opportunities we used. That doesn't mean we enjoy using those skills. It would be very hard to find any other job without taking a massive pay cut, investing huge amounts of money, time and effort only to have a high chance you won't like your new job as well.
I see no job or career I am interested in: I hate everything the moment it becomes work. And I am no unique snow flake. I am part of the majority with that.
https://www.wellable.co/blog/employee-engagement-statistics-....
Things I enjoy don't pay enough to live a comfortable life. Tech does. So I do well enough at my job to pay for the things I enjoy, and hope I find enough edge cases at work to avoid burnout.
In a true post-scarcity society, where everyone has the freedom to choose a career based purely on fulfillment, your argument is excellent. Until then, however, it's not.
At this stage, the best advice I could formulate would be to learn LangChain and prompt engineering, but these too are fast moving targets, and who knows what's going to be relevant in 2024?
I think the best thing one can do is learn how LLMs work, acquaint themselves with real implementations of it (ChatGPT, copilot), and then find ways to integrate these techniques into their companies.
Instead, look at the job postings for titles you want. Note the skills in demand at more than one job. Focus on those skills. There's your set of skills the market currently is in demand of.
Don't pivot your career. Don't burn the boat and jump into AI. Just be aware of these tools and get good at what they're poor at.
While I agree with the sentiment, there is way too much noise in that channel. Job listings written by non-technical people just throwing key words together, recruiters detached from specific roles and companies trying signalling growth to mention just a few sources of confusion...
I scratched and clawed, read tons of books, blogs, spent extra time polishing features beyond what was needed so I could learn new skills... but now I am a father of two young kids, with a wife. How long am I supposed to put in all this extra work? I'm likely slightly above average intelligence, but I'm far from being at the level where I could be an AI researcher... if I am even capable of doing the kind of math required there, it would require many years of learning.
GPT4 isn't going to replace me, but watching this space unfold really has me worrying about the versions that come out over the next 2-5 years.
A human is only so moldable, and while I am more than happy to learn new skills, I have no idea where to even start. What profession is safe? Where will the growth be in a field that will have equivalent or even near equivalent earning potential?
If GPT ends up getting to the point where it can replace me at my job, I really have a hard time thinking of a career path I could get into at this stage in life. It would need to be able to architect systems at a high level, write code to implement various features, communicate with stakeholders, document design decisions... if it can do that, it can do a whole hell of a lot of other jobs too.
Once it gets to that point, I don't think physical jobs will be that far behind on being automated either. We already have robots of all shapes and sizes (including bipedal), the main thing slowing down their deployment is that they aren't adaptable enough. With AGI, that changes. It will take a bit longer due to the capital requirements and factory build outs that would be needed.
GPT-4 is a very capable systems architect and can also implement the code. There are a few tools available to put it in a debug loop. Writing documents is a walk in the park for GPT-4. Emails or Discord chats or even perfectly realistic voice conversations are completely doable (I have that on my website).
At this point it's about connecting things together and looping them properly to automate a very high portion of jobs.
I think the answer is not employment but rather production. Think of something you can leverage these AIs that would be interesting or useful to someone else or some business.
Beyond that things like UBI and generally better integration of technology into government is going to be critical for our survival. Especially decentralized technologies and real-world resource data.
I’ve worked with tons of programmers like you describe. I’ve continued to tell them that simple UIs and CRUd interfaces to dbs are solved problems we should not be fighting with.
Maybe we shouldn't be, but it's still a problem that regularly needs to be solved.
In any case, I need to refute your argument, in my work as software engineer spanning more than a decade, I have noticed zero deprecation of my skills (Java, SQL, HTML/JS/CSS) (while keeping them up to date!) until now and only had to learn a few new complementing skills (cloud, docker, SPA, Kubernetes). The only skill that got replaced might have been "Java application server management" since that got replaced by whatever docker runtime is en vogue at the moment. I have worked for the government and met PL1/Cobol mainframe programmers that refused to learn Java and still got paid generously for their long term expertise.
I can see how you might think that... until you start actually talking in depth with enough actual users and executives and trying to get them to agree on how all that stuff should work and what it should be capable of.
Most of the development process is about trying to wrangle abstract ideas about how business logic should be implemented/improved from flawed humans who aren't great at communicating those ideas. Your 'simple' CRUD app still often has to be highly customized by someone willing to do the difficult work of dealing with people. And that's before you even start getting into working with more regulated businesses.
Code monkeys/plumbers using 'outdated' tech who can deliver something that makes a workplace more efficient in the long run will continue to be in demand. There was enough functionality in software by the 1970s to handle the vast majority of business needs. Someone still has to understand those businesses needs (which ultimately have little to nothing to do with software) well enough to translate them into something that works. Whether it works for those who are using it is all that really matters.
The only problem is that we live in a system that directs the gains upward and any costs downwards, and in so doing creates perverse incentives against people welcoming their redundancy.
Like sibling commenters, I love the idea of building something new with greater leverage. On an individual level, I'm looking forward to leveling up and finding new ways to be effective in my work.
Unlike sibling commenters, I don't think that should be our only option in life. It saddens me greatly that, given a new option to increase the effective output of a unit of time, we repeatedly choose as a society to profit monetarily (and with vast disparity in who benefits) rather than to give people more options in life than drilling on their jobs.
The industrial revolution promised people lives of relative leisure by replacing the need for much physical labor, but instead we concentrated the benefit to the few—and we keep making that same choice over and over.
Is this really true? I may be missing something (I probably am), but I didn't find much use for AI tools in my itsec/programming work. It's a nice tool to have, but I don't write that much boilerplate. I've tried to use it as a better Google, but it kept replying with made up nonsense (things I have problem with are usually niche technologies OpenAI is not good at - I expect it will get better in the future). So I find it dubious it will "10x my productivity" in the "upcoming years". Decades, maybe.
But maybe the future really is now, and I'm just being an old-timer who can't adapt.
If you want to do anything new or - god forbid - know of a better way to do things than what 90% of the population is doing (htmx?). Good luck.
So the future is anyone with that model access (the 8k tokens could have 20kb of docs which is still useful) who wants to really try.
Millions of creators grinding for pennies while the lucky ones that got in early and made it rake in the profits.
I think success in tech is going to become extremely pyramidal in the coming years. This is a huge shame, as this was one of the only fields out there where you could make a really good living without going to the "right" school for years and years and years.
10 years from now we might have the equivalent of what today costs 10 million dollars today. Automated farming means what today we consider high end and expensive produce becomes almost free. Automated transportation means that food gets delivered to you for almost nothing. Imagine you had a 95% off coupon on Uber Eats. Does that sound terrible? If so why? Because it also means that Jeff bezos gets a 2000 foot yacht?
Edit:---------
I'm getting a lot of doom and gloom respones. And you all are right, there are a lot of people who do not have food/shelter/cheap colleges. But what you all probably are not aware of is that 100 million people have risen out of poverty in India over the past 15 years. Your word view is being warped by the doom and gloom media. I would suggest reading just the beginning of the book factfulness. It will totally change your view of the world and probably make you much happier.
Most people also don't have $1000 for an emergency, live hand to mouth, and are dead scared of the cost and impact of a potential health issue. They are also overworked, underpaid, and with raising expenses, and sick of it, with depression levels skyrocketing. Having "a 10 million dollar supercomputer in their pocket" is not that comforting compared to that.
We've killed old style job security, cheap college education, affordable housing, the middle class and decent working class jobs, public infrastructure, and many other things (not to mention the environment), but in return we can have a rectangular gadget to access "all of the world's information in an instant" (which practically is just used to distract ourselves to death). Hurray!
https://www.marketwatch.com/story/more-americans-are-using-b...
https://www.cnbc.com/2022/01/19/56percent-of-americans-cant-...
This has been debunked many times. The source is misleading to the point of being deceptive, it is pushing a narrative. Per the US government, the median household has $1000 per month leftover after all ordinary expenses. A very detailed breakdown of this for each income decile is available from the BLS.
You can’t square “most Americans can’t afford a $1000 emergency expense” with “median Americans can afford to light $1000 on fire each month without impacting their standard of living”.
And it would be news to million struggling to pay the bills and rent (and not because they buy expensive lattes or new iPhones) that then can "afford to light $1000 every month without impacting their standard of living".
Especially for people whose standard of living is already working their ass off, perhaps in two jobs, and still scrapping to make it and not even thinking of affording to sent their kids to school, or can't even dream of ever being able to survive a need to stay off work for a month for medical reasons...
We have an abundance of inessentials. Housing is still scarce and food is volatile. Health care and education are expensive. Many people are sleeping on the streets or falling into lifestyles of despair.
Progress has been applied unevenly and most critically not to the factors of life that form the base of Maslow’s hierarchy.
Lots of properties being kept vacant so as to drive up rents/prop up property values, and it's difficult to get low-income housing built because of NIMBY.
We are going through 2.5 earth's worth of non-renewable resources each year in order to maintain our current lifestyles --- this simply isn't sustainable.
Let's turn things around:
- under what circumstances should a person be allowed to use more than 1/7 billionth of the solar energy which the earth receives each day?
- under what circumstances is at acceptable for a person to create more heat than 1/7 billionth of what the planet is able to radiate out into space on a daily basis?
IF we make it through...
Obviously the target number of starving children is zero. But the reality is that we are not going to get that number to zero overnight. It takes incremental steps.
But you’re right, the more level the playing field, the greater the competition.
In my niche(s), I still see new Youtubers pop up all the time that gain large followings and turn Youtube into a full-time job. Sure, they don't all become rich, but many have started earning enough to drive Teslas, so it's definitely not pennies.
Software development, as an employment opportunity, does not have these same dynamics.
This 10x productivity absense of a 10x expansion of programming industry (which is very unlikely) translates to less developers in general, including senior ones. Even more so in an economy like this...
>It means competition between companies will increase but it isn’t necessarily bad for existing software engineers, especially solo founders.
"Solo founders" is what? 1/10,000 of working programmers? And they're absolutely not the ones people worry about regarding GPT replacements...
I think I disagree. If software then becomes 10x cheaper, a lot of use cases that used to be too expensive to build now becomes affordable. At my own job, I think we could easily do 10x the business, because our customers need tons of tooling (for example for energy transition) but we don't have the people (among other problems).
The information society is a machine maximizing information exchange, something that only incidentally implies increasing profit or increasing productivity.
> I don’t get the overall doom and gloom towards LLMs on the software field.
From the second line of your comment:
> Now you don’t need to hire junior devs
Do you need GPT to put the two together? I think it's pretty obvious why folks are freaking out.
Every entrepreneur that ever existed.
> If you are a software engineer, this will output your productivity ten fold on the upcoming years. Now you don’t need to hire junior devs and can just build the product of your dreams with very limited capital.
And if you're a junior software engineer? Fuck you and be unemployed.*
Do you get it now?
* Until you can climb up the ladder where each rung is now 20 feet apart.
Are you seriously asking that question? What are the barriers to a junior dev writing the Linux kernel from scratch by themselves? What are the barriers from climbing from the bottom to the top of a ladder where the rungs are 20 feet apart?
Sure, start at the top, then it's great. Very few start at the top.
If I'm missing one, or a class of product with different barriers, I genuinely would like you to point that out.
Seriously, think about it a bit, without being sanguine.
The junior dev is inexperienced, in everything, and now has no path to build up that experience. No one's going to want their 18/22 year old amateur-hour "chatgpt make me a cloud app" (which is in competition against millions of others). So unless they're extremely lucky, they goto fail.
Maybe after 10 years of those failures they could build up enough experience through trial-and-error to maybe see a little success with a "chatgpt make me a cloud app," but how are they going to feed themselves the meantime? Maybe that will work if they have rich parents, but otherwise they're probably going to have to use up their energy to scrape by. So another goto fail.
This hypothetical scenario is literally like "pull up the ladder behind you", as all this experience and connections is something that a senior person has gotten while being handsomely paid for their time, but a future junior person may have to get on their own time and dime.
Ideas are a dime a dozen, execution is everything, and there's no reason to assume that random unemployed inexperienced people will be superior at execution.
If you are a CTO, this will output your productivity ten fold on the upcoming years. Now you don’t need to hire managers and can just build the product of your dreams with very limited capital.
If you are a VC, this will output your productivity ten fold on the upcoming years. Now you don’t need to hire anyone and can just build the product of your dreams with very limited capital.
Agree it'll definitely be amazing for creatives and solo founders, but how many ideas are really out there to be had compared to the reduction in workforce?
I don't know. But I don't see why you might not be able to ask GPT-6 or GPT-7 to enumerate (and patent and implement) all of them for you. Why do you think "founders" or "creatives" are special?
In the end, something like that is "amazing" only for the person who owns the most GPUs or manages to figure out the first effective meta-prompt.
No white collar job will be valued the same since GPT will basically be doing most of the work and we will maybe review it and steer it. We will just keep feeding it and it will know everything at the cutting edge of all fields.
If you are a software engineer, this will output your productivity ten fold on the upcoming years. Now you don’t need to hire junior devs and can just build the product of your dreams with very limited capital.
In my opinion this technology will be as democratising as the YouTube’s early days.
Instead of worrying, learn to work with it. It will be harder for large companies/large teams to extract value from this compared to small companies/small teams.
It means competition between companies will increase but it isn’t necessarily bad for existing software engineers, especially solo founders.