Re:Apple capped engineers at a $200 daily AI budget
by tetraodonpuffer on Monday November 09, 2026 @12:41PM
(#50428781)
when I still had access to flat rate seats at work (I think equivalent to the consumer 200/mo) I was at estimated ~8000-ish/month api costs at 100% usage, which is 400/workday. This with maxing out the 50% fable usage and using opus for the rest, usually 1-3 concurrent sessions.
Having moved to api billing (where my spend is not allowed to be nowhere near that high), I think that estimate was conservative and I wouldn't be surprised if it was more like 500/workday equivalent.
I am glad I was able to do a lot of experimenting and learning while we were on flat rate, and I am surprised a lot of coworkers did not take advantage while they could.
Re:Apple capped engineers at a $200 daily AI budget
by thewhitetulip on Monday November 09, 2026 @06:46AM
(#50424284)
Makes it a whole lot worse doesn't it?
My Fedora boots under a second in my extremely old and cheap HP. Meanwhile MacOS introducing new bugs and Liquid Glass that hung my m1 air
Re:Apple capped engineers at a $200 daily AI budget
by pixlmint on Monday November 09, 2026 @01:22AM
(#50421780)
My "AI subscription" is just buying 20$ openrouter credits when I run out and it's costing me less every month then a monthly Claude subscription. 200$ a day is insane
Re:Apple capped engineers at a $200 daily AI budget
by yokaze on Monday November 09, 2026 @01:31AM
(#50421849)
Your data is likely kept and used for training models.
For most businesses, that's a no go. At least at the company I work for, we have to wait for new models because they negotiate away the training and retention and the vendors are not too eager to give up their moat.
Re:Apple capped engineers at a $200 daily AI budget
by teekert on Monday November 09, 2026 @01:57AM
(#50422023)
I also have the 20$ pro plan, I'm not reaching the limits of it... That said, I'm a one man company so I'm not just emptying a kanban board, I use Claude a lot as a thinking buddy, and my deliberations are the thing that limit the speed.
Re:Apple capped engineers at a $200 daily AI budget
by odo1242 on Monday November 09, 2026 @01:28AM
(#50421831)
Apple is paying API prices, not subscription prices, though. $6000/month is half the engineer's monthly salary, it seems ridiculous to say that won't be enough, unless you're being very inefficient with token spend.
Re:Apple capped engineers at a $200 daily AI budget
by MattRix on Monday November 09, 2026 @01:34AM
(#50421867)
The fact that it's expensive has nothing to do with how useful it is though... I know plenty of people who max out their $200 plans every week, and they are working on stuff a lot less financially valuable than what Apple employees work on.
Re:Apple capped engineers at a $200 daily AI budget
by recursive on Monday November 09, 2026 @12:06PM
(#50428345)
You caught me. I would guess though, that at the end user/retail level, more money is spent on lottery tickets than AI subscriptions. Does that work better?
Re:Apple capped engineers at a $200 daily AI budget
by jrockway on Monday November 09, 2026 @01:52AM
(#50421974)
Yeah. I think people are reading $200 as "per month" and not "per day". I do a lot with unrationed Claude tokens and $6k/month is fine. Have I exceeded it? Yes. But it's very rare.
Things that drive up spend is mostly doing other people's work. Triage, "that doesn't seem quite right, let's see what happens if I prompt it", properly investigating incidents (I get a lot where the reporter's agent didn't read the code and just guesses at how it works, kind of making the report useless). Fixing those things is what would really get token spend down -- a consistent way of making bug reports against other teams that has the same context as the people that work on it everyday. I don't know if it's possible. But I'm anti-rationing because the first thing you do when your tokens are counted is to stop helping other people, right?
Re:Apple capped engineers at a $200 daily AI budget
by onion2k on Monday November 09, 2026 @01:33AM
(#50421860)
It's only too low if the goal is to use AI as much as possible. If Apple are saying their engineers should not use AI for everything, and that they should still be working as they did but with a small assist from AI, the budget makes a lot of sense.
Giving people some constraints so they have to actually think about solving their problems properly rather than just throwing money (or tokens) at it is not a bad idea.
Re:Apple capped engineers at a $200 daily AI budget
by htfy96 on Monday November 09, 2026 @01:41AM
(#50421907)
It's kinda borderline. My dev workflow in my full-time job (Opus 5.5, 5 concurrent worktrees with human checking results and giving instructions) spend exactly $200/day on average. I imagine it could be more friendly if it's $300, as otherwise I might have to move some of my AI usage to weekends, which implicitly increases working hours :[
Re:Apple capped engineers at a $200 daily AI budget
by whazor on Monday November 09, 2026 @07:01AM
(#50424425)
In my experience Claude Max x5 is the very reasonable amount of tokens for a work week.
But yeah, API pricing is crazy. Note that Apple might have negotiated a discount with Anthropic but is actually not allowed to share this discount details with its employees. So they communicate the budget based on public pricing.
Re:Apple capped engineers at a $200 daily AI budget
by sgerenser on Tuesday November 10, 2026 @06:21PM
(#50447725)
I doubt it, the standard issue laptop for engineers would be a 16" MacBook Pro, but only refreshed every ~3 years. So the average engineer is probably on a MacBook Pro M3 Max or M4 Max, with 36GB of RAM. Not really sufficient for any but the smallest local models. It's possible things have changed (I last worked there before the rise of LLMs) but I kind of doubt it.
Re:Apple capped engineers at a $200 daily AI budget
by asaddhamani on Monday November 09, 2026 @02:02AM
(#50422053)
$52K per engineer per year extra cost to the company. I think at an Apple scale that level of ROI should be easy. I wonder if they were not seeing the ROI they wanted? As an indie hacker AI has been amazing for me and has freed me up to do so much more.
Re:Apple capped engineers at a $200 daily AI budget
by jdlshore on Monday November 09, 2026 @02:08AM
(#50422086)
I’ve been talking to a bunch of companies about how they use LLMs and I’m seeing dramatic differences in costs, with very few concrete measures of value. Mostly just PR counts. We’re talking order-of-magnitude differences in spending, from hundreds up to many thousands. (API pricing, not subscription prices.)
I’m not surprised companies are pulling back. That’s a decent chunk of money and CFOs are going to want to know what they’re getting for the money. “More PRs” isn't a good enough answer.
Re:Apple capped engineers at a $200 daily AI budget
by oblio on Monday November 09, 2026 @03:19AM
(#50422634)
LOL :-)))
I appreciate the boundless optimism.
Or, get this - figuring out what customers really want and need is super hard and churning out code doesn't solve the truly hard problems of software development.
Re:Apple capped engineers at a $200 daily AI budget
by kijin on Monday November 09, 2026 @01:58AM
(#50422027)
Yes, it's a significant expense even on top of an Apple salary.
Any company, not just Apple, should be tracking whether the extra spending is worth it. There must be a point of diminishing returns where additional AI usage stops increasing productivity.
Companies also can't justify ever-increasing costs just because it increases productivity. Profit is the ultimate criterion, not productivity, and Apple doesn't seem to be having a particularly great time these days.
Re:Apple capped engineers at a $200 daily AI budget
by closetheloopdev on Monday November 09, 2026 @01:45AM
(#50421932)
They are looking to lower it further to $100 [0]. This is definitely concerning for frontier labs since Accenture also caps their employees' usage to $29 a month [1].
Re:Apple capped engineers at a $200 daily AI budget
by Copenjin on Monday November 09, 2026 @01:47AM
(#50421945)
Accenture lol, in that case, considering the quality of the output previously released by their humans, maybe local LLMs are already more than enough for that use case.
Re:Apple capped engineers at a $200 daily AI budget
by closetheloopdev on Monday November 09, 2026 @01:50AM
(#50421959)
Yes, considering their CEO said that AI usage was a requirement for promotion earlier this year [0]. Companies are backpedaling now when the AI bills come out and bite them.
Re:Apple capped engineers at a $200 daily AI budget
by dash-44 on Monday November 09, 2026 @02:17AM
(#50422146)
For smaller companies they can get Claude team plan for $20/month/seat and the plans give a lot of usage. We rarely hit limits. Codex plans used to have more usage and those were the go-to. Before that, GitHub Copilot CLI was the service with insane usage limits for $10-$20/month.
So it's about staying nimble enough so you can easily switch over. Don't tie yourself down to a single product/harness.
Re:Apple capped engineers at a $200 daily AI budget
by closetheloopdev on Monday November 09, 2026 @02:27AM
(#50422227)
The Claude Team plan is subsidized, and pricing for them is significantly less than what enterprises pay with API pricing. For example, your $20/month plan would cost the equivalent of $400/month if they charged you using API pricing.
That's why those plans are only available to small companies with 150 employees or less.
Re:Apple capped engineers at a $200 daily AI budget
by f30e3dfed1c9 on Monday November 09, 2026 @11:54AM
(#50428185)
> That's why those plans are only available to small companies with 150 employees or less.
As far as I can tell, that's not the limit. A team plan may not have more than 150 members but the size of the company doesn't matter. I you have 150 people who need to use it inside an organization of 200, 500, 5,000, whatever, that's fine.
Re:Apple capped engineers at a $200 daily AI budget
by mike_hearn on Monday November 09, 2026 @04:28AM
(#50423200)
Accenture isn't a giant software company though. For the sort of things their employees do, that might be a reasonable average (think chat, PowerPoint, a bit of research).
Re:Apple capped engineers at a $200 daily AI budget
by Gigachad on Monday November 09, 2026 @02:09AM
(#50422090)
$100 day should be more than enough. To exceed that you have to coming up with creative ways to waste it. You couldn’t hit that in normal development using AI all day.
For the edge cases that might need more like running a security audit, it would make more sense to submit that as a project proposal and have the expense approved.
Re:Apple capped engineers at a $200 daily AI budget
by closetheloopdev on Monday November 09, 2026 @02:13AM
(#50422122)
We don't know how low it will get yet. The first article I linked also has this: "[m]any groups outside of engineering already face a $100 daily cap, but Apple has considered reducing that limit to as little as $25 for some teams, the people said."
They could be tightening the purse strings further until they hit some magical ROI numbers.
Re:Apple capped engineers at a $200 daily AI budget
by shepherdjerred on Monday November 09, 2026 @12:15PM
(#50428451)
I don’t agree. You should be empowering your engineers. A higher budget allows them to:
- freely experiment and understand the limitations of AI
- create things outside of what they are officially expected to
I’m not advocating for people who burn tokens for the sake of it. But I do think a single engineer has more potential for impact today than ever before and a high budget unlocks that.
It also isn’t _that_ much more when a fully loaded mid-level engineer is costing you $300k+
Re:Apple capped engineers at a $200 daily AI budget
by coffeebeqn on Monday November 09, 2026 @11:23AM
(#50427704)
I find it hard to use that much in a day. Especially if you delegate to a cheaper model for anything context hungry like reading large amounts of data etc
Re:Apple capped engineers at a $200 daily AI budget
by nrclark on Monday November 09, 2026 @01:23PM
(#50429406)
token-maxxing aside, what's the business value for something like this? Slide-deck generators have been around for a long time already. And at least for me, the LLM-authored decks I've created have always needed tweaking / editing to really make the content correct and punchy.
Re:Apple capped engineers at a $200 daily AI budget
by shepherdjerred on Monday November 09, 2026 @03:13PM
(#50431274)
> what's the business value for something like this?
We already generated slide decks from a template. The decks generated were consistently missing data, incorrectly formatted, and required many manual edits.
This led to hiring contractors to fix up the decks before being sent internally before being presented to clients.
So, thousands of contractor hours every year going towards fixing up decks in additional to the engineering effort from ~5 bugs each month due to bugs in the deck or feature gaps.
> Then they use tool a few times and ultimately forget about it or throw it away.
This is a running production service
> More time gets spent tweaking/iterating with the LLM than it would take to make the decks by hand.
I think you misunderstood. The LLM produced deterministic deck templates in code that is then templated from a payload and the deck dynamically changes depending on what is in the payload. The user can then further modify the deck as they please since the deck is just code. Then they can export it to a PPTX and make any further adjustment in their favorite tool since it emits a "normal" PPTX.
Re:Apple capped engineers at a $200 daily AI budget
by SubmarineClub on Monday November 09, 2026 @03:27PM
(#50431534)
Techie types seem particularly susceptible to spending massive effort re-inventing things that have already existed for a while.
See also, Matt Levine’s recurring joke about the crypto community constantly re-inventing/re-discovering the need for financial regulations that the larger finance industry have had for a while.
Re:Apple capped engineers at a $200 daily AI budget
by TimByte on Monday November 09, 2026 @04:30AM
(#50423224)
> $100 day should be more than enough. To exceed that you have to coming up with creative ways to waste it.
You do not need much creativity for that. Just forget to put build artifacts or node_modules in your agent's ignore list and it will happily burn through the cap in thirty minutes
Re:Apple capped engineers at a $200 daily AI budget
by jjav on Monday November 09, 2026 @03:08AM
(#50422555)
> This is definitely concerning for frontier labs
Yes. The frontier models are good, indeed, but they are just far too expensive to use much. Recently I was showing my executive leader that we could simply run a certain set of tasks on the top frontier model and we'd be good to go. Oh but it would cost over 15M/year. We're a relatively small company, that's over two magnitudes more than what makes sense for us. So, never going to happen.
What remains then is an optimization exercise to bring the cost down. For months now we've been optimizing usage so we can run nearly all tasks on very cheap models to good success. It's fun to optimize and keeps the CFO from having a heart attack.
But not good news for the AI companies relying in a firehose of cash coming in from their frontier models.
Re:Apple capped engineers at a $200 daily AI budget
by tirednessitself on Monday November 09, 2026 @01:54PM
(#50429866)
LLMs are so cool.
It's kinda like commuting in the autobahn with a Porsche.
Some agentic madness is like doing donuts in the parking lot drinking beer impressing the local baddies.
So, so much fun. But at the end of the day we used to get so much more done with much, much less computer power, energy, mental drain.
It's always more software tooling, more moving parts, more apps, more more more. Fun. Looks neat. Used sooo much energy, I feel so drained. It was fun.
But at the end of the day, for the long run what I want in my life is to win at rally on a dependable machine with a nice navigator I'm friends with. Or have a shed full of tractors making money for my family on the farm everyday.
LLMs are fun. But I want to use my mind to write great software that adds value in as little lines of code as possible designing systems that people can understand readily and maintain well 2 or 3 handovers from me.
Re:Apple capped engineers at a $200 daily AI budget
by jstummbillig on Monday November 09, 2026 @05:20AM
(#50423642)
Why is it "concerning"? Personally, I get a lot of stuff done on the $200/month subs. +$100/day per employee seems like a fairly significant amount of money and if a lot of companies do that (even a lot less than that) that seems entirely fine for frontier labs, given all the other uses as well.
That is not to say that you can't spend a lot more. And I would be surprised if Apple did not allow for that too. Note that the text says "for some of its own engineers", which could amount to a total nothing-burger, given the overall vagueness.
Re:Apple capped engineers at a $200 daily AI budget
by _aavaa_ on Monday November 09, 2026 @09:42AM
(#50426329)
Depends on the sub you're using, but the anthropic one is giving you ~$12k/month [0], or $400/day. So you're already working at 4x the $100/day you consider significant.
Re:Apple capped engineers at a $200 daily AI budget
by aunty_helen on Monday November 09, 2026 @01:49AM
(#50421953)
I’m not sure if the /usage in cc is directly comparable to this? It gives a $ value which I assume is API equivalent.
Most of the programming work I get opus5.5 to do, sometimes with fable coordinating. When I’m building a large feature it will often run over $500 and occasionally on longer sessions over 1k. Everyone else seems to think $200 should get by?
Re:Apple capped engineers at a $200 daily AI budget
by NavinF on Monday November 09, 2026 @02:09AM
(#50422099)
Just checked codexbar. I spend $1,000/mo in API credits across two $20/mo plans (claude and codex) just for side projects. I can't imagine having a API budget in this range for a day job, I'd run out every day
Re:Apple capped engineers at a $200 daily AI budget
by 80fj0348i on Monday November 09, 2026 @03:22AM
(#50422661)
Do you work at a company that requires human code review for every change? Even if I tried to spend that much my work would just get logjammed in code review, so I intentionally don't generate output faster than I can get reviewers to read it.
Re:Apple capped engineers at a $200 daily AI budget
by NavinF on Monday November 09, 2026 @09:07PM
(#50435200)
I don't see why that would make a difference. A lot of my prompts are stuff like "Tune tok/s. Change one thing at a time, check 2nd step speed to decide how long to sleep, treat it as multi armed bandit". This burns tokens doing many turns trying stuff and fixing whatever breaks. At the end I get a table of the 100 combinations it tried with confidence intervals for each and a small patch with the 5 new settings that together doubled speed.
Re:Apple capped engineers at a $200 daily AI budget
by lifeisloving on Monday November 09, 2026 @01:49AM
(#50421957)
Finally companies are realizing that subsidizing unlimited AI for your employees is basically just paying for the tools for them to work 2hrs a day while you pay them for 8.
Listen, I dont care if employees scam their bosses by offshoring their work to AI, but its absolutely the case that 90% of people irresponsibly use AI to be lazy, get by doing less work.
Unfortunately, as Ive personally witnessed when you do this and take away the cheating tools engineers just start copying and pasting IP into their own AI subs where you have less garuntees about ZDR. Employees will gladly spend an extra $200 a month so they can work 4hrs less a day and just get by.
Only 10%, maybe less, are actual super contributors with AI. The rest are literally getting a form of diabetes of the brain and the exercise required to reverse that disease is quite uncomfortable, especially when you've been hands off using a cheating tool for a year straight.
Re:Apple capped engineers at a $200 daily AI budget
by lifeisloving on Monday November 09, 2026 @09:06AM
(#50425816)
I wont argue with you there, I dont really care about the companies at all
Im just saying employers will notice that its basically being used as a cheating tool by a large subset of users and they 'll stop subsidizing that behavior.
What Im really trying to say is its not a producitivity enhancer for an enterprise, maybe for a small percentage of employees, so I dont really see the value in it as an enterprise wide investment.
Re:Apple capped engineers at a $200 daily AI budget
by whatever1 on Monday November 09, 2026 @01:50AM
(#50421963)
200 daily means that you use 1 session in a turn-based setup. Hence likely you still know what is going on in the code.
Once you have multiple agents working in parallel, hands off the wheel becomes very attractive. And at that exactly point you lose completely touch of what the heck is going on in your ex-code.
Re:Apple capped engineers at a $200 daily AI budget
by mingus88 on Monday November 09, 2026 @10:27AM
(#50426948)
None of the financials make sense right now because everyone is racing to AGI under the assumption that whoever wins will (probably literally) rule the world
Re:Apple capped engineers at a $200 daily AI budget
by wickedsight on Monday November 09, 2026 @01:57AM
(#50422019)
Giving people an unlimited amount of anything means they have zero incentive to optimize using that thing. It's quite common that we complain here about Electron apps using 1GB for something as simple as a REST client. OTOH, many here keep calling for unlimited token budgets. I feel like capping will cause people to find better workflows, which we really need to in order to reduce (among others) the ecological impact of AI.
Re:Apple capped engineers at a $200 daily AI budget
by stasomatic on Monday November 09, 2026 @10:30AM
(#50426988)
Wow, capped and yet roughly still $6K a month, times how many? Yeah, they have trillions. Could someone share what milestones have been reached at corps? Is it doing more with less headcount, so the costs are "justified", is it making more with more?
It's an intriguing juxtaposition for me. I am not anti AI at all, but I can't wrap my head around its costs. DCs, layoffs, gas turbines. I a hobbyist at $20/m. It's going to "fun" to see it all unwind. How much more software needs to built, most of it is CRUD and frameworks, what problems are being solved that couldn't before? (outside of medicine, math, physics).
Having moved to api billing (where my spend is not allowed to be nowhere near that high), I think that estimate was conservative and I wouldn't be surprised if it was more like 500/workday equivalent.
I am glad I was able to do a lot of experimenting and learning while we were on flat rate, and I am surprised a lot of coworkers did not take advantage while they could.
For most businesses, that's a no go. At least at the company I work for, we have to wait for new models because they negotiate away the training and retention and the vendors are not too eager to give up their moat.
That's their moat: your data.
factually would imply it's impossible for your data to ever be used inappropriately.
But it's telling that you claim to while treating this as some sort of equivalence.
Things that drive up spend is mostly doing other people's work. Triage, "that doesn't seem quite right, let's see what happens if I prompt it", properly investigating incidents (I get a lot where the reporter's agent didn't read the code and just guesses at how it works, kind of making the report useless). Fixing those things is what would really get token spend down -- a consistent way of making bug reports against other teams that has the same context as the people that work on it everyday. I don't know if it's possible. But I'm anti-rationing because the first thing you do when your tokens are counted is to stop helping other people, right?
Smart guy showed up. Yes. Don't do this.
Giving people some constraints so they have to actually think about solving their problems properly rather than just throwing money (or tokens) at it is not a bad idea.
But yeah, API pricing is crazy. Note that Apple might have negotiated a discount with Anthropic but is actually not allowed to share this discount details with its employees. So they communicate the budget based on public pricing.
I’m not surprised companies are pulling back. That’s a decent chunk of money and CFOs are going to want to know what they’re getting for the money. “More PRs” isn't a good enough answer.
Finally! Gravity and sanity are starting to win.
I appreciate the boundless optimism.
Or, get this - figuring out what customers really want and need is super hard and churning out code doesn't solve the truly hard problems of software development.
You cut it when you have evidence that it was wasteful.
Any company, not just Apple, should be tracking whether the extra spending is worth it. There must be a point of diminishing returns where additional AI usage stops increasing productivity.
Companies also can't justify ever-increasing costs just because it increases productivity. Profit is the ultimate criterion, not productivity, and Apple doesn't seem to be having a particularly great time these days.
They vibe coded some slopware mobile app on a $200 Claude subscription and roleplay as that being productive.
In reality those companies are measuring what the extra cost brought in as a return, and are likely deciding that it was not worth it.
I fully expect this to become the norm, figuring out ways to extract usefulness out of LLMs while spending as little as possible.
[0] https://finance.yahoo.com/technology/ai/articles/apple-cuts-...
[1] https://finance.yahoo.com/technology/ai/articles/accenture-j...
They also should have a smart model supervise the cheaper and less capable ones.
[0] https://finance.yahoo.com/news/accentures-ceo-says-using-ai-...
So it's about staying nimble enough so you can easily switch over. Don't tie yourself down to a single product/harness.
That's why those plans are only available to small companies with 150 employees or less.
As far as I can tell, that's not the limit. A team plan may not have more than 150 members but the size of the company doesn't matter. I you have 150 people who need to use it inside an organization of 200, 500, 5,000, whatever, that's fine.
For the edge cases that might need more like running a security audit, it would make more sense to submit that as a project proposal and have the expense approved.
They could be tightening the purse strings further until they hit some magical ROI numbers.
It's easy to spend a lot when writing an entire service, large features, or doing research loops.
- freely experiment and understand the limitations of AI
- create things outside of what they are officially expected to
I’m not advocating for people who burn tokens for the sake of it. But I do think a single engineer has more potential for impact today than ever before and a high budget unlocks that.
It also isn’t _that_ much more when a fully loaded mid-level engineer is costing you $300k+
- Convert PPTX to TypeScript
- Allow editing of that TypeScript via an LLM interface
- Convert TypeScript to PPTX
The intent was to create slide deck templates via code. The first step was to convert our existing templates to this new format.
So I had it write a harness, gave them problem to Opus, and a couple thousand dollars later the import/export worked near perfectly.
We already generated slide decks from a template. The decks generated were consistently missing data, incorrectly formatted, and required many manual edits.
This led to hiring contractors to fix up the decks before being sent internally before being presented to clients.
So, thousands of contractor hours every year going towards fixing up decks in additional to the engineering effort from ~5 bugs each month due to bugs in the deck or feature gaps.
> Then they use tool a few times and ultimately forget about it or throw it away.
This is a running production service
> More time gets spent tweaking/iterating with the LLM than it would take to make the decks by hand.
I think you misunderstood. The LLM produced deterministic deck templates in code that is then templated from a payload and the deck dynamically changes depending on what is in the payload. The user can then further modify the deck as they please since the deck is just code. Then they can export it to a PPTX and make any further adjustment in their favorite tool since it emits a "normal" PPTX.
See also, Matt Levine’s recurring joke about the crypto community constantly re-inventing/re-discovering the need for financial regulations that the larger finance industry have had for a while.
- Emits normal PPTX
- Can import any PPTX
- Representation can easily be edited by an LLM
- Handles most PPTX features -- rich text, transforms, charts/tables, images
- Can be templated
Things I tried:
- python-pptx, PptxGenJS
- Marp
- Google Slides + Google Sheets + Google AppScript
You do not need much creativity for that. Just forget to put build artifacts or node_modules in your agent's ignore list and it will happily burn through the cap in thirty minutes
Yes. The frontier models are good, indeed, but they are just far too expensive to use much. Recently I was showing my executive leader that we could simply run a certain set of tasks on the top frontier model and we'd be good to go. Oh but it would cost over 15M/year. We're a relatively small company, that's over two magnitudes more than what makes sense for us. So, never going to happen.
What remains then is an optimization exercise to bring the cost down. For months now we've been optimizing usage so we can run nearly all tasks on very cheap models to good success. It's fun to optimize and keeps the CFO from having a heart attack.
But not good news for the AI companies relying in a firehose of cash coming in from their frontier models.
It's kinda like commuting in the autobahn with a Porsche.
Some agentic madness is like doing donuts in the parking lot drinking beer impressing the local baddies.
So, so much fun. But at the end of the day we used to get so much more done with much, much less computer power, energy, mental drain.
It's always more software tooling, more moving parts, more apps, more more more. Fun. Looks neat. Used sooo much energy, I feel so drained. It was fun.
But at the end of the day, for the long run what I want in my life is to win at rally on a dependable machine with a nice navigator I'm friends with. Or have a shed full of tractors making money for my family on the farm everyday.
LLMs are fun. But I want to use my mind to write great software that adds value in as little lines of code as possible designing systems that people can understand readily and maintain well 2 or 3 handovers from me.
That is not to say that you can't spend a lot more. And I would be surprised if Apple did not allow for that too. Note that the text says "for some of its own engineers", which could amount to a total nothing-burger, given the overall vagueness.
[0]: https://newsletter.semianalysis.com/p/anthropic-subscription...
Most of the programming work I get opus5.5 to do, sometimes with fable coordinating. When I’m building a large feature it will often run over $500 and occasionally on longer sessions over 1k. Everyone else seems to think $200 should get by?
I’m looking for a point of reference here.
Listen, I dont care if employees scam their bosses by offshoring their work to AI, but its absolutely the case that 90% of people irresponsibly use AI to be lazy, get by doing less work.
Unfortunately, as Ive personally witnessed when you do this and take away the cheating tools engineers just start copying and pasting IP into their own AI subs where you have less garuntees about ZDR. Employees will gladly spend an extra $200 a month so they can work 4hrs less a day and just get by.
Only 10%, maybe less, are actual super contributors with AI. The rest are literally getting a form of diabetes of the brain and the exercise required to reverse that disease is quite uncomfortable, especially when you've been hands off using a cheating tool for a year straight.
Im just saying employers will notice that its basically being used as a cheating tool by a large subset of users and they 'll stop subsidizing that behavior.
What Im really trying to say is its not a producitivity enhancer for an enterprise, maybe for a small percentage of employees, so I dont really see the value in it as an enterprise wide investment.
Once you have multiple agents working in parallel, hands off the wheel becomes very attractive. And at that exactly point you lose completely touch of what the heck is going on in your ex-code.
I have been able to soak up a weeks worth of tokens in 6 hours with astra ultra if I'm not very explicit and bounded in my requests.
But we already know they have their own models, ship their own IDE and have released many programming languages.
It seems clear that they would be negligent if they weren’t training on all this employee token usage that they are paying for
Tokens are a resource. We should use as few as possible (Tokengolfing?).
Does anyone know that study? I mean, I can understand other languages takes more tokens but that amount of energy? ...
It's an intriguing juxtaposition for me. I am not anti AI at all, but I can't wrap my head around its costs. DCs, layoffs, gas turbines. I a hobbyist at $20/m. It's going to "fun" to see it all unwind. How much more software needs to built, most of it is CRUD and frameworks, what problems are being solved that couldn't before? (outside of medicine, math, physics).