News for hackers. Stuff that matters.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by bartread on Wednesday November 04, 2026 @11:12AM (#50367670)
The thing is, it's not actually that hard to spend at that kind of rate.

I wouldn't say this was the norm, but I have burned through £1k of tokens in a couple of days before. And, on that same gig, I realised a test I was considering running would burn £2.5k worth of tokens over the course of a few hours so spent a couple of hours of my own time re-engineering it to get that down to £150.

The point is that I don't necessarily know that spending a shitload of money on tokens really tells us anything useful. If he's getting a return on that investment, fine, whatever.

Obviously most of us couldn't afford to spend that much ourselves, no matter how much value it might deliver, and many of our employers wouldn't be too happy if we spent it on their dime either. Equally, if you can, and it's delivering real value, then I don't see why you wouldn't?

Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by plusfour on Wednesday November 04, 2026 @11:29AM (#50367964)
> would burn £2.5k worth of tokens over the course of a few hours

details please

Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by hparadiz on Wednesday November 04, 2026 @11:54AM (#50368340)
Any 3D work in blender can burn that easily. Add video editing to that mix in any capacity.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by deadnomore on Wednesday November 04, 2026 @12:13PM (#50368577)
Evaluation loops do this easily. You have to run hundreds of reasoning jobs in parallel and very quickly you can torch thousands of dollars.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by sixtyj on Wednesday November 04, 2026 @01:15PM (#50369405)
Yup, run multiple agents on expensive model in loop via API.

You can do it if your employer has endless pockets.

Example: $30/1M input tokens (I don’t count output or cache, for simplification), you have several daily agents for everything => 3M tokens daily per agent * 10 agents ~> $900/day => $328k/year (API spending)

Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by bartread on Wednesday November 04, 2026 @02:55PM (#50370665)
Yeah, it was basically this, and running a whole lot of agents concurrently to churn through the dataset faster.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by nodesocket on Wednesday November 04, 2026 @11:54AM (#50368339)
At what point do you buy a Mac studio or AMD Gorgon Halo and try running some of these tasks in local models? Surely don’t need frontier models for all this work.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by bartread on Wednesday November 04, 2026 @02:58PM (#50370702)
You definitely don't need frontier models for all this work.

And, in fact, I got it from £2500 to £150 by careful model selection (I ran a trial over a small dataset with different models until I found the least expensive/capable model that would reliably do what I needed), using a local model for one step, and paring down the inputs as well so the token count plummeted.

Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by wolvoleo on Wednesday November 04, 2026 @09:42PM (#50374451)
Yeah I see the same thing at work. Most of the people burning crazy numbers of tokens aren't doing any amazing work. They're just using fable to write their emails and do their web searches.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by bigfatkitten on Thursday November 05, 2026 @04:11AM (#50376955)
I tokenmaxxed in my last role.

Management succumbed to AI psychosis, and so we were directed to show that we were adopting and using AI, but what we were using it for was not considered important. So we went out of our way to burn as many tokens as possible.

If you tell Claude to burn as many tokens as possible, it’ll happily oblige. It will also offer useful advice as to how to use even more tokens.

Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by jorvi on Wednesday November 04, 2026 @10:39PM (#50374848)
You don't.

Once you factor in cost of electricity and depreciation of hardware, it is more expensive to run locally.

There are many arguments for running local but cost isn't one of them.

Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by nodesocket on Wednesday November 04, 2026 @10:50PM (#50374930)
> but cost isn't one of them.

Let's do quick back of the napkin math.

  - Mac Studio M5 Ultra, 80-core GPU, 256GB memory, 2TB storage -- $11,299.00.
  - Power (385w continually 100% of month) is $40/mo (my regional) or $480 annually. Let's say power is 3x more expensive in California, which it probably is, that's still only $1,440 annually in power.
The Studio M5 Ultra has a worklife life of at least 3 years.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by jcelerier on Thursday November 05, 2026 @06:44AM (#50378009)
it's going to be quite slower than remote providers, won't be able to run full models, only quantised, and for more cost than the highest Claude subscription tier where you can do roughly 60-100M token per month at 200$, e.g. 7200 for three years. It makes sense if you prioritize local AI but not really otherwise sadly.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by klrefg on Friday November 06, 2026 @02:11AM (#50389151)
You have to compare with how much Deepseek costs since all the models you will be running will be inferior anyway, certainly not Opus or similar.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by bitfilped on Thursday November 05, 2026 @05:47PM (#50385612)
You have to be using an incredibly small amount of usage for your math to math here. Go price out a few MW or better site then ask a neo cloud how much that same amount of compute will cost at an API.
Re:YC's Garry Tan uses AI agents so much, he spends up to $2... by jmathai on Friday November 06, 2026 @08:45PM (#50400826)
If I were spending $200k on tokens then I sure would expect some mind boggling results. I don't know much about what this person is doing with them and maybe they've launched several companies or created several new inventions .... but that's what I'd expect personally at that spend.