News for hackers. Stuff that matters.
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by CamperBob2 on Tuesday September 29, 2026 @07:02PM (#49902009)
Note that $400 a month is a typical car payment. For the same money -- well, OK, probably a little more -- you could be paying off a set of 4 RTX 6000 cards that will run 4.1 Flash all you want, all day and all night, at hundreds of tokens per second.
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by eru on Tuesday September 29, 2026 @07:42PM (#49902393)
Electricity costs money.

And there's a lot of labour and effort involved in setting these things up and maintaining them. People don't even run their own email servers, even though the hardware side of that is trivial.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by CamperBob2 on Tuesday September 29, 2026 @07:47PM (#49902432)
Electricity costs money

Not $400 a month, it doesn't.

And there's a lot of labour and effort involved...

Theoretically, the people who hang around HN are more likely than most to be capable of the labour and effort of setting these things up and maintaining them.

People don't even run their own email servers...

People don't run their own email servers because a convenient coalition of spammers, standards bodies, and large email providers have done their best to make running one's own email server almost impossible.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by qwerpy on Tuesday September 29, 2026 @09:21PM (#49903212)
4x RTX 6000 running at full load with relatively cheap electricity ($0.25/kWh) is around $450/month.

I did the math and decided it’d better to pay for tokens than to buy the hardware and generate them myself.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by eru on Tuesday September 29, 2026 @10:01PM (#49903483)
> Theoretically, the people who hang around HN are more likely than most to be capable of the labour and effort of setting these things up and maintaining them.

'Capable' doesn't mean your labour has no opportunity costs.

I think my argument is easier to attack by noting that you can use AI to substitute for much of that labour.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by CamperBob2 on Tuesday September 29, 2026 @10:24PM (#49903635)
That's what I did personally, not being a Linux guru. But to your point, I still had to spend a lot of time and effort dorking around with the hardware.

It's worth it, knowing that there are no rugs Sam or Dario or anyone else can pull.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by eru on Wednesday September 30, 2026 @01:38AM (#49904774)
> It's worth it, knowing that there are no rugs Sam or Dario or anyone else can pull.

At the moment, it's still very easy to switch from one open weights model to another, and even between the closed models. So the 'no rug pull' property is nice to have, but not as big of a deal.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by quacktopia on Tuesday September 29, 2026 @10:41PM (#49903741)
Power averages $0.30 to $0.45 for a business in the UK if you convert it to dollars. Smaller businesses without load shedding agreements are at the middle / top of that. (there are lots of people complaining about it). Maybe I just have expensive power, but $0.12 per kWh is pretty cheap.
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by teiferer on Wednesday September 30, 2026 @03:00AM (#49905394)
> Theoretically, the people who hang around HN are more likely than most to be capable of the labour and effort of setting these things up and maintaining them.

Theoretically, the people who hang around HN have immense opportunity cost when doing this. Being capable does not mean it takes no time. Time they could be using for something more profitable (and fun?).

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by CamperBob2 on Wednesday September 30, 2026 @11:58AM (#49910652)
That's one way to look at it. Another way to look at it is to point out that the potential cost of delegating cognitive resources to companies like OpenAI and Anthropic is unbounded.

The AI models we currently have still maintain their working state with a finite and laughably-small context window, but that is already starting to change. My .claude directory already contains over 300 .md files. The question of who owns, stores, maintains, and can access the content that is currently being scribbled down in those ad-hoc files is going to become insanely important over the next couple of years. If you thought LLMs themselves were disruptive and contentious, just wait until the fight over object permanence gets under way. That's when owning your own box full of graphics cards is going to become important.

My own bet is that I won't care too much about the electric bill or my opportunity cost when we all find out what the AI labs really have in mind, and what they're going to have to do in order to justify the valuations they're seeking.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by eru on Tuesday October 06, 2026 @12:21AM (#49974144)
> The question of who owns, stores, maintains, and can access that data is going to become insanely important over the next couple of years.

That's a good point. But you already have one possible answer: use an open source harness and call out to open-weigh models only. Then you can own all the relevant data. Still without any need to own a box full of GPUs.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by sbrother on Tuesday September 29, 2026 @09:14PM (#49903152)
Ok, but I have two of those cards plugged into fiber internet, and they consistently rent out for $1500+/mo on vast.ai. So your example would be $3000, minus a couple hundred for business internet and electricity… that still buys a LOT of $200/mo frontier model subscriptions.
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by d675 on Tuesday September 29, 2026 @10:16PM (#49903582)
which year are they from?
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by sbrother on Wednesday September 30, 2026 @01:09AM (#49904582)
I bought them direct from PNY the week the RTX Pro 6000 was released. Prices are almost double now what they were then.
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by CamperBob2 on Tuesday September 29, 2026 @09:21PM (#49903215)
Seriously? People are paying you $1500/month to rent your 2x RTX 6000 Blackwell cards?
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by selimthegrim on Tuesday September 29, 2026 @09:53PM (#49903431)
I think the point was this was the spot price he/she would be paying if he/she had to rent and didn't own them
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by CamperBob2 on Tuesday September 29, 2026 @10:12PM (#49903556)
You can buy 2 of them from Central Computer any day of the week for $30K US, and that's not the lowest price I've heard lately.

So if you can spend $30K and immediately start mining $1500/month out of thin air, that's a pretty nice investment even if the electricity costs $200/month. Two years later the cards will have paid for themselves entirely and (I suspect) will still be pretty useful.

It does argue in favor of just paying OpenAI or Anthropic for tokens, though.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by sbrother on Wednesday September 30, 2026 @01:12AM (#49904604)
You do need fairly high end workstations to put them in, adequate cooling, power and very solid business internet as well. I've put more work into keeping them online than I had expected. But overall the economics are fantastic for it right now, the big question is how long it will continue.
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by teiferer on Wednesday September 30, 2026 @02:57AM (#49905362)
If you break down the pure profit per work hour you put in (after all the expenses), how much is that?
Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by CamperBob2 on Wednesday September 30, 2026 @12:32PM (#49911078)
How important is it that you maintain a good availability record? I have a few RTX 6000s in a server that I use occasionally for NDA'ed contract work and for experimenting with open models, and now I feel stupid for just letting it idle at ~1 kWh when it could be earning revenue. I didn't realize that anyone would care to rent prosumer-grade GPUs.

At the same time, when I need to use the hardware for something, whoever is renting it from me at the moment is going to get unceremoniously booted, and I imagine they are not going to be happy about that. I assume that vast.ai's providers get uptime ratings that drive their work allocation, right?

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by sbrother on Wednesday September 30, 2026 @08:12PM (#49916114)
Yeah - that is the issue. Doing it that way is going to nuke your reliability rating and you will have to cut prices drastically to get rented.

What I do is… rent on the same platform when I actually need to use a card. A benefit is that if I need a burst of more power, that’s not an issue since it’s available from other hosts. But obviously there’s an inflection point of first party utilization where it makes more sense to own.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by sbrother on Wednesday September 30, 2026 @01:08AM (#49904576)
Yes, they have been near 100% utilization on vast.ai at $1 to $1.25 depending on demand for the past two months. They're in two separate workstations, which I purchased for around $12k each before GPU and RAM prices went nuts this year.

Now, I have absolutely no clue how long this situation is going to last! But the economics don't really work out for local models while it does.

Re:GPT 6.1 Sol: Near-Astra intelligence for a fifth of the p... by teiferer on Wednesday September 30, 2026 @02:49AM (#49905302)
Doesn't a RTX 6000 run at about $100/month for electricity? Do that x4 and I don't see where your savings would be coming from.