News for hackers. Stuff that matters.

A comment on For Most of the World, Open-Source AI Is the Only Way Forward. Parent comment

Re:For Most of the World, Open-Source AI Is the Only Way For... by thewebguyd on Wednesday June 24, 2026 @01:59PM (#48663472)
> You need a system with either 32+ GB VRAM

I do hope you're right that it will get cheaper over time (it should), but right now 32GB of VRAM is not affordable to a lot of people. You're talking ~$4500 just for the GPU, or $800 ish used if you can find one.

[ Parent | on HN ]
Re:For Most of the World, Open-Source AI Is the Only Way For... by daan-k on Wednesday June 24, 2026 @02:05PM (#48663548)
For inference you can split the 32GB between two 16GB cards. Two new 5060tis for ~€1000 in total is more than fine.

It's a tad less efficient and a bit more of a hassle, but still a good experience for only a fraction of the price.

[ Parent | on HN ]
Re:For Most of the World, Open-Source AI Is the Only Way For... by gleenn on Wednesday June 24, 2026 @03:07PM (#48664373)
A Mac laptop can be had with 32GB of RAM for far less than $4500. Not sure if they actually need 32GB of discreet GPU RAM. My Mac laptop does run Qwen at a reasonable speed.
[ Parent | on HN ]
Re:For Most of the World, Open-Source AI Is the Only Way For... by FloatArtifact on Thursday June 25, 2026 @12:08AM (#48668756)
Intel Arc Pro B70 32gb for $999ish https://www.newegg.com/intel-arc-pro-b70-32gb-graphics-card/...
[ Parent | on HN ]