News for hackers. Stuff that matters.
Re:Nvidia GeForce RTX 5090 could be up to 70% faster than th... by leshokunin on Thursday February 29, 2024 @10:00PM (#39558066)
I love upgrading my pc to ridiculous specs, playing in 8k, opening stupid amounts of apps and not worrying.

I was pondering about the 5090 earlier today. For the first time, I'm not sure what I could do with it. No flagship game, everything already runs fine in 8k. No mining.

I'm sure it'll be great for some people who want to upgrade, but I fail to see what would actually leverage it, better than a 4090.

Re:Nvidia GeForce RTX 5090 could be up to 70% faster than th... by GeekFortyTwo on Friday March 01, 2024 @09:59AM (#39562363)
Local LLMs and other AI models. Even on my 4090 I run into a lot of limitations, to the point that I've been debating whether I buy a second one or wait on the 5090 to release and move my 4090 to secondary. I've even considered going with moire then 2 cards just to get some larger models running(still cheaper then the high memory server/workstation cards).
Re:Nvidia GeForce RTX 5090 could be up to 70% faster than th... by kelvie on Friday March 01, 2024 @01:52PM (#39565311)
This comment is assuming the 5090 will come with more VRAM right? I haven't heard if that will be the case for consumer cards, it would be obviously nice if nvidia did, but it doesn't seem like it is in their best interest to do so versus just offering it on their high VRAM on their datacenter/workstation cards, unless e.g. Intel or AMD starts putting pressure on them at this front.

A 4090 runs a lot of these ML models more than fast enough, the problem is just VRAM right now. I think a lot of local LLM people think even a 3090 is plenty fast enough.