News for hackers. Stuff that matters.
Re:Llama.cpp AI Performance with the GeForce RTX 5090 Review by jacekm on Monday March 10, 2025 @09:27AM (#43320368)
If my budget is only ~$1000 should I buy a used 3090 or a new 5080? (for AI, I don't care about gaming)
Re:Llama.cpp AI Performance with the GeForce RTX 5090 Review by zamadatix on Monday March 10, 2025 @10:06AM (#43320794)
3090, the 24 GB of VRAM will be more relevant than running smaller models even faster on lower capacity card (small models already run fast by nature of being less to copy from memory and compute on).
Re:Llama.cpp AI Performance with the GeForce RTX 5090 Review by washadjeffmad on Monday March 10, 2025 @10:01AM (#43320740)
3090. Models like flux or wanvideo with fp16 text encoders will push your VRAM usage over 20GB. LLMs with functional context (or workflows with multi-model, not modal, tie in) will all break 16GB.

There's no point to performance without context. At its pricepoint, the 5080 is purely a gaming card.

Re:Llama.cpp AI Performance with the GeForce RTX 5090 Review by passwordqwe on Monday March 10, 2025 @10:04AM (#43320767)
Do you think you can get a 5080 for a 1000? In the Netherland they're going for 1600 euro's minimum, more like 1800. So I would totally get a new 5080 for a 1000 dollars.
Re:Llama.cpp AI Performance with the GeForce RTX 5090 Review by jacekm on Monday March 10, 2025 @07:40PM (#43327496)
Sigh, I knew they were more than $1000 but did not anticipate that much. You are correct, the price seem to go up every time I check.