News for hackers. Stuff that matters.
Re:Stability.ai – Introducing Stable Video 3D by chaostheory on Monday March 18, 2024 @09:14PM (#39752008)
Yeah, I’m still debating whether I go with a Mac Studio with the RAM maxed out (approx $7500 for 192 GB) or a PC with a 4090. Is there a better value path with the Nvidia A series or something else? (I’m not sure about tibygrad)
Re:Stability.ai – Introducing Stable Video 3D by karolist on Tuesday March 19, 2024 @02:30AM (#39753414)
I have an M1 Max with 64GB and 3090 Ti. M1 Max is ~4x slower at inference for the same models than 3090 (i.e. 7t/s vs 30t/s), which depending on the task can be very annoying. As a plus you get to run really large models, albeit very slowly. Think if that will bother you or not. I will not give up my 3090 Ti and am rather waiting for 5090 to see what it can do because when programming, the Mac is too slow to shoot of questions. I use it mostly to better understand book topics now and 3090 Ti to do fast chat sessions.
Re:Stability.ai – Introducing Stable Video 3D by chaxor on Tuesday March 19, 2024 @03:20AM (#39753599)
Groq may be an option?
Re:Stability.ai – Introducing Stable Video 3D by Oioioioiio on Tuesday March 19, 2024 @05:19AM (#39754045)
Just don't max out the Mac Studio and get both...
Re:Stability.ai – Introducing Stable Video 3D by kristianp on Tuesday March 19, 2024 @06:56AM (#39754504)
You can get a previous gen RTX A6000 with 48GB of gddr6 for about $5000 (1). Disclosure: I run that website. Is anyone using the pro cards for inference?

(1) https://gpuquicklist.com/pro?models=RTX%20A6000