Re:Serving AI from the Basement – 192GB of VRAM Setup
by koyote on Sunday September 08, 2024 @07:38PM
(#41484203)
This is undoubtedly cool and I am a bit jealous!
Maybe a bit of a stupid question, but what do you actually do with the models you run/build, a part from tinkering? I'd assume most tinkering can also be done on smaller systems? Is it in order to build a model that is actually 'useful'/competitive?
Maybe a bit of a stupid question, but what do you actually do with the models you run/build, a part from tinkering? I'd assume most tinkering can also be done on smaller systems? Is it in order to build a model that is actually 'useful'/competitive?