Re:Serving AI from the Basement – 192GB of VRAM Setup
by smcnally on Sunday September 08, 2024 @06:28PM
(#41483768)
Thank you for this post. I’d read it in ~June and it helped quite a bit with manual ‘nvidia-smi’ runs. I just recently created the systemd service description and am still delving related power and performance possibilities.
[ Parent
| on HN ]
There are no comments on this comment yet.