Re:A look at Apple's technical approach to AI including core...
by pbronez on Friday June 14, 2024 @07:33AM
(#40679782)
Heh I am so ready to put an A100 in my homelab. Gonna take some intelligent power management though…
[ Parent
| on HN ]
Re:A look at Apple's technical approach to AI including core...
by xattt on Friday June 14, 2024 @07:40AM
(#40679827)
Have you considered running busbars from your closest pole transformer?
Re:A look at Apple's technical approach to AI including core...
by pbronez on Friday June 14, 2024 @11:39AM
(#40681837)
haha no fire hazards there!
The official specs [0] say the A100 80GB has a 300W TDP. That's pretty doable on standard domestic power... harder if you want to run multiples.
[0] https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...
Re:A look at Apple's technical approach to AI including core...
by Gracana on Friday June 14, 2024 @08:27AM
(#40680241)
Same here. My eBay watchlist always has a few in it, but the prices just aren't where I need them to be. For now I am focused on inference with a dual 3090 rig, and my next step will be to fit another pair of 3090s, which is the max I can easily support with my AM5 motherboard. What's slowing me down is the fact that I can't run server hardware due to noise, and I can't run an open-air setup because my cats would get into it, so I need to buy or build a case to hold everything.
Re:A look at Apple's technical approach to AI including core...
by pbronez on Friday June 14, 2024 @11:43AM
(#40681870)
Dug into A100 sale prices using Ebay's Terapeak analytics. I found several recent sales for $2000 or less:
https://www.ebay.com/itm/335392812272?nordt=true
https://www.ebay.com/itm/335408349837?nordt=true
https://www.ebay.com/itm/335414821299?nordt=true
Too good to be true? Perhaps. For $2000 I might trust Ebay's buyer protections...