News for hackers. Stuff that matters.
Re:GPU mining no longer profitable after Ethereum merge by illuminerdy on Friday September 16, 2022 @02:49PM (#32870439)
Great. Now I can build my next rig with 4x RTX 3080 and, well...who cares about the rest of the parts?

Also, I hope every GPU miner's fireproof safe fails and all their money burns up.

Re:GPU mining no longer profitable after Ethereum merge by ftufek on Friday September 16, 2022 @03:35PM (#32870965)
It's actually not that straightforward to plug in these consumer cards as 4x setup. We spent weeks researching how to achieve up to 7x RTX 3090 setup in a single rig. Could write up our method if anyone is interested.
Re:GPU mining no longer profitable after Ethereum merge by krisdol on Friday September 16, 2022 @03:52PM (#32871179)
What kind of motherboard can accommodate such a set up? There are not enough PCIe slots on many high end boards.
Re:GPU mining no longer profitable after Ethereum merge by ftufek on Friday September 16, 2022 @03:54PM (#32871196)
It's not even just about the slots, it's about the PCIe lanes (which is something I never had to worry until now, though I built countless PCs in the past).

We tried bunch of setups with Threadrippers and EPYC, at the end settled for the ROMED8-2T which is a monster motherboard.

Re:GPU mining no longer profitable after Ethereum merge by tinco on Friday September 16, 2022 @05:50PM (#32872439)
We run 4x 2080s on threadripper systems. What sort of trouble did you run into? I thought threadripper has plenty of PCIe lanes. We didn't have any trouble but it could be I missed something, we had to get it working quick and I didn't do very much benchmarking.
Re:GPU mining no longer profitable after Ethereum merge by ftufek on Friday September 16, 2022 @05:58PM (#32872522)
Threadrippers are great and I had 4x Threadripper setup for the longest time, but they are a bit more expensive.

The advantage of EPYC is that because it's so common, we can find used cheaper ones on ebay. They are a bit slower I believe, but we can deal with that by using Nvidia's DALI and decoding images on the GPU rather than CPU.

Re:GPU mining no longer profitable after Ethereum merge by tinco on Saturday September 17, 2022 @02:50AM (#32875353)
Ohh I hadn't thought of there being cheaper ones on ebay. That's a good tip, I'll check it out for our next upgrade.

We're doing photogrammetry not machine learning, running some blackbox software that scaled best with clock speed so threadrippers were the most efficient option.

I put them in 4U supermicro boxes with a noctua cooler with 2 9000RPM delta fans attached to it with rip ties.

Re:GPU mining no longer profitable after Ethereum merge by BonoboIO on Saturday September 17, 2022 @05:14AM (#32876029)
9000 RMP Delta

They must scream and push air like hell

Re:GPU mining no longer profitable after Ethereum merge by knicholes on Friday September 16, 2022 @11:57PM (#32874641)
I just built a rig with a Romed8-2T as well. I got pcie 3 16x risers and zip-tied them above the tower into a rack shelf above it. It's super ghetto, and I can't believe it works, but it totally does. I'm hosting on vast.ai hoping someone will train with my 4-6 3090s, but everyone wants their large language models and image generation models that require more than the 24GB of RAM. shrug

Maybe some day I'll use it myself to train my plastic surgery outcome estimation visualization GAN or diffusion model if I can figure out how to fine-tune one.

Re:GPU mining no longer profitable after Ethereum merge by johndough on Saturday September 17, 2022 @04:54AM (#32875922)
I once had some zip ties which became brittle after a few months and would simply snap. Might be something to watch out for.
Re:GPU mining no longer profitable after Ethereum merge by ftufek on Saturday September 17, 2022 @09:55AM (#32877561)
There are very cheap high quality metal zip ties on Amazon, wouldn't recommend anything else since the heat from the card would just melt it.
Re:GPU mining no longer profitable after Ethereum merge by galkk on Saturday September 17, 2022 @01:48AM (#32875096)
Damn, could you share photo somewhere
Re:GPU mining no longer profitable after Ethereum merge by knicholes on Monday September 19, 2022 @01:33PM (#32901360)
Re:GPU mining no longer profitable after Ethereum merge by jph00 on Friday September 16, 2022 @08:42PM (#32873766)
I'd be very interested!
Re:GPU mining no longer profitable after Ethereum merge by ftufek on Friday September 16, 2022 @11:19PM (#32874475)
Never thought I'd get a response from Jeremy Howard, now I have to post a well polished article! Thanks for all your teachings btw, I really enjoyed and learned a lot from the fast.ai ML course!
Re:GPU mining no longer profitable after Ethereum merge by jph00 on Saturday September 17, 2022 @04:59AM (#32875967)
Awesome! I think a lot of the fast.ai community would be interested to learn from your experiences.
Re:GPU mining no longer profitable after Ethereum merge by lossolo on Friday September 16, 2022 @08:12PM (#32873597)
What problems you had? I've built rigs with 7x NVIDIA GPU cards 5 years ago using risers and dual/triple PSUs, it was pretty straightforward.
Re:GPU mining no longer profitable after Ethereum merge by Cixelyn on Friday September 16, 2022 @06:10PM (#32872650)
would love to see the riser setup that you're using for such a monster!

we mostly gave up and just got barebones machines since the cabling situation becomes pretty tricky, and the barebones total cost is low relative to the GPUs anyways.

Re:GPU mining no longer profitable after Ethereum merge by ftufek on Friday September 16, 2022 @06:16PM (#32872711)
I posted a link just below to twitter with an image of the riser setup. That setup worked well for 4x, but for the 7x we're moving the cards upside down and setting them up like tree branches if you will. So the trunk/floor is the motherboard and you get close to edges, the cards are angled and use longer riser cables.

The issue we had with barebones was cost and cooling, we use 30$ racks from Target and hang the GPUs with metal zip ties and a box fan from below, so they get lots of air and we don't break the bank and can easily roll them around.

Re:GPU mining no longer profitable after Ethereum merge by pixelHD on Friday September 16, 2022 @05:11PM (#32872052)
Oh that sounds interesting! I'd love to read about it, please post/write!
Re:GPU mining no longer profitable after Ethereum merge by ftufek on Friday September 16, 2022 @05:40PM (#32872341)
Sure, will do, though it might take some time to finish writing the blog post, you can get a preview of our previous setup with 4x GPUs here: https://twitter.com/ftufek/status/1569367127878139905. For those that are curious, that's running a Threadripper 3970x.

It's not exactly a "clean" one, like a proper 2u/4u chassis and server grade GPUs but it does the job for 70-90% cheaper.

Re:GPU mining no longer profitable after Ethereum merge by throwaway742 on Saturday September 17, 2022 @04:03AM (#32875655)
I actually love it. I think it might be the most beautiful computer I have ever seen. It is a work of art.
Re:GPU mining no longer profitable after Ethereum merge by post_break on Friday September 16, 2022 @04:25PM (#32871587)
Without SLI no you can't.