Re:Tinygrad: Hacked 4090 driver to enable P2P
by myself248 on Friday April 12, 2024 @03:11PM
(#40016575)
Oooo, got a link to one of these fabric boards? I've been playing with stupid PCIe tricks but that's a new one on me.
Re:Tinygrad: Hacked 4090 driver to enable P2P
by genewitch on Friday April 12, 2024 @04:28PM
(#40017309)
https://www.amazon.com/gp/product/B07DMNJ6QM/
i used to use this one when i had all (three of my) nvme -> 4x sata boardlets and therefore could not fit a GPU in a PCIe slot due to the cabling mess.
per 1 above crypto "boards" have lots of x1 (or x4) slots, the really short PCIe slots. You then use a riser that uses USB3 cables to go to a full size slot on a small board, with power connectors on it. If your board only has x8 or x16 slots (the full size slot) you can buy a breakout PCIe board that splits that into four slots, using 4 USB-3 cables, again, to boards with full size slots and power connectors. These are different than the PCIe riser boards you can buy for use with cases that allow the GPUs to be placed vertically rather than horizontally, as those have full x16 "fabric" that interconnect between the riser and the board with the x16 slot on them.
[0] i didn't read the article because i'm not planning on buying a threadripper (48-64+ lanes) or an epyc (96-128 lanes?) just to run AI workloads when i could just rent them for the kind of usage i do.