Re:Tinygrad: Hacked 4090 driver to enable P2P
by georgehotz on Friday April 12, 2024 @02:25PM
(#40016085)
It should if your 3090s have Resizable BAR support in the VBIOS. AFAIK most card manufacturers released BIOS updates enabling this.
Re: 3090 NVLink, that only allows pairs of cards to be connected. PCIe allows full fabric switch of many cards.
Re:Tinygrad: Hacked 4090 driver to enable P2P
by Ratiofarmings on Friday April 12, 2024 @05:15PM
(#40017749)
In cases where they didn't, the techpowerup vBIOS collection solves the problem.
Re:Tinygrad: Hacked 4090 driver to enable P2P
by learnedmachine on Monday April 15, 2024 @03:12PM
(#40044546)
Thanks for the amazing work! I tried the driver with some 3090s (all of which show the 32G line with lspci -s 01:00.0 -v) and while torch says I have p2p access, I can't get it to work with anything as I get illegal memory access errors.
Re:Tinygrad: Hacked 4090 driver to enable P2P
by cjbprime on Friday April 12, 2024 @02:23PM
(#40016061)
Doesn't nvlink work natively on 3090s? I thought it was only removed (and here re-enabled) in 4090.
Re:Tinygrad: Hacked 4090 driver to enable P2P
by qeternity on Friday April 12, 2024 @03:40PM
(#40016847)
This not not nvlink.
Re:Tinygrad: Hacked 4090 driver to enable P2P
by davidzweig on Saturday April 13, 2024 @12:16AM
(#40020450)
Update, I checked with the case company, toploong, they say that board is a 5mm too big or so for the case.
btw, I found a Gigabyte board on Taobao that is unlisted on their site: MZF2-AC0, costs $900. 2 socket Epyc and 10 PCIE slots, may be of interest. A case that should fit, with 2x 2000W Great Wall PSUs and PDU is 4050 RMB (https://www.toploong.com/en/4GPU-server-case/644.html). You still need blower GPUs.