Re:Tinygrad: Hacked 4090 driver to enable P2P
by doctorpangloss on Friday April 12, 2024 @01:30PM
(#40015426)
Have you compared 3x 3090-3090 pairs over NVLink?
IMO the most painful thing is that since these hardware configurations are esoteric, there is no software that detects them and moves things around "automatically." Regardless of what people thing device_map="auto" does, and anyway, Hugging Face's transformers/diffusers are all over the place.
IMO the most painful thing is that since these hardware configurations are esoteric, there is no software that detects them and moves things around "automatically." Regardless of what people thing device_map="auto" does, and anyway, Hugging Face's transformers/diffusers are all over the place.