Tinygrad: Hacked 4090 driver to enable P2P

Re:Tinygrad: Hacked 4090 driver to enable P2P by numpad0 on Friday April 12, 2024 @11:40AM (#40014157)

I was googling public NVIDIA SXM2 materials the other day, and it seemed SXM2/NVLink 2.0 just was a six-way system. NVIDIA SXM had updated to versions 3 and 4 since, and this isn't based on none of those anyway, but maybe there's something we don't know that make six-way reasonable.

[ Parent | on HN ]

Re:Tinygrad: Hacked 4090 driver to enable P2P by andersa on Friday April 12, 2024 @11:43AM (#40014181)

It was probably just before running LLMs with tensor parallelism became interesting. There are plenty of other workloads that can be divided by 6 nicely, it's not an end-all thing.

[ Parent | on HN ]

Re:Tinygrad: Hacked 4090 driver to enable P2P by dheera on Friday April 12, 2024 @03:12PM (#40016578)

What is a six-way system?

[ Parent | on HN ]

Re:Tinygrad: Hacked 4090 driver to enable P2P by TylerE on Friday April 12, 2024 @11:58PM (#40020374)

oid school way of saying core (or in this case GPU), basically.

[ Parent | on HN ]