News for hackers. Stuff that matters.
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G... by lmeyerov on Monday February 23, 2026 @12:34AM (#47118490)
Bandwidth-wise, it's fun when you have a storage array instead of just 1 nvme. Then you can saturate the pcies, and go beyond what's cost effective on ram. Interesting to think of this as opening the door to 10-100T MoEs..

There are no comments on this comment yet.