News for hackers. Stuff that matters.
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G... by xaskasdf on Sunday February 22, 2026 @10:07AM (#47111593)
Ya know, here on the local market there are a bunch of optanes hanging around, I'll try to manage one to check if there's any improvement
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G... by jonassm on Sunday February 22, 2026 @01:08PM (#47113210)
Optanes will be good for latency, but not so much for BW which seems to be your major bottleneck if I'm not mistaken?
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G... by xaskasdf on Sunday February 22, 2026 @03:06PM (#47114152)
yeah, the mobo upgrade is something I gotta do anyway, so I'll cover that up more or less, the optane is something I didn't thought about