News for hackers. Stuff that matters.
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G... by xaskasdf on Sunday February 22, 2026 @10:00AM (#47111512)
I thought about that, but idk if they allow me to modify the linux kernel and nvidia cuda kernel at all
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G... by green-salt on Sunday February 22, 2026 @12:23PM (#47112779)
I think you can do a bunch of that on Digitalocean's GPU droplets.
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G... by jonassm on Sunday February 22, 2026 @12:37PM (#47112889)
In those systems you could probably leverage something like Nvidia SCADA or GDS directly.
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G... by xaskasdf on Sunday February 22, 2026 @03:07PM (#47114159)
Actually since they have direct GDS it should perform really well on professional gpus