Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G...
by charcircuit on Sunday February 22, 2026 @01:53AM
(#47108875)
Why not the PS5? That's when games started streaming assets straight from the NVME SSD to the GPU. In this case the assets are weights.
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G...
by xaskasdf on Sunday February 22, 2026 @09:37AM
(#47111342)
Actually I'm thinking about buyin an AMD BC-250 that's bassically a ps5 with pcie factor format; and it's linux capable by default, maybe next month
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G...
by rustyhancock on Sunday February 22, 2026 @11:16AM
(#47112206)
Just because he mentioned retro gaming.
Otherwise DMA is everywhere.
In the PS5 case since it uses unified memory it's not quite the same as say an GBA streamed from a flash cart to video RAM.
Perhaps that's what made them think to try.
Perhaps the current batch of smart memory cards which on the PS2 I believe have quite complex DMA capabilities to stream from the SD card game data.