Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G...
by qoez on Sunday February 22, 2026 @07:09AM
(#47110367)
Open router is highly subsidized. This might be cheaper in the long run once these companies shift to taking profits
[ Parent
| on HN ]
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G...
by culopatin on Sunday February 22, 2026 @02:09PM
(#47113706)
But why not cross that bridge then. By that time you might have much more optimized local infrastructure. Although I do see that someone suffering through the local slowness now is what drives the development of these local options.