Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Ask HN: Affordable hardware for running local large language models?.
You can experiment with a lot of models, it's just going to be slow.
With ddr5 you can even go higher with 48GB modules.
Otherwise I got a 3060 12G, which can be had for 200€ used.
Its a very affordable setup.
There are no comments on this comment yet.
You can experiment with a lot of models, it's just going to be slow.
With ddr5 you can even go higher with 48GB modules.
Otherwise I got a 3060 12G, which can be had for 200€ used.
Its a very affordable setup.