News for hackers. Stuff that matters.

A comment on Ask HN: How to get started with local language models?.

Re:Ask HN: How to get started with local language models? by fzzzy on Sunday March 17, 2024 @11:47AM (#39735244)
How much ram do you have? How much gpu ram do you have? What gpu do you have? What kind of performance are you hoping to get in tokens per second?
[ Parent | on HN ]

There are no comments on this comment yet.