News for hackers. Stuff that matters.

A comment on Building a personal, private AI computer on a budget. Parent comment

Re:Building a personal, private AI computer on a budget by vanillax on Tuesday February 11, 2025 @09:49AM (#43013332)
Huh? Toys? You can run DeepSeek 70b on 36GB ram Macbook pro.. You can run Phi4, Qwen2.5, or llama3.3. They work great for coding tasks
[ Parent | on HN ]
Re:Building a personal, private AI computer on a budget by 3s on Tuesday February 11, 2025 @09:55AM (#43013420)
Yeah but as one of the replies points out the resulting tokens/second would be unusable in production environments
[ Parent | on HN ]
Re:Building a personal, private AI computer on a budget by vanillax on Tuesday February 11, 2025 @09:10PM (#43021004)
What? Literally use it at work to write code.
[ Parent | on HN ]
Re:Building a personal, private AI computer on a budget by jt_b on Tuesday February 11, 2025 @09:33PM (#43021154)
I think they're talking about using it to power inference for self hosted user facing applications.
[ Parent | on HN ]
Re:Building a personal, private AI computer on a budget by vanillax on Wednesday February 12, 2025 @09:26AM (#43025717)
ahhhhh yes ok. Totally agree here.
[ Parent | on HN ]