News for hackers. Stuff that matters.
Re:Ask HN: How much would you pay for local LLMs? by eth0up on Tuesday December 03, 2024 @11:22AM (#42307866)
That's the only AI I'm interested in, for personal use. I presently pay $20 monthly for something I'm far from satisfied with.
Re:Ask HN: How much would you pay for local LLMs? by kayduyenma on Tuesday December 03, 2024 @11:39AM (#42308124)
What tool are you using? I'm self hosting a small AI chatbot. Although it's not as fast as ChatGPT, it's somehow more private and a fun experience for me
Re:Ask HN: How much would you pay for local LLMs? by eth0up on Tuesday December 03, 2024 @12:30PM (#42308712)
I'm embarrassed to admit, I'm using Perplexity. It's not all bad but the censorship and sometimes extreme reluctance to discuss out-of-the-box material infuriates me. The token caching also makes soome coding excursions a hassle and requires frequent new sessions.
Re:Ask HN: How much would you pay for local LLMs? by worksonmymach on Wednesday December 04, 2024 @06:09AM (#42316387)
Dont pay $20, use the API and pay $2 or less :)