News for hackers. Stuff that matters.
Re:You can't build a moat with AI by transitorykris on Thursday April 11, 2024 @04:02PM (#40006230)
Network availability, latency, privacy, etc. many qualities to consider beyond model size and performance for applications.
Re:You can't build a moat with AI by happypumpkin on Thursday April 11, 2024 @04:09PM (#40006301)
And cost-efficiency, if I'm using an LLM as an Siri-like assistant on my phone, most of the tasks I'll want it to do won't be that complicated and it would be a waste to send them to some SOTA LLM in the cloud, which I'll have to pay for by a monthly subscription or on a per-token basis.