News for hackers. Stuff that matters.

A comment on Character.ai shows how to reduce LLM costs by 13 times.

Re:Character.ai shows how to reduce LLM costs by 13 times by gnabgib on Thursday July 04, 2024 @02:18PM (#40876941)
Article title: Optimizing AI Inference

Discussion (63 points, 14 days ago) https://news.ycombinator.com/item?id=40739225

[ Parent | on HN ]

There are no comments on this comment yet.