Re:Looking for fast GPT-4 level LLM usable via API. (not via...
by minimaxir on Tuesday March 19, 2024 @09:38PM
(#39762144)
Claude Haiku.
[ Parent
| on HN ]
Re:Looking for fast GPT-4 level LLM usable via API. (not via...
by eerop on Tuesday March 19, 2024 @10:10PM
(#39762297)
Thanks. I just tried it, it's definitely fater, but still, sometimes it takes >3 seconds (my app requires the completion to be done in <3 seconds).
I've tried to optimize it by reducing token length and other methods, but I'm wondering if there's any better LLMs