Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Launch HN: Relace (YC W23) – Models for fast and reliable codegen. Parent comment
It's limiting to not be able to call it through routers like LiteLLM & to make a new billing account
Not to mention local- these are presumably small models and I'd take 800 tokens/sec vs 4000/sec with latency any day
There are no comments on this comment yet.
It's limiting to not be able to call it through routers like LiteLLM & to make a new billing account
Not to mention local- these are presumably small models and I'd take 800 tokens/sec vs 4000/sec with latency any day