News for hackers. Stuff that matters.

A comment on Show HN: Arch-Router – 1.5B model for LLM routing by preferences, not benchmarks. Parent comment

Re:Show HN: Arch-Router – 1.5B model for LLM routing by pref... by cotran2 on Tuesday July 01, 2025 @08:19PM (#44439167)
The model is compact 1.5B, most GPUs can serve it locally and has <100ms e2e latency. For L40s, its 50ms.
[ Parent | on HN ]

There are no comments on this comment yet.