Amritpal001
Re:Show HN: GPT Router – Open-Source API Gateway for LLMs (OpenAI, Ant...
on Friday December 22, 2023 @01:13PM (#38736848)
Just gave it a go. The flexibility to switch models dynamically based on their availability and latency is impressive. It is much required for scenarios requiring high reliability. The ability to pass models' priority order adds another layer of excellence.