Re:Show HN: Route your prompts to the best LLM
by danlenton on Thursday May 23, 2024 @04:47AM
(#40452198)
Yeah I agree, routing all the time is overkill for some applications, however for others it really is necessary in order to reach the necessary speed and performance for users of your real-time app.
For those who don't want to always route, another core benefit of our platform is simple custom benchmarking on your task across all existing providers:
https://youtu.be/PO4r6ek8U6M
If you then just want to use that provider rather than a router config, then that's fine!
For those who don't want to always route, another core benefit of our platform is simple custom benchmarking on your task across all existing providers: https://youtu.be/PO4r6ek8U6M
If you then just want to use that provider rather than a router config, then that's fine!