Re:Most ML applications are just request routers
by rossamurphy on Wednesday May 29, 2024 @03:32PM
(#40515944)
Moving an internal ML project from "a quick demo on localhost", to "deployed in production", is hard. We think latency is one of the biggest problems. We built OneContext to solve that problem. We launched today. Would love your feedback + feature requests!
how does this fit in with barebones langchain/bedrock setup?