Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy

Re:Show HN: archgw: open-source, intelligent proxy for AI ag... by naveed174 on Tuesday November 19, 2024 @04:11PM (#42188134)

For complex agent scenarios where there might be COT reasoning needed how does archgw work in that scenario? BTW nice detailed post. And congratulations on the launch.

[ Parent | on HN ]

Re:Show HN: archgw: open-source, intelligent proxy for AI ag... by sparacha on Tuesday November 19, 2024 @06:02PM (#42189001)

If you are building a state machine then you should use tools that enable you to do that (temporal, langgraph, etc) by orchestrating multple LLM calls - in that case archgw offers intelligent routing to your COT agent and enables you to transparently add rich observability and metrics for all calls made to LLMs in the COT/state machine scenario.

[ Parent | on HN ]