News for hackers. Stuff that matters.

A comment on Show HN: Arch – an intelligent prompt gateway built on Envoy. Parent comment

Re:Show HN: Arch – an intelligent prompt gateway built on Envoy by sparacha on Wednesday October 16, 2024 @06:23PM (#41864438)
Great to hear that - walk us a bit more how you are planning on using the filter? The filter today does communicate with a model_server service for the intelligence piece. Were you thinking of using the filter for outbound LLM traffic management?
[ Parent | on HN ]

There are no comments on this comment yet.