News for hackers. Stuff that matters.
Re:Show HN: archgw: open-source, intelligent proxy for AI ag... by mikram on Tuesday November 19, 2024 @02:47PM (#42187352)
Congrats Adil! Interested idea with lot of potential.

Do you have to use envoyproxy to use archgw? Can archgw be used for LLM routing without using envoyproxy?

Re:Show HN: archgw: open-source, intelligent proxy for AI ag... by adilhafeez on Tuesday November 19, 2024 @02:59PM (#42187472)
Thanks! My responses inline,

> do you have to use envoyproxy to use archgw

Yes, 100%. Our gateway is implemented as rust filter which runs inside envoy process.

> Can archgw be used for LLM routing without using envoyproxy?

Unfortunately no. Since we are built in top of envoyproxy.