Async Queue – One of My Favorite Programming Interviews (Can AI Break It?)

Re:Async Queue – One of My Favorite Programming Interviews (... by xnorswap on Monday July 07, 2025 @09:53AM (#44490387)

I've dealt with low-limit APIs, and I've always considered the better approach to the problem is to create a proxy rather than trust the clients to manage, limit and coordinate themselves.

Then we send all traffic to proxy.service instead of canon.service, and implement queuing, rate limiting, caching, etc on the proxy.

This shields the weak part of the system from the clients.

[ Parent | on HN ]

Re:Async Queue – One of My Favorite Programming Interviews (... by Jarwain on Monday July 07, 2025 @12:18PM (#44491873)

Makes sense as a broad pattern!

I guess I hadn't considered the existence of generic TCP proxies And I'd probably have concerns around how much latency it would introduce in an environment where we have some requirements on the rate of data collection.

That said our service Does act as a kind of proxy for a few protocols.

[ Parent | on HN ]