Rate limit of external API without dropping requests? Any SaaS or OSS?

3 pointsflashglbm_1 comment

I'm currently stuck with a problem of limiting my outgoing requests to external API that has a limit. My requests are being throttled (429 error) and I need a solution that would allow me to prioritize, cache, delay execution to fit into the rate limits. Do you know any OSS or SaaS solution for such problem?

View on HN

I did something free and unorthodox for a small project before, where the actual application was a black box binary that was made by a vendor: run an instance of nginx, listen locally, and proxy-pass to the actual external API.

Here, you can have nginx ignore caching and revalidate headers or strip them, cache them locally onto the filesystem with determinable times or sizes based on regex or path prefixes, and set rate limit + burst limits for each path (just put them in a different location block).

Reply on news.ycombinator.com