> few billion requests/ month
A billion requests per month is 400 requests per second. My toaster can do better than that :)
Not to say that your product isn’t capable for many use cases, but the fact that the 1krps range is something impressive in Python world is indicative of the issue: Python is not built for speed, it’s built for convenience, and increasingly it’s competing against more modern languages that offer both.