1. Serverless functions timing out with high latency or elongated completions + DB calls.
2. Edge funcs not being sufficient, esp if you're batching together requests
3. Devs spinning up their own simple express servers to handle requests and reinventing the wheel with rate-limiting, retry-logic, and webhook configuration.
Thruway could be an open source library for handling these problems and simplify integrating AI. Thoughts?