Fastly just dropped a new feature called "AI Accelerator." I haven’t had the chance to play around with it yet, but I’m really keen to see how they're managing to speed up inference processes with clever caching. Sounds pretty incredible, right?
While Cloudflare and Akamai are leaning hard into AI with edge GPUs, Fastly is sticking to its roots with a unique twist on speeding up LLMs... Interesting!