Have you heard of Microsoft's distributed FPGA fabric project? They are using acceleration for a lot of Bing's algorithms with excellent result all around. They are now working on bringing it to Azure.
Do you have a recommendation for a specific data processing experiment of theirs I should check out? I really feel like I just missed a paper where they proved some real advantage over other hardware, and once I found that I'd understand. I respect the Azure teams generally and assume they know what they're doing- but can't escape the hunch that what they are doing is network acceleration, and are just releasing to the public cloud because they have these sitting around anyway.