Main source of latency will be network. The main problem are synchronous GET requests as then performance == latency. Better go async instead of reducing latency with hardware accel.
Less than 400ns per switch hop (http://www.arista.com/en/products/7150-series) excluding congestion.