Network tuning guides

Have been working on a project where we have a high throughput/low latency requirement (500k+ requests/sec, with sub 5ms responses SLA).

One thing we haven't worked on yet much is tuning of the actual server and it's network settings. Was curious if there are any guides you recommend.