This bit us in a recent project where we have very long ongoing downloads, where even a very high grace period wouldn't really help.
I wonder whether it's technically generally feasible (possibly depends on net/http2's capabilities) to handover the connection from the old to the new server instance, comparable to what systemd does in terms of FD passing for socket-activated services.