Looks like WebTransport has been designed to do what I want to do.