What i know from the past is for realtime guarantees ethernet does not cut it. So you might be right.
Audio is usually soft realtime, sometimes, e.g. when doing studio recordings, firm realtime.
Some audio setups are run quite "close to the metal", both because it needs less buffering, but also the lower human threshold for noticing latency seems to be around 10ms. And having audio not get out of phase with multiple sources/sinks gets added on top of that.