This is similar to my setup and experience as well. I have a multi-purpose server running Samba with 10 Gbps SFP+. I have 2.5 GbE on my desktop and easily saturate that when transferring files.
I even use the network for stuff like old game ROMs and ISOs for emulation. The random access times are still magnitudes better than I’d be able to get with any HDD.