Related, when I play H.265 videos on Windows 10/NVIDIA 10 series card the player app crashes after 4-5 seek operations. I assume it's video card related, but it has up to date drivers.
And at the same time, it depends on if the file have 8-bits or 10-bits. Some CPU/GPU don't have the support for 10-bits which can offload it to the software decoding which can be resource intensive for your system to decode the file at the software level.
If you said it is pretty heavy on the CPU, then it could be your CPU that is causing the issue.