I agree, I always thought in theory it could be possible to mix memory palaces with VR.

Someone did a research study on it here if you're interested.

https://obj.umiacs.umd.edu/virtual_reality_study/10.1007-s10...