It depends on the games you play. I often run out when playing VR games, so I have to reduce resolution. Even with an 8gb card.
How do you know that's a memory issue? I'd expect that to be less of a concern in VR games and more a requirement to render the exact same duplicate resources at slightly different perspectives, which should not be memory, but pure GPU throughput.