The userland part is the implementation of hardware accelerated OpenGL ES 2 and OpenMAX (video acceleration), at least.
Now, I guess NVidia could put a high-powered processor on their GPUs and move their entire OpenGL driver stack onto it as "firmware" so that they could claim their drivers were open source, but that doesn't seem like something they'd do.
And sure, having the userspace and kernel driver open source is only a start. But having everything that runs on the CPU open source is great from a separation-of-concerns perspective.
Open sourcing the firmware and even the hardware itself would be cool, but is a battle for another day... And that'd no more be a matter of the just the GPU, but of all hardware that has firmware, including the CPU, network equipment, 3G radios...