There's actually a way for us to experience something similar: wear eyeglasses where the two lenses have different spectra. Then these "extra colors" show up as a shimmering sensation.
I have such a pair, but have to say it's not very exciting; there's not that much metamerism in the real world.