It means that they transcended the "works on my machine" stage, and can reliably run a quantum algorithm on more than one different quantum computer.
But apparently they haven't demonstrated the actual portability between two different quantum computers.
If a company says they've built the fastest car in the world, a reasonable response is "ok, let's see it drive faster than any other car can", even though they already said that it can do that.