Actually, this makes me think the opposite. This is a great example actually.
Polyurethane wheels weren't introduced to skateboarding until 1971. It took off in popularity due to this because the previous wheels were made of clay and were basically terrible.
I don't know the history of luggage wheels, but it sounds like it was waiting for the invention of the polyurethane wheel.