Linking ordinals to cardinals is done by the same abstraction process that first led us to think of numbers as distinct objects. We noticed there was a property in common between the set of our five fingers and a pile of five sticks. And hey, it's not so different from the property of the fifth object in some sequence, so let's lump those together. They're formally different, but intuitively similar.