A rubber duck with a vacuum inside (removing the air material) of it is just a piece of rubber with eyes. Assuming OP's point about the rubber not being less dense than water, it would sink, no?
Not if there is vacuum outside too. In a vacuum it remains a duck and still floats.