> When USA do the same, the non-USA dollar holders also take on the cost

They don't. If they aren't holding USD or something pegged to it then it is not devalued.