We should get rid of at least pennies and nickels (both of which cost more to make than they are worth.) The last time the US phased out a denomination -- the half-cent piece in 1857 -- it had more purchasing power than a dime does today.
Besides, if we got rid of the penny and nickel, the size of the dime would finally actually make sense.