Suppose we remove an ice cube of mass 10g.
The ice cube was previously floating and was therefore displacing 10g of water.
If we let our ice cube melt, we will have 10g of water than we can add back to the glass.
The net result is that the water level remains the same.