When my sister had her first baby, I was tip-toeing around their house when her baby was sleeping and was told not to.
Apparently if you go about your normal day, babies will get used to falling asleep in a semi-noisy environment. However, you go out of your way to create an ultra quiet place when they sleep, any slight disturbance will wake them up.