The graveyard orbits are ~40,000km above the earth's surface - there's a LOT of space to avoid debris in.
The issue with space debris is with orbits in the 500-5,000km range. Lower than that and the debris will reenter quickly, higher and you start getting spread out enough to not matter as much.