There's a lot of essential software that I would improve, but I wouldn't replace or rewrite:
- Nautilus. Serious usability/UX problems.
- Audio in linux. Ubuntu often selects the wrong audio devices (microphone, headphones, speakers)
- Linux sleep/hibernation. System hangs are common.
- GRUB. The interface is dated, why is it so ugly?