From the systems/operations side of things..
Ganeti: rock solid clustered virtualization suite.
OpenBSD: no fuzz server/router distro.
Ceph: clustered network storage without tears.
Varnish: covers any HTTP needs. Add haproxy or nginx for HTTPS.
Corosync/Pacemaker: Designed for reliability. Leave VRRP where it belongs (I'm looking at you keepalived).
xCAT: Little-known but widely used datacenter lifecycle management suite. Comes with cluster-aware shell, native remote consoles, BMC provisioning, unattended installs, DNS and much more.
Guix: The package manager for the future.
Things that make me want to tear my eyes out:
Openstack: keeps breaking inexplicably, nightmare to configure and maintain. Terrible documentation.
Vyatta: Don't even want to talk about it.
RHEL: Upgrades systemd 207->219 in minor release. Backports unstable kernel patches. Requires EPEL for lots of standard software. RabbitMQ logging has been broken more than two months (BZ 1324922).