OpenZFS on illumos
blog.delphix.com
blog.delphix.com
[2] https://github.com/joyent/sdc/
[3] https://github.com/joyent/manta
The net is that we have found the work going into illumos to be exactly what you want upon integration: innovative, pragmatic work that has already proven itself in production.
If you're looking for a general server OS, use OmniOS. If you're running armies of VMs, use SmartOS. For desktop, OpenIndiana Hipster, although illumos is more for servers.
Personally, I'm fond of SmartOS, in large part because it comes with pkgsrc. The bad old Solaris days, with its anemic packages, blastwave and sunfreeware, are long gone.
Would i gain performance ? Would it let me backup my server more easily ? Make the stack easier to shard ? Be less prone to security issues ? Etc.
edit: It wasn't?
That said, Linux lags in many very useful features. It's only recently gotten a usable OS-virtualization solution (containers/Docker), while Solaris/illumos (and FreeBSD, for that matter) have had versions of it production ready for over a decade. Tracing on Linux is a pale shadow of DTrace--which bcantrill among others built a decade ago, and which has been available on the BSDs and Mac OSX for the better part of the decade since. ZFS, which many would argue is standing king of file systems, has been battle-tested on Solaris/illumos and FreeBSD for years, while licensing issues prevent it from being included as part of Linux. The file system that btrfs is meant to be better than is ZFS, a goal it's still seeking.
Of course, as far as it goes, Linux is good enough to get by. But once you've worked with a more fully-featured OS, you find yourself thinking wistfully of them.
Clicking through some of the links there, it sounds like the Illumos devs aren't entirely happy with the current FreeBSD code, but a new implementation looks stalled.