I suspect that if a hacker friendly OS that "just works" does come out, it will be from a computer company trying to offer a non Windows option (either for price and/or because people start not liking Windows). Given the volume of computers such large companies make, the unit cost associated with a polished OS will be very low. Although this OS would be designed for the average user, the company would likely choice to use open source programs for cost.
I'd pay $2k+ for a 14 inch laptop, 1600x1200 IPS screen, SSD, i7, dedicated graphics, and a good keyboard (with home, end, pgup, pgdown) that could run Linux. Hell, I'd be happy with the dedicated graphics just working in Windows, and I'd dual-boot to game. But no such machine exists right now.
Slackware is simple, easy to use, and "it just works". It's free software so of course it's hackable. It's not as GUI-y as an OSX fan might like, but otherwise, it fits your requirements.
It even has the "top dollar" price tag ($30-$50 depending on if you want the 6 CD set or a single DVD, and whether you sign up for the subscription or not), although you can download it for free if you want.
OSX "just works" because it has a full suite of software that comes loaded on it and "just works" very well and makes a lot of Windows programs jealous (except for some Office products). If people want customization and general freedom, they already have Linux for free.
I think it is safe to say that the market for people unhappy enough with both OSX and Linux, and willing to pay for that, enough to justify years and years of expensive and risky development, is _relatively_ small.
It's not Linux though.