It's so true. I spend the majority of my time working for a company that sells physical products, and we roll everything ourselves. Managing fulfillment, integrating with accounting, and basic CRM among a medium-sized team is an enormous task that's completely underserved by Shopify (or anyone else for that matter).
Knowing a good handful of other small to medium-sized business owners I know we're not alone in this (as your comment points out), and it makes me all the more eager to open source everything we do. But first, there are bugs to fix.