For clarity, when you refer to finance, I think you mean Financial Planning & Analysis (FP&A). I think you would agree that centralized Tax, Treasury, and Accounting functions are ok and should probably report to the CFO.
With respect to FP&A, I have seen several firms that simply embed them within a product line or business unit. They need to submit forecasts to a central group, but their primary mission is to support the product or business line.