Ground source scales well if you have a large building and a large body of water near by then the payback time is short. But at single family home level it's just not that useful.
Further south solar systems have below your 5-10 year payback period.
There is a way: open-loop systems.
A few years ago we installed an open-loop ground source heat pump (ClimateMaster brand) for under $6k. Water at 50F is drawn from a preexisting 15 gpm/50 foot well, through the heat pump unit, then dumped in a dry well at around 40F. It uses half a million gallons of water a year (costing <$30 in electricity), but of course there's no aquifer depletion, and closed-loop systems also use energy to pump water. This unit also pre-warms hot water at its coefficient of performance (about "600%"), reducing electric DHW costs.
We homeowner installed, so we weren't eligible for NYS incentives. But it cut our annual bill in half vs. the previous heating oil furnace, with a payback period of 5-8 years.
Relative net savings depend on getting a system sized for your use, and how much cooling you use in the summer. But, you can also add solar panels for summer use with the overall value balancing over the year.
For clarity, my system provides both water heating and space heating/cooling.
It's basically "free" if your house needs a well anyway. (this assumes a lot about the ground under your house but it's relatively true ;P)
If you live in a mild climate, you are just not going see a lot of payback because as you said, you don't spend a lot.
Note: Most of them also provide hot water, not just heating and cooling
But all told, the path to making it popular would be to make it part of new construction. I understand why they want to try to make retrofitting cheap, but it's just not even close right now.