The buyer brings the money but the seller brings the house.
Tax incidence depends on the elasticity of either buyer vs seller (whether or not it's a seller's market or a buyer's market)
I mean yes the literal money is paid out but the money is just the abstraction over the real thing.