Maybe, but are you insinuating that no back breaking work would need to be done if money weren’t to exist?
Pretty sure the introduction of money reduces the total amount of backbreaking work to be done. Instead of hauling grain to trade for axe heads and carrying those back to your farm, you carry coins, paper, or in modern times, tap a few buttons on your smartphone.
Money is an abstraction, but the status quo as a whole (monetary policy, capital markets, labor policy) is designed to ensure a supply of labor. Capital begets capital [1], so those who don't have will engage in riskier behavior to get off the wage slave treadmill.
[1] https://news.ycombinator.com/item?id=16592414 ("I think capitalism is much simpler: capital begets capital. Those who have capital will accumulate more capital, almost infinitely, until the capital/income ratio reaches an equilibrium who knows how high (in the absence of major corrections like wars and hyper inflation). Add inherited wealth and low taxes. Capitalism's winners are those who already have capital. Thomas Pickety's book "Capital in the 21st Century" cogently illustrates this using massive tax return based data sets.")
If the grain only ever exists on your farm, it has no value to anyone else whether for coins or axe heads.