Most hunters aren't feeding animals.
In general you're correct, most hunters don't. But some hunters -- particularly the ones that hunt the most -- do feed prey. On the high end of that histogram are people that acquire property in communities that are designed to accommodate hunters. They feed a lot of game.
That is likely the case. General farming on behalf of human consumption is likely to be an order of magnitude greater impact on whatever "ecological imbalances" you care to measure.
Humans have been "imbalancing" ecologies thus for a long time.