> Forcing a town of <1,000 people to infill with huge apartment buildings doesn't fundamentally alter the overall housing problem, but it does impact the people that live and work in the community.
I'm not sure what does alter the housing problem if not housing. It seems your position is "don't come here...unless you're rich" because the rich don't affect the "character" of the town.
You don't want lots of people. But your only option is to make it hard for people to move in, which constrains the supply of housing relative to demand. Which, in turn, makes prices go up. Which, in turn, forces out your blue collar resident friends. You can't have it both ways.
What you're doing with one unit honestly doesn't make much of a dent in any problem unless you're adding an order of magnitude more units. If anything, you're locking in that space to higher-but-still-very-low density. It's much easier to bulldoze a mansion than evict multiple families.