> If I sold it today, I don't know if the 3-4% gain would be enough to offset the costs of repairs/taxes etc. that I have spent in last 7 years.
Sure, agreed, but let's think that through a minute. So your housing has 'only' beaten inflation by ~25%, and that if you sold it today, you would have 'only' gotten 7 years of effectively-rent-free living?
Imagine if you had actually had to rent a house during that time. I don't know what rates are in NJ, but you would have spent about $1200/month in rent (or ~$100k over 7 years) to have done something like that in Michigan.
The common "bad" scenario I hear about is one like yours, where you got 7 years of housing, and the appreciation "only" covered almost all of that maintenance/upkeep, but didn't also cut you a free-money bonus check on top of it.
That's where the "housing is always a good investment" line comes from. Yes, you had to take out a loan and front all the other money out-of-pocket yourself (and not everyone can afford to do that). But if you get it most-to-all of it back when you sell the house, then even in your "bad" example, you came out ~$100,000 ahead of any regular person who had not owned.