"People" don't hate lifestyle businesses. "Investors" (both VC and angel) hate them, and it's for the obvious reasons: if an entrepreneur doesn't take outside funding, and doesn't shoot for a big exit in 5-7 years, then there's no opportunity for a VC to profit.
The early-stage investment community controls the dialog about entrepreneurship, and they're not entirely unbiased.