Everyone's life FEELS hard, especially compared to the lives of those a few rungs up the ladder.
That said, not everyone's life IS hard. If you can afford not to take a paycheck for a few months to work on a dream, perhaps you should recalibrate your "how hard life is"-o-meter.