That's definitely "grass is always greener" thinking, of the same sort that makes others hear about Google project manager salaries and think they should be working as a programmer.
For every one person making 250k+ at a construction company, there are probably a hundred making <100k. Salaries don't go much beyond 120k unless you're in the owner sort of category. And the industry comes along with working 10+ hour days (630am to 5pm is a pretty regular schedule, 4pm on Fridays tho!), outdoors, regardless of weather. And it's physically demanding work
It can be physically exhausting work, and long hours for sure. Still, it's impressive that they can pull in those kinds of figures.
Fluctuations in interest rates, material costs and the housing market in general means they also have a lot of risk on the business side. This is especially true for those building spec houses.
Honestly, compared to the software world, that profit range sounds too small.