I don't know where it comes from, but the distinction's basically 'when a home server becomes home servers', or at least becomes a hobby, as opposed to just setting up and forgetting a Pi-hole once or something.
It's kind of morphed and people fold their home "production" environments into the term too.
Homelab [hom-læb](n): a laboratory of (usually slightly outdated) awesome in the domicile