You're not missing anything. Most devices these days are extremely limited without internet access.

Tailscale is the key ingredient.