If you connect them to the internet you can control them remotely, there is nothing wrong with doing that.
If the application is properly secured (strong encryption, strong authentication) there is no point for the VPN
and if the application isn't configured correctly, the vpn/internal network might not be configured correctly either.