You don't have to run the web interface on the server.

You can use Cockpit Client (from flathub) to connect with SSH.