Why desktop as opposed to a server (headless) image?
I would suspect it would be more common to connect via ethernet from a PC or laptop, vs local console. Especially for field servicing, carrying a laptop is simpler.
In the case HMI is needed, installing the desktop is just some additional packages.
This raises another question: what repository are you using? How are (security) updates handled, if at all?