The UK authorities agree with you: if you pass the exam with a manual car you can use both, but if you pass it with an automatic one, you can only drive automatic ones.
Source: https://www.admin.ch/gov/de/start/dokumentation/medienmittei..., grep for Automateneintrag