Isn’t there a UI to remove those inside Xcode? I just used to trash them in Finder but it sounds like that changed.
In Xcode, go to Window > Devices and Simulators in the menu bar (or press Shift+Cmd+2), then select the Simulators tab in the sidebar to open the list of simulators. Here you can select and delete simulators.