If you replace the Teensy 4.x it would have to be something very close to the same pinout, foot print, cost and features otherwise it would just be a new product. Ideally you would find a way to source the Teensy directly bypassing Sparkfun.
These chips have perfectly-fine ROM USB bootloaders and SWD, don't ruin them by adding extra garbage.
USB HS on a board that small is a non issue: it's one measly differential pair with easy impedance requirements.