I searched that FreeDos can now somehow run Windows 3.1 [0], but the article only shows it on QEMU. FreeDos might be able to boot on a USB stick [1]. As for downloads, there's WinWorldPC where you could also find 16 bit Delphi 1.x.
[0] https://virtuallyfun.com/2021/07/27/freedos-running-windows-...
[1] http://wiki.freedos.org/wiki/index.php/How_to_Create_a_USB_B...
Edit: I deleted my previous dosbox answer as it missed the booting from USB part.