There was at least one CP/M machine that used tape -- the Epson PX-8 Geneva (an early laptop that had a built in micro-cassette drive). Although it had CP/M in built in ROM and also had the ability to use ROM cartridges like a game console in order to load applications like WordStar.