While that's true and required to successfully decrypt most algorithms, it is also true that there are more types of tampering one can do than changing the output ciphertext. Usually involving storing the key or leaking data somehow.
Tampering with the RNG probably provides the best value for an attacker, and is harder to detect.