If you're truly paranoid, you can certainly encrypt data in RDS with keys that you have and Amazon doesn't.
But yes, the rest they expect us to take on faith. Or trust some boilerplate in their ToS (written by their lawyers, to absolve them of liability).