This is exactly what I've done for the past year. I realized that most of the time, I know which directory I'm in, I know which user I am, and I know which host I'm on. It's trivial to look up any of these (as well as other crazy things people embed in their PS1).
Now my prompt is nothing but a green ">> " on a black background. I'm not deluding myself when I say that the reduced clutter improves my productivity.