There are a couple of other museums well worth visiting near El Prado. El Prado can get very busy because it's on everybody's list of things to visit. I've been there on a quiet day at some point and it's very enjoyable. But when you have to queue up for 45 minutes just to get in, it's probably a lot less nice. Thyssen-Bornemisza Museum has a pretty amazing collection and is right across the street. And down the street is the Reina Sofia, which has a nice modern art collection (think lots of Miro, Picasso, Dali, etc.).
If you have time and a car, driving around Spain is very enjoyable. I've seen most of it's larger and smaller cities over the years.