I mostly enjoyed Python for Data Analysis, but do agree that there was too much focus on pandas (though that was to be expected with Wes McKinney writing it).

I would have loved if the book had included sections on the statsmodels and scikit libraries, especially since they are integrated with pandas.