Some good tips in here, I've find myself reaching for JSON/excel methods often.
Despite using it for years, I still haven't decided if pandas is poorly architected or if the clunkiness (for lack of better of term) is a result of the inherent difficulty of the tasks.