My unpopular opinion is that pandas specifically is terrible for data engineering. The type inference when loading data from files can result in fragile jobs. In my experience, it's also surprisingly slow for a lot of data engineering tasks. IMO, it should just be used for analysis.

Python's parallelism story also holds it back, but that may be improving soon. It's unlikely it will be as nice as Go's though.