At scale you would drop pandas in favour of polar and eventually move to DuckDB. See, this is the blue collar mentality, arguing about whether a wrench or screwdriver helps here and how much WD-40 is enough. An engineer would be tasked to build the chassis entirely, making sure that complaints from previous versions are addressed properly.