The physical infrastructure required to do this at any scale makes it prohibitively expensive. I've rarely spent more than 15 minutes at a fast charger. Modern BEVs have a pretty impressive charging curve, and with the extensive charging network that is available, at least in Norway, you can optimize this further. I think there's a good analogy to IP over Avian Carriers. You can technically get super high bandwidth, but the latency kills you. Latency in this case being the physical battery swap stations.
Having swappable batteries on the other hand, that might have some benefit. I don't really need a 82kWh battery pack in my car for my every day needs. It just adds a lot of weight. I also think this is what Nio is aiming for. I doubt they see battery swapping as a solution to fast charging, more to let customers have some flexibility in terms of battery capacity, and to make people still nervous about battery longevity calm down a little.