Why not make these much, much smaller, and have the battery swap be part of the design? Connect 100 bee-sized platforms together in a grid. Any one of which could be the "battery swapper" bee and keep the rest of the flock afloat?
So they'd constantly travel from the base station to the swarm, picking up energy and depositing it to the others. They'd form a platform that can lift appreciable amounts of weight, maybe even 100 kg (a person), and fly forever.
Right now I think drones like that would cost around $100 each. But if they could be made for $10, then conservatively we could have flying platforms for around $10,000. And unlike batteries, the capacitors would last forever.
Not so much grey goo, more like grey girders. I haven't researched this at all yet, if it already exists.