Yes, you are mad to think that. You literally have 400k users trying to execute trades in parallel (some many per second) on a common order book. Add leverage, a liquidation engine, etc.
I think my conceptual problem here is what is done on the Bitcoin part and what is done at the exchange level. I thought the Bitcoin network handled that part and obviously I’m wrong about that.
Scaling with satisfactory security is never trivial.