I was thinking a lot about this idea lately. An API/programmatic-first brokerage/trading platform. Let people design automated trading strategies on top of solid APIs, and use your site for visualization/planning. OptionAlpha seems to get into this but not nearly far enough. Latency wouldn't be critical either for retail investing.
I don't really understand why it doesn't exist. IB is probably the closest well known broker. There are some other smaller ones with better APIs.