> executed on a paired phone

One constraint around this is the sheer bandwidth required to do any sort of live processing (either for viewfinding purposes or autofocus) — the latency (and even bandwidth) of anything less than a direct raw feed into the processor isn't gonna be good enough.