I saw a video of a Chinese phone that did something like that. Their implementation was a privacy and security nightmare but basically it shared a active feed of your screen with an LLM and would literally tap, type and swipe to achieve your objective. Like order these oodles from this app, it would only interrupt it's actions at payment processing screens.

Looked really cool and like the AI I've always imagined.