If you ask this of any current day AI it will answer exactly how you would expect. Telling you to drive, and acknowledging the comedic nature of the question.
But try asking your favorite LLM what happens if you're holding a pen with two hands (one at each end) and let go of one end.
Seems fine to me?
https://chatgpt.com/share/69bcd01a-a750-800d-95f5-3b840b9ee2...
https://gemini.google.com/share/edc223bb6291 (the try again gave a woman, oops)
Even Midjourney couldn't do it.