Funny, the sequence I learned somehow is Alt-Space, down arrow, Enter (this selects Move), tap any arrow key. Now the window follows your cursor until you click. I'll try X next time.
If you restore it again, it flies off screen again.
Your method is how I do it (modulo using M for move, rather than reaching for the cursor keys.)