You set prefix to C-a and then send double-presses on.

So C-a-a still does beginning of line.