In bash, you can alternatively replace your shortcuts

    Ctrl+P → Ctrl+A → Alt+D

with `!:1-$`, where 1 is the index of the first argument you want from your previous command.

So:

    ls [files ...]
    rm !:1-$

I personally find it faster to use bash's history expansion. But, we're talking about subsecond differences here.