This is indeed a lovely feature I couldn't live without.
In bash, you can get it by adding the following to your .inputrc (at least on mac terminal)
"\e[B": history-search-forward
"\e[A": history-search-backward