If you're on 10.8 and want to use the built in notification center:

    gem install terminal-notifier
    make; terminal-notifier -title "Make" -message "Done compiling..." 

You can of course wrap that in a bash function to make it a bit shorter just as the TFA does.