I haven't used it but I've heard good things about taskwarrior:

http://taskwarrior.org/projects/show/taskwarrior/