Assuming it's sexist is sexist, babe is a gender neutral term of endearment.