This is how I always did it. Why would the alternative involve going into safe mode? Pretty sure I've manually deleted those files before too.