Say no and find a better job if your manager doesn't like it.