The biggest pet peeve is when I give an estimate such as "I don't currently see a reason why we can't deliver X by the end of next week, assuming no other priorities come up." Of course something more important comes up in the mean time and I get scolded in a large meeting with a statement such as "You promised me I'd have X by Friday!" — this is especially infuriating when it is the PM's other project that is the higher priority interruption.
In short it sounds like you don't have the power to say no - but actually you do.
Another thing that helped us is to answer with ranges instead of dates e.g., "this will take 1-3 weeks".
Of course, if you already have a toxic development culture like the one you describe, then they'd probably abuse more agile processes too.