Exactly. It's a long-haul flight, you might have a grudge against the flight attendant, you've already behaved slightly oddly - thinking it appropriate to say "I hope you didn't think I was a terrorist" is odd - and there are so many ways the flight could become a nightmare for all concerned, all thanks to you remaining on the plane.
Maybe the captain could have handled things better. At the same time, the author went off the plane calmly and without making a scene. The author's disappointment aside, it sounds like a success to me.