The other party would then file Motion to Compel Arbitration. This will usually result in the dismissal of the lawsuit.
You maybe missed the point where the Supreme Court ruled that binding arbitration clauses are enforceable.
But arbitration does, that's the problem.
You'd pretty much be spending money with no hope of even getting your issues discussed. And possibly having to pay the legal fees of your boss for the hassle.