On net, the people calling Chapelle out are more correct than his defenders. He really did spend an hour making unfunny jokes at trans people's expense. Was the whole thing as bad as many who didn't watch it are assuming based on a few cherry picked quotes? No, but it was still pretty bad.
Should Netflix remove it? I wouldn't say so, but I think much of the criticism is well deserved if lacking nuance.