This man is a federal district judge, who's appointment and removal are governed by Article 2 of the Constitution. Specifically, he must be nominated by the president, and confirmed by the Senate for a lifetime term. While he converts to senior status at some point, that doesn't change much in his case*. To remove him, you must have the House of Representative pass a bill of impeachment, the senate must hold an impeachment hearing, and 60 senators must vote in favor. That bars him from all federal service.
To change local district procedure, the Chief Judge can simply make it so. A lot easier than getting Senators to agree on something. One guy who's under a lot of outside pressure (from appeals courts and potentially the Chief Justice of the Supreme Court, who senators were asking to look into the issue) is highly motivated to fix a problem in his house, so to speak.