He made an argument (that I considered specious) about "fairness" to other patients and problems he'd had in the past with patients mistreating the office staff because of perceived "unfairness" in his offering discounts.
My attorney advised me that I'd likely spend more money fighting the doctor than just paying him. Because I care (probably more deeply than I should) about my credit rating I opted to pay the doctor and put the whole mess behind me. I also ditched my pre-ACA insurance that carried this never-expiring pre-existing condition waiver and moved to an ACA plan with no such waivers.
The surgery center that was involved in the ordeal was much more reasonable, BTW. They charged me the amount my insurance company would have reimbursed them. When I brought this up to the doctor (who is also a partner in the surgery center business) he simply stated that his office's policies differed from those of the surgery center, and that his policy was to receive his full fee.