Garner’s Modern English Usage (4th edition) acknowledges didn’t used to as “fully accepted” (Stage 5) and notes that it was almost twice as common in journalistic usage.
There’s long been open debate among linguists about what might be formally more correct, but with sound arguments on both sides. It mostly comes down to grammatical rule vs idiomatic phrase with a strong validating history.
That said, he suggests never used to as a way to escape the grammar debate while still keeping used.