Both "the 4th of July" and "July 4th" are common in American English
Yes, and only "the 4th of July" is common in UK English.
Only because that's a holiday. The 23rd of March sounds a bit formal here compared to March 23rd, and sounds like it refers to an event or holiday. Wedding invitations might sometimes use that style, for example.