"The 4th of July" is more formal sounding, so it makes sense for the holiday, but many just say "July 4th" more informally when referring to the holiday.

Again grammatically is easier and shorter to say month day vs the day of month.