Private businesses can be just as inefficient but when they are and don't clean up their act they tend not to survive too long.
Public institutions are indeed bound by some rules that force some inefficiencies. But after decades working both in the private and the public sectors I can say with confidence that the public sector is substantially less efficient, for a myriad of reasons, some legitimate and some not.