Being public libraries, I assume there are official channels with which to convey opinions to the powers that be, and proper procedures that must be followed to permit or not permit books from being included in a library's collection.
What's more, being public, it's reasonable to assume the libraries are funded in majority from taxpayer money.
So personally: If the taxpayers who provide the money for the library are unsatisfied with the library's book selection, file formal complaints, and the books are subsequently removed as applicable, I see no problem.
And ultimately: Taxpayers (aka voters) have the ultimate and absolute authority to just rescind funding for public libraries and/or school districts with objectional collections if they refuse to comply with complaints and other such requests and demands.