Visual art is distinctly different from music. It's possible to be entertained and feel emotion for visual art that is not a photorealistic depiction. Music, meanwhile, has certain rules that need to be obeyed in order for people to want to experience it. I'm sorry, John Cage might have some interesting concepts, but it's completely unlistenable. There are just some things that you cannot develop a real taste for.
Think about the culinary arts. It too is an art, but with even more restrictions on what can be done than music. "Experimental Chefs" can't just start dabbling in putting sawdust and latex paint in their dishes and still expect it to be eaten.
That being said, experimental musicians have the right to push the envelope and discover what the boundaries of taste are. Sometimes they'll fail, and sometimes they'll discover something interesting, but experimentation alone doesn't cause it to be good or bad.