I didn't know there was a bad art museum there. However I do strongly recommend the penis museum in Reykjavik.
To be fair my expectations of a penis museum weren't THAT high, and it was still funny to go and get pictures! But that's about all the experience really is.